-- Logs begin at Sun 2022-10-16 00:10:41 UTC, end at Sun 2022-10-16 02:40:44 UTC. -- Oct 16 00:49:37.255399 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 16 00:49:37.262497 n-d-master-1 devstack@n-api.service[104515]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 16 00:49:37.264669 n-d-master-1 devstack@n-api.service[104515]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 16 00:49:37 2022] *** Oct 16 00:49:37.264669 n-d-master-1 devstack@n-api.service[104515]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 16 00:49:37.264669 n-d-master-1 devstack@n-api.service[104515]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 16 00:49:37.264669 n-d-master-1 devstack@n-api.service[104515]: nodename: n-d-master-1 Oct 16 00:49:37.264669 n-d-master-1 devstack@n-api.service[104515]: machine: x86_64 Oct 16 00:49:37.264669 n-d-master-1 devstack@n-api.service[104515]: clock source: unix Oct 16 00:49:37.264669 n-d-master-1 devstack@n-api.service[104515]: pcre jit disabled Oct 16 00:49:37.264669 n-d-master-1 devstack@n-api.service[104515]: detected number of CPU cores: 4 Oct 16 00:49:37.265253 n-d-master-1 devstack@n-api.service[104515]: current working directory: / Oct 16 00:49:37.265253 n-d-master-1 devstack@n-api.service[104515]: detected binary path: /usr/bin/uwsgi-core Oct 16 00:49:37.265253 n-d-master-1 devstack@n-api.service[104515]: your processes number limit is 47680 Oct 16 00:49:37.265253 n-d-master-1 devstack@n-api.service[104515]: your memory page size is 4096 bytes Oct 16 00:49:37.265253 n-d-master-1 devstack@n-api.service[104515]: detected max file descriptor number: 2048 Oct 16 00:49:37.265253 n-d-master-1 devstack@n-api.service[104515]: lock engine: pthread robust mutexes Oct 16 00:49:37.265253 n-d-master-1 devstack@n-api.service[104515]: thunder lock: enabled Oct 16 00:49:37.265253 n-d-master-1 devstack@n-api.service[104515]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 16 00:49:37.266007 n-d-master-1 devstack@n-api.service[104515]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 16 00:49:37.305359 n-d-master-1 devstack@n-api.service[104515]: Python main interpreter initialized at 0x559af4f489c0 Oct 16 00:49:37.305359 n-d-master-1 devstack@n-api.service[104515]: python threads support enabled Oct 16 00:49:37.305359 n-d-master-1 devstack@n-api.service[104515]: your server socket listen backlog is limited to 100 connections Oct 16 00:49:37.305359 n-d-master-1 devstack@n-api.service[104515]: your mercy for graceful operations on workers is 90 seconds Oct 16 00:49:37.305723 n-d-master-1 devstack@n-api.service[104515]: mapped 403077 bytes (393 KB) for 2 cores Oct 16 00:49:37.305812 n-d-master-1 devstack@n-api.service[104515]: *** Operational MODE: preforking *** Oct 16 00:49:37.306064 n-d-master-1 devstack@n-api.service[104515]: *** uWSGI is running in multiple interpreter mode *** Oct 16 00:49:37.306064 n-d-master-1 devstack@n-api.service[104515]: spawned uWSGI master process (pid: 104515) Oct 16 00:49:37.306261 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 16 00:49:37.309646 n-d-master-1 devstack@n-api.service[104515]: spawned uWSGI worker 1 (pid: 104516, cores: 1) Oct 16 00:49:37.309646 n-d-master-1 devstack@n-api.service[104515]: spawned uWSGI worker 2 (pid: 104517, cores: 1) Oct 16 00:49:37.309646 n-d-master-1 devstack@n-api.service[104515]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 16 00:49:37.966408 n-d-master-1 devstack@n-api.service[104517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 16 00:49:37.968412 n-d-master-1 devstack@n-api.service[104516]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 16 00:49:39.051784 n-d-master-1 devstack@n-api.service[104517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:49:39.051784 n-d-master-1 devstack@n-api.service[104517]: from cryptography.utils import int_from_bytes Oct 16 00:49:39.052379 n-d-master-1 devstack@n-api.service[104517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:49:39.052379 n-d-master-1 devstack@n-api.service[104517]: from cryptography.utils import int_from_bytes Oct 16 00:49:39.052973 n-d-master-1 devstack@n-api.service[104516]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:49:39.052973 n-d-master-1 devstack@n-api.service[104516]: from cryptography.utils import int_from_bytes Oct 16 00:49:39.053415 n-d-master-1 devstack@n-api.service[104516]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:49:39.053415 n-d-master-1 devstack@n-api.service[104516]: from cryptography.utils import int_from_bytes Oct 16 00:49:41.557495 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:49:41.558116 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:49:41.558396 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:49:41.558651 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:49:41.558934 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:49:41.559289 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:49:41.559658 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.560205 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:49:41.560351 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.560351 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.560516 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:49:41.560595 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.560681 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:49:41.560770 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.560850 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:49:41.560935 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.561068 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.561200 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.561987 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.562174 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.562331 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.562639 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.562745 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.562908 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.563101 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.563255 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.563425 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.563591 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.563755 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.563925 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.564089 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.564240 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.564424 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.564558 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.564693 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.564883 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.565048 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.565200 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.565353 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.565525 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.565683 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.565839 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.565998 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.566316 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.566408 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.566642 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.566782 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.566973 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.567104 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.567304 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.567418 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.567616 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.567814 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.568059 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.568174 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.568377 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.568480 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.568701 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.568805 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.569017 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.569117 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.569343 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.569436 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.569656 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.569757 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.569972 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.570063 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.570300 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.570392 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.570616 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.570708 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.570961 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.571066 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.571281 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.571375 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.571696 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.571787 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.572010 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.572103 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.572326 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.572483 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.572634 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.572773 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.572965 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.573125 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.573292 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.573433 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.573618 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.573707 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.573943 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.574097 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.574267 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.574363 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.574576 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.574671 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.574893 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.574998 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.575228 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.575338 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.575553 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.575649 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.575864 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.575950 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.576172 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.576269 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.576424 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.576508 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.576738 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.576835 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.577144 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.577246 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.577479 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.577625 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.577805 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.577943 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.578063 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.578203 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.578317 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.578519 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.578639 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.578851 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.578971 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.579229 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.579318 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.579559 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.579644 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.579819 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.579907 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.580077 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.580187 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.580403 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.580489 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.580729 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.580824 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.581046 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.581131 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.581361 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.581526 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.581674 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.581762 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.581987 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.582073 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.582301 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.582394 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.582609 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.582693 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.582957 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.583048 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.583264 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.583366 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.583584 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.583670 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.583897 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.583982 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.584225 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.584323 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.584540 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.584626 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.584851 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.584948 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.585179 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.585274 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.585504 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.585611 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.585814 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.585907 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.586128 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.586223 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.586438 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.586668 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.586754 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.586823 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.587109 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.587204 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.587418 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.587510 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.587674 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.587782 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.587981 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.588112 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.588291 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.588379 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.588614 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.588709 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.588925 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.589017 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.589237 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.589324 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.589502 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.589599 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.589810 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.589897 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.590120 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.590206 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.590435 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.590532 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.590744 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.590830 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.591075 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.591177 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.591388 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.591481 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.591695 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.591778 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.592002 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.592096 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.592313 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.592406 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.592644 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.592766 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.592957 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.593092 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.593266 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.593361 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.593577 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.593662 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.593884 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.593967 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.594191 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.594326 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.594501 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.594587 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.594812 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.594897 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.595159 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.595262 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.595469 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.595555 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.595779 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.595863 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.596088 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.596175 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.596394 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.596480 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.596703 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.596794 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.597022 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.597107 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.597329 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.597414 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.597634 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.597719 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.597955 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.598048 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.598256 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.598341 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.598563 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.598649 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.598884 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.598997 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.599215 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.599316 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.599523 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.599607 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.599831 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.599927 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.600137 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.600221 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.600442 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.600535 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.600750 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.600836 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.601058 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.601142 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.601366 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.601462 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.601668 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.601755 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.601976 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.602059 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.602285 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.602380 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.602595 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.602680 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.602903 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.603004 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.603236 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.603341 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.603540 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.603624 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.603864 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.603952 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.604191 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.604279 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.604505 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.604593 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.604818 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.604911 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.605129 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.605223 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.605453 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:49:41.605540 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.605794 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.605886 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.606117 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.606203 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.606437 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.606522 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.606769 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.606863 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.607111 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.607200 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.607431 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.607516 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.607752 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.607849 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.608076 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.608161 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.608927 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.609064 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.609345 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.609508 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.609672 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.609778 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.609996 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.610106 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.610322 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.610417 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.610641 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.610747 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.610987 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.611110 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.611325 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.611449 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.611652 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.611773 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.611972 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.612099 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.612323 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.612420 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.612675 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.612761 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.612996 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.613081 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.613329 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.613425 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.613656 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.613742 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.613975 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.614064 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.614293 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.614387 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.614612 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.614700 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.614981 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.615082 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.615310 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.615397 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.615629 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.615716 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.615945 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.616029 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.616261 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.616354 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.616579 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.616664 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.616894 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.616985 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.617212 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.617300 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.617526 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.617612 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.617845 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.617940 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.618162 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.618246 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.618491 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.618586 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.618807 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.618981 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.619150 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.619236 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.619468 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.619551 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.619784 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.619920 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.620103 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.620189 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.620416 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.620508 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.620733 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.620829 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.621050 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.621136 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.621363 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.621449 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.621674 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.621763 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.621985 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.622070 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.622300 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.622392 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.622607 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.622692 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.622951 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.623052 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.623261 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.623355 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.623579 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.623664 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.624428 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.624521 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.624767 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.624996 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.625090 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.625315 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.625402 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.625645 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.625730 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.625983 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.626078 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.626299 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.626383 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.626615 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.626702 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.626940 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.627030 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.627270 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.627355 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.627583 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.627667 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.627896 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.627995 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.628207 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.628291 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.628523 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.628607 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.628838 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.628925 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.629150 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.629237 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.629464 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.629548 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.629781 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.629868 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.630090 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.630174 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.630404 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.630496 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.630722 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.630809 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.631060 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.631150 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.631380 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.631480 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.631696 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.631782 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.632014 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.632099 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.632335 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.632434 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.632655 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.632743 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.632982 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.633072 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.633300 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.633425 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.633609 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.633693 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.633923 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.634008 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.634231 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.634317 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.634541 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.634635 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.634851 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.634978 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.635194 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.635282 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.635506 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.635592 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.635817 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.635902 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.636129 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.636215 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.636438 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.636523 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.636746 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.636830 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.637057 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.637142 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.637372 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.637456 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.637681 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.637778 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.637987 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.638071 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.638294 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.638381 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.638604 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.638697 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.638931 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.639019 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.639266 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.639350 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.639703 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.639813 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.640022 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.640107 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.640337 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.640422 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.640651 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.640747 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.640970 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.641054 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.641289 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.641381 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.641606 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.641692 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.641921 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.642007 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.642236 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.642321 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.642561 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.642648 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.642876 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.642979 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.643227 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.643311 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.643541 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.643633 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.643861 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.643989 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.644172 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.644257 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.644488 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.644580 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.644796 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.644883 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.645118 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.645211 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.645445 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.645531 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.645764 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.645849 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.646087 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.646179 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.646402 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.646496 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.646715 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.646801 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.647051 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.647154 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.647370 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.647455 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.647685 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.647771 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.648000 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.648102 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.648314 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.648400 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.648636 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.648731 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.648949 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.649043 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.649269 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.649353 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.649579 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.649664 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.649894 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.649979 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.650206 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.650290 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.650519 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.650603 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.650826 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.650929 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.651170 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.651266 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.651491 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.651576 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.651807 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.651894 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.652127 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.652211 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.652440 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.652524 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.652763 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.652847 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.653071 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.653155 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.653385 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.653478 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.653702 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.653789 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.654011 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.654097 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.654322 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.654418 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.654638 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.654725 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.654984 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.655075 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.655331 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.655437 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.655642 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.655727 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.655951 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.656034 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.656260 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.656352 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.656572 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.656658 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.656879 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.656963 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.657188 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.657275 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.657502 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.657586 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.657819 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.657904 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.658130 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.658223 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.658714 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.658806 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.659058 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.659146 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.659368 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.659454 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.659676 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.659761 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.659995 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.660089 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.660306 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.660391 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.660615 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.660700 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.660924 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.661017 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.661234 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.661327 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.661551 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.661635 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.661863 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.661960 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.662175 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.662261 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.662496 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.662580 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.662809 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.662995 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.663144 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.663230 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.663465 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.663551 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.663779 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.663874 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.664095 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.664184 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.664415 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.664498 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.664733 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.664826 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.665047 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.665135 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.665362 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.665445 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.665673 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.665759 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.665987 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.666072 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.666298 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.666390 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.666624 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.666711 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.666955 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.667045 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.667272 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.667368 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.667585 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.667672 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.667894 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.667979 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.668205 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.668302 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.668521 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.668607 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.668848 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.669091 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.669176 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.669428 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.669560 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.669752 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.669840 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.670060 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.670144 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.670375 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.670462 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.671274 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.671385 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.671584 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.671915 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.672006 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.672234 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.672321 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.672545 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.672630 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.672860 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.672953 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.673173 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.673267 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.673483 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.673601 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.673797 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.673928 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.674106 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.674261 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.674444 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.674579 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.674727 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.674885 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.675064 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.675228 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.675373 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.675543 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.675683 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.675857 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.675992 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.676176 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.676301 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.676490 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.676621 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.676805 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.676928 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.677119 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.677242 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.677437 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.677549 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.677750 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.677875 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.678061 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.678188 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.678371 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.678495 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.678684 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.678803 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.679031 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.679134 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.679345 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.679470 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.679665 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.679810 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.679977 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.680103 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.680304 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.680434 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.680620 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.680777 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.680931 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.681087 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.681242 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.681397 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.681555 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.681724 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.681904 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.682032 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.682217 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.682338 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.682562 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.682649 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.682898 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.683030 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.683264 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.683363 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.683572 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.683658 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.683883 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.684004 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.684193 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.684285 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.684506 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.684592 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.684814 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.684898 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.685117 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.685211 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.685430 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.685515 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.685735 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.685827 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.686041 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.686134 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.686419 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.687028 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.687445 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.687538 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.687772 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.688035 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.688121 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.688394 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.688488 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.688712 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.688876 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.689026 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.689114 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.689352 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.689437 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.689669 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.689764 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.689980 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.690069 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.690292 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.690377 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.690600 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.690693 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.690927 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.691018 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.691246 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.691331 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.691559 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.691646 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.691865 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.691949 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.692187 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.692272 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.692499 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.692585 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.692807 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.692891 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.693114 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.693199 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.693428 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.693514 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.693734 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.693819 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.694043 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.694128 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.694352 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.694437 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.694670 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.694762 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.695006 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.695112 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.695320 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.695406 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.695632 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.695716 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.695940 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.696041 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.696244 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.696329 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.696552 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.696638 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.696865 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.696960 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.697172 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.697258 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.697476 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.697561 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.697782 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.697877 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.698089 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.698184 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.698396 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.698482 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.698704 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.698790 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.699045 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.699135 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.699356 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.699441 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.699664 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.699751 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.699971 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.700067 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.700279 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.700363 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.700590 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.700678 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.700920 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.701006 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.701238 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.701330 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.701552 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.701639 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.701864 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.701974 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.702243 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.702337 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.702597 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.702685 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.702910 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.703028 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.703276 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.703370 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.703601 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.703689 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.703918 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.704003 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.704236 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.704335 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.704547 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.704641 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.704863 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.704947 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.705184 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.705278 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.705496 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.705585 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.705809 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.705893 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.706125 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.706218 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.706444 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.706537 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.706759 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.706845 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.707089 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.707190 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.707406 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.707492 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.707723 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.707813 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.708037 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.708125 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.708352 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.708438 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.708666 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.708751 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.708981 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.709068 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.709293 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.709377 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.709603 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.709694 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.709919 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.710004 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.710231 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.710317 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.710541 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.710635 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.710857 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.710963 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.711264 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.711362 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.711576 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.711671 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.711891 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.711983 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.712205 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.712290 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.712516 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.712614 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.712828 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.712913 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.713133 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.713217 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.713448 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.713546 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.713757 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.713843 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.714086 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.714183 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.714404 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.714501 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.714716 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.714802 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.715059 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.715150 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.715371 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.715494 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.715689 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.715783 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.716002 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.716089 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.716334 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.716420 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.716645 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.716730 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.717039 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.717123 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.717352 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.717439 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.717695 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.717783 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.718011 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.718313 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.718414 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.718495 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.718615 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.718701 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.718947 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.719049 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.719283 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.719457 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.719593 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.719781 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.719902 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.720101 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.720227 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.720422 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.720508 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.720736 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.720820 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.721046 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.721133 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.721365 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.721537 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.721698 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.721854 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.722011 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.722164 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.722323 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.722581 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.722667 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.722897 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.723008 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.723256 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.723342 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.723584 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.723682 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.723911 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.724006 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.724239 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.724325 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.724550 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.724649 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.724873 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.725016 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.725189 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.725335 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.725519 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.725654 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.725848 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.725983 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.726162 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.726311 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.726483 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.726643 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.726793 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.726980 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.727148 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.727307 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.727475 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.727628 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.727793 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.727961 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.728119 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.728293 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.728536 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.728622 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.728864 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.729025 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.729179 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.729267 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.729503 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.729598 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.729834 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.729929 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.730146 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.730287 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.730456 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.730550 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.730771 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.730881 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.731104 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.731238 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.731414 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.731559 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.731750 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.731888 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.732050 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.732221 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.732365 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.732537 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.732679 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.732856 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.732993 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.733175 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.733959 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.734123 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.734240 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.734398 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.734570 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.734737 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.734880 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.735079 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.735236 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.735401 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.735557 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.735721 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.735883 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.736040 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.736210 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.736354 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.736520 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.736669 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.736848 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.737002 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.737163 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.737316 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.737472 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.737650 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.737779 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.737973 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.738087 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.738320 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.738415 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.738637 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.738737 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.738973 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.739062 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.739310 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.739396 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.739631 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.739732 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.739947 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.740045 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.740260 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.740346 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.740573 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.740667 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.740922 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.741008 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.741236 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.741321 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.741564 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.741658 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.741892 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.741977 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.742204 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.742289 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.742515 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.742602 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.742830 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.742957 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.743164 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.743250 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.743475 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.743563 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.743785 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.743871 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.744098 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.744191 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.744406 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.744494 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.744713 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.744798 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.745021 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.745113 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.745353 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.745441 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.745662 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.745747 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.745975 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.746073 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.746287 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.746371 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.746598 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.746683 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.746905 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.747021 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.747233 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.747318 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.747540 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.747624 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.747870 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.747968 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.748185 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.748271 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.748504 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.748588 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.748836 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.749442 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.749687 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.749835 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.750009 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.750155 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.750332 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.750466 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.750654 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.750808 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.751004 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.751151 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.751329 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.751490 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.751650 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.751810 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.751965 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.752142 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.752286 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.752468 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.752607 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.752792 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.752930 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.753114 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.753442 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.753527 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.753764 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.753850 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.754083 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.754176 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.754403 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.754489 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.754717 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.754801 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.755063 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.755166 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.755387 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.755473 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.755706 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.755790 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.756025 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.756233 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.756342 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.756571 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.756656 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.756895 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.756991 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.757219 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.757314 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.757543 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.757629 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.757866 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.757960 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.758189 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.758276 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.758512 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.758598 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.758834 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.758962 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.759176 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.759274 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.759495 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.759582 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.759833 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.759930 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.760141 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.760236 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.760462 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.760594 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.760782 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.760871 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.761102 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.761188 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.761420 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.761522 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.761736 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.761823 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.762055 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.762140 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.762375 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.762469 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.762692 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.762778 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.763028 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.763119 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.763351 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.763449 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.763670 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.763758 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.763990 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.764082 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.764310 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.764397 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.764676 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.764782 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.764993 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.765106 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.765353 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.765442 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.765677 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.765774 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.766038 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.766201 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.766362 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.766524 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.766686 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.766864 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.767045 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.767219 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.767388 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.767548 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.767716 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.767870 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.768039 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.768192 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.768359 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.768523 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.768682 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.768834 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.769144 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.769237 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.769460 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.769584 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.769776 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.769862 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.770086 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.770185 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.770415 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.770507 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.770733 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.770870 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.771067 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.771156 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.771391 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.771476 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.771707 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.771793 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.772044 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.772249 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.772344 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.772602 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.772687 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.772928 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.773022 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.773263 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.773349 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.773585 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.773668 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.773899 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.773987 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.774210 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.774294 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.774528 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.774620 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.774844 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.775095 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.775255 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.775453 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.775579 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.775781 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.775881 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.776118 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.776204 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.776453 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.776538 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.776778 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.776872 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.777094 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.777181 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.777403 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.777489 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.777720 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.777808 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.778030 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.778115 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.778353 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.778437 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.778662 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.778748 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.778994 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.779083 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.779308 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.779404 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.779624 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.779711 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.779936 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.780029 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.780281 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.780381 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.780594 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.780681 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.780904 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.780988 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.781224 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.781317 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.781536 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.781620 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.781848 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.781931 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.782156 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.782249 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.782471 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.782555 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.782781 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.782866 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.783119 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.783218 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.783705 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.783794 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.784018 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.784104 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.784338 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.784430 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.784649 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.784737 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.784963 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.785046 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.785275 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.785369 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.785594 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.785681 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.785911 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.785995 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.786228 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.786315 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.786556 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.786640 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.786884 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.786988 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.787264 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.787446 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.787541 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.787788 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.787874 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.788116 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.788218 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.788457 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.788548 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.788766 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.788855 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.789081 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.789174 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.789393 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.789479 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.789704 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.789790 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.790035 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.790269 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.790355 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.790611 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.790697 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.790962 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.791109 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.791294 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.791379 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.791611 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.791698 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.791928 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.792025 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.792239 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.792323 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.792551 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.792636 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.792865 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.792951 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.793180 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.793266 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.793494 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.793580 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.793809 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.793897 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.794124 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.794210 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.794438 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.794530 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.794754 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.794840 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.795098 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.795197 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.795419 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.795514 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.796268 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.796363 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.796594 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.796679 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.796968 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.797066 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.797289 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.797375 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.797610 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.797695 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.797932 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.798026 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.798256 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.798342 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.798605 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.798689 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.798958 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.799048 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.799276 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.799360 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.799587 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.799672 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.799913 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.800234 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.800319 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.800555 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.800642 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.800874 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.801008 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.801193 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.801280 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.801510 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.801603 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.801843 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.801937 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.802164 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.802256 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.802480 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.802567 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.802804 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.803150 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.803252 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.803488 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.803574 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.803821 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.803914 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.804154 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.804240 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.804475 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.804560 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.804786 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.804878 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.805098 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.805185 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.805415 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.805503 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.805733 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.805821 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.806053 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.806137 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.806367 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.806458 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.806680 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.806767 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.807016 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.807116 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.807334 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.807422 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.807687 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.807780 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.807953 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.808051 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.808263 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.808358 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.808573 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.808659 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.808886 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.808971 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.809195 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.809288 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.809503 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.809601 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.809812 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.809904 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.810120 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.810222 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.810426 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.810511 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.810732 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.810818 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.811073 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.811176 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.812007 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.812161 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.812354 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.812573 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.812674 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.812972 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.813154 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.813287 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.813599 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.813734 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.813916 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.814229 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.814313 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.814547 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.814859 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.814957 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.815198 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.815509 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.815594 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.815824 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.815912 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.816136 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.816229 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.816475 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.816562 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.816817 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.816902 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.817140 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.817227 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.817469 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.817565 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.817787 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.817873 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.818117 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.818205 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.818437 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.818522 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.818767 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.818860 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.819116 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.819205 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.819438 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.819522 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.819757 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.819843 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.820081 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.820207 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.820409 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.820507 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.820728 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.820835 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.821050 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.821138 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.821372 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.821458 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.821687 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.821847 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.822003 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.822090 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.822334 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.822419 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.822661 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.822760 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.822997 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.823086 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.823317 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.823401 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.823650 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.823737 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.823965 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.824050 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.824283 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.824377 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.824601 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.824689 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.824920 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.825006 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.825239 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.825327 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.825557 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.825643 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.825873 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.825959 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.826189 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.826287 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.826507 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.826600 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.826828 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.826973 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.827207 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.827308 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.827529 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.827627 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.827846 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.827941 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.828169 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.828265 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.828500 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.828585 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.828830 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.828916 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.829150 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.829237 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.829484 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.829579 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.829812 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.829897 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.830137 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.830242 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.830456 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.830551 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.830768 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.830863 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.831042 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:49:41.831164 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.831490 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.831811 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.832124 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:49:41.832375 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:49:41.985044 n-d-master-1 devstack@n-api.service[104516]: INFO dbcounter [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Registered counter for database nova_api Oct 16 00:49:41.985743 n-d-master-1 devstack@n-api.service[104517]: INFO dbcounter [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Registered counter for database nova_api Oct 16 00:49:42.005821 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_db.sqlalchemy.engines [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:49:42.007598 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_db.sqlalchemy.engines [None req-524c9776-adae-40b0-837c-500f13f3061e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:49:42.012476 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writer thread running {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:49:42.014316 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writer thread running {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:49:42.069402 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.context [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) {{(pid=104516) load_cells /opt/stack/nova/nova/context.py:464}} Oct 16 00:49:42.071757 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.context [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) {{(pid=104517) load_cells /opt/stack/nova/nova/context.py:464}} Oct 16 00:49:42.073241 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:49:42.073716 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:49:42.075297 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:49:42.075655 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:49:42.076024 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:49:42.076118 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:49:42.076472 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:49:42.078291 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:49:42.079046 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:49:42.079142 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:49:42.079499 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:49:42.081017 n-d-master-1 devstack@n-api.service[104516]: INFO dbcounter [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Registered counter for database nova_cell0 Oct 16 00:49:42.081470 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:49:42.083627 n-d-master-1 devstack@n-api.service[104517]: INFO dbcounter [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Registered counter for database nova_cell0 Oct 16 00:49:42.085094 n-d-master-1 devstack@n-api.service[104516]: INFO dbcounter [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Registered counter for database nova_cell1 Oct 16 00:49:42.087434 n-d-master-1 devstack@n-api.service[104517]: INFO dbcounter [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Registered counter for database nova_cell1 Oct 16 00:49:42.094066 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_db.sqlalchemy.engines [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:49:42.094837 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_db.sqlalchemy.engines [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:49:42.095901 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_db.sqlalchemy.engines [None req-524c9776-adae-40b0-837c-500f13f3061e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:49:42.098053 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_db.sqlalchemy.engines [None req-524c9776-adae-40b0-837c-500f13f3061e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:49:42.101993 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writer thread running {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:49:42.102606 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writer thread running {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:49:42.103485 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writer thread running {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:49:42.241189 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writer thread running {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:49:42.247282 n-d-master-1 devstack@n-api.service[104516]: INFO dbcounter [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Registered counter for database nova_cell0 Oct 16 00:49:42.251887 n-d-master-1 devstack@n-api.service[104517]: INFO dbcounter [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Registered counter for database nova_cell0 Oct 16 00:49:42.256884 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_db.sqlalchemy.engines [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:49:42.260447 n-d-master-1 devstack@n-api.service[104517]: DEBUG oslo_db.sqlalchemy.engines [None req-524c9776-adae-40b0-837c-500f13f3061e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:49:42.261763 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writer thread running {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:49:42.265425 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writer thread running {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:49:42.600894 n-d-master-1 devstack@n-api.service[104517]: WARNING keystonemiddleware.auth_token [None req-524c9776-adae-40b0-837c-500f13f3061e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:49:42.601433 n-d-master-1 devstack@n-api.service[104516]: WARNING keystonemiddleware.auth_token [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:49:42.608856 n-d-master-1 devstack@n-api.service[104517]: WARNING keystonemiddleware.auth_token [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:49:42.608997 n-d-master-1 devstack@n-api.service[104516]: WARNING keystonemiddleware.auth_token [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:49:42.951398 n-d-master-1 devstack@n-api.service[104517]: WARNING keystonemiddleware.auth_token [None req-524c9776-adae-40b0-837c-500f13f3061e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:49:42.951594 n-d-master-1 devstack@n-api.service[104516]: WARNING keystonemiddleware.auth_token [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:49:42.957966 n-d-master-1 devstack@n-api.service[104516]: WARNING keystonemiddleware.auth_token [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:49:42.958078 n-d-master-1 devstack@n-api.service[104517]: WARNING keystonemiddleware.auth_token [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:49:42.963309 n-d-master-1 devstack@n-api.service[104517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559af4f489c0 pid: 104517 (default app) Oct 16 00:49:42.963500 n-d-master-1 devstack@n-api.service[104516]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559af4f489c0 pid: 104516 (default app) Oct 16 00:49:42.965399 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-524c9776-adae-40b0-837c-500f13f3061e None None] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:49:42.966604 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-524c9776-adae-40b0-837c-500f13f3061e None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Oct 16 00:49:42.967035 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Sun Oct 16 00:49:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:05.046369 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:05.048261 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003252 Oct 16 00:51:05.048651 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:05.059869 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:SELECT=3 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:05.060798 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_cell0:SELECT=3 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:05.063358 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_cell1:SELECT=3 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:05.064367 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:05.950501 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-db2fdf01-1ac2-4f73-ab65-95cbe87c8295 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:05.983441 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-db2fdf01-1ac2-4f73-ab65-95cbe87c8295 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928367 Oct 16 00:51:05.985279 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 00:51:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:51:08.624285 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:08.626180 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-b2fe8067-7ba1-416d-a3ab-dd6a312b502e None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002143 Oct 16 00:51:08.631839 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 2/4] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:09.100416 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-c8a7cbd2-785a-44c4-a602-cd28472efd2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:09.154620 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-c8a7cbd2-785a-44c4-a602-cd28472efd2e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521133 Oct 16 00:51:09.156131 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 3/5] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 00:51:09.410075 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-cbf3eea1-5ca7-4dc0-a748-c2e5b80703e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:09.416899 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writing DB stats nova_api:SELECT=3 {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:09.417926 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writing DB stats nova_cell0:SELECT=3 {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:09.418616 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writing DB stats nova_cell1:SELECT=3 {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:09.419354 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:09.494473 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-cbf3eea1-5ca7-4dc0-a748-c2e5b80703e4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.325991 Oct 16 00:51:09.495098 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 3/6] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Oct 16 00:51:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:51:12.171438 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-c8a7cbd2-785a-44c4-a602-cd28472efd2e admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:12.172457 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-c8a7cbd2-785a-44c4-a602-cd28472efd2e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Oct 16 00:51:12.172862 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 4/7] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:12.959782 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-4fcab989-4ccd-463a-ac8c-b77eff10bdee admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:13.017264 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-4fcab989-4ccd-463a-ac8c-b77eff10bdee admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.838151 Oct 16 00:51:13.018438 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 4/8] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 00:51:13.035144 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-c8bea457-3f73-4569-b690-bb59a339a302 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:13.092555 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-c8bea457-3f73-4569-b690-bb59a339a302 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065313 Oct 16 00:51:13.094105 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 5/9] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Oct 16 00:51:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:51:16.059680 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-4fcab989-4ccd-463a-ac8c-b77eff10bdee admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:16.060670 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-4fcab989-4ccd-463a-ac8c-b77eff10bdee admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 16 00:51:16.061468 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:16.612759 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-3ce6c5ad-4d3c-4989-8f53-8c9bc2b13e78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:16.633646 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-3ce6c5ad-4d3c-4989-8f53-8c9bc2b13e78 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.562716 Oct 16 00:51:16.634957 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 6/11] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:51:16.646653 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-24bfcf49-151a-4816-96f4-6bf4f573b946 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:16.676030 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-24bfcf49-151a-4816-96f4-6bf4f573b946 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033053 Oct 16 00:51:16.676650 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 6/12] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Oct 16 00:51:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:51:19.322065 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-3ce6c5ad-4d3c-4989-8f53-8c9bc2b13e78 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:19.323123 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-3ce6c5ad-4d3c-4989-8f53-8c9bc2b13e78 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 16 00:51:19.323528 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 7/13] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:19.776406 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-b3c4e683-e80b-4fae-9515-7ddd4779d42f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:19.799339 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-b3c4e683-e80b-4fae-9515-7ddd4779d42f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468329 Oct 16 00:51:19.803222 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 7/14] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:51:19.811975 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-3825d97a-19e2-4742-a35c-8b633851de7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:19.853023 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-3825d97a-19e2-4742-a35c-8b633851de7d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044782 Oct 16 00:51:19.854993 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 8/15] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Oct 16 00:51:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:51:22.542555 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-b3c4e683-e80b-4fae-9515-7ddd4779d42f admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:22.544227 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-b3c4e683-e80b-4fae-9515-7ddd4779d42f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Oct 16 00:51:22.554999 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 8/16] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:22.993416 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-a588327c-b9be-4b84-a339-d4e31e5800a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:23.027032 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-a588327c-b9be-4b84-a339-d4e31e5800a0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475485 Oct 16 00:51:23.042446 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-490e277b-874c-473e-9e33-81247743b112 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:23.048307 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 9/17] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:51:23.081310 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-490e277b-874c-473e-9e33-81247743b112 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042741 Oct 16 00:51:23.082610 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 9/18] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Oct 16 00:51:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:51:25.801911 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-a588327c-b9be-4b84-a339-d4e31e5800a0 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:25.802949 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-a588327c-b9be-4b84-a339-d4e31e5800a0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 16 00:51:25.803348 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 10/19] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:26.217496 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-6eb55324-0dfa-4e96-8704-a471c5f10813 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:26.242110 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-6eb55324-0dfa-4e96-8704-a471c5f10813 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.432846 Oct 16 00:51:26.242657 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 00:51:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:51:28.869785 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-a588327c-b9be-4b84-a339-d4e31e5800a0 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:28.871147 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-a588327c-b9be-4b84-a339-d4e31e5800a0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Oct 16 00:51:28.871717 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 11/21] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:29.328408 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-06d4fcd8-7626-43f8-b854-9fe4619518d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "name": "m1.tiny", "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:29.350198 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-06d4fcd8-7626-43f8-b854-9fe4619518d1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.471848 Oct 16 00:51:29.351024 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 11/22] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 00:51:29.365205 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-d57f17fb-765c-4061-9449-67deb64f6ed1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:29.398228 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-d57f17fb-765c-4061-9449-67deb64f6ed1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037996 Oct 16 00:51:29.398833 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 12/23] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Oct 16 00:51:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:51:32.185314 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-06d4fcd8-7626-43f8-b854-9fe4619518d1 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:32.186757 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-06d4fcd8-7626-43f8-b854-9fe4619518d1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 16 00:51:32.187193 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:32.577347 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-46e9dd5a-e580-48a6-a972-bced703d6706 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:32.596229 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-46e9dd5a-e580-48a6-a972-bced703d6706 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.402907 Oct 16 00:51:32.596776 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 13/25] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:51:32.609196 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-9eb6c674-9a23-4de2-8254-38cdba343fa1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:32.633131 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-9eb6c674-9a23-4de2-8254-38cdba343fa1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028061 Oct 16 00:51:32.633695 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Oct 16 00:51:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 00:51:35.235349 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-46e9dd5a-e580-48a6-a972-bced703d6706 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:35.237070 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-46e9dd5a-e580-48a6-a972-bced703d6706 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Oct 16 00:51:35.237560 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:35.611578 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-08988d0b-0f4b-4255-84a7-32461a3c03ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:35.634105 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-08988d0b-0f4b-4255-84a7-32461a3c03ba admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.390072 Oct 16 00:51:35.634660 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 14/28] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:51:35.646838 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-f97c7f6e-0200-438f-aead-92fb439f5bfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:35.651716 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:35.676319 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-f97c7f6e-0200-438f-aead-92fb439f5bfd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033077 Oct 16 00:51:35.676900 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 15/29] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Oct 16 00:51:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:51:38.331292 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-08988d0b-0f4b-4255-84a7-32461a3c03ba admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:38.332304 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-08988d0b-0f4b-4255-84a7-32461a3c03ba admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 16 00:51:38.332702 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:38.779621 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-f9f239ae-6418-43f7-a461-15353967490d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:38.800422 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-f9f239ae-6418-43f7-a461-15353967490d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461404 Oct 16 00:51:38.800975 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 16/31] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:51:38.815055 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-7aba7c45-4fc3-4351-8faa-69f389a5ae2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:38.843337 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-7aba7c45-4fc3-4351-8faa-69f389a5ae2c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032030 Oct 16 00:51:38.844233 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 16/32] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Oct 16 00:51:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:51:41.492576 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-f9f239ae-6418-43f7-a461-15353967490d admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:51:41.494574 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-f9f239ae-6418-43f7-a461-15353967490d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002424 Oct 16 00:51:41.495440 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:51:41.940242 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-aa0f890d-c021-4048-9aef-1f8088a21841 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:41.946497 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:41.967214 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-aa0f890d-c021-4048-9aef-1f8088a21841 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465166 Oct 16 00:51:41.968503 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 17/34] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Oct 16 00:51:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:51:41.980158 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-1fd38c4c-e864-412b-b6c8-d55809e4b8d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:51:42.006688 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-1fd38c4c-e864-412b-b6c8-d55809e4b8d6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030084 Oct 16 00:51:42.007342 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 18/35] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Oct 16 00:51:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:52:02.492492 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-aa0f890d-c021-4048-9aef-1f8088a21841 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:02.493515 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-aa0f890d-c021-4048-9aef-1f8088a21841 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 16 00:52:02.493922 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:02.504297 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:02.883965 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-8d5d0dc3-93dd-495a-929d-135989576d11 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:02.901993 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-8d5d0dc3-93dd-495a-929d-135989576d11 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402111 Oct 16 00:52:02.902526 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 00:52:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:52:04.227916 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-aa0f890d-c021-4048-9aef-1f8088a21841 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:04.228997 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-aa0f890d-c021-4048-9aef-1f8088a21841 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 16 00:52:04.229400 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:04.759786 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-5fe855ab-1fa6-4d27-a70f-902db2a5688e admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:04.765144 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.wsgi [None req-5fe855ab-1fa6-4d27-a70f-902db2a5688e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-5fe855ab-1fa6-4d27-a70f-902db2a5688e admin admin] Request method failure captured: Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: Accept: application/json Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: Accept-Encoding: gzip, deflate Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: Connection: keep-alive Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: Content-Length: 0 Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: Host: 10.222.0.39 Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: Openstack-Api-Version: compute 2.92 Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: Openstack-System-Scope: None Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: User-Agent: python-novaclient Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Auth-Token: gAAAAABjS1W0jDCNRXdlAxvadmqNarVzcuyZf0K6GmRRf6kguaKqwrAokIvXIwFLWQPodVKe-r0oRhTjxU5JMxQjwrSHi3Oh9TlMCrQbHQmHZfcNqLc1VX3sfoDH7VJqAzRuBCqfXnMlIqwAe1EJQ6e2FFj-mdZ49H5pnBh1PY5KSiVgVQkfoyM Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Domain-Id: None Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Domain-Name: None Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Identity-Status: Confirmed Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Is-Admin-Project: True Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Project-Domain-Id: default Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Project-Domain-Name: Default Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Project-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Project-Name: admin Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Role: member,reader,admin Oct 16 00:52:04.768411 n-d-master-1 devstack@n-api.service[104517]: X-Roles: member,reader,admin Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_660cf62d7ad1499c81cc23908b4bdde4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-Tenant: admin Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-Tenant-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-Tenant-Name: admin Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-User: admin Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-User-Domain-Id: default Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-User-Domain-Name: Default Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-User-Id: 1fe17027043247a5ba6d4296eb07bb32 Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: X-User-Name: admin Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: method: > Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: exception: Flavor 42 could not be found. Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: action_args: {'id': '42'} Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:52:04.770085 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:04.771212 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.772635 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-5fe855ab-1fa6-4d27-a70f-902db2a5688e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:52:04.773874 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-5fe855ab-1fa6-4d27-a70f-902db2a5688e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393585 Oct 16 00:52:04.773874 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Oct 16 00:52:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:04.780193 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-e96375cd-8189-4833-9efc-f107242d90cb admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:04.804593 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-e96375cd-8189-4833-9efc-f107242d90cb admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028551 Oct 16 00:52:04.805148 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Oct 16 00:52:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:52:04.816396 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-42274e6f-ed67-4186-bdc1-f71b3bf5b8ac admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:04.838298 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-42274e6f-ed67-4186-bdc1-f71b3bf5b8ac admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026965 Oct 16 00:52:04.838835 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Oct 16 00:52:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:52:04.848193 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-ab83628a-fb0b-4350-876d-f4da4a5cee40 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:04.853494 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.wsgi [None req-ab83628a-fb0b-4350-876d-f4da4a5cee40 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-ab83628a-fb0b-4350-876d-f4da4a5cee40 admin admin] Request method failure captured: Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: Accept: application/json Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: Accept-Encoding: gzip, deflate Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: Connection: keep-alive Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: Content-Length: 0 Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: Host: 10.222.0.39 Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: Openstack-Api-Version: compute 2.92 Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: Openstack-System-Scope: None Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: User-Agent: python-novaclient Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Auth-Token: gAAAAABjS1W0jDCNRXdlAxvadmqNarVzcuyZf0K6GmRRf6kguaKqwrAokIvXIwFLWQPodVKe-r0oRhTjxU5JMxQjwrSHi3Oh9TlMCrQbHQmHZfcNqLc1VX3sfoDH7VJqAzRuBCqfXnMlIqwAe1EJQ6e2FFj-mdZ49H5pnBh1PY5KSiVgVQkfoyM Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Domain-Id: None Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Domain-Name: None Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Identity-Status: Confirmed Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Is-Admin-Project: True Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Project-Domain-Id: default Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Project-Domain-Name: Default Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Project-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Project-Name: admin Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Role: member,reader,admin Oct 16 00:52:04.856821 n-d-master-1 devstack@n-api.service[104516]: X-Roles: member,reader,admin Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_660cf62d7ad1499c81cc23908b4bdde4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-Tenant: admin Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-Tenant-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-Tenant-Name: admin Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-User: admin Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-User-Domain-Id: default Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-User-Domain-Name: Default Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-User-Id: 1fe17027043247a5ba6d4296eb07bb32 Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: X-User-Name: admin Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: method: > Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: exception: Flavor 42 could not be found. Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: action_args: {'id': '42'} Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:52:04.858824 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:04.859676 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:04.860893 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-ab83628a-fb0b-4350-876d-f4da4a5cee40 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:52:04.862071 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-ab83628a-fb0b-4350-876d-f4da4a5cee40 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013626 Oct 16 00:52:04.862071 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Oct 16 00:52:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:06.073306 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-42274e6f-ed67-4186-bdc1-f71b3bf5b8ac admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:06.074311 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-42274e6f-ed67-4186-bdc1-f71b3bf5b8ac admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 16 00:52:06.074740 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:06.595615 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-045489cf-1332-4d1b-a873-d84c425c73ec admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:06.600693 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.wsgi [None req-045489cf-1332-4d1b-a873-d84c425c73ec admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-045489cf-1332-4d1b-a873-d84c425c73ec admin admin] Request method failure captured: Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: Accept: application/json Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: Accept-Encoding: gzip, deflate Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: Connection: keep-alive Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: Content-Length: 0 Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: Host: 10.222.0.39 Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: Openstack-Api-Version: compute 2.92 Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: Openstack-System-Scope: None Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: User-Agent: python-novaclient Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Auth-Token: gAAAAABjS1W1pt-_eA68i669Y-1ekNqDBjFNJX0nQGKLz57s75qBOv5PGARqM_hVw8uXrbPkc87Q1JodlOvrlpmDI4XzwxhJ31aUtQL9azAYVXSS5zPh4rvIvd-bJVGa4QHTn_UNFcvleTJpfOsJ-1wjuE5530jXE-qZTwb3mvvzVxG_jTLXT4U Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Domain-Id: None Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Domain-Name: None Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Identity-Status: Confirmed Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Is-Admin-Project: True Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Project-Domain-Id: default Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Project-Domain-Name: Default Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Project-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Project-Name: admin Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Role: member,reader,admin Oct 16 00:52:06.602190 n-d-master-1 devstack@n-api.service[104516]: X-Roles: member,reader,admin Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_660cf62d7ad1499c81cc23908b4bdde4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-Tenant: admin Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-Tenant-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-Tenant-Name: admin Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-User: admin Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-User-Domain-Id: default Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-User-Domain-Name: Default Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-User-Id: 1fe17027043247a5ba6d4296eb07bb32 Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: X-User-Name: admin Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: method: > Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: exception: Flavor 84 could not be found. Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: action_args: {'id': '84'} Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:52:06.603754 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:06.604707 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.606247 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-045489cf-1332-4d1b-a873-d84c425c73ec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:52:06.607552 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-045489cf-1332-4d1b-a873-d84c425c73ec admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391360 Oct 16 00:52:06.607552 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Oct 16 00:52:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:06.613491 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-6000d9d9-b155-4994-b460-e6f596f23647 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:06.628525 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-6000d9d9-b155-4994-b460-e6f596f23647 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018575 Oct 16 00:52:06.629048 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Oct 16 00:52:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:52:06.638049 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-71c409ab-22cd-49dd-a605-9dbd0b7ebbc7 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:06.654021 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-71c409ab-22cd-49dd-a605-9dbd0b7ebbc7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019375 Oct 16 00:52:06.654528 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Oct 16 00:52:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:52:06.663793 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-3ce352f7-0ced-4c9a-9e6b-6af1f05634f2 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:06.668776 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.wsgi [None req-3ce352f7-0ced-4c9a-9e6b-6af1f05634f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-3ce352f7-0ced-4c9a-9e6b-6af1f05634f2 admin admin] Request method failure captured: Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: Accept: application/json Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: Accept-Encoding: gzip, deflate Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: Connection: keep-alive Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: Content-Length: 0 Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: Host: 10.222.0.39 Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: Openstack-Api-Version: compute 2.92 Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: Openstack-System-Scope: None Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: User-Agent: python-novaclient Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Auth-Token: gAAAAABjS1W1pt-_eA68i669Y-1ekNqDBjFNJX0nQGKLz57s75qBOv5PGARqM_hVw8uXrbPkc87Q1JodlOvrlpmDI4XzwxhJ31aUtQL9azAYVXSS5zPh4rvIvd-bJVGa4QHTn_UNFcvleTJpfOsJ-1wjuE5530jXE-qZTwb3mvvzVxG_jTLXT4U Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Domain-Id: None Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Domain-Name: None Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Identity-Status: Confirmed Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Is-Admin-Project: True Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Project-Domain-Id: default Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Project-Domain-Name: Default Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Project-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Project-Name: admin Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Role: member,reader,admin Oct 16 00:52:06.670270 n-d-master-1 devstack@n-api.service[104517]: X-Roles: member,reader,admin Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_660cf62d7ad1499c81cc23908b4bdde4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-Tenant: admin Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-Tenant-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-Tenant-Name: admin Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-User: admin Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-User-Domain-Id: default Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-User-Domain-Name: Default Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-User-Id: 1fe17027043247a5ba6d4296eb07bb32 Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: X-User-Name: admin Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: method: > Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: exception: Flavor 84 could not be found. Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: action_args: {'id': '84'} Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:52:06.671992 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:06.673477 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:06.674773 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-3ce352f7-0ced-4c9a-9e6b-6af1f05634f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:52:06.676466 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-3ce352f7-0ced-4c9a-9e6b-6af1f05634f2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011610 Oct 16 00:52:06.676466 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Oct 16 00:52:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:07.900089 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-71c409ab-22cd-49dd-a605-9dbd0b7ebbc7 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:07.901119 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-71c409ab-22cd-49dd-a605-9dbd0b7ebbc7 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 16 00:52:07.901507 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 24/48] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:08.428738 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-ca665aa5-90fe-465d-aa54-c9d9a2858ebe admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:08.434578 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.wsgi [None req-ca665aa5-90fe-465d-aa54-c9d9a2858ebe admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-ca665aa5-90fe-465d-aa54-c9d9a2858ebe admin admin] Request method failure captured: Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: Accept: application/json Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: Accept-Encoding: gzip, deflate Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: Connection: keep-alive Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: Content-Length: 0 Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: Host: 10.222.0.39 Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: Openstack-Api-Version: compute 2.92 Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: Openstack-System-Scope: None Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: User-Agent: python-novaclient Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Auth-Token: gAAAAABjS1W3xvSLA9fspvYLs4Ag6sPPDeAGrS6Mf1uF86GGXOjS-5XI_aUBKbVfbBkCq6UFpT6pHwzNVgqYTwrw8WWn1NEiv5-_9z_ukQpK9ksjJnNQ_ud9SveaVAwQCVudK0YLhoi0B6LBRrPH7UUwTlyzA1Yv-RgBJJnyHRg23MtS6cTr1VQ Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Domain-Id: None Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Domain-Name: None Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Identity-Status: Confirmed Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Is-Admin-Project: True Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Project-Domain-Id: default Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Project-Domain-Name: Default Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Project-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Project-Name: admin Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Role: member,reader,admin Oct 16 00:52:08.436133 n-d-master-1 devstack@n-api.service[104517]: X-Roles: member,reader,admin Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_660cf62d7ad1499c81cc23908b4bdde4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-Tenant: admin Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-Tenant-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-Tenant-Name: admin Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-User: admin Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-User-Domain-Id: default Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-User-Domain-Name: Default Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-User-Id: 1fe17027043247a5ba6d4296eb07bb32 Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: X-User-Name: admin Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: method: > Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: exception: Flavor 451 could not be found. Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: action_args: {'id': '451'} Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:52:08.438190 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:08.439040 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.440440 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-ca665aa5-90fe-465d-aa54-c9d9a2858ebe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:52:08.441692 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-ca665aa5-90fe-465d-aa54-c9d9a2858ebe admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.399300 Oct 16 00:52:08.441692 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Oct 16 00:52:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:08.447747 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-672c05a6-16a8-414e-a71f-227136fe66f7 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:08.463251 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-672c05a6-16a8-414e-a71f-227136fe66f7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019065 Oct 16 00:52:08.463772 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Oct 16 00:52:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:52:08.473137 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:08.488328 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018635 Oct 16 00:52:08.488855 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Oct 16 00:52:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 00:52:08.497730 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-0b2a6d89-7d8f-4cc4-9648-d948b14d1b82 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:08.503205 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.wsgi [None req-0b2a6d89-7d8f-4cc4-9648-d948b14d1b82 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-0b2a6d89-7d8f-4cc4-9648-d948b14d1b82 admin admin] Request method failure captured: Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: Accept: application/json Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: Accept-Encoding: gzip, deflate Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: Connection: keep-alive Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: Content-Length: 0 Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: Host: 10.222.0.39 Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: Openstack-Api-Version: compute 2.92 Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: Openstack-System-Scope: None Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: User-Agent: python-novaclient Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Auth-Token: gAAAAABjS1W3xvSLA9fspvYLs4Ag6sPPDeAGrS6Mf1uF86GGXOjS-5XI_aUBKbVfbBkCq6UFpT6pHwzNVgqYTwrw8WWn1NEiv5-_9z_ukQpK9ksjJnNQ_ud9SveaVAwQCVudK0YLhoi0B6LBRrPH7UUwTlyzA1Yv-RgBJJnyHRg23MtS6cTr1VQ Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Domain-Id: None Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Domain-Name: None Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Identity-Status: Confirmed Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Is-Admin-Project: True Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Openstack-Nova-Api-Version: 2.92 Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Project-Domain-Id: default Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Project-Domain-Name: Default Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Project-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Project-Name: admin Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Role: member,reader,admin Oct 16 00:52:08.504699 n-d-master-1 devstack@n-api.service[104516]: X-Roles: member,reader,admin Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_660cf62d7ad1499c81cc23908b4bdde4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/660cf62d7ad1499c81cc23908b4bdde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-Tenant: admin Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-Tenant-Id: 660cf62d7ad1499c81cc23908b4bdde4 Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-Tenant-Name: admin Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-User: admin Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-User-Domain-Id: default Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-User-Domain-Name: Default Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-User-Id: 1fe17027043247a5ba6d4296eb07bb32 Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: X-User-Name: admin Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: method: > Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: exception: Flavor 451 could not be found. Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: action_args: {'id': '451'} Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 00:52:08.506251 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:08.507151 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: ERROR nova.api.openstack.wsgi Oct 16 00:52:08.508219 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-0b2a6d89-7d8f-4cc4-9648-d948b14d1b82 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 00:52:08.509221 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-0b2a6d89-7d8f-4cc4-9648-d948b14d1b82 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011818 Oct 16 00:52:08.509221 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Oct 16 00:52:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:09.830079 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:09.831158 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 16 00:52:09.831559 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:10.357072 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-d010a6f1-87a5-4600-88d3-79430dd1d78f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:52:10.376457 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-d010a6f1-87a5-4600-88d3-79430dd1d78f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406473 Oct 16 00:52:10.376928 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 27/54] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Oct 16 00:52:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:52:11.602249 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:11.603282 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 16 00:52:11.603683 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:12.127828 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-f10c1b39-f4d5-4cbc-8f50-90da7ba746b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:52:12.146027 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-f10c1b39-f4d5-4cbc-8f50-90da7ba746b6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.406281 Oct 16 00:52:12.146572 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Oct 16 00:52:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:52:13.365873 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:13.366868 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 16 00:52:13.367290 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:13.890487 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-5fe24f16-ba82-4592-8e12-6587904149b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:52:13.908753 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-5fe24f16-ba82-4592-8e12-6587904149b1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.401923 Oct 16 00:52:13.909291 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 29/58] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Oct 16 00:52:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:52:15.118485 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:15.119534 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Oct 16 00:52:15.119924 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 30/59] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:15.638821 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-161a9c9c-bdaf-41a5-9a0a-ef73ad462462 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 00:52:15.657268 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-161a9c9c-bdaf-41a5-9a0a-ef73ad462462 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397783 Oct 16 00:52:15.657810 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 30/60] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Oct 16 00:52:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 00:52:16.864031 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:16.865039 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 16 00:52:16.865435 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 31/61] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:52:17.398012 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-9c2a828c-fac7-4c09-909b-bc5aac80a468 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:52:17.419157 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-9c2a828c-fac7-4c09-909b-bc5aac80a468 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.415185 Oct 16 00:52:17.419621 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 31/62] 10.222.0.39 () {60 vars in 1202 bytes} [Sun Oct 16 00:52:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:53:14.434487 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:14.435611 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-02f22c6c-26cb-4f72-85a4-811f42dd82fb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Oct 16 00:53:14.436013 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 931 bytes} [Sun Oct 16 00:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:53:14.446695 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:14.826943 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-28d5bd0c-8ade-4619-aca4-c234f8a7f505 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:14.847666 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-28d5bd0c-8ade-4619-aca4-c234f8a7f505 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405470 Oct 16 00:53:14.848207 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 00:53:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:53:14.869446 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:SELECT=14 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:14.873906 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-c2d685fa-d784-4349-a1ab-b1fbd8a1825a admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:14.881102 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-c2d685fa-d784-4349-a1ab-b1fbd8a1825a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013200 Oct 16 00:53:14.881625 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 33/65] 10.222.0.39 () {60 vars in 1283 bytes} [Sun Oct 16 00:53:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:53:14.893833 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-42132f1f-4b6f-480d-b9c5-f60aeec1609d admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:14.901258 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-42132f1f-4b6f-480d-b9c5-f60aeec1609d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011067 Oct 16 00:53:14.901776 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 33/66] 10.222.0.39 () {60 vars in 1286 bytes} [Sun Oct 16 00:53:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:53:14.913621 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-7c03a914-b851-4fe5-ba3a-42b51e491e88 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:14.920632 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-7c03a914-b851-4fe5-ba3a-42b51e491e88 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011041 Oct 16 00:53:14.921147 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1286 bytes} [Sun Oct 16 00:53:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:53:14.932424 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-4a58cbf9-cead-4334-ad2c-638152dd4bcf admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:53:14.940208 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-4a58cbf9-cead-4334-ad2c-638152dd4bcf admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011338 Oct 16 00:53:14.940721 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 34/68] 10.222.0.39 () {60 vars in 1283 bytes} [Sun Oct 16 00:53:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 00:58:31.833839 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-7c03a914-b851-4fe5-ba3a-42b51e491e88 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:31.834853 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-7c03a914-b851-4fe5-ba3a-42b51e491e88 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 16 00:58:31.835281 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:58:31.977939 n-d-master-1 devstack@n-api.service[104516]: DEBUG dbcounter [-] [104516] Writing DB stats nova_api:SELECT=6 {{(pid=104516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:32.125922 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-fa82df5f-3c2c-4c1b-a770-e5fd8cb6b365 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:32.131354 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-fa82df5f-3c2c-4c1b-a770-e5fd8cb6b365 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:32.131833 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-fa82df5f-3c2c-4c1b-a770-e5fd8cb6b365 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:32.132265 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-fa82df5f-3c2c-4c1b-a770-e5fd8cb6b365 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:32.132986 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-fa82df5f-3c2c-4c1b-a770-e5fd8cb6b365 admin admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:32.133446 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-fa82df5f-3c2c-4c1b-a770-e5fd8cb6b365 admin admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:32.133869 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-fa82df5f-3c2c-4c1b-a770-e5fd8cb6b365 admin admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:32.172752 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-fa82df5f-3c2c-4c1b-a770-e5fd8cb6b365 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.195979 Oct 16 00:58:32.173307 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 35/70] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Oct 16 00:58:31 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:58:33.255907 n-d-master-1 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-7c03a914-b851-4fe5-ba3a-42b51e491e88 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:33.256900 n-d-master-1 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-7c03a914-b851-4fe5-ba3a-42b51e491e88 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 16 00:58:33.257292 n-d-master-1 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Oct 16 00:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 00:58:33.450453 n-d-master-1 devstack@n-api.service[104516]: DEBUG nova.api.openstack.wsgi [None req-03aca7fd-1e47-4577-9919-79ed09dcc0a1 admin admin] Calling method '>' {{(pid=104516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 00:58:33.453958 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-03aca7fd-1e47-4577-9919-79ed09dcc0a1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:33.454427 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-03aca7fd-1e47-4577-9919-79ed09dcc0a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:33.454851 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-03aca7fd-1e47-4577-9919-79ed09dcc0a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:33.455584 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-03aca7fd-1e47-4577-9919-79ed09dcc0a1 admin admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:58:33.456026 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-03aca7fd-1e47-4577-9919-79ed09dcc0a1 admin admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:58:33.456443 n-d-master-1 devstack@n-api.service[104516]: DEBUG oslo_concurrency.lockutils [None req-03aca7fd-1e47-4577-9919-79ed09dcc0a1 admin admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:58:33.482579 n-d-master-1 devstack@n-api.service[104516]: INFO nova.api.openstack.requestlog [None req-03aca7fd-1e47-4577-9919-79ed09dcc0a1 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.083263 Oct 16 00:58:33.483095 n-d-master-1 devstack@n-api.service[104516]: [pid: 104516|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Oct 16 00:58:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 00:59:20.284044 n-d-master-1 devstack@n-api.service[104515]: Sun Oct 16 00:59:20 2022 - graceful shutdown triggered... Oct 16 00:59:20.283537 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 16 00:59:20.285046 n-d-master-1 devstack@n-api.service[104516]: Gracefully killing worker 1 (pid: 104516)... Oct 16 00:59:20.286779 n-d-master-1 devstack@n-api.service[104517]: Gracefully killing worker 2 (pid: 104517)... Oct 16 00:59:20.416201 n-d-master-1 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:SELECT=4 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:21.284614 n-d-master-1 devstack@n-api.service[104515]: worker 1 buried after 1 seconds Oct 16 00:59:21.284614 n-d-master-1 devstack@n-api.service[104515]: worker 2 buried after 1 seconds Oct 16 00:59:21.284614 n-d-master-1 devstack@n-api.service[104515]: goodbye to uWSGI. Oct 16 00:59:21.286228 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 16 00:59:21.286841 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 16 00:59:21.289876 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 16 00:59:21.305774 n-d-master-1 devstack@n-api.service[120530]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 16 00:59:21 2022] *** Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: nodename: n-d-master-1 Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: machine: x86_64 Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: clock source: unix Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: pcre jit disabled Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: detected number of CPU cores: 4 Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: current working directory: / Oct 16 00:59:21.307934 n-d-master-1 devstack@n-api.service[120530]: detected binary path: /usr/bin/uwsgi-core Oct 16 00:59:21.308733 n-d-master-1 devstack@n-api.service[120530]: your processes number limit is 47680 Oct 16 00:59:21.308733 n-d-master-1 devstack@n-api.service[120530]: your memory page size is 4096 bytes Oct 16 00:59:21.308733 n-d-master-1 devstack@n-api.service[120530]: detected max file descriptor number: 2048 Oct 16 00:59:21.308733 n-d-master-1 devstack@n-api.service[120530]: lock engine: pthread robust mutexes Oct 16 00:59:21.308733 n-d-master-1 devstack@n-api.service[120530]: thunder lock: enabled Oct 16 00:59:21.308733 n-d-master-1 devstack@n-api.service[120530]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 16 00:59:21.308733 n-d-master-1 devstack@n-api.service[120530]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 16 00:59:21.350890 n-d-master-1 devstack@n-api.service[120530]: Python main interpreter initialized at 0x56234b55c9c0 Oct 16 00:59:21.350890 n-d-master-1 devstack@n-api.service[120530]: python threads support enabled Oct 16 00:59:21.350890 n-d-master-1 devstack@n-api.service[120530]: your server socket listen backlog is limited to 100 connections Oct 16 00:59:21.350890 n-d-master-1 devstack@n-api.service[120530]: your mercy for graceful operations on workers is 90 seconds Oct 16 00:59:21.351719 n-d-master-1 devstack@n-api.service[120530]: mapped 403077 bytes (393 KB) for 2 cores Oct 16 00:59:21.351814 n-d-master-1 devstack@n-api.service[120530]: *** Operational MODE: preforking *** Oct 16 00:59:21.352095 n-d-master-1 devstack@n-api.service[120530]: *** uWSGI is running in multiple interpreter mode *** Oct 16 00:59:21.352095 n-d-master-1 devstack@n-api.service[120530]: spawned uWSGI master process (pid: 120530) Oct 16 00:59:21.352305 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 16 00:59:21.354965 n-d-master-1 devstack@n-api.service[120530]: spawned uWSGI worker 1 (pid: 120545, cores: 1) Oct 16 00:59:21.354965 n-d-master-1 devstack@n-api.service[120530]: spawned uWSGI worker 2 (pid: 120546, cores: 1) Oct 16 00:59:21.354965 n-d-master-1 devstack@n-api.service[120530]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 16 00:59:22.016526 n-d-master-1 devstack@n-api.service[120545]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 16 00:59:22.027137 n-d-master-1 devstack@n-api.service[120546]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 16 00:59:23.188500 n-d-master-1 devstack@n-api.service[120545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:59:23.188500 n-d-master-1 devstack@n-api.service[120545]: from cryptography.utils import int_from_bytes Oct 16 00:59:23.189132 n-d-master-1 devstack@n-api.service[120545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:59:23.189132 n-d-master-1 devstack@n-api.service[120545]: from cryptography.utils import int_from_bytes Oct 16 00:59:23.210518 n-d-master-1 devstack@n-api.service[120546]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:59:23.210518 n-d-master-1 devstack@n-api.service[120546]: from cryptography.utils import int_from_bytes Oct 16 00:59:23.211132 n-d-master-1 devstack@n-api.service[120546]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:59:23.211132 n-d-master-1 devstack@n-api.service[120546]: from cryptography.utils import int_from_bytes Oct 16 00:59:25.659218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:59:25.659867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:59:25.659996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:59:25.660402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:59:25.660665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:59:25.661064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.661395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.661717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.662040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.662374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.662695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.663050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.663389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.663706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.663969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.664290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.665044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.665378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.665694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.666015 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.666341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.666650 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.667003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.667321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.667832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.669261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.669261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.669261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.669261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.669629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.669869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.670142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.670457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.670790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.671138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.671536 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.671857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.672168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.672497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.672921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.673223 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.673516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.673842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.674161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.674473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.674808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.675155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.675482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.676506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.676955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.677275 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.677593 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.677923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.678236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.678546 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.678802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.679139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.679461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.679787 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.680112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.680399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.680619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.680940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.681261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.681572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.681674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:59:25.682082 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.682161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:59:25.682262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.682463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:59:25.682567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.682769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.682904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:59:25.683109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:59:25.683183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.683400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.683524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.683710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.683820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.684035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.684170 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.684355 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.684463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.684681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.684842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.684999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.685160 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.685334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.685500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.685662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.685816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.685961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.686117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.686269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.686437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.686628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.686783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.686957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.687117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.687264 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.687425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.687579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.687725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.687876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.688039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.688186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.688343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.688489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.688640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.688796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.688948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.689099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.689258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.689402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.689552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.689727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.689889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.690043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.690197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.690342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.690537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.690702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.690847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.691040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.691188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.692001 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.692220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.692380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.693083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.693253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.693402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.693548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.693699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.693850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.693994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.694147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.694292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.694459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.694614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.694940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.695098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.695255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.695401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.695557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.695557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.695845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.695992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.696135 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.696291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.696443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.696596 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.696750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.696895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.697038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.697038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.697339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.697339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.697630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.697775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.697919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.698076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.698220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.698375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.698528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.698681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.698835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.699014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.699191 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.699349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.699501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.699655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.699815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.699971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.700115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.700271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.700423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.700615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.700852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.701007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.701007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.701312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.701458 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.701608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.701767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.701767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.702050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.702195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.702339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.702501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.702674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.703399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.703711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.703869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.704015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.704177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.704323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.704469 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.704612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.704756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.705079 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.705351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.705517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.705672 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.705830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.705984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.706142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.706288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.706444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.706589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.706743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.706983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.707153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.707310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.707455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.707607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.707761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.707926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.708082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.708235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.708388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.708542 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.708687 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.708837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.708992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.708992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.709295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.709448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.709645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.709808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.709964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.710115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.710115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.710397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.710549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.710752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.710904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.711073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.711229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.711375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.711531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.711685 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.711847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.711999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.712144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.712289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.712445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.712597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.712742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.712742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.713598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.713833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.713995 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.714142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.714291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.714449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.714601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.714746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.714899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.715249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.715413 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.715568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.715770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.715921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.716075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.716238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.716391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.716550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.716714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.716858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.717011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.717163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.717163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.717447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.717600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.717755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.717899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.718051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.718203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.718354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.718508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.718676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.718821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.719002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.719162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.719318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.719462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.719617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.719762 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.719921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.720073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.720225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.720384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.720551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.720709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.720903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.721066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.721211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.721369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.721514 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.721660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.721811 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.721956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.722106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.722259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.722410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.723155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.723987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.724146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.724146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.724429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.724581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.724734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.724893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.725054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.725352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.725501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.725645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.726378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.726547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.726705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.726851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.727021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.727179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.727333 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.727333 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.727631 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.727787 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.727941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.728094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.728238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.728392 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.728557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.728703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.728854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.729009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.729160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.729318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.729470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.729616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.729767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.729919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.730065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.730295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.730443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.730599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.730743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.730953 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.731118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.731274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.731419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:59:25.731564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.731714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.731859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.732010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.732172 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.732317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.732471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.732622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.732775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.732775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.733066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.733213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.733413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.734018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.734269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.734530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.734683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.734829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.735021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.735330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.735488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.735645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.735791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.735942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.736088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.736240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.736386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.736539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.736684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.736829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.736980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.737133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.737306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.737460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.737605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.737750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.737902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.738048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.738814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.738986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.739139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.739294 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.739486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.739643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.739814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.739968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.740128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.740273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.740425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.740579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.740732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.740878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.741074 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.741228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.741379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.741544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.741697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.741859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.742009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.742159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.742318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.742478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.742478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.742784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.742978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.743154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.743307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.743467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.744060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.744249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.744482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.744482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.744482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.745052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.745206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.745505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.745679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.745834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.745998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.746165 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.746331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.746491 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.746643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.746814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.747003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.747164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.747323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.747475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.747475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.747761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.747761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.748071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.748224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.748382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.748541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.748713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.748883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.749063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.749305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.749464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.749616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.749782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.749942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.750102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.750254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.750404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.750554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.750715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.750878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.751103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.751103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.751406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.751693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.751880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.752037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.752189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.752340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.752491 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.752643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.752803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.752956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.753119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.753271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.753429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.753627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.754195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.755280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.755470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.755763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.755935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.756104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.756259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.756410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.756570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.756734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.756894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.757061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.757214 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.757214 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.757519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.757519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.757832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.757832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.758139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.758290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.758442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.758600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.758763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.758943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.759104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.759258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.759420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.759572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.759736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.759896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.760055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.760207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.760358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.760510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.760685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.760845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.761006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.761202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.761435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.761606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.761770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.761923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.762082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.762243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.762403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.762563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.762726 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.762889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.763064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.763216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.763377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.763615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.763778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.764290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.764470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.764632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.764786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.764947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.765126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.765509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.765828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.765999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.766152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.766521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.766691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.766847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.767042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.767195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.767354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.767519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.767681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.767835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.767986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.768157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.768157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.768462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.768613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.768796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.768796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.769477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.769768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.769944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.770097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.770248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.770399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.770563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.770730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.770890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.771069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.771265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.771265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.771580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.771743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.771903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.771903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.772201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.772201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.772499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.772670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.772823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.772973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.773131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.773291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.773458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.773618 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.773769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.773927 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.774098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.774720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.774900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.775080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.775246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.775246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.775964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.776127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.776296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.776449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.776601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.776751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.776909 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.777069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.777237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.777388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.777540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.777710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.777863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.778023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.778184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.778338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.778496 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.778656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.778808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.778808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.779149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.779302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.779469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.779633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.779797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.779959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.780111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.780111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.780413 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.780564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.780726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.780888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.781039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.781190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.781391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.781550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.781731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.781884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.782047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.782200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.782358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.782511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.782669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.782828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.783041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.783209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.783371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.783525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.783676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.783837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.783988 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.784153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.784306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.784817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.785531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.786153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.786319 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.786488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.786642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.786802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.786972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.787130 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.787316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.787481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.787642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.787794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.787945 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.788104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.788257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.788417 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.788570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.788721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.788880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.789039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.789201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.789364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.789534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.789955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.790113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.790265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.790427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.790579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.790730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.790882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.791071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.791232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.791440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.791609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.791767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.791920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.791920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.791920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.792362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.792522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.792681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.792841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.793001 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.793168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.793320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.793488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.793704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.793867 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.794019 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.794184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.794345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.794504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.795075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.795234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.795386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.795552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.795705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.795878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.796409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.796583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.796583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.796886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.796886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.797183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.797335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.797494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.797656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.797808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.797960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.798118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.798280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.798432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.798432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.798746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.798898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.799097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.799097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.799411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.799589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.799751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.799902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.800054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.800213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.800379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.800543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.800805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.800983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.801151 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.801311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.801587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.801755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.801917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.801917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.801917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.802391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.802553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.802725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.802897 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.803096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.803250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.803401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.803564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.803718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.803869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.804020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.804180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.804341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.804341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.804668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.805192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.805482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.805667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.805835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.805997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.806591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.806755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.807001 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.807164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.807329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.807490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.807664 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.807833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.807986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.808149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.808318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.808470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.808634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.808868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.809024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.809185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.809346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.809510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.809663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.809829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.810004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.810169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.810321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.810481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.810638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.810802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.811022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.811182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.811333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.811483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.811704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.811864 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.812016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.812167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.812338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.812603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.812786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.812952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.813105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.813266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.813418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.813578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.813744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.813899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.814059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.814212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.814507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.814679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.814843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.815388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.815559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.815723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.815923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.816096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.817175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.817353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.817353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.817353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.817353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.817940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.818106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.818259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.818259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.818259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.818259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.818259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.818259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.818259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.819304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.819304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.819304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.819304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.819929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.819929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.819929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.820380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.820541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.820693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.820851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.821004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.821004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.821307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.821473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.821625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.821818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.821993 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.822157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.822319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.822319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.822627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.822780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.822969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.823139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.823301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.823468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.823622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.823781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.823933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.823933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.824241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.824406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.824646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.824814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.824968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.825277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.825643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.825798 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.826002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.826156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.826316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.826507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.826691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.826869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.827381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.827548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.827702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.827854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.828032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.828191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.828354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.828524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.828679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.828832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.829009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.829163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.829337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.829493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.829646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.829819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.829978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.830131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.830282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.830434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.830585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.830754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.830910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.830910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.831261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.831412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.831572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.831735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.832569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.832731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.832894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.833047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.833198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.833359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.833512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.833676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.833849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.834001 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.834167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.834455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.834710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.835085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.835652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.835834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.835834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.836137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.836298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.836459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.836619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.836794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.836947 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.837119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.837616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.837785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.837940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.838102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.838255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.838415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.838578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.838731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.838891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.839131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.839298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.839451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.839610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.839769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.839941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.840103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.840256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.840421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.840575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.840727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.840897 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.841058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.841223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.841374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.841533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.841693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.841856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.842063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.842231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.842385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.842537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.842689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.842960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.843133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.843295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.843467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.843628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.843801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.843801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.843801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.844398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.846060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.846223 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.846376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.846538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.846538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.846538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.847020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.847177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.847336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.847905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.848067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.848243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.848398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.848560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.848721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.848883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.848883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.849183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.849337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.849496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.849664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.849664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.850065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.850235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.850400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.850561 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.850716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.850868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.851078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.851311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.851473 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.851660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.851974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.852197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.852197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.852505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.852657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.852833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.852987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.853147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.853147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.853147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.853147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.853147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.853147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.854016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.854179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.854179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.854470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.854622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.854798 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.854984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.855240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.855411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.855585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.856102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.856276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.856444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.856609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.856609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.856609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.857094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.857274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.857428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.857580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.857974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.858230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.858401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.858563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.858724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.858724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.859051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.859051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.859356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.859356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.859667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.859836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.860001 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.860001 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.860319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.860473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.860633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.860633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.860931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.861082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.861247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.861409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.861641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.861821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.861976 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.862143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.862349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.862502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.862654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.862805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.862988 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.863200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.863360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.863521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.863817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.863995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.864168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.864337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.864499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.864652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.864804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.864804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.865101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.865101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.865101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.865657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.865838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.866315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.866501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.866656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.866808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.867058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.867058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.867355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.867522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.867683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.867998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.868256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.868256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.868658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.868826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.869004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.869167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.869320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.869320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.869620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.869785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.869957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.870119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.870280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.870431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.870594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.870749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.870908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.871095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.871259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.871420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.871587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.871741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.871893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.872052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.872204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.872409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.872577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.872732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.872891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.873054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.873214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.873214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.873520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.873673 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.873825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.873978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.874141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.874304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.874485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.874754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.874954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.875116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.875290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.875542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.875770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.875937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.876429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.876602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.876756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.876925 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.877086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.877249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.877401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.877553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.877713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.878065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.878249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.878511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.879547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.879722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.879896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.880060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.880213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.880365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.880516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.880685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.880853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.881020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.881181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.881334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.881485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.881652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.881805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.881967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.882129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.882284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.882477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.882644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.882804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.882996 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.883165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.883319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.883471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.883636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.883797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.883956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.884115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.884276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.884436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.884600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.884761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.884921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.885084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.885236 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.885402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.885556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.885708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.885955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.886148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.886654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.886831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.887016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.887172 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.887337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.887509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.887663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.887829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.887983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.888293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.888474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.888474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.888971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.889131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.889284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.889438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.889589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.889749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.889928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.890090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.890256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.890416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.890590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.890744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.890928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.891091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.891255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.891408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.891569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.891728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.891891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.892055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.892207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.892371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.892569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.892741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.892903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.893056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.893207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.893359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.893518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.893686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.893840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.894002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.894155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.894313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.894578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.894828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.894828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.895170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.895329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.895482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.895642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.895811 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.895981 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.896219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.896410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.896928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.897095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.897257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.897410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.897569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.897730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.897893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.898060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.898359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.898530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.898709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.899115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.899296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.899469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.899647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.899647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.899960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.900113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.900266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.900428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.900600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.900755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.900926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.901085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.901258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.901421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.901581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.901741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.901894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.902047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.902214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.902390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.902587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.902755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.902909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.903144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.903308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.903472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.903633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.903786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.903786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.904095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.904255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.904408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.904560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.904560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.904560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.905194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.907022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.907189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.907355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.907524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.907679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.907830 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.907994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.908156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.908156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.908612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.908777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.908949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.909202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.909490 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.909744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.909932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.909932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.910844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.911075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.911233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.911400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.911600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.911761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.911930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.912083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.912249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.912410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.912410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.912753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.912753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.913059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.913233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.913386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.913553 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.913707 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.913881 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.914046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.914213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.914376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.914530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.914963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.915128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.915293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.915465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.915626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.915787 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.915997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.916156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.916156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.916566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.916755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.917259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.917429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.917583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.917747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.917919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.918074 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.918225 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.918377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.918377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.918835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.919054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.919229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.919485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.919734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.919904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.920057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.920057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.920366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.920518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.920678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.920845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.921009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.921163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.921323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.921476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.921628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.921628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.921930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.922083 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.922243 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.922409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.922572 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.922786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.922979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.923151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.923151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.923151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.923633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.923977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.924145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.924300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.924300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.924300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.924755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.924910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.925063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.925215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.925375 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.925544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.925798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.925992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.926152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.926371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.926650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.926826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.927028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.927534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.927703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.927857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.928009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.928175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.928407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.928573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.928573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.929025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.929194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.929194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.929194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.929869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.930038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.930200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.930371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.930371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.930671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.930824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.931035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.931035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.931035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.931504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.931658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.931822 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.931975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.932128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.932290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.932457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.932610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.932769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.932769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.933119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.933287 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.933448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.933603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.933755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.933926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.934088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.934248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.934452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.934607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.934769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.934941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.935114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.935268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.935268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.935568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.935728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.935887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.936064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.936218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.936382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.936542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.936789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.936956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.937124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.937691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.937854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.938041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.938205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.938368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.938539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.940495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.940495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.942145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.942402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.942569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.942732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.942897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.943129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.943285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.943453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.943609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.943609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.943931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.943931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.944236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.944236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.944544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.944698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.944857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.945020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.945181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.945354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.945509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.945679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.945834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.945986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.946219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.946385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.946539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.946691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.947030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.947207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.947401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.948018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.948190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.948346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.948519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.948681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.948850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.949003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.949164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.949325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.949486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.949653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.949815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.949983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.950136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.950692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.950866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.951057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.951221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.951387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.951549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.951703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.951855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.952158 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.952343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.952501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.952662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.952764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.952850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.952939 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.953954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954223 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.954990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955432 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:59:25.955773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.955773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.956384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.956384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.956384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.956384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.956384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.956384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.956384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.956384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.957122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.957122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.957122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.957122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.957122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.957122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.957122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.957122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.958741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.959400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.959400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.959400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.959400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.959400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.959400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.959400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.959400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.960883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.961515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.961515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.961515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.961515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.961515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.961515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.961515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.961515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.962238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.962238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.962434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.962764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.963176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.963491 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.963820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.964152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.964503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.964815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.965163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.965499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.965817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.966128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.966434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:59:25.966679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:59:26.006084 n-d-master-1 devstack@n-api.service[120546]: INFO dbcounter [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Registered counter for database nova_api Oct 16 00:59:26.027588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_db.sqlalchemy.engines [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:59:26.030895 n-d-master-1 devstack@n-api.service[120545]: INFO dbcounter [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Registered counter for database nova_api Oct 16 00:59:26.034717 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writer thread running {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:59:26.053187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_db.sqlalchemy.engines [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:59:26.060501 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writer thread running {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:59:26.098502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.context [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) {{(pid=120546) load_cells /opt/stack/nova/nova/context.py:464}} Oct 16 00:59:26.102824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.103420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.105304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.106520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.107189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.109560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.111859 n-d-master-1 devstack@n-api.service[120546]: INFO dbcounter [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Registered counter for database nova_cell0 Oct 16 00:59:26.117745 n-d-master-1 devstack@n-api.service[120546]: INFO dbcounter [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Registered counter for database nova_cell1 Oct 16 00:59:26.122240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.context [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) {{(pid=120545) load_cells /opt/stack/nova/nova/context.py:464}} Oct 16 00:59:26.125275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_db.sqlalchemy.engines [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:59:26.127710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.128456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.130531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.130665 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writer thread running {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:59:26.131827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 00:59:26.132296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 00:59:26.134337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 00:59:26.136431 n-d-master-1 devstack@n-api.service[120545]: INFO dbcounter [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Registered counter for database nova_cell0 Oct 16 00:59:26.140751 n-d-master-1 devstack@n-api.service[120545]: INFO dbcounter [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Registered counter for database nova_cell1 Oct 16 00:59:26.152067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_db.sqlalchemy.engines [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:59:26.157514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_db.sqlalchemy.engines [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:59:26.162719 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writer thread running {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:59:26.163105 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writer thread running {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:59:26.278563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_db.sqlalchemy.engines [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:59:26.282860 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writer thread running {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:59:26.293632 n-d-master-1 devstack@n-api.service[120546]: INFO dbcounter [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Registered counter for database nova_cell0 Oct 16 00:59:26.300564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_db.sqlalchemy.engines [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:59:26.306052 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writer thread running {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:59:26.314812 n-d-master-1 devstack@n-api.service[120545]: INFO dbcounter [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Registered counter for database nova_cell0 Oct 16 00:59:26.324320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_db.sqlalchemy.engines [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:59:26.335850 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writer thread running {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:59:26.636245 n-d-master-1 devstack@n-api.service[120546]: WARNING keystonemiddleware.auth_token [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:59:26.643540 n-d-master-1 devstack@n-api.service[120546]: WARNING keystonemiddleware.auth_token [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:59:26.658416 n-d-master-1 devstack@n-api.service[120545]: WARNING keystonemiddleware.auth_token [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:59:26.666057 n-d-master-1 devstack@n-api.service[120545]: WARNING keystonemiddleware.auth_token [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:59:27.000516 n-d-master-1 devstack@n-api.service[120546]: WARNING keystonemiddleware.auth_token [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:59:27.007685 n-d-master-1 devstack@n-api.service[120546]: WARNING keystonemiddleware.auth_token [None req-56a4ced2-b30a-4f62-8e87-40da37273752 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:59:27.011001 n-d-master-1 devstack@n-api.service[120545]: WARNING keystonemiddleware.auth_token [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 16 00:59:27.013143 n-d-master-1 devstack@n-api.service[120546]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56234b55c9c0 pid: 120546 (default app) Oct 16 00:59:27.016998 n-d-master-1 devstack@n-api.service[120545]: WARNING keystonemiddleware.auth_token [None req-12db4cc5-003f-43ad-8c7e-25d79a541874 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 16 00:59:27.022460 n-d-master-1 devstack@n-api.service[120545]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56234b55c9c0 pid: 120545 (default app) Oct 16 01:00:08.191185 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.192281 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.193063 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.194140 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.315224 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.316347 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.317240 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.318102 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:09.486002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0211d769-617d-4cf7-85b5-b64d27469bed tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:09.489266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0211d769-617d-4cf7-85b5-b64d27469bed tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.489758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0211d769-617d-4cf7-85b5-b64d27469bed tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.490196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0211d769-617d-4cf7-85b5-b64d27469bed tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.490953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0211d769-617d-4cf7-85b5-b64d27469bed tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.491402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0211d769-617d-4cf7-85b5-b64d27469bed tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.491824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0211d769-617d-4cf7-85b5-b64d27469bed tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.533559 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0211d769-617d-4cf7-85b5-b64d27469bed tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.225605 Oct 16 01:00:09.543182 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1/1] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Oct 16 01:00:08 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:09.640993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '.version_select at 0x7fd64ffbd550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:09.648406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) {{(pid=120546) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 16 01:00:09.649137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.649632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.650048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.676667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.677157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.677593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.690392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.690987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.691614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.698171 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8fefdddb-59df-440d-a2a1-e6ab2fc91903 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.512331 Oct 16 01:00:09.698890 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1/2] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Oct 16 01:00:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:09.768012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64ffbda60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:09.776005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) {{(pid=120545) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 16 01:00:09.776974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.777632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.778263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.806495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.807266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.807800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.820486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.820963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.821393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.827284 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0a1ebee1-cc93-49f7-ba82-df9eb584a536 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.282657 Oct 16 01:00:09.827836 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:09.871273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Calling method '.version_select at 0x7fd64fef8790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:09.876002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.876629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.876983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.895492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.895968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.896399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.908330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:09.908831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:09.909215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:09.952031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-63a9a8e5-025a-4426-86e3-f0bcc7b419ac tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.221192 Oct 16 01:00:09.952031 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2/4] 10.222.0.39 () {60 vars in 1208 bytes} [Sun Oct 16 01:00:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:10.001200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f82e0e9-daf2-4a4d-a600-49baf08a9525 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.007405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f82e0e9-daf2-4a4d-a600-49baf08a9525 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.010067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f82e0e9-daf2-4a4d-a600-49baf08a9525 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.010795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f82e0e9-daf2-4a4d-a600-49baf08a9525 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.011726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f82e0e9-daf2-4a4d-a600-49baf08a9525 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.012193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f82e0e9-daf2-4a4d-a600-49baf08a9525 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.012622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f82e0e9-daf2-4a4d-a600-49baf08a9525 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.038662 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f82e0e9-daf2-4a4d-a600-49baf08a9525 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.209619 Oct 16 01:00:10.039288 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:00:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:10.044407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f790e09b-919f-4414-9e02-e9674605a11b tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.046346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f790e09b-919f-4414-9e02-e9674605a11b tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.047209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f790e09b-919f-4414-9e02-e9674605a11b tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.047813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f790e09b-919f-4414-9e02-e9674605a11b tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.048541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f790e09b-919f-4414-9e02-e9674605a11b tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.048998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f790e09b-919f-4414-9e02-e9674605a11b tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.049420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f790e09b-919f-4414-9e02-e9674605a11b tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.073474 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f790e09b-919f-4414-9e02-e9674605a11b tempest-AZAdminV2TestJSON-1408625067 tempest-AZAdminV2TestJSON-1408625067-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.033019 Oct 16 01:00:10.074462 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Oct 16 01:00:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:10.085150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Calling method '.version_select at 0x7fd64feaf700>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.087161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.087336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-939cd25a-465a-4ee6-ae98-f3192aec6582 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-617953777", "name": "tempest-test_aggregate-313992062"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:10.087995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.088613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.103163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.104146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.104753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.116351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.117288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.118072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.125415 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16099dde-46ac-4dbb-8d30-22a241e7226f tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.201861 Oct 16 01:00:10.132373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-939cd25a-465a-4ee6-ae98-f3192aec6582 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid db83bfb9-5a56-4f9d-a741-c3133d0577d5 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:00:10.134277 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3/7] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:00:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:10.138673 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64ffbd940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.140539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.141288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.141861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.159813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.160544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.161118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.171899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.172614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.173463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.182072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aff4b8bc-41b4-49c7-9fe7-08a46367e6a3 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.046807 Oct 16 01:00:10.183200 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Oct 16 01:00:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:10.219290 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-939cd25a-465a-4ee6-ae98-f3192aec6582 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.144189 Oct 16 01:00:10.227694 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 5/9] 10.222.0.39 () {60 vars in 1165 bytes} [Sun Oct 16 01:00:10 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:10.232675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-50710436-678b-4466-adb0-cdb0f0bb6b62 tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Calling method '.version_select at 0x7fd64fe16550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.234660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50710436-678b-4466-adb0-cdb0f0bb6b62 tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.235371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50710436-678b-4466-adb0-cdb0f0bb6b62 tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.236016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50710436-678b-4466-adb0-cdb0f0bb6b62 tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.252538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50710436-678b-4466-adb0-cdb0f0bb6b62 tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.253032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50710436-678b-4466-adb0-cdb0f0bb6b62 tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.253494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50710436-678b-4466-adb0-cdb0f0bb6b62 tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.259680 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-50710436-678b-4466-adb0-cdb0f0bb6b62 tempest-HypervisorAdminV228Test-106133200 tempest-HypervisorAdminV228Test-106133200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.030728 Oct 16 01:00:10.260277 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 6/10] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Oct 16 01:00:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:10.267154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64fe16940>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.269158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.269822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.270462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.284432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.285510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.286112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.296614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.297261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.297856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.304684 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e403626-531b-40c9-868a-e7661c72a217 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042907 Oct 16 01:00:10.310807 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 7/11] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:10.310807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bac2e5db-8914-4b57-b90b-e343bf02beed tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.322829 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bac2e5db-8914-4b57-b90b-e343bf02beed tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.016301 Oct 16 01:00:10.323423 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 8/12] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:00:10 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:10.334474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-631ae06f-5fe7-4944-9e04-2aa679c8190b tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64fe16790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.337540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-631ae06f-5fe7-4944-9e04-2aa679c8190b tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.338600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-631ae06f-5fe7-4944-9e04-2aa679c8190b tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.339197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-631ae06f-5fe7-4944-9e04-2aa679c8190b tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.354027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-631ae06f-5fe7-4944-9e04-2aa679c8190b tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.354512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-631ae06f-5fe7-4944-9e04-2aa679c8190b tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.355288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-631ae06f-5fe7-4944-9e04-2aa679c8190b tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.362040 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-631ae06f-5fe7-4944-9e04-2aa679c8190b tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.033494 Oct 16 01:00:10.362692 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 9/13] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:00:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:10.367836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-267d99f0-d0d1-46d1-9171-9e4133fc4c1f tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:10.380023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-267d99f0-d0d1-46d1-9171-9e4133fc4c1f tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.380519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-267d99f0-d0d1-46d1-9171-9e4133fc4c1f tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.380952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-267d99f0-d0d1-46d1-9171-9e4133fc4c1f tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.501194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c49ceab-e5e2-49f9-b20b-5a6ef365e021 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1411250039", "id": 685048027, "os-flavor-access:is_public": "False"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:10.578858 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c49ceab-e5e2-49f9-b20b-5a6ef365e021 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.382296 Oct 16 01:00:10.579498 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 5/14] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:10 2022] POST /compute/v2.1/flavors => generated 436 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:10.594524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db2e02d4-46d4-4f63-8cb6-5f2c0b6ce9bd tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64feaf160>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:10.596659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db2e02d4-46d4-4f63-8cb6-5f2c0b6ce9bd tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:10.597714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db2e02d4-46d4-4f63-8cb6-5f2c0b6ce9bd tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:10.598523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db2e02d4-46d4-4f63-8cb6-5f2c0b6ce9bd tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:10.618591 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db2e02d4-46d4-4f63-8cb6-5f2c0b6ce9bd tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.034103 Oct 16 01:00:10.619215 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 6/15] 10.222.0.39 () {58 vars in 1179 bytes} [Sun Oct 16 01:00:10 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:10.631732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58d71b95-1548-4dda-923d-5ea31f201285 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:11.152305 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58d71b95-1548-4dda-923d-5ea31f201285 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/685048027/action" status: 200 len: 96 microversion: 2.1 time: 0.524445 Oct 16 01:00:11.154803 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 7/16] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Oct 16 01:00:10 2022] POST /compute/v2.1/flavors/685048027/action => generated 96 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:11.161006 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64fdf5280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:11.163435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.164082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.164650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.185283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.185772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.186363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.220637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.221145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.221575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.230225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e210a47-f845-4451-bf86-0cc82110c872 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.073524 Oct 16 01:00:11.231660 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 8/17] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:11.240118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df16e5a9-456f-4d0b-8072-9a30202e286e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:11.349547 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-267d99f0-d0d1-46d1-9171-9e4133fc4c1f tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 0.985171 Oct 16 01:00:11.350750 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 10/18] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:00:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:11.355851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-329d539d-6363-4411-bfba-0930df56d180 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64fe16dc0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:11.357685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-329d539d-6363-4411-bfba-0930df56d180 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.358164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-329d539d-6363-4411-bfba-0930df56d180 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.358748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-329d539d-6363-4411-bfba-0930df56d180 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.375688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-329d539d-6363-4411-bfba-0930df56d180 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.376361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-329d539d-6363-4411-bfba-0930df56d180 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.376796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-329d539d-6363-4411-bfba-0930df56d180 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.383290 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-329d539d-6363-4411-bfba-0930df56d180 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.031095 Oct 16 01:00:11.384650 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 11/19] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:00:11 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:11.399829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0486af1a-7b2f-4b74-ace3-93755d09caad tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64f5bdd30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:11.402627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0486af1a-7b2f-4b74-ace3-93755d09caad tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.403573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0486af1a-7b2f-4b74-ace3-93755d09caad tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.404161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0486af1a-7b2f-4b74-ace3-93755d09caad tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.426060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0486af1a-7b2f-4b74-ace3-93755d09caad tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.426745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0486af1a-7b2f-4b74-ace3-93755d09caad tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.427387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0486af1a-7b2f-4b74-ace3-93755d09caad tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.436419 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0486af1a-7b2f-4b74-ace3-93755d09caad tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.041176 Oct 16 01:00:11.437239 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 12/20] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:00:11 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:00:11.649456 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-df16e5a9-456f-4d0b-8072-9a30202e286e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project 4afeba85d0bc4d87ba15ccf94db80957 combination. Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df16e5a9-456f-4d0b-8072-9a30202e286e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Request method failure captured: Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/flavors/685048027/action HTTP/1.1 Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 67 Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eYQGNhp47bNSiKyHLTp501JfvbXO6JAUZd64IECqpeWZjvQyCgQHEyvJEcw_VbrKJ8ZaAEbuyAC_c2cpojI6XgrCu5SPpAQRI5yYzs0xrP8-OojgSMDpEVfeGSAD18uq1buAGmuBoHFGOqxxzi0t23Ezi1M9qAAT4Ksnji9mqJeFI Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 37a10f4a46bc4cf987efd5db9700673c Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:11.662696 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_37a10f4a46bc4cf987efd5db9700673c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 37a10f4a46bc4cf987efd5db9700673c Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e87e7bd1a4114926af6d6520e4a67b88 Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: {"addTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} Oct 16 01:00:11.663914 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: exception: Flavor access already exists for flavor 15 and project 4afeba85d0bc4d87ba15ccf94db80957 combination. Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '685048027', 'body': {'addTenantAccess': {'tenant': '4afeba85d0bc4d87ba15ccf94db80957'}}} Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result.read() Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:00:11.664544 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-4afeba85d0bc4d87ba15ccf94db80957' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi session.flush() Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 01:00:11.665876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 01:00:11.667271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:00:11.668567 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result.read() Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-4afeba85d0bc4d87ba15ccf94db80957' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 16, 1, 0, 11, 643010), 'updated_at': None, 'flavor_id': 15, 'project_id': '4afeba85d0bc4d87ba15ccf94db80957'}] Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:11.669456 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project 4afeba85d0bc4d87ba15ccf94db80957 combination. Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:11.670247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project 4afeba85d0bc4d87ba15ccf94db80957 combination. Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:11.671253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:11.673116 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project 4afeba85d0bc4d87ba15ccf94db80957 combination. Oct 16 01:00:11.673116 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:11.673674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df16e5a9-456f-4d0b-8072-9a30202e286e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project 4afeba85d0bc4d87ba15ccf94db80957 combination. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:11.674960 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df16e5a9-456f-4d0b-8072-9a30202e286e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/685048027/action" status: 409 len: 152 microversion: 2.1 time: 0.441939 Oct 16 01:00:11.676419 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 9/21] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Oct 16 01:00:11 2022] POST /compute/v2.1/flavors/685048027/action => generated 152 bytes in 444 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:00:11.684477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Calling method '.version_select at 0x7fd64fbb7d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:11.686260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.686738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.687350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.703443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.704184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.704621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.715278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.715751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.716340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.723773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:00:11.724370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50717a99-bdb8-49ce-b93d-b9b067f3c730 tempest-HypervisorAdminTestJSON-492149206 tempest-HypervisorAdminTestJSON-492149206-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:00:11.725574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.726185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.726771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.727679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.728288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.728694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.740659 n-d-master-1 devstack@n-api.service[120546]: INFO nova.compute.rpcapi [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 16 01:00:11.741528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] Releasing lock "compute-rpcapi-router" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:00:11.796548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Calling method '.version_select at 0x7fd64fe165e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:11.798559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.799078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.799504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.804994 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6551b029-b420-4420-94e8-a7e9773c46ee None None] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.123555 Oct 16 01:00:11.806108 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 10/22] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Oct 16 01:00:11 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:11.822801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.823482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.824208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.836843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:11.838133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:11.838713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:11.845792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a97431e-fbcf-484b-bfd3-445ed46f145f tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.401318 Oct 16 01:00:11.846827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 13/23] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:11.852834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68aef264-fcc6-4a08-adb4-c6946edf897e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:12.238716 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-859571711", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "availability_zone": "tempest-test_az-617953777"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:12.277252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.277737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.278337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.279085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.279678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.280260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.523912 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68aef264-fcc6-4a08-adb4-c6946edf897e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/685048027/action" status: 200 len: 21 microversion: 2.1 time: 0.674530 Oct 16 01:00:12.524668 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 14/24] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Oct 16 01:00:11 2022] POST /compute/v2.1/flavors/685048027/action => generated 21 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:12.529187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Calling method '.version_select at 0x7fd6507eba60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.531122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.531744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.532341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.568626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.569120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.570135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.616115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.616685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.619096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.630165 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-37de4d5d-0488-4a63-b594-7b16fe4d45c0 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.103275 Oct 16 01:00:12.631655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 15/25] 10.222.0.39 () {58 vars in 1212 bytes} [Sun Oct 16 01:00:12 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/servers => generated 104 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:12.642116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d272763f-4262-426e-8f3e-d0ddeef9b3d0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.672086 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d272763f-4262-426e-8f3e-d0ddeef9b3d0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/685048027" status: 202 len: 0 microversion: 2.1 time: 0.038945 Oct 16 01:00:12.676002 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 16/26] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:00:12 2022] DELETE /compute/v2.1/flavors/685048027 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:00:12.679109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Calling method '.version_select at 0x7fd64f5d2d30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.681590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.682179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.682788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.712161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.713139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.714217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.730427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.732537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.733231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.743496 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-70f3070f-576c-4216-b6b0-9b7d3b47ec39 tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.069262 Oct 16 01:00:12.744469 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 17/27] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:12.749919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b4316fd2-0a2b-4967-b36f-205d8ef28944 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.785431 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b4316fd2-0a2b-4967-b36f-205d8ef28944 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038983 Oct 16 01:00:12.798944 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 18/28] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:12.804345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8bcd7928-2bcc-458b-b79d-7be0fb84c67e tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Calling method '.version_select at 0x7fd64f4c5700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.806569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bcd7928-2bcc-458b-b79d-7be0fb84c67e tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.807139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bcd7928-2bcc-458b-b79d-7be0fb84c67e tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.807692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bcd7928-2bcc-458b-b79d-7be0fb84c67e tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.821715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bcd7928-2bcc-458b-b79d-7be0fb84c67e tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:12.822332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bcd7928-2bcc-458b-b79d-7be0fb84c67e tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:12.822769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bcd7928-2bcc-458b-b79d-7be0fb84c67e tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:12.833277 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8bcd7928-2bcc-458b-b79d-7be0fb84c67e tempest-HypervisorAdminUnderV252Test-565987069 tempest-HypervisorAdminUnderV252Test-565987069-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.045824 Oct 16 01:00:12.834165 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 19/29] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:00:12 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 104 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:12.846063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69d04d56-b4ed-4ba4-9c0f-00fb1293b009 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-788802257", "id": 15267896, "os-flavor-access:is_public": "True"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:12.879623 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69d04d56-b4ed-4ba4-9c0f-00fb1293b009 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.038814 Oct 16 01:00:12.882959 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 20/30] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:12 2022] POST /compute/v2.1/flavors => generated 431 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:12.893206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-19c1b4de-5d15-48e0-add9-dbf8c9bf8029 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.901155 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-19c1b4de-5d15-48e0-add9-dbf8c9bf8029 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-19c1b4de-5d15-48e0-add9-dbf8c9bf8029 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Request method failure captured: Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/flavors/15267896/os-flavor-access HTTP/1.1 Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYQGNhp47bNSiKyHLTp501JfvbXO6JAUZd64IECqpeWZjvQyCgQHEyvJEcw_VbrKJ8ZaAEbuyAC_c2cpojI6XgrCu5SPpAQRI5yYzs0xrP8-OojgSMDpEVfeGSAD18uq1buAGmuBoHFGOqxxzi0t23Ezi1M9qAAT4Ksnji9mqJeFI Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 37a10f4a46bc4cf987efd5db9700673c Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:00:12.903835 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_37a10f4a46bc4cf987efd5db9700673c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 37a10f4a46bc4cf987efd5db9700673c Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e87e7bd1a4114926af6d6520e4a67b88 Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: exception: Access list not available for public flavors. Oct 16 01:00:12.905124 n-d-master-1 devstack@n-api.service[120545]: action_args: {'flavor_id': '15267896'} Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 16 01:00:12.905880 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:12.907151 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-19c1b4de-5d15-48e0-add9-dbf8c9bf8029 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:12.907151 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-19c1b4de-5d15-48e0-add9-dbf8c9bf8029 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/15267896/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.016651 Oct 16 01:00:12.907151 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 21/31] 10.222.0.39 () {58 vars in 1203 bytes} [Sun Oct 16 01:00:12 2022] GET /compute/v2.1/flavors/15267896/os-flavor-access => generated 91 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:00:12.914699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec8db2fa-9663-449c-ba66-26d6762241f7 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.939776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec8db2fa-9663-449c-ba66-26d6762241f7 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/15267896" status: 202 len: 0 microversion: 2.1 time: 0.029337 Oct 16 01:00:12.944568 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 22/32] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:00:12 2022] DELETE /compute/v2.1/flavors/15267896 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:00:12.949279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0fd21ab5-85f7-49ac-ae2e-fc41d1344800 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:12.971715 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0fd21ab5-85f7-49ac-ae2e-fc41d1344800 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025920 Oct 16 01:00:12.973461 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 23/33] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:12.993479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ab10853a-aa30-4e7d-a114-6c96fd133fc1 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-680552106", "id": 1486294998, "os-flavor-access:is_public": "False"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:13.023107 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ab10853a-aa30-4e7d-a114-6c96fd133fc1 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.032780 Oct 16 01:00:13.026601 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 24/34] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:12 2022] POST /compute/v2.1/flavors => generated 438 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:00:13.120571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:00:13.463105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd6fff34-0163-4797-ad8d-e2daf682c6ed tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:13.466339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bd6fff34-0163-4797-ad8d-e2daf682c6ed tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b9794779bff74483839f7102a1344d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afeba85d0bc4d87ba15ccf94db80957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:13.471847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:00:13.473216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd6fff34-0163-4797-ad8d-e2daf682c6ed tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] Request method failure captured: Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/flavors/1486294998/action HTTP/1.1 Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 67 Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eWYCQzKRgrolZQUV2Jy7KpgxtkXdStzm3aox7mn5teV2Uj3UwdtOwtimE6hFy020xkeW9GmtUCd3tc1ZnBQbWbwtAY8UMsZQmawBpE5um_ZFTZpV19F1TCUHgxBty_tgDCOLjnGQZEXuhJvGQWFXzWmi_qgxkFIbvzY3LCLBBnvOg Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 4afeba85d0bc4d87ba15ccf94db80957 Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1039215362 Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:00:13.473320 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4afeba85d0bc4d87ba15ccf94db80957", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4afeba85d0bc4d87ba15ccf94db80957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4afeba85d0bc4d87ba15ccf94db80957"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4afeba85d0bc4d87ba15ccf94db80957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1039215362 Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 4afeba85d0bc4d87ba15ccf94db80957 Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1039215362 Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FlavorsAccessNegativeTestJSON-1039215362-project Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b9794779bff74483839f7102a1344d59 Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1039215362-project Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: {"addTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} Oct 16 01:00:13.474412 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1486294998', 'body': {'addTenantAccess': {'tenant': '4afeba85d0bc4d87ba15ccf94db80957'}}} Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:13.475098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 16 01:00:13.476147 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:13.477958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd6fff34-0163-4797-ad8d-e2daf682c6ed tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:13.477958 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd6fff34-0163-4797-ad8d-e2daf682c6ed tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] 10.222.0.39 "POST /compute/v2.1/flavors/1486294998/action" status: 403 len: 130 microversion: 2.1 time: 0.440075 Oct 16 01:00:13.477958 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 25/35] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Oct 16 01:00:13 2022] POST /compute/v2.1/flavors/1486294998/action => generated 130 bytes in 441 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:13.479269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:00:13.480111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:00:13.481365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:00:13.484857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c630301f-e9e6-42bb-b115-81495c684d3e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:13.491141 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:13.500380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:13.500867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:13.501309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:13.502047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:13.502505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:13.503082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:13.512117 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c630301f-e9e6-42bb-b115-81495c684d3e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1486294998" status: 202 len: 0 microversion: 2.1 time: 0.030792 Oct 16 01:00:13.517700 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 26/36] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:00:13 2022] DELETE /compute/v2.1/flavors/1486294998 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:00:13.523963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-33619a9e-9b3a-47fa-a50a-69ab53849bb6 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:13.544254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Getting quotas for project 4e9880e0613c4f87a00daf04c040edb0. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:00:13.545556 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-33619a9e-9b3a-47fa-a50a-69ab53849bb6 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027021 Oct 16 01:00:13.551678 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 27/37] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:13.566523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Getting quotas for user b01de0795d2f472ab35e08f4651c19ae and project 4e9880e0613c4f87a00daf04c040edb0. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:00:13.569619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4fc81722-c38c-40f9-ac37-bb58b3c27b7e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-750176769", "id": 1226089440, "os-flavor-access:is_public": "False"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:13.586269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:00:13.589964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:00:13.592851 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4fc81722-c38c-40f9-ac37-bb58b3c27b7e tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.029812 Oct 16 01:00:13.593465 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 28/38] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:13 2022] POST /compute/v2.1/flavors => generated 438 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:13.606368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78ceea80-f6bb-4fe2-9845-d191ca94c137 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:13.689260 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-853698ec-5bdf-40ba-b48b-bca111da19b4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.881728 Oct 16 01:00:13.692527 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 11/39] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:00:13.710157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d7ada121-9ab9-4766-89ce-eaabaa99c270 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:13.713099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d7ada121-9ab9-4766-89ce-eaabaa99c270 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:13.866211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d7ada121-9ab9-4766-89ce-eaabaa99c270 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:13.898569 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d7ada121-9ab9-4766-89ce-eaabaa99c270 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1241 microversion: 2.1 time: 0.197399 Oct 16 01:00:13.901681 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 12/40] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:13 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:14.166319 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78ceea80-f6bb-4fe2-9845-d191ca94c137 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1226089440/action" status: 200 len: 97 microversion: 2.1 time: 0.562669 Oct 16 01:00:14.174909 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 29/41] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Oct 16 01:00:13 2022] POST /compute/v2.1/flavors/1226089440/action => generated 97 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:14.185951 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52ea5310-89c6-4530-b830-e2c6ee352ac6 tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:14.189692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-52ea5310-89c6-4530-b830-e2c6ee352ac6 tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b9794779bff74483839f7102a1344d59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4afeba85d0bc4d87ba15ccf94db80957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52ea5310-89c6-4530-b830-e2c6ee352ac6 tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] Request method failure captured: Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/flavors/1226089440/action HTTP/1.1 Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 70 Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eWYCQzKRgrolZQUV2Jy7KpgxtkXdStzm3aox7mn5teV2Uj3UwdtOwtimE6hFy020xkeW9GmtUCd3tc1ZnBQbWbwtAY8UMsZQmawBpE5um_ZFTZpV19F1TCUHgxBty_tgDCOLjnGQZEXuhJvGQWFXzWmi_qgxkFIbvzY3LCLBBnvOg Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 4afeba85d0bc4d87ba15ccf94db80957 Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1039215362 Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:14.193857 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4afeba85d0bc4d87ba15ccf94db80957", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4afeba85d0bc4d87ba15ccf94db80957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4afeba85d0bc4d87ba15ccf94db80957"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4afeba85d0bc4d87ba15ccf94db80957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1039215362 Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 4afeba85d0bc4d87ba15ccf94db80957 Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1039215362 Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FlavorsAccessNegativeTestJSON-1039215362-project Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b9794779bff74483839f7102a1344d59 Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1039215362-project Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: {"removeTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} Oct 16 01:00:14.195132 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '1226089440', 'body': {'removeTenantAccess': {'tenant': '4afeba85d0bc4d87ba15ccf94db80957'}}} Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can( Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:14.195731 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 16 01:00:14.197338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:14.198285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52ea5310-89c6-4530-b830-e2c6ee352ac6 tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:14.198285 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-52ea5310-89c6-4530-b830-e2c6ee352ac6 tempest-FlavorsAccessNegativeTestJSON-1039215362 tempest-FlavorsAccessNegativeTestJSON-1039215362-project] 10.222.0.39 "POST /compute/v2.1/flavors/1226089440/action" status: 403 len: 133 microversion: 2.1 time: 0.014249 Oct 16 01:00:14.198285 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 13/42] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Oct 16 01:00:14 2022] POST /compute/v2.1/flavors/1226089440/action => generated 133 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:14.204323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4dbfc324-8c71-4e16-a6a5-b61cc6f4e2bb tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4afeba85d0bc4d87ba15ccf94db80957"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:14.938094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b123e334-45ca-4a1e-80a9-07fba132dd5a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:14.938696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b123e334-45ca-4a1e-80a9-07fba132dd5a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:15.024544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b123e334-45ca-4a1e-80a9-07fba132dd5a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:15.032427 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b123e334-45ca-4a1e-80a9-07fba132dd5a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1241 microversion: 2.1 time: 0.098424 Oct 16 01:00:15.033311 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 14/43] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:14 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:00:15.121169 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4dbfc324-8c71-4e16-a6a5-b61cc6f4e2bb tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1226089440/action" status: 200 len: 21 microversion: 2.1 time: 0.920408 Oct 16 01:00:15.123444 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 30/44] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Oct 16 01:00:14 2022] POST /compute/v2.1/flavors/1226089440/action => generated 21 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:15.139306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a62bc84d-99dc-41ab-b47b-4a58f545dec0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:15.177172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a62bc84d-99dc-41ab-b47b-4a58f545dec0 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1226089440" status: 202 len: 0 microversion: 2.1 time: 0.047678 Oct 16 01:00:15.178361 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 15/45] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:00:15 2022] DELETE /compute/v2.1/flavors/1226089440 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:00:15.189031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-25a46b67-1829-40ea-9c95-2732c2e02806 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:15.224196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-25a46b67-1829-40ea-9c95-2732c2e02806 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041301 Oct 16 01:00:15.225297 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 31/46] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:00:15.244371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d84be3a7-80b4-4073-ac0d-eb13daf44591 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-930666070", "id": 128536062, "os-flavor-access:is_public": "False"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:15.266616 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d84be3a7-80b4-4073-ac0d-eb13daf44591 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.026381 Oct 16 01:00:15.267237 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 16/47] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:15 2022] POST /compute/v2.1/flavors => generated 435 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:15.282732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cb673d9-22ad-4650-aa1c-6b81a9b497c3 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "445b59e2270d43dcb4cdab573023a1ae"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:15.773769 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-7cb673d9-22ad-4650-aa1c-6b81a9b497c3 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] HTTP exception thrown: Flavor access not found for 19 / 445b59e2270d43dcb4cdab573023a1ae combination. Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cb673d9-22ad-4650-aa1c-6b81a9b497c3 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Request method failure captured: Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/flavors/128536062/action HTTP/1.1 Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 70 Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYQGNhp47bNSiKyHLTp501JfvbXO6JAUZd64IECqpeWZjvQyCgQHEyvJEcw_VbrKJ8ZaAEbuyAC_c2cpojI6XgrCu5SPpAQRI5yYzs0xrP8-OojgSMDpEVfeGSAD18uq1buAGmuBoHFGOqxxzi0t23Ezi1M9qAAT4Ksnji9mqJeFI Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 37a10f4a46bc4cf987efd5db9700673c Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:00:15.780656 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_37a10f4a46bc4cf987efd5db9700673c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/37a10f4a46bc4cf987efd5db9700673c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 37a10f4a46bc4cf987efd5db9700673c Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-567099867 Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e87e7bd1a4114926af6d6520e4a67b88 Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: {"removeTenantAccess": {"tenant": "445b59e2270d43dcb4cdab573023a1ae"}} Oct 16 01:00:15.782073 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: exception: Flavor access not found for 19 / 445b59e2270d43dcb4cdab573023a1ae combination. Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '128536062', 'body': {'removeTenantAccess': {'tenant': '445b59e2270d43dcb4cdab573023a1ae'}}} Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 16 01:00:15.782819 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 19 / 445b59e2270d43dcb4cdab573023a1ae combination. Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 19 / 445b59e2270d43dcb4cdab573023a1ae combination. Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:15.784139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:15.785788 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:15.785788 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:15.785788 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:15.785788 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:15.785788 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 19 / 445b59e2270d43dcb4cdab573023a1ae combination. Oct 16 01:00:15.785788 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:15.787677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cb673d9-22ad-4650-aa1c-6b81a9b497c3 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Returning 404 to user: Flavor access not found for 19 / 445b59e2270d43dcb4cdab573023a1ae combination. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:15.789045 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7cb673d9-22ad-4650-aa1c-6b81a9b497c3 tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/128536062/action" status: 404 len: 124 microversion: 2.1 time: 0.509766 Oct 16 01:00:15.790540 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 32/48] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Oct 16 01:00:15 2022] POST /compute/v2.1/flavors/128536062/action => generated 124 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:15.799270 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7c8918b-6d44-4228-b5a6-de146c6710be tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:15.821223 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7c8918b-6d44-4228-b5a6-de146c6710be tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/128536062" status: 202 len: 0 microversion: 2.1 time: 0.025533 Oct 16 01:00:15.821929 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 17/49] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:00:15 2022] DELETE /compute/v2.1/flavors/128536062 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:00:15.830189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1837a2e1-f4c5-4a13-a180-803bd18b2b6a tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:15.855223 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1837a2e1-f4c5-4a13-a180-803bd18b2b6a tempest-FlavorsAccessNegativeTestJSON-567099867 tempest-FlavorsAccessNegativeTestJSON-567099867-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028697 Oct 16 01:00:15.867463 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 33/50] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:16.055862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:16.056486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:16.062952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:16.063663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:16.064106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:16.064807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:16.065270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:16.066222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:16.204938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:16.221725 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a7e677f-581e-420d-8750-d047aee42c87 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1289 microversion: 2.1 time: 0.169533 Oct 16 01:00:16.226951 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 18/51] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:16 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1289 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:16.762297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91cd8b9a-f01a-4918-af22-594f0738e605 tempest-AZAdminNegativeTestJSON-1774520368 tempest-AZAdminNegativeTestJSON-1774520368-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-91cd8b9a-f01a-4918-af22-594f0738e605 tempest-AZAdminNegativeTestJSON-1774520368 tempest-AZAdminNegativeTestJSON-1774520368-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '656af6e3a8db4e3e9a27011215309fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c388114ccddd410a98d50e0a04d659ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91cd8b9a-f01a-4918-af22-594f0738e605 tempest-AZAdminNegativeTestJSON-1774520368 tempest-AZAdminNegativeTestJSON-1774520368-project] Request method failure captured: Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eeEjU3ciQGRiYH4uwdObQpGv91LcZMHNvyHnj_jHc8baJrLuhPbHSTEo8ckdzbNc5BJOJ4_4n4IEI1Futpfj6uXeINhiMfUl_2wG2OQAP9DvnUbmNgSiEkK2BB9yoN4pw4IjKaFkIzs8w2iZnGxlpgpAP2eh0MRbojBIEP_lW4mD8 Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: c388114ccddd410a98d50e0a04d659ba Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1774520368 Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:00:16.774216 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c388114ccddd410a98d50e0a04d659ba", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c388114ccddd410a98d50e0a04d659ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c388114ccddd410a98d50e0a04d659ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c388114ccddd410a98d50e0a04d659ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AZAdminNegativeTestJSON-1774520368 Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: c388114ccddd410a98d50e0a04d659ba Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1774520368 Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AZAdminNegativeTestJSON-1774520368-project Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 656af6e3a8db4e3e9a27011215309fb8 Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AZAdminNegativeTestJSON-1774520368-project Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 16 01:00:16.782476 n-d-master-1 devstack@n-api.service[120545]: action_args: {} Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:16.783527 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:16.786028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91cd8b9a-f01a-4918-af22-594f0738e605 tempest-AZAdminNegativeTestJSON-1774520368 tempest-AZAdminNegativeTestJSON-1774520368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:16.787228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91cd8b9a-f01a-4918-af22-594f0738e605 tempest-AZAdminNegativeTestJSON-1774520368 tempest-AZAdminNegativeTestJSON-1774520368-project] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.427689 Oct 16 01:00:16.787228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 34/52] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Oct 16 01:00:16 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 429 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:17.247582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:17.248363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:17.266522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:17.267162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:17.270804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:17.271641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:17.272123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:17.274340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:17.445331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:17.454693 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f2540f0-25df-4b7c-9542-262136aacda4 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1295 microversion: 2.1 time: 0.211992 Oct 16 01:00:17.456060 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 19/53] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:17 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1295 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:18.460610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71d9c5d3-de50-4fa4-85c5-b3430349ac40 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Action: 'update', calling method: .version_select at 0x7fd64f4388b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:18.483528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:18.488581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:18.526548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:18.530115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:18.532868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:18.534868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:18.542635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:18.544487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:18.984340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:19.000849 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9a6914ee-1ef5-491a-8dcb-f884924de58b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.521011 Oct 16 01:00:19.003852 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 20/54] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:18 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:19.805319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71d9c5d3-de50-4fa4-85c5-b3430349ac40 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:19.808816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71d9c5d3-de50-4fa4-85c5-b3430349ac40 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:19.809346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71d9c5d3-de50-4fa4-85c5-b3430349ac40 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:19.815435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71d9c5d3-de50-4fa4-85c5-b3430349ac40 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:19.816548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71d9c5d3-de50-4fa4-85c5-b3430349ac40 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:19.817052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71d9c5d3-de50-4fa4-85c5-b3430349ac40 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:20.002716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71d9c5d3-de50-4fa4-85c5-b3430349ac40 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/a919e52c25ae4e9ea96e13fbf2d16b39" status: 200 len: 240 microversion: 2.36 time: 2.145812 Oct 16 01:00:20.007108 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 35/55] 10.222.0.39 () {62 vars in 1303 bytes} [Sun Oct 16 01:00:17 2022] PUT /compute/v2.1/os-quota-sets/a919e52c25ae4e9ea96e13fbf2d16b39 => generated 240 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:20.018445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a9ac75c-41ac-4129-afec-148504df7604 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Calling method '.version_select at 0x7fd64f2400d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:20.039924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:20.041356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:20.067008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:20.068621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:20.070340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:20.076335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:20.078432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:20.079453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:20.974248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a9ac75c-41ac-4129-afec-148504df7604 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:20.976660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a9ac75c-41ac-4129-afec-148504df7604 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:20.978939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a9ac75c-41ac-4129-afec-148504df7604 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:20.980263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a9ac75c-41ac-4129-afec-148504df7604 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:20.982709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a9ac75c-41ac-4129-afec-148504df7604 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:20.983480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a9ac75c-41ac-4129-afec-148504df7604 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.074411 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a9ac75c-41ac-4129-afec-148504df7604 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/a919e52c25ae4e9ea96e13fbf2d16b39/detail" status: 200 len: 672 microversion: 2.36 time: 1.059616 Oct 16 01:00:21.079616 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 21/56] 10.222.0.39 () {60 vars in 1304 bytes} [Sun Oct 16 01:00:20 2022] GET /compute/v2.1/os-quota-sets/a919e52c25ae4e9ea96e13fbf2d16b39/detail => generated 672 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:21.376689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Calling method '.version_select at 0x7fd64f22a550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:21.382086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.384857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.387946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.451161 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:21.453128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.460419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.461212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.539366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.540314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.541366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.555499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.556269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.556847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.590083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.590976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.591555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.607215 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39c6024e-a12e-4120-9bb8-dc03ce54f45f tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.525842 Oct 16 01:00:21.621500 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 22/57] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Oct 16 01:00:21 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:21.632398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Action: 'update', calling method: .version_select at 0x7fd64f124a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:21.731025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.732802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.733774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.739757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.740911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.741957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.803230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.804013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.804944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.805923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.806769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.807592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:21.904524 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bf1fc297-8568-4c94-a39f-fb7b853b6e66 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/a919e52c25ae4e9ea96e13fbf2d16b39?user_id=b293bf2146324aafb53bf97aa3820c77" status: 200 len: 240 microversion: 2.36 time: 0.281395 Oct 16 01:00:21.906336 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 23/58] 10.222.0.39 () {62 vars in 1384 bytes} [Sun Oct 16 01:00:21 2022] PUT /compute/v2.1/os-quota-sets/a919e52c25ae4e9ea96e13fbf2d16b39?user_id=b293bf2146324aafb53bf97aa3820c77 => generated 240 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:21.936996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Calling method '.version_select at 0x7fd64f1779d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:21.967493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:21.972148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:21.974795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.022793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.026032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.029303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.089714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.092204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.092825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.118198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.119233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.120209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.129730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:22.157984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.158401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.158829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.190011 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bd89e6d5-8c1d-45ba-b7c7-32ceb62f089d tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.279389 Oct 16 01:00:22.191330 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 24/59] 10.222.0.39 () {60 vars in 1222 bytes} [Sun Oct 16 01:00:21 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:22.194324 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83621001-9d83-436d-89dc-2802ac8d128b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 2.146616 Oct 16 01:00:22.216807 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 36/60] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:20 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:22.233370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c150c61b-07c9-4cbf-a7e2-cb3c501f8009 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] Calling method '.version_select at 0x7fd64f364ee0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:22.561467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a938790e-b3c0-450c-855d-e8a80061123d req-6b1ad320-462f-4c02-ba1a-03d2e9113e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea237879-35ce-4fb1-a360-a421f412d960", "tag": "63db1b73-bb24-4574-8d1e-ca84c4ceeb9c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:22.616500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a938790e-b3c0-450c-855d-e8a80061123d req-6b1ad320-462f-4c02-ba1a-03d2e9113e0c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.617125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a938790e-b3c0-450c-855d-e8a80061123d req-6b1ad320-462f-4c02-ba1a-03d2e9113e0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.617594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a938790e-b3c0-450c-855d-e8a80061123d req-6b1ad320-462f-4c02-ba1a-03d2e9113e0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.671461 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a938790e-b3c0-450c-855d-e8a80061123d req-6b1ad320-462f-4c02-ba1a-03d2e9113e0c service nova] Creating event network-changed:63db1b73-bb24-4574-8d1e-ca84c4ceeb9c for instance ea237879-35ce-4fb1-a360-a421f412d960 on n-h1-master-1 Oct 16 01:00:22.684955 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a938790e-b3c0-450c-855d-e8a80061123d req-6b1ad320-462f-4c02-ba1a-03d2e9113e0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.482435 Oct 16 01:00:22.686207 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 25/61] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:22.704202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5c826fe8-626d-4c8c-afc6-c8cabd6346fe tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Calling method '.version_select at 0x7fd64f2401f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:22.715158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c826fe8-626d-4c8c-afc6-c8cabd6346fe tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.715757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c826fe8-626d-4c8c-afc6-c8cabd6346fe tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.719176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c826fe8-626d-4c8c-afc6-c8cabd6346fe tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.773111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c826fe8-626d-4c8c-afc6-c8cabd6346fe tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:22.777270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c826fe8-626d-4c8c-afc6-c8cabd6346fe tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:22.777674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c826fe8-626d-4c8c-afc6-c8cabd6346fe tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:22.798629 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5c826fe8-626d-4c8c-afc6-c8cabd6346fe tempest-HypervisorAdminV253TestBase-1579188073 tempest-HypervisorAdminV253TestBase-1579188073-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/ed91fa5b-e338-485f-92d3-4ab8d189d6e7" status: 200 len: 792 microversion: 2.53 time: 0.107855 Oct 16 01:00:22.813180 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 26/62] 10.222.0.39 () {60 vars in 1298 bytes} [Sun Oct 16 01:00:22 2022] GET /compute/v2.1/os-hypervisors/ed91fa5b-e338-485f-92d3-4ab8d189d6e7 => generated 792 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:23.196893 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c150c61b-07c9-4cbf-a7e2-cb3c501f8009 tempest-QuotasAdminTestV236-730416456 tempest-QuotasAdminTestV236-730416456-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/a919e52c25ae4e9ea96e13fbf2d16b39?user_id=b293bf2146324aafb53bf97aa3820c77" status: 200 len: 282 microversion: 2.36 time: 0.976176 Oct 16 01:00:23.207238 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 37/63] 10.222.0.39 () {60 vars in 1364 bytes} [Sun Oct 16 01:00:22 2022] GET /compute/v2.1/os-quota-sets/a919e52c25ae4e9ea96e13fbf2d16b39?user_id=b293bf2146324aafb53bf97aa3820c77 => generated 282 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:23.223937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:23.224986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:23.248551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:23.251409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:23.251976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:23.255616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:23.260974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:23.262117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:23.335888 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:23.708139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:23.727364 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4b4953be-f644-4988-ba33-9d90bcf40fee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.508328 Oct 16 01:00:23.745592 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 27/64] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:23 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:24.755125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:24.756561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:24.773078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:24.779103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:24.779829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:24.796308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:24.797859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:24.799683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:26.732190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:26.741281 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b1b4280-56c5-4f12-b423-51f6d4c6d7ea tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 1.992247 Oct 16 01:00:26.748509 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 38/65] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:24 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:27.776681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:27.780340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:27.811098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:27.812803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:27.819785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:27.823466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:27.826139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:27.828328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:28.348582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-94618055-9d21-48b7-94f1-2d7e6d9e0ed3 tempest-FlavorMetadataValidation-1573021265 tempest-FlavorMetadataValidation-1573021265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-724978344", "id": 2044564583, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:28.421788 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-94618055-9d21-48b7-94f1-2d7e6d9e0ed3 tempest-FlavorMetadataValidation-1573021265 tempest-FlavorMetadataValidation-1573021265-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.951792 Oct 16 01:00:28.438162 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 28/66] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:00:27 2022] POST /compute/v2.1/flavors => generated 470 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:00:28.462162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8bfe745-0fbd-4f98-977c-bb942395e3fd tempest-FlavorMetadataValidation-1573021265 tempest-FlavorMetadataValidation-1573021265-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:28.573307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:28.589672 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7954acd-6b25-4acb-bc42-b39189899f89 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.822755 Oct 16 01:00:28.603402 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 39/67] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:27 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:29.087215 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8bfe745-0fbd-4f98-977c-bb942395e3fd tempest-FlavorMetadataValidation-1573021265 tempest-FlavorMetadataValidation-1573021265-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/2044564583/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.643472 Oct 16 01:00:29.088485 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 29/68] 10.222.0.39 () {62 vars in 1265 bytes} [Sun Oct 16 01:00:28 2022] POST /compute/v2.1/flavors/2044564583/os-extra_specs => generated 62 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:29.099208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f0bd9fa-16d8-4d0d-9227-ab2a6e38e0cc tempest-FlavorMetadataValidation-1573021265 tempest-FlavorMetadataValidation-1573021265-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:29.122698 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f0bd9fa-16d8-4d0d-9227-ab2a6e38e0cc tempest-FlavorMetadataValidation-1573021265 tempest-FlavorMetadataValidation-1573021265-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2044564583" status: 202 len: 0 microversion: 2.86 time: 0.027936 Oct 16 01:00:29.124390 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 40/69] 10.222.0.39 () {60 vars in 1202 bytes} [Sun Oct 16 01:00:29 2022] DELETE /compute/v2.1/flavors/2044564583 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:00:29.134550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5293f762-75d0-4771-82e3-401c90c5570c tempest-FlavorMetadataValidation-1573021265 tempest-FlavorMetadataValidation-1573021265-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:29.182537 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5293f762-75d0-4771-82e3-401c90c5570c tempest-FlavorMetadataValidation-1573021265 tempest-FlavorMetadataValidation-1573021265-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.052577 Oct 16 01:00:29.183788 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 30/70] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:00:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:29.618878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:29.619630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:29.636480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:29.636985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:29.638253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:29.639013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:29.642959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:29.648289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:29.839492 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:30.030021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:30.042126 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3c802ee0-b6d1-4813-9bf4-6109d8af7886 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.428415 Oct 16 01:00:30.042126 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 41/71] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:29 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:31.072293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:31.073767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:31.088296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:31.089610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:31.090269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:31.092306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:31.093826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:31.094594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:31.518196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:31.529023 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9fe7a6d-106b-43e1-9924-4ef6ee0f6e21 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.463667 Oct 16 01:00:31.533111 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 31/72] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:31 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:32.562211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:32.562818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:32.571154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:32.571651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:32.573189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:32.574324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:32.576710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:32.578207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:33.179447 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:33.202549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:33.219910 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68161581-a468-463d-acc7-1fecb02162b1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.663342 Oct 16 01:00:33.222109 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 42/73] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:32 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:33.275491 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=13 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:33.276215 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=24 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:33.778017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1030316538", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:33.935236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:00:34.247138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:34.248408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:34.261266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:34.263173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:34.263999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:34.266840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:34.268305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:34.269719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:34.631345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:00:34.632268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:00:34.633080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:00:34.633655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:00:34.634260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:00:34.657986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:34.659523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:34.661589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:34.662608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:34.665739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:34.666605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:34.719577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:00:34.729061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:34.737397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for user f3b14e05c41648159d8ed97719c68862 and project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:00:34.737701 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cc2e64b-e5cd-45ae-b7ce-c39595c7732c tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.496282 Oct 16 01:00:34.738295 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 43/74] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:34 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:34.771337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:00:34.777638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:00:34.881540 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-018fff7a-64df-4e2e-a1d1-638acd80f6b7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.612303 Oct 16 01:00:34.888678 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 32/75] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:00:34.893947 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1b8f4161-5f6a-435d-97ef-4d3712f13c25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:34.895414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b8f4161-5f6a-435d-97ef-4d3712f13c25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:35.107846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1b8f4161-5f6a-435d-97ef-4d3712f13c25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:35.152615 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1b8f4161-5f6a-435d-97ef-4d3712f13c25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1213 microversion: 2.1 time: 0.261952 Oct 16 01:00:35.153733 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 44/76] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:34 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1213 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:35.765453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:35.766667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:35.780309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:35.780821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:35.781992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:35.792232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:35.792978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:35.793581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:36.164539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:36.184290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8a9ad0e2-5c2e-41b4-aaee-3f4f0374f3b1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:36.187619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8a9ad0e2-5c2e-41b4-aaee-3f4f0374f3b1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:36.209026 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ac52f9f-2d41-440c-9439-5351e049093a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.448056 Oct 16 01:00:36.212572 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 33/77] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:35 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:36.299400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8a9ad0e2-5c2e-41b4-aaee-3f4f0374f3b1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:36.327724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8a9ad0e2-5c2e-41b4-aaee-3f4f0374f3b1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1213 microversion: 2.1 time: 0.151136 Oct 16 01:00:36.328748 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 45/78] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:36 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:36.604770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a5cc2a9-212e-441e-84b9-1bbb55d40427 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-491809883", "ram": 512, "vcpus": 1, "disk": 10, "id": 274768370, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:36.645030 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a5cc2a9-212e-441e-84b9-1bbb55d40427 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.348755 Oct 16 01:00:36.656019 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 34/79] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:36 2022] POST /compute/v2.1/flavors => generated 412 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:36.861725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38d35587-b399-48f0-9863-0140e3971c9c tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:36.881370 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-38d35587-b399-48f0-9863-0140e3971c9c tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] HTTP exception thrown: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38d35587-b399-48f0-9863-0140e3971c9c tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Request method failure captured: Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/flavors/274768370/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eyMQm66_zenbqppyHSwiGghfnmZt1abz0ixW1J0ai_YMdFt7zs9kaRccVoT7PDpXZicd3hE_E13tBmprdtZo62n3ZdVndh8yonU-MXrlRJ8sWLd8_C_T71NbFjDnBCVNGEMbFvBF7hzkC1Bo6DoLpyHC4TljW4AII7gAlpH8kVU70 Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f7c109c5dd4f4be2b47d3c4d4bba3d5c Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:00:36.883340 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7c109c5dd4f4be2b47d3c4d4bba3d5c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f7c109c5dd4f4be2b47d3c4d4bba3d5c Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 835264587c7f4e68ab1e8338b507e6c0 Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:00:36.884589 n-d-master-1 devstack@n-api.service[120545]: exception: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: action_args: {'flavor_id': '274768370', 'id': 'hw:cpu_thread_policy'} Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:36.885242 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38d35587-b399-48f0-9863-0140e3971c9c tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Returning 404 to user: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:36.886441 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-38d35587-b399-48f0-9863-0140e3971c9c tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] 10.222.0.39 "GET /compute/v2.1/flavors/274768370/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.229216 Oct 16 01:00:36.897084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76f2eeea-ef7b-4bc9-bd72-4efa063516d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:36.901554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-76f2eeea-ef7b-4bc9-bd72-4efa063516d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '835264587c7f4e68ab1e8338b507e6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c109c5dd4f4be2b47d3c4d4bba3d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:36.901799 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 46/80] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:00:36 2022] GET /compute/v2.1/flavors/274768370/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76f2eeea-ef7b-4bc9-bd72-4efa063516d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Request method failure captured: Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/flavors/274768370/os-extra_specs HTTP/1.1 Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 66 Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eyMQm66_zenbqppyHSwiGghfnmZt1abz0ixW1J0ai_YMdFt7zs9kaRccVoT7PDpXZicd3hE_E13tBmprdtZo62n3ZdVndh8yonU-MXrlRJ8sWLd8_C_T71NbFjDnBCVNGEMbFvBF7hzkC1Bo6DoLpyHC4TljW4AII7gAlpH8kVU70 Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f7c109c5dd4f4be2b47d3c4d4bba3d5c Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:36.903958 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7c109c5dd4f4be2b47d3c4d4bba3d5c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f7c109c5dd4f4be2b47d3c4d4bba3d5c Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 835264587c7f4e68ab1e8338b507e6c0 Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 16 01:00:36.905414 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: action_args: {'flavor_id': '274768370', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:36.906135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 16 01:00:36.907172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.910543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76f2eeea-ef7b-4bc9-bd72-4efa063516d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:36.911756 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76f2eeea-ef7b-4bc9-bd72-4efa063516d8 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] 10.222.0.39 "POST /compute/v2.1/flavors/274768370/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020272 Oct 16 01:00:36.922562 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71c8b012-7939-46d0-a11e-d4f59f6c5588 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:36.923305 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 35/81] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Oct 16 01:00:36 2022] POST /compute/v2.1/flavors/274768370/os-extra_specs => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:36.967409 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71c8b012-7939-46d0-a11e-d4f59f6c5588 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/274768370/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048789 Oct 16 01:00:36.974036 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 47/82] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Oct 16 01:00:36 2022] POST /compute/v2.1/flavors/274768370/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:36.980173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-118462ef-19ae-41ae-a61c-9f551d9aaa64 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:36.983394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-118462ef-19ae-41ae-a61c-9f551d9aaa64 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '835264587c7f4e68ab1e8338b507e6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c109c5dd4f4be2b47d3c4d4bba3d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-118462ef-19ae-41ae-a61c-9f551d9aaa64 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Request method failure captured: Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eyMQm66_zenbqppyHSwiGghfnmZt1abz0ixW1J0ai_YMdFt7zs9kaRccVoT7PDpXZicd3hE_E13tBmprdtZo62n3ZdVndh8yonU-MXrlRJ8sWLd8_C_T71NbFjDnBCVNGEMbFvBF7hzkC1Bo6DoLpyHC4TljW4AII7gAlpH8kVU70 Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f7c109c5dd4f4be2b47d3c4d4bba3d5c Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:36.985261 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7c109c5dd4f4be2b47d3c4d4bba3d5c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f7c109c5dd4f4be2b47d3c4d4bba3d5c Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 835264587c7f4e68ab1e8338b507e6c0 Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:00:36.986355 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: action_args: {'flavor_id': '274768370', 'id': 'hw:numa_nodes'} Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:36.987334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 16 01:00:36.989527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:36.997016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-118462ef-19ae-41ae-a61c-9f551d9aaa64 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:36.998411 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-118462ef-19ae-41ae-a61c-9f551d9aaa64 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] 10.222.0.39 "DELETE /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024296 Oct 16 01:00:36.999548 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 36/83] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:00:36 2022] DELETE /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:37.010708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f5aeea2-c291-4f9c-97cf-173fe9c8d133 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:37.046757 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=8,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:37.062221 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f5aeea2-c291-4f9c-97cf-173fe9c8d133 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/274768370/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056542 Oct 16 01:00:37.069623 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 48/84] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Oct 16 01:00:37 2022] POST /compute/v2.1/flavors/274768370/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:00:37.076114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-521fad38-3f35-4ec8-a5e6-a6543311991e tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:37.080182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-521fad38-3f35-4ec8-a5e6-a6543311991e tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '835264587c7f4e68ab1e8338b507e6c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7c109c5dd4f4be2b47d3c4d4bba3d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-521fad38-3f35-4ec8-a5e6-a6543311991e tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Request method failure captured: Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 22 Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eyMQm66_zenbqppyHSwiGghfnmZt1abz0ixW1J0ai_YMdFt7zs9kaRccVoT7PDpXZicd3hE_E13tBmprdtZo62n3ZdVndh8yonU-MXrlRJ8sWLd8_C_T71NbFjDnBCVNGEMbFvBF7hzkC1Bo6DoLpyHC4TljW4AII7gAlpH8kVU70 Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f7c109c5dd4f4be2b47d3c4d4bba3d5c Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:37.085127 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7c109c5dd4f4be2b47d3c4d4bba3d5c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7c109c5dd4f4be2b47d3c4d4bba3d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f7c109c5dd4f4be2b47d3c4d4bba3d5c Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 835264587c7f4e68ab1e8338b507e6c0 Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: {"hw:numa_nodes": "1"} Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:00:37.086241 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: action_args: {'flavor_id': '274768370', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:37.087173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 16 01:00:37.088309 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.091334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-521fad38-3f35-4ec8-a5e6-a6543311991e tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:37.092391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-521fad38-3f35-4ec8-a5e6-a6543311991e tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109 tempest-FlavorsExtraSpecsNegativeTestJSON-1247794109-project] 10.222.0.39 "PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021150 Oct 16 01:00:37.093508 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 37/85] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:00:37 2022] PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:37.114219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7bf8883-a211-491f-8335-f9d2f762f23e tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:37.124964 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a7bf8883-a211-491f-8335-f9d2f762f23e tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] HTTP exception thrown: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7bf8883-a211-491f-8335-f9d2f762f23e tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Request method failure captured: Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/flavors/274768370/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1e0sbJCzLo8mTvRbSxPQFPEtR4CEOoeAUU4aDpWmE8lnYq_1otYJ4qduQbf9xugGuC4ilWxVyMEiJcAavVtHoCDPG_cRTp65ViK0zH2P3Ina9PsNgbwtqy6RQAwaeSkdzOJ5COfS47mHBf4hTUdXQbqsPf0sobp_Rz8yyrAnZyo_28 Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 293794b5b8284f03bdda4e3dd3c71929 Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:00:37.127579 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_293794b5b8284f03bdda4e3dd3c71929", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 293794b5b8284f03bdda4e3dd3c71929 Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d54d3e92ad06463188e86d49725acd8d Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:00:37.130037 n-d-master-1 devstack@n-api.service[120545]: exception: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: action_args: {'flavor_id': '274768370', 'id': 'hw:cpu_thread_policy'} Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:37.130630 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7bf8883-a211-491f-8335-f9d2f762f23e tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Returning 404 to user: Flavor 274768370 has no extra specs with key hw:cpu_thread_policy. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:37.131724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7bf8883-a211-491f-8335-f9d2f762f23e tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/274768370/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.031022 Oct 16 01:00:37.146126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d33b2e1e-b6e2-4ca5-a84c-d0de06c6d3ab tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:37.147806 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 49/86] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:00:37 2022] DELETE /compute/v2.1/flavors/274768370/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:37.172304 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-d33b2e1e-b6e2-4ca5-a84c-d0de06c6d3ab tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d33b2e1e-b6e2-4ca5-a84c-d0de06c6d3ab tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Request method failure captured: Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 27 Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e0sbJCzLo8mTvRbSxPQFPEtR4CEOoeAUU4aDpWmE8lnYq_1otYJ4qduQbf9xugGuC4ilWxVyMEiJcAavVtHoCDPG_cRTp65ViK0zH2P3Ina9PsNgbwtqy6RQAwaeSkdzOJ5COfS47mHBf4hTUdXQbqsPf0sobp_Rz8yyrAnZyo_28 Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 293794b5b8284f03bdda4e3dd3c71929 Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:37.174042 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_293794b5b8284f03bdda4e3dd3c71929", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 293794b5b8284f03bdda4e3dd3c71929 Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d54d3e92ad06463188e86d49725acd8d Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: {"hw:cpu_policy": "shared"} Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:00:37.175275 n-d-master-1 devstack@n-api.service[120546]: exception: Request body and URI mismatch Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: action_args: {'flavor_id': '274768370', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:37.175946 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:37.176942 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:37.176942 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:37.176942 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 16 01:00:37.176942 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.180720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d33b2e1e-b6e2-4ca5-a84c-d0de06c6d3ab tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:37.182623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d33b2e1e-b6e2-4ca5-a84c-d0de06c6d3ab tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.043073 Oct 16 01:00:37.184537 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 38/87] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:00:37 2022] PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes => generated 73 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:00:37.195423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ebc4dc44-f6f1-42cb-86b9-b9eab6268fb7 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ebc4dc44-f6f1-42cb-86b9-b9eab6268fb7 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Request method failure captured: Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 49 Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1e0sbJCzLo8mTvRbSxPQFPEtR4CEOoeAUU4aDpWmE8lnYq_1otYJ4qduQbf9xugGuC4ilWxVyMEiJcAavVtHoCDPG_cRTp65ViK0zH2P3Ina9PsNgbwtqy6RQAwaeSkdzOJ5COfS47mHBf4hTUdXQbqsPf0sobp_Rz8yyrAnZyo_28 Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 293794b5b8284f03bdda4e3dd3c71929 Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:00:37.220955 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_293794b5b8284f03bdda4e3dd3c71929", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/293794b5b8284f03bdda4e3dd3c71929"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 293794b5b8284f03bdda4e3dd3c71929 Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d54d3e92ad06463188e86d49725acd8d Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 16 01:00:37.222782 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: action_args: {'flavor_id': '274768370', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance: Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 16 01:00:37.223547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.224758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:37.225821 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:37.225821 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:37.225821 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:00:37.225821 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:00:37.225821 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 16 01:00:37.225821 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:37.236618 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:37.237031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ebc4dc44-f6f1-42cb-86b9-b9eab6268fb7 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:37.238582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:37.239371 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ebc4dc44-f6f1-42cb-86b9-b9eab6268fb7 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.048100 Oct 16 01:00:37.240635 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 50/88] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:00:37 2022] PUT /compute/v2.1/flavors/274768370/os-extra_specs/hw:numa_nodes => generated 117 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:00:37.260272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-517723d4-f923-40de-9e57-0f7176ee9852 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:37.263499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:37.265238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:37.267023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:37.269284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:37.270319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:37.271585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:37.306168 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-517723d4-f923-40de-9e57-0f7176ee9852 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/274768370" status: 202 len: 0 microversion: 2.1 time: 0.060171 Oct 16 01:00:37.307117 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 51/89] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:00:37 2022] DELETE /compute/v2.1/flavors/274768370 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:00:37.322620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d3028b5e-7730-4a90-895d-cab7784c4e2a tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:37.377916 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d3028b5e-7730-4a90-895d-cab7784c4e2a tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575 tempest-FlavorsExtraSpecsNegativeTestJSON-1745528575-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063758 Oct 16 01:00:37.382228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 52/90] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:37.398118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:37.399384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:37.411660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:37.413543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:37.414479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:37.417084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:37.417633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:37.418822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:37.429958 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:37.598823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:37.608006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:37.611046 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-45ba994b-1a8a-4bdb-b345-cc3034a29129 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.380404 Oct 16 01:00:37.630662 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 39/91] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:37 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:37.636218 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2666fb02-850e-42c8-a7ac-dd30f17857aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1265 microversion: 2.1 time: 0.252638 Oct 16 01:00:37.642444 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 53/92] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:37 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:38.643036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:38.645295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:38.654959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.656948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.657598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.659645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.660951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.662158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.664719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:38.665330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:38.682437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.682887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.683346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:38.684074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:38.693229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:38.693910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:39.067102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:39.077511 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-02751ab8-c495-460c-8148-986c99ca6049 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1271 microversion: 2.1 time: 0.416517 Oct 16 01:00:39.080237 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 54/93] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:38 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1271 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:00:39.560038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:39.569981 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7bc9e78-f42e-4070-b43a-94f5b40fea7e tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.931750 Oct 16 01:00:39.575634 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 40/94] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:38 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:40.106968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:40.107724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:40.121067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:40.121622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:40.124281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:40.125156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:40.135285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:40.135932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:40.468489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:40.489014 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-216c0623-9252-450e-9126-05441ef56ac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1271 microversion: 2.1 time: 0.378386 Oct 16 01:00:40.489662 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 55/95] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:40 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1271 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:40.604055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:40.604744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:40.616219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:40.616997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:40.617548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:40.622307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:40.624106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:40.625113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:40.973981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:40.983289 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fe3e906f-d6c4-440a-9873-75ec872196c7 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.383384 Oct 16 01:00:40.988112 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 41/96] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:40 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:00:41.516603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:41.517741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:41.524280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.534684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.536292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:41.537291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.538008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.538680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:41.691139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-db0eb8f2-0507-477f-b73f-2b2018d980c4 req-b6ce6c10-a587-4dcf-9df8-8306b61d76c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea237879-35ce-4fb1-a360-a421f412d960", "name": "network-vif-plugged", "status": "completed", "tag": "63db1b73-bb24-4574-8d1e-ca84c4ceeb9c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:41.730292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-db0eb8f2-0507-477f-b73f-2b2018d980c4 req-b6ce6c10-a587-4dcf-9df8-8306b61d76c5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.731014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-db0eb8f2-0507-477f-b73f-2b2018d980c4 req-b6ce6c10-a587-4dcf-9df8-8306b61d76c5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.731507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-db0eb8f2-0507-477f-b73f-2b2018d980c4 req-b6ce6c10-a587-4dcf-9df8-8306b61d76c5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:41.789888 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-db0eb8f2-0507-477f-b73f-2b2018d980c4 req-b6ce6c10-a587-4dcf-9df8-8306b61d76c5 service nova] Creating event network-vif-plugged:63db1b73-bb24-4574-8d1e-ca84c4ceeb9c for instance ea237879-35ce-4fb1-a360-a421f412d960 on n-h1-master-1 Oct 16 01:00:41.792587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-db0eb8f2-0507-477f-b73f-2b2018d980c4 req-b6ce6c10-a587-4dcf-9df8-8306b61d76c5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:00:41.794287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-db0eb8f2-0507-477f-b73f-2b2018d980c4 req-b6ce6c10-a587-4dcf-9df8-8306b61d76c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:00:41.801275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.805085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.805744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:41.807994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:41.808471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:41.812810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:41.855038 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.rpcapi [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 16 01:00:41.855038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] Releasing lock "compute-rpcapi-router" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:00:41.901554 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ce088fd-4dff-4aa9-94ff-9555a914d384 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.535223 Oct 16 01:00:41.902451 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 56/97] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:41.991758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:42.020342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:42.021295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:42.027184 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-968f4969-3ca4-4930-88e2-4b9964bb4c6c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 0.514173 Oct 16 01:00:42.047828 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 42/98] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:41 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:42.051288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:42.054588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:42.055273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:42.056415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:42.056989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:42.059513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:42.810143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:42.821787 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc40b11e-ef7c-4d89-9a21-d106bc829a99 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.807602 Oct 16 01:00:42.828420 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 57/99] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:42 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:43.053760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:43.054427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:43.067294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.068066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.068658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.069532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:43.079759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:43.080491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:43.351309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1952320145", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:43.447684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:00:44.363115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:44.377727 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-94c8da2e-a77d-4d76-a764-2fc42fabd44a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 1.328011 Oct 16 01:00:44.378855 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 58/100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:43 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:00:44.383638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:44.397589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:44.418019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:44.418727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:44.419384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:44.420138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:44.420588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:44.421187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:44.685619 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:44.702332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:00:44.702783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:00:44.703291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:00:44.703704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:00:44.704118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:00:44.726263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:44.726667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:44.730372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:44.732258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:44.733085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:44.734854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:44.759847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Getting quotas for project 9500f36a03e342caa2c0073b801da342. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:00:44.763080 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:44.766607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Getting quotas for user 83743824a8004cec9913f112e21f319e and project 9500f36a03e342caa2c0073b801da342. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:00:44.788950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:00:44.792681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:00:44.863411 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-41eb09b0-43ff-4b74-a182-713d90958a16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845767 Oct 16 01:00:44.864430 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 43/101] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:00:45.127211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:45.130339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-261883436", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "d8ca3633-753d-4a02-9054-6faae6f93606"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:45.138278 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1cb6808f-0abb-454e-af9e-c12b58e9550b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1337 microversion: 2.1 time: 0.758092 Oct 16 01:00:45.139357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 59/102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:44 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1337 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:45.159744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8fe80c36-e322-4d65-bab5-add844d83e3e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:45.160894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8fe80c36-e322-4d65-bab5-add844d83e3e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:45.268273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] validate_networks() for [('d8ca3633-753d-4a02-9054-6faae6f93606', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:00:45.402025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8fe80c36-e322-4d65-bab5-add844d83e3e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:45.420360 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8fe80c36-e322-4d65-bab5-add844d83e3e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1223 microversion: 2.1 time: 0.278800 Oct 16 01:00:45.447355 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 60/103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:45 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1223 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:45.470855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:45.473589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:45.492987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:45.493669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:45.494318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:45.495242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:45.496025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:45.496733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:46.761021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:46.781573 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c8512b03-cfd9-4704-a2c4-12a3036020a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 1.332664 Oct 16 01:00:46.785234 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 61/104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:45 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:46.799454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:46.800813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:46.813943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:46.817193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:46.818989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:46.820572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:46.821149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:46.821616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:47.361800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:47.371284 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-01725eb6-4c70-4009-9c61-0cbd32ef8a71 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1487 microversion: 2.1 time: 0.584151 Oct 16 01:00:47.382941 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 62/105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:46 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1487 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:47.388662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:47.389568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:47.398038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:47.398661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:47.399214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:47.400031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:47.400627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:47.401155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:47.604206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:47.615439 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3af85ada-5ffc-4230-9182-4a96008af900 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1302 microversion: 2.1 time: 0.241918 Oct 16 01:00:47.616636 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 63/106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:47 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1302 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:47.841807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ebed0be-5a4f-44e9-80a1-7639a5ada98f tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Calling method '.version_select at 0x7fd64f264790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:47.846146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebed0be-5a4f-44e9-80a1-7639a5ada98f tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:47.847170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebed0be-5a4f-44e9-80a1-7639a5ada98f tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:47.848165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebed0be-5a4f-44e9-80a1-7639a5ada98f tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:47.848437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebed0be-5a4f-44e9-80a1-7639a5ada98f tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:47.848987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebed0be-5a4f-44e9-80a1-7639a5ada98f tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:47.849315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebed0be-5a4f-44e9-80a1-7639a5ada98f tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:47.896670 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ebed0be-5a4f-44e9-80a1-7639a5ada98f tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.278201 Oct 16 01:00:47.898698 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 64/107] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:00:47 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:47.903403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:47.904007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:47.914345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:47.915122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:47.915848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:47.917030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:47.917697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:47.918311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:48.132009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:00:48.134976 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:00:48.136495 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:00:48.136996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:00:48.137639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:00:48.159522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:48.160428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:48.161314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:48.162480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:48.163176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:48.164018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:48.213914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for project e9173928e9c94d31b8d2eca240e28d50. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:00:48.218533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for user 5f46ddd0268d44bfacff0400e3f38e7e and project e9173928e9c94d31b8d2eca240e28d50. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:00:48.234568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:00:48.237657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:00:48.320653 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-010907dc-bb76-4ad7-afff-ec1c2d88c391 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.454434 Oct 16 01:00:48.322406 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 44/108] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3457 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:00:48.333357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:48.335047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:48.355696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:48.356259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:48.356832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:48.357543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:48.358224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:48.358785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.151777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.167878 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a47bce9-6c24-4492-af02-69972574b7be tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 0.842412 Oct 16 01:00:49.169752 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 45/109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:48 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:49.276172 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2a4b26ef-61e0-4640-9a0d-9f1b036eb46d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1638 microversion: 2.1 time: 1.376251 Oct 16 01:00:49.277889 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 65/110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:47 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1638 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:49.310376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.311051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:49.331311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.331843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.332304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.335341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.336029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.338171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.418577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-074cbe0f-7f9c-4805-8099-57aa1b7c4d88 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Calling method '.version_select at 0x7fd64f087b80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.423583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-074cbe0f-7f9c-4805-8099-57aa1b7c4d88 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '30ca3998322a4f5f80b38e796a4659d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-074cbe0f-7f9c-4805-8099-57aa1b7c4d88 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Request method failure captured: Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e9xU4843b2ZgNUNDDF1KaYR3xcCzPPR3JSepqwQu5wdS9msv60ecsOh6ovKtwJBrWGHBx7Dpihg1c-grndL64s1K9eNWVIoaw-rzJYSQkLUBPACQs_z_De-FINz5KWOfZ0NydeDE4mJZiU2UAe6LZcKvJb1CnRuBfEL898f88PY4Y Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:49.427177 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c0ea29a7b41e4d6788555e1c8e5d5124", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 30ca3998322a4f5f80b38e796a4659d9 Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:00:49.428607 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:49.429628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 16 01:00:49.430987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.432492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-074cbe0f-7f9c-4805-8099-57aa1b7c4d88 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:49.433070 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-074cbe0f-7f9c-4805-8099-57aa1b7c4d88 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.260078 Oct 16 01:00:49.437834 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 46/111] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:49.442701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f81f1b82-bf08-4fc9-ba62-47ed0c7ae715 req-00aba8dd-9b96-416b-8cd9-9934037be187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e192d949-f638-4890-ae93-709a7cde5fc9", "tag": "6acb8c4d-9089-480a-99ad-6c45fdf5d04c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:49.456710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f81f1b82-bf08-4fc9-ba62-47ed0c7ae715 req-00aba8dd-9b96-416b-8cd9-9934037be187 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.457292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f81f1b82-bf08-4fc9-ba62-47ed0c7ae715 req-00aba8dd-9b96-416b-8cd9-9934037be187 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.457860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f81f1b82-bf08-4fc9-ba62-47ed0c7ae715 req-00aba8dd-9b96-416b-8cd9-9934037be187 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.471361 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f81f1b82-bf08-4fc9-ba62-47ed0c7ae715 req-00aba8dd-9b96-416b-8cd9-9934037be187 service nova] Creating event network-changed:6acb8c4d-9089-480a-99ad-6c45fdf5d04c for instance e192d949-f638-4890-ae93-709a7cde5fc9 on n-h2-master-1 Oct 16 01:00:49.478804 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f81f1b82-bf08-4fc9-ba62-47ed0c7ae715 req-00aba8dd-9b96-416b-8cd9-9934037be187 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042776 Oct 16 01:00:49.479515 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 47/112] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:49.485363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.486350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:49.494530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.495146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.495648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.496597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.497455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.498222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.544273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.557235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.558666 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.564854 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-518b788b-26d8-46c6-a61d-b775230b2813 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1313 microversion: 2.25 time: 0.267849 Oct 16 01:00:49.566036 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 66/113] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:49.572253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.572962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:49.579982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.581114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.581694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.582538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.583162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.583741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.602716 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.611943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2e45669f-946c-4fb6-90ff-aa93d019ab16 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1302 microversion: 2.1 time: 0.130770 Oct 16 01:00:49.616529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:00:49.620178 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 48/114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:49.664813 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35822bdf-afcb-44f7-b666-ebd56997b5f9 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Calling method '.version_select at 0x7fd64efa5dc0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.668242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35822bdf-afcb-44f7-b666-ebd56997b5f9 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '30ca3998322a4f5f80b38e796a4659d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35822bdf-afcb-44f7-b666-ebd56997b5f9 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Request method failure captured: Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e9xU4843b2ZgNUNDDF1KaYR3xcCzPPR3JSepqwQu5wdS9msv60ecsOh6ovKtwJBrWGHBx7Dpihg1c-grndL64s1K9eNWVIoaw-rzJYSQkLUBPACQs_z_De-FINz5KWOfZ0NydeDE4mJZiU2UAe6LZcKvJb1CnRuBfEL898f88PY4Y Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:49.676237 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c0ea29a7b41e4d6788555e1c8e5d5124", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 30ca3998322a4f5f80b38e796a4659d9 Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'n-d-master-1'} Oct 16 01:00:49.677760 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:49.678650 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 16 01:00:49.680935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.682623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35822bdf-afcb-44f7-b666-ebd56997b5f9 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:49.684981 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35822bdf-afcb-44f7-b666-ebd56997b5f9 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.046112 Oct 16 01:00:49.687084 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 49/115] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:49.696810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-600217e8-ce3e-4ee5-af54-aa50b74e8baf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Calling method '.version_select at 0x7fd64f1779d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.744334 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-600217e8-ce3e-4ee5-af54-aa50b74e8baf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-600217e8-ce3e-4ee5-af54-aa50b74e8baf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Request method failure captured: Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e-d3CjXx3F6f_OT6qH02cSOpIZUzWitfqCUPNNZbCrw7pS_FbAV6Sbt7vnWt6RHzQeeLg-pJAd95c6Q5m1jW3MCWlDl_W2iXcEIs6jlb0Kj1B9BQzyd2-zZxZwCSBCROx09EIRUMw7AD2xqWPuBIImhxlNVoThYHR2VHqAFihpI8g Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:49.748548 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_77ca78acb642499a83a32544ea4d6c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: deeb9768f9f04c8ba3fd946cc2186988 Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'nonexistent_hostname'} Oct 16 01:00:49.749716 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:00:49.750424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 16 01:00:49.751496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-600217e8-ce3e-4ee5-af54-aa50b74e8baf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-600217e8-ce3e-4ee5-af54-aa50b74e8baf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.058033 Oct 16 01:00:49.752471 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 50/116] 10.222.0.39 () {58 vars in 1212 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:00:49.769651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57403a10-d20d-44b9-ab90-3443c1c97c63 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Calling method '.version_select at 0x7fd64ef01b80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.772327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-57403a10-d20d-44b9-ab90-3443c1c97c63 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '30ca3998322a4f5f80b38e796a4659d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57403a10-d20d-44b9-ab90-3443c1c97c63 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Request method failure captured: Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e9xU4843b2ZgNUNDDF1KaYR3xcCzPPR3JSepqwQu5wdS9msv60ecsOh6ovKtwJBrWGHBx7Dpihg1c-grndL64s1K9eNWVIoaw-rzJYSQkLUBPACQs_z_De-FINz5KWOfZ0NydeDE4mJZiU2UAe6LZcKvJb1CnRuBfEL898f88PY4Y Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:49.774204 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c0ea29a7b41e4d6788555e1c8e5d5124", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 30ca3998322a4f5f80b38e796a4659d9 Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'n-d-master-1'} Oct 16 01:00:49.775373 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:49.776121 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 16 01:00:49.777108 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.780154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57403a10-d20d-44b9-ab90-3443c1c97c63 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:49.781962 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57403a10-d20d-44b9-ab90-3443c1c97c63 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.017886 Oct 16 01:00:49.791875 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 51/117] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:49.800345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0e06f1d-f495-4279-8de8-fb4fd7803704 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Calling method '.version_select at 0x7fd64ef17700>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.820701 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f0e06f1d-f495-4279-8de8-fb4fd7803704 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0e06f1d-f495-4279-8de8-fb4fd7803704 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Request method failure captured: Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e-d3CjXx3F6f_OT6qH02cSOpIZUzWitfqCUPNNZbCrw7pS_FbAV6Sbt7vnWt6RHzQeeLg-pJAd95c6Q5m1jW3MCWlDl_W2iXcEIs6jlb0Kj1B9BQzyd2-zZxZwCSBCROx09EIRUMw7AD2xqWPuBIImhxlNVoThYHR2VHqAFihpI8g Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:49.826736 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_77ca78acb642499a83a32544ea4d6c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: deeb9768f9f04c8ba3fd946cc2186988 Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'nonexistent_hostname'} Oct 16 01:00:49.827932 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.828668 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.829917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.838150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0e06f1d-f495-4279-8de8-fb4fd7803704 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:49.839177 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f0e06f1d-f495-4279-8de8-fb4fd7803704 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.045884 Oct 16 01:00:49.844269 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 52/118] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:00:49.852291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8af74fc-7a05-468a-826d-2a2123b08960 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Calling method '.version_select at 0x7fd64ef01790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.854509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8af74fc-7a05-468a-826d-2a2123b08960 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '30ca3998322a4f5f80b38e796a4659d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8af74fc-7a05-468a-826d-2a2123b08960 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Request method failure captured: Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e9xU4843b2ZgNUNDDF1KaYR3xcCzPPR3JSepqwQu5wdS9msv60ecsOh6ovKtwJBrWGHBx7Dpihg1c-grndL64s1K9eNWVIoaw-rzJYSQkLUBPACQs_z_De-FINz5KWOfZ0NydeDE4mJZiU2UAe6LZcKvJb1CnRuBfEL898f88PY4Y Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:49.856312 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c0ea29a7b41e4d6788555e1c8e5d5124", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 30ca3998322a4f5f80b38e796a4659d9 Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'n-d-master-1'} Oct 16 01:00:49.857449 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:49.858218 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 16 01:00:49.859210 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.860092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8af74fc-7a05-468a-826d-2a2123b08960 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:49.860651 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8af74fc-7a05-468a-826d-2a2123b08960 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011866 Oct 16 01:00:49.865687 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 53/119] 10.222.0.39 () {58 vars in 1194 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:49.874255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-923bb271-4a98-4394-9be1-ef7583b10c41 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Calling method '.version_select at 0x7fd64ef17af0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.881278 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60261521-f6f8-4e9f-aae8-70a81e34eb1a tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 204 len: 0 microversion: 2.1 time: 0.313737 Oct 16 01:00:49.882145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 67/120] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:00:49 2022] DELETE /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:00:49.894116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.894747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:49.897581 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-923bb271-4a98-4394-9be1-ef7583b10c41 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-923bb271-4a98-4394-9be1-ef7583b10c41 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Request method failure captured: Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e-d3CjXx3F6f_OT6qH02cSOpIZUzWitfqCUPNNZbCrw7pS_FbAV6Sbt7vnWt6RHzQeeLg-pJAd95c6Q5m1jW3MCWlDl_W2iXcEIs6jlb0Kj1B9BQzyd2-zZxZwCSBCROx09EIRUMw7AD2xqWPuBIImhxlNVoThYHR2VHqAFihpI8g Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:49.899322 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_77ca78acb642499a83a32544ea4d6c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: deeb9768f9f04c8ba3fd946cc2186988 Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'nonexistent_hostname'} Oct 16 01:00:49.900543 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:00:49.901229 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 16 01:00:49.902193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-923bb271-4a98-4394-9be1-ef7583b10c41 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:49.903196 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-923bb271-4a98-4394-9be1-ef7583b10c41 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.034069 Oct 16 01:00:49.904898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.904898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.904898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.904898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:49.905324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:49.905324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:49.906081 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 54/121] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:00:49.912545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c69379d-f352-4f76-a8c1-8395b69b3915 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Calling method '.version_select at 0x7fd64ef01f70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.915717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c69379d-f352-4f76-a8c1-8395b69b3915 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '30ca3998322a4f5f80b38e796a4659d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c69379d-f352-4f76-a8c1-8395b69b3915 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Request method failure captured: Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e9xU4843b2ZgNUNDDF1KaYR3xcCzPPR3JSepqwQu5wdS9msv60ecsOh6ovKtwJBrWGHBx7Dpihg1c-grndL64s1K9eNWVIoaw-rzJYSQkLUBPACQs_z_De-FINz5KWOfZ0NydeDE4mJZiU2UAe6LZcKvJb1CnRuBfEL898f88PY4Y Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:49.918518 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c0ea29a7b41e4d6788555e1c8e5d5124", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 30ca3998322a4f5f80b38e796a4659d9 Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'n-d-master-1'} Oct 16 01:00:49.919823 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:49.920494 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 16 01:00:49.921628 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.934607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c69379d-f352-4f76-a8c1-8395b69b3915 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:49.936894 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c69379d-f352-4f76-a8c1-8395b69b3915 tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.029832 Oct 16 01:00:49.945514 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 55/122] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:49.958462 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-228990c6-0db2-404b-9380-bbc5a03c1bbf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Calling method '.version_select at 0x7fd64ef175e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:49.989016 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-228990c6-0db2-404b-9380-bbc5a03c1bbf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-228990c6-0db2-404b-9380-bbc5a03c1bbf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Request method failure captured: Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e-d3CjXx3F6f_OT6qH02cSOpIZUzWitfqCUPNNZbCrw7pS_FbAV6Sbt7vnWt6RHzQeeLg-pJAd95c6Q5m1jW3MCWlDl_W2iXcEIs6jlb0Kj1B9BQzyd2-zZxZwCSBCROx09EIRUMw7AD2xqWPuBIImhxlNVoThYHR2VHqAFihpI8g Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:49.992842 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_77ca78acb642499a83a32544ea4d6c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: deeb9768f9f04c8ba3fd946cc2186988 Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'nonexistent_hostname'} Oct 16 01:00:49.993971 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:00:49.994639 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 16 01:00:49.995792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:49.996823 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.002958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-228990c6-0db2-404b-9380-bbc5a03c1bbf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:50.004808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-228990c6-0db2-404b-9380-bbc5a03c1bbf tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.057882 Oct 16 01:00:50.011812 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 56/123] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:00:50.026682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e118dde8-63ab-4597-82c0-50a11757b347 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ef170d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e118dde8-63ab-4597-82c0-50a11757b347 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Request method failure captured: Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 51 Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e-d3CjXx3F6f_OT6qH02cSOpIZUzWitfqCUPNNZbCrw7pS_FbAV6Sbt7vnWt6RHzQeeLg-pJAd95c6Q5m1jW3MCWlDl_W2iXcEIs6jlb0Kj1B9BQzyd2-zZxZwCSBCROx09EIRUMw7AD2xqWPuBIImhxlNVoThYHR2VHqAFihpI8g Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:50.037708 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_77ca78acb642499a83a32544ea4d6c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: deeb9768f9f04c8ba3fd946cc2186988 Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: {"status": "enable", "maintenance_mode": "invalid"} Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:50.039311 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'disable', Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'Enable', Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'Disable', Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance: Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'invalid' Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.040550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.044588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.046998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.046998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:00:50.046998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:00:50.046998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 16 01:00:50.046998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.046998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e118dde8-63ab-4597-82c0-50a11757b347 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:50.046998 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e118dde8-63ab-4597-82c0-50a11757b347 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.026562 Oct 16 01:00:50.048145 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 57/124] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:00:50 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:00:50.056743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57bbd5fe-032c-4822-8c5a-0e7107092852 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ef1e820>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57bbd5fe-032c-4822-8c5a-0e7107092852 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Request method failure captured: Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 51 Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e-d3CjXx3F6f_OT6qH02cSOpIZUzWitfqCUPNNZbCrw7pS_FbAV6Sbt7vnWt6RHzQeeLg-pJAd95c6Q5m1jW3MCWlDl_W2iXcEIs6jlb0Kj1B9BQzyd2-zZxZwCSBCROx09EIRUMw7AD2xqWPuBIImhxlNVoThYHR2VHqAFihpI8g Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:50.068658 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_77ca78acb642499a83a32544ea4d6c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: deeb9768f9f04c8ba3fd946cc2186988 Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: {"status": "invalid", "maintenance_mode": "enable"} Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:50.069927 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'disable', Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'Enable', Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'Disable', Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance: Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'invalid' Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.070606 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.071902 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.075248 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.075248 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:00:50.075248 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:00:50.075248 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 16 01:00:50.075248 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.075248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57bbd5fe-032c-4822-8c5a-0e7107092852 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:50.075248 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57bbd5fe-032c-4822-8c5a-0e7107092852 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.021411 Oct 16 01:00:50.075248 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 58/125] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:00:50 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:00:50.084681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-69c5fa2d-2503-4eed-b7e6-c7148d93434b tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Action: 'update', calling method: .version_select at 0x7fd64ef01790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:50.089610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-69c5fa2d-2503-4eed-b7e6-c7148d93434b tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '30ca3998322a4f5f80b38e796a4659d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ea29a7b41e4d6788555e1c8e5d5124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-69c5fa2d-2503-4eed-b7e6-c7148d93434b tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Request method failure captured: Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 50 Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e9xU4843b2ZgNUNDDF1KaYR3xcCzPPR3JSepqwQu5wdS9msv60ecsOh6ovKtwJBrWGHBx7Dpihg1c-grndL64s1K9eNWVIoaw-rzJYSQkLUBPACQs_z_De-FINz5KWOfZ0NydeDE4mJZiU2UAe6LZcKvJb1CnRuBfEL898f88PY4Y Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:50.091254 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c0ea29a7b41e4d6788555e1c8e5d5124", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c0ea29a7b41e4d6788555e1c8e5d5124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: c0ea29a7b41e4d6788555e1c8e5d5124 Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-950993185 Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 30ca3998322a4f5f80b38e796a4659d9 Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-950993185-project Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: {"status": "enable", "maintenance_mode": "enable"} Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 16 01:00:50.092648 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:50.093394 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 16 01:00:50.094385 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.099172 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-69c5fa2d-2503-4eed-b7e6-c7148d93434b tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:50.100217 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-69c5fa2d-2503-4eed-b7e6-c7148d93434b tempest-HostsAdminNegativeTestJSON-950993185 tempest-HostsAdminNegativeTestJSON-950993185-project] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.020214 Oct 16 01:00:50.105258 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 59/126] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:00:50 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:50.110385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0900d3b-031f-41c4-bca1-7ff8b2ec48a4 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Action: 'update', calling method: .version_select at 0x7fd64eebc820>, body: {"status": null, "maintenance_mode": null} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0900d3b-031f-41c4-bca1-7ff8b2ec48a4 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Request method failure captured: Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 42 Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e-d3CjXx3F6f_OT6qH02cSOpIZUzWitfqCUPNNZbCrw7pS_FbAV6Sbt7vnWt6RHzQeeLg-pJAd95c6Q5m1jW3MCWlDl_W2iXcEIs6jlb0Kj1B9BQzyd2-zZxZwCSBCROx09EIRUMw7AD2xqWPuBIImhxlNVoThYHR2VHqAFihpI8g Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:50.117796 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_77ca78acb642499a83a32544ea4d6c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: deeb9768f9f04c8ba3fd946cc2186988 Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: {"status": null, "maintenance_mode": null} Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 16 01:00:50.119146 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'disable', Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'Enable', Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'Disable', Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance: Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi None Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.119893 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.121135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.122095 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:00:50.122095 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:00:50.122095 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 16 01:00:50.122095 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.124101 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0900d3b-031f-41c4-bca1-7ff8b2ec48a4 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:50.126124 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b0900d3b-031f-41c4-bca1-7ff8b2ec48a4 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.018848 Oct 16 01:00:50.126899 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 60/127] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:00:50 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:00:50.138558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9c3a4c3-4be2-4826-8ab8-7721ef598908 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Action: 'update', calling method: .version_select at 0x7fd64eebcf70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:50.142478 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.hosts [None req-f9c3a4c3-4be2-4826-8ab8-7721ef598908 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Enabling host nonexistent_hostname. Oct 16 01:00:50.160765 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f9c3a4c3-4be2-4826-8ab8-7721ef598908 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9c3a4c3-4be2-4826-8ab8-7721ef598908 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Request method failure captured: Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 50 Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e-d3CjXx3F6f_OT6qH02cSOpIZUzWitfqCUPNNZbCrw7pS_FbAV6Sbt7vnWt6RHzQeeLg-pJAd95c6Q5m1jW3MCWlDl_W2iXcEIs6jlb0Kj1B9BQzyd2-zZxZwCSBCROx09EIRUMw7AD2xqWPuBIImhxlNVoThYHR2VHqAFihpI8g Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:00:50.166187 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_77ca78acb642499a83a32544ea4d6c1b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/77ca78acb642499a83a32544ea4d6c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 77ca78acb642499a83a32544ea4d6c1b Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-974481795 Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: deeb9768f9f04c8ba3fd946cc2186988 Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HostsAdminNegativeTestJSON-974481795-project-admin Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: {"status": "enable", "maintenance_mode": "enable"} Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:50.167613 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 16 01:00:50.168325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:00:50.169207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 16 01:00:50.170216 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:50.173480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9c3a4c3-4be2-4826-8ab8-7721ef598908 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:50.183949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f9c3a4c3-4be2-4826-8ab8-7721ef598908 tempest-HostsAdminNegativeTestJSON-974481795 tempest-HostsAdminNegativeTestJSON-974481795-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.049613 Oct 16 01:00:50.186725 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 61/128] 10.222.0.39 () {60 vars in 1211 bytes} [Sun Oct 16 01:00:50 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:00:50.205325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:50.207773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:50.215119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:50.215936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:50.216932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:50.218581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:50.219958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:50.220579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:50.774589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:50.786853 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68170d24-026f-4493-b3c3-c821380961a8 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1493 microversion: 2.1 time: 0.897645 Oct 16 01:00:50.788210 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 68/129] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:49 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1493 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:50.802652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:50.803636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:50.819876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:50.823622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:50.824328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:50.826082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:50.826711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:50.827336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:50.914746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:50.936263 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b7099d6-4087-49ac-b672-7a7db1de9949 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 0.739635 Oct 16 01:00:50.937249 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 62/130] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:50 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:50.955325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:50.957641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:50.976314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:50.976812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:50.977251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:50.977962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:50.978416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:50.981368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:51.199441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:51.209038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:51.216097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:51.217551 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5fd20fd5-174b-45d6-8cf6-9bd47c6e7c3a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1319 microversion: 2.25 time: 0.426141 Oct 16 01:00:51.218329 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 69/131] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:00:50 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:51.796306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:51.807729 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-43f3adaf-70f5-4bc5-9dcd-11acd852592e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1344 microversion: 2.1 time: 0.869369 Oct 16 01:00:51.824081 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 63/132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:50 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1344 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:51.829892 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:51.830508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:51.839098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:51.839755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:51.840572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:51.841268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:51.842039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:51.842659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:51.884307 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:51.967207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:51.967818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:51.982382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:51.983152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:51.984001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:51.984609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:51.985071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:51.985493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:52.697034 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:52.707166 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92047289-5207-46ee-a118-73e6cb2c2cf1 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1493 microversion: 2.1 time: 0.881964 Oct 16 01:00:52.710350 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 70/133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:51 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1493 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:00:52.726077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:52.726941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:52.735454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:52.736199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:52.736620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:52.738306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:52.738796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:52.739625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:52.899652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:52.912200 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9bdc26db-e58f-4e98-b18c-cc444de596fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 0.948864 Oct 16 01:00:52.913466 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 64/134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:51 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:00:52.940132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:52.941076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:52.949027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:52.951411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:52.952151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:52.953085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:52.953569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:52.954201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:53.454134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:53.466256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:53.468868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:53.470220 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-005f334c-ff18-4977-a4c3-d2175039eae6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1361 microversion: 2.25 time: 0.758749 Oct 16 01:00:53.471168 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 71/135] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:00:52 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1361 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:53.734125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:53.735021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:53.744775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:53.745274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:53.745712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:53.746431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:53.748307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:53.748768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:54.002272 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:54.005617 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=84 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:54.014515 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-edd19fb1-e0d1-4b56-a218-7cd75373e72f tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1344 microversion: 2.1 time: 1.099714 Oct 16 01:00:54.028859 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 65/136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:52 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1344 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:54.107576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:54.118663 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5c19d63e-12be-48bd-9951-26b2bb255976 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1451 microversion: 2.1 time: 0.388799 Oct 16 01:00:54.125074 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 72/137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:53 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1451 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:54.132642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:54.133259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:54.159725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:54.160658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:54.162401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:54.165084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:54.165750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:54.166573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:54.379312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-afd73496-3c47-4770-911c-31b375d4267b req-f7c69b09-2360-4746-b04f-01cdecc8062e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0a075a-d3cd-41c7-bf45-14b134b9edbc", "tag": "ba7f5844-fb1b-4a88-a6ae-169867236249"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:54.398581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-afd73496-3c47-4770-911c-31b375d4267b req-f7c69b09-2360-4746-b04f-01cdecc8062e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:54.399096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-afd73496-3c47-4770-911c-31b375d4267b req-f7c69b09-2360-4746-b04f-01cdecc8062e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:54.399524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-afd73496-3c47-4770-911c-31b375d4267b req-f7c69b09-2360-4746-b04f-01cdecc8062e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:54.424546 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-afd73496-3c47-4770-911c-31b375d4267b req-f7c69b09-2360-4746-b04f-01cdecc8062e service nova] Creating event network-changed:ba7f5844-fb1b-4a88-a6ae-169867236249 for instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc on n-h2-master-1 Oct 16 01:00:54.442256 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-afd73496-3c47-4770-911c-31b375d4267b req-f7c69b09-2360-4746-b04f-01cdecc8062e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411756 Oct 16 01:00:54.451137 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 66/138] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:54.502280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:54.504008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:54.520720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:54.527049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:54.531838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:54.533048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:54.533807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:54.534540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.088151 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.098816 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a03356b-52db-40c7-a9fd-5ec17208b4af tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 0.972295 Oct 16 01:00:55.106869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.111796 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 73/139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:54 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:55.115801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.117933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.119606 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e679adcc-3a67-4d69-b1de-8c3f40f63186 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1361 microversion: 2.25 time: 0.622576 Oct 16 01:00:55.120310 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 67/140] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:00:54 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1361 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:55.133860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6d5e488c-2e30-4da3-8f0e-363ff336b3e7 req-b1dc4f81-0d12-480e-8fb2-758d75d7f960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea237879-35ce-4fb1-a360-a421f412d960", "name": "network-vif-deleted", "tag": "63db1b73-bb24-4574-8d1e-ca84c4ceeb9c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:55.133860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6d5e488c-2e30-4da3-8f0e-363ff336b3e7 req-b1dc4f81-0d12-480e-8fb2-758d75d7f960 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.133860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6d5e488c-2e30-4da3-8f0e-363ff336b3e7 req-b1dc4f81-0d12-480e-8fb2-758d75d7f960 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.133860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6d5e488c-2e30-4da3-8f0e-363ff336b3e7 req-b1dc4f81-0d12-480e-8fb2-758d75d7f960 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.142332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:55.145682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:55.147546 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6d5e488c-2e30-4da3-8f0e-363ff336b3e7 req-b1dc4f81-0d12-480e-8fb2-758d75d7f960 service nova] Creating event network-vif-deleted:63db1b73-bb24-4574-8d1e-ca84c4ceeb9c for instance ea237879-35ce-4fb1-a360-a421f412d960 on n-h1-master-1 Oct 16 01:00:55.155448 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6d5e488c-2e30-4da3-8f0e-363ff336b3e7 req-b1dc4f81-0d12-480e-8fb2-758d75d7f960 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041539 Oct 16 01:00:55.156645 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 74/141] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:55.158375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.159569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.160434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.161229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.161764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.162307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.165856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:55.167094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:55.173867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.175645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.176585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.177812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.178272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.178697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.216094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.216810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.217440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.218057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lazy-loading 'fault' on Instance uuid ea237879-35ce-4fb1-a360-a421f412d960 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:00:55.357040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01de0795d2f472ab35e08f4651c19ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e9880e0613c4f87a00daf04c040edb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.369238 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82b70b03-7c8d-45a6-a536-6c4b002a118b tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 200 len: 1327 microversion: 2.1 time: 0.210788 Oct 16 01:00:55.371497 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 75/142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:55 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 1327 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:55.598690 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:55.699438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.710230 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4b65036-1237-4174-8b8c-49f9e19fad06 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1344 microversion: 2.1 time: 0.573986 Oct 16 01:00:55.711214 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 68/143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:55 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1344 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:55.816408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d3d72c0-966f-4fa6-91da-0bc0182055a7 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Calling method '.version_select at 0x7fd64f282310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:55.818256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d3d72c0-966f-4fa6-91da-0bc0182055a7 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ad1bfd5f2b494b6d995f2b2688d56b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e819d14f3c4474591d4398574d803d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d3d72c0-966f-4fa6-91da-0bc0182055a7 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Request method failure captured: Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fGfNqcXFnQFC7VEmDVW4ZX7SGO2VscSYsWlv4a1B2tSPRnIKAzF8gJ-tC4XgrOLmeXUCXET7GHHnkTEGi8pAb7U5dunzDh_Us2kvmh3SYQ4bkC9ZTqi3Wwr_wPl8uXbowGBsIcxRfHpRZJ3YHxfa8oABhqEUe3aM0qcT6dAd6wR3E Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:00:55.820290 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e819d14f3c4474591d4398574d803d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ad1bfd5f2b494b6d995f2b2688d56b3d Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: action_args: {} Oct 16 01:00:55.821932 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:55.822924 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 16 01:00:55.824399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.825745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d3d72c0-966f-4fa6-91da-0bc0182055a7 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:55.825745 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d3d72c0-966f-4fa6-91da-0bc0182055a7 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.228434 Oct 16 01:00:55.831303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-638b0cb0-16e6-410d-8a5a-d370561d3c52 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Calling method '.version_select at 0x7fd64f087a60>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:55.833092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-638b0cb0-16e6-410d-8a5a-d370561d3c52 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ad1bfd5f2b494b6d995f2b2688d56b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e819d14f3c4474591d4398574d803d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-638b0cb0-16e6-410d-8a5a-d370561d3c52 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Request method failure captured: Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fGfNqcXFnQFC7VEmDVW4ZX7SGO2VscSYsWlv4a1B2tSPRnIKAzF8gJ-tC4XgrOLmeXUCXET7GHHnkTEGi8pAb7U5dunzDh_Us2kvmh3SYQ4bkC9ZTqi3Wwr_wPl8uXbowGBsIcxRfHpRZJ3YHxfa8oABhqEUe3aM0qcT6dAd6wR3E Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:55.835150 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e819d14f3c4474591d4398574d803d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ad1bfd5f2b494b6d995f2b2688d56b3d Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:00:55.836733 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:55.837572 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 16 01:00:55.838871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.840189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-638b0cb0-16e6-410d-8a5a-d370561d3c52 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:55.840189 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-638b0cb0-16e6-410d-8a5a-d370561d3c52 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009093 Oct 16 01:00:55.840189 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 69/144] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:55 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:55.841216 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 76/145] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Oct 16 01:00:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 245 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:00:55.846090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b7b71dae-4adc-41fb-82a6-21a606e26251 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Calling method '.version_select at 0x7fd64f0e4c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:55.848641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7b71dae-4adc-41fb-82a6-21a606e26251 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ad1bfd5f2b494b6d995f2b2688d56b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e819d14f3c4474591d4398574d803d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b7b71dae-4adc-41fb-82a6-21a606e26251 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Request method failure captured: Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fGfNqcXFnQFC7VEmDVW4ZX7SGO2VscSYsWlv4a1B2tSPRnIKAzF8gJ-tC4XgrOLmeXUCXET7GHHnkTEGi8pAb7U5dunzDh_Us2kvmh3SYQ4bkC9ZTqi3Wwr_wPl8uXbowGBsIcxRfHpRZJ3YHxfa8oABhqEUe3aM0qcT6dAd6wR3E Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:55.850178 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e819d14f3c4474591d4398574d803d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ad1bfd5f2b494b6d995f2b2688d56b3d Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:00:55.852786 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:55.854954 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 16 01:00:55.857280 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.859359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b7b71dae-4adc-41fb-82a6-21a606e26251 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:55.859359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b7b71dae-4adc-41fb-82a6-21a606e26251 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.011684 Oct 16 01:00:55.861184 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 70/146] 10.222.0.39 () {58 vars in 1179 bytes} [Sun Oct 16 01:00:55 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:55.914420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Calling method '.version_select at 0x7fd64f1b53a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:55.916658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.917308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.917907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.931648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.932468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.933068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.946875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:55.947386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:55.947815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:55.953866 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2bc0987a-bb43-4715-845e-a3ab22fd8863 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.093975 Oct 16 01:00:55.961486 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 77/147] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:55.967173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af07536b-0457-4cd2-918a-c1b0f587c4e1 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Calling method '.version_select at 0x7fd64f0e4dc0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:55.969153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af07536b-0457-4cd2-918a-c1b0f587c4e1 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ad1bfd5f2b494b6d995f2b2688d56b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e819d14f3c4474591d4398574d803d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af07536b-0457-4cd2-918a-c1b0f587c4e1 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Request method failure captured: Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fGfNqcXFnQFC7VEmDVW4ZX7SGO2VscSYsWlv4a1B2tSPRnIKAzF8gJ-tC4XgrOLmeXUCXET7GHHnkTEGi8pAb7U5dunzDh_Us2kvmh3SYQ4bkC9ZTqi3Wwr_wPl8uXbowGBsIcxRfHpRZJ3YHxfa8oABhqEUe3aM0qcT6dAd6wR3E Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:00:55.970688 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e819d14f3c4474591d4398574d803d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ad1bfd5f2b494b6d995f2b2688d56b3d Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '1'} Oct 16 01:00:55.973032 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:55.973830 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 16 01:00:55.974853 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.975808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af07536b-0457-4cd2-918a-c1b0f587c4e1 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:55.975808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af07536b-0457-4cd2-918a-c1b0f587c4e1 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009562 Oct 16 01:00:55.975808 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 71/148] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Oct 16 01:00:55 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:55.982961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b4d7ea5-e7c2-479e-8525-9d36c6db8710 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Calling method '.version_select at 0x7fd64f1d3160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:55.984389 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2b4d7ea5-e7c2-479e-8525-9d36c6db8710 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] HTTP exception thrown: Hypervisor with ID '6ab93951-8573-49e0-8a3c-d72ceafc9c73' could not be found. Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b4d7ea5-e7c2-479e-8525-9d36c6db8710 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Request method failure captured: Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-hypervisors/6ab93951-8573-49e0-8a3c-d72ceafc9c73/uptime HTTP/1.1 Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fHK_QP4mUXgdaT1eH62nZzNr1rFCoZ0epk2aUQm3XzYIRjoxvUkrzqdT4BcNUYaZq7bOlE0CkJG_w--RFN6sBjZAy2M8EcYYF0PXVklSmBHOaAd66g03gCnIRx3FUzwXdFYwRqEnIAFDd6CcqX23Tlno3h0rhSbu4AsQkzYbz42nI Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: a6c919608f584e728a6680e500be3fdf Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-63556788 Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:00:55.995462 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6c919608f584e728a6680e500be3fdf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6c919608f584e728a6680e500be3fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6c919608f584e728a6680e500be3fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6c919608f584e728a6680e500be3fdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-63556788 Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: a6c919608f584e728a6680e500be3fdf Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-63556788 Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0df403c0d8054d7fbdb1e55a8900c190 Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: exception: Hypervisor with ID '6ab93951-8573-49e0-8a3c-d72ceafc9c73' could not be found. Oct 16 01:00:55.996968 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6ab93951-8573-49e0-8a3c-d72ceafc9c73'} Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6ab93951-8573-49e0-8a3c-d72ceafc9c73' Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 16 01:00:55.997852 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6ab93951-8573-49e0-8a3c-d72ceafc9c73' could not be found. Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:55.999379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6ab93951-8573-49e0-8a3c-d72ceafc9c73' could not be found. Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b4d7ea5-e7c2-479e-8525-9d36c6db8710 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Returning 404 to user: Hypervisor with ID '6ab93951-8573-49e0-8a3c-d72ceafc9c73' could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:56.000772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2b4d7ea5-e7c2-479e-8525-9d36c6db8710 tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/6ab93951-8573-49e0-8a3c-d72ceafc9c73/uptime" status: 404 len: 123 microversion: 2.1 time: 0.021981 Oct 16 01:00:56.011228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 78/149] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Oct 16 01:00:55 2022] GET /compute/v2.1/os-hypervisors/6ab93951-8573-49e0-8a3c-d72ceafc9c73/uptime => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:56.014898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Calling method '.version_select at 0x7fd64eebc940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:56.023994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.024538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.024947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.047270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.047971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.048624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.064757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.069467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.070166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.087646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bcffc464-f50e-4c3c-a074-f77f6ef6bacc tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.080198 Oct 16 01:00:56.088265 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 72/150] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:00:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:00:56.100114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5befd11f-1599-4d34-8c4e-9abe8eeb29b9 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Calling method '.version_select at 0x7fd64f208670>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:56.103330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5befd11f-1599-4d34-8c4e-9abe8eeb29b9 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ad1bfd5f2b494b6d995f2b2688d56b3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e819d14f3c4474591d4398574d803d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5befd11f-1599-4d34-8c4e-9abe8eeb29b9 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Request method failure captured: Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fGfNqcXFnQFC7VEmDVW4ZX7SGO2VscSYsWlv4a1B2tSPRnIKAzF8gJ-tC4XgrOLmeXUCXET7GHHnkTEGi8pAb7U5dunzDh_Us2kvmh3SYQ4bkC9ZTqi3Wwr_wPl8uXbowGBsIcxRfHpRZJ3YHxfa8oABhqEUe3aM0qcT6dAd6wR3E Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:00:56.105276 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e819d14f3c4474591d4398574d803d0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e819d14f3c4474591d4398574d803d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 1e819d14f3c4474591d4398574d803d0 Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-649829954 Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ad1bfd5f2b494b6d995f2b2688d56b3d Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-649829954-project Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1'} Oct 16 01:00:56.106496 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:00:56.107258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 16 01:00:56.108249 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.119167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5befd11f-1599-4d34-8c4e-9abe8eeb29b9 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:56.120395 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5befd11f-1599-4d34-8c4e-9abe8eeb29b9 tempest-HypervisorAdminNegativeTestJSON-649829954 tempest-HypervisorAdminNegativeTestJSON-649829954-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.025004 Oct 16 01:00:56.121474 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 79/151] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:00:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:56.130533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4fd25fa8-8173-4668-bfe0-b898250eb0ba tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Calling method '.version_select at 0x7fd64f2d71f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:56.134033 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4fd25fa8-8173-4668-bfe0-b898250eb0ba tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] HTTP exception thrown: Hypervisor with ID 'cc11757c-5f04-47fd-92cb-c100a324d467' could not be found. Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4fd25fa8-8173-4668-bfe0-b898250eb0ba tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Request method failure captured: Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-hypervisors/cc11757c-5f04-47fd-92cb-c100a324d467 HTTP/1.1 Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fHK_QP4mUXgdaT1eH62nZzNr1rFCoZ0epk2aUQm3XzYIRjoxvUkrzqdT4BcNUYaZq7bOlE0CkJG_w--RFN6sBjZAy2M8EcYYF0PXVklSmBHOaAd66g03gCnIRx3FUzwXdFYwRqEnIAFDd6CcqX23Tlno3h0rhSbu4AsQkzYbz42nI Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: a6c919608f584e728a6680e500be3fdf Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-63556788 Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:00:56.137801 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a6c919608f584e728a6680e500be3fdf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a6c919608f584e728a6680e500be3fdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6c919608f584e728a6680e500be3fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a6c919608f584e728a6680e500be3fdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-63556788 Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: a6c919608f584e728a6680e500be3fdf Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-63556788 Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0df403c0d8054d7fbdb1e55a8900c190 Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: exception: Hypervisor with ID 'cc11757c-5f04-47fd-92cb-c100a324d467' could not be found. Oct 16 01:00:56.139286 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'cc11757c-5f04-47fd-92cb-c100a324d467'} Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'cc11757c-5f04-47fd-92cb-c100a324d467' Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 16 01:00:56.140115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:00:56.141406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'cc11757c-5f04-47fd-92cb-c100a324d467' could not be found. Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'cc11757c-5f04-47fd-92cb-c100a324d467' could not be found. Oct 16 01:00:56.142454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.146845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4fd25fa8-8173-4668-bfe0-b898250eb0ba tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] Returning 404 to user: Hypervisor with ID 'cc11757c-5f04-47fd-92cb-c100a324d467' could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:56.147751 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4fd25fa8-8173-4668-bfe0-b898250eb0ba tempest-HypervisorAdminNegativeTestJSON-63556788 tempest-HypervisorAdminNegativeTestJSON-63556788-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/cc11757c-5f04-47fd-92cb-c100a324d467" status: 404 len: 123 microversion: 2.1 time: 0.021232 Oct 16 01:00:56.148344 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 80/152] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:00:56 2022] GET /compute/v2.1/os-hypervisors/cc11757c-5f04-47fd-92cb-c100a324d467 => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:00:56.149381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:56.150058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:56.165563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:56.178722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:56.183968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.184680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.185277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.186128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.186723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.187310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.204709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.208551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.209368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.212335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.224711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.225456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.793554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:56.806118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:56.807773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:56.809159 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-443c4bfe-5d9b-4b43-9053-56d196962609 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1361 microversion: 2.25 time: 0.657086 Oct 16 01:00:56.809962 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 81/153] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:00:56 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1361 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:56.816315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:56.816918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:56.823069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.823724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.824156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.824876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.825358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.825945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.833600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:56.842190 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11310642-c194-4944-8bfc-aa04c6a406ef tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 0.722054 Oct 16 01:00:56.843602 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 73/154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:56 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:56.847991 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] HTTP exception thrown: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:00:56.850317 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-3d1ec420-ada1-4f2e-add2-c86b1274a6f6 req-367a5ab2-faa2-4f13-a00a-103e726bab05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192d949-f638-4890-ae93-709a7cde5fc9", "name": "network-vif-plugged", "status": "completed", "tag": "6acb8c4d-9089-480a-99ad-6c45fdf5d04c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Request method failure captured: Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 HTTP/1.1 Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eV-Rg8_aAXoFAF1LoTk66i7dAU7K2ptuC9oFfG5RatvUSJiGO3pY54fp1_hr0XLc45pQRDf08vdxqvdapop7LgX6VhonEJKDYi7_XJcfy1B--9Hb98Bf76YqJNH02UqSYRoYUd-YDs-UheVlT2ynYnwwB2jxWqx2-efCtrWFMJED8 Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 4e9880e0613c4f87a00daf04c040edb0 Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:00:56.852640 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e9880e0613c4f87a00daf04c040edb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 4e9880e0613c4f87a00daf04c040edb0 Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminTestJSON-1020923527-project Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b01de0795d2f472ab35e08f4651c19ae Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminTestJSON-1020923527-project Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: exception: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:00:56.853821 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ea237879-35ce-4fb1-a360-a421f412d960'} Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:00:56.854548 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:00:56.855635 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:00:56.856657 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Returning 404 to user: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:00:56.856657 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b7634ff1-3d4b-4eca-8681-a921665ad4ee tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 404 len: 111 microversion: 2.1 time: 0.042807 Oct 16 01:00:56.858302 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 82/155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:56 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:56.864016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:56.864849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:56.868365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3d1ec420-ada1-4f2e-add2-c86b1274a6f6 req-367a5ab2-faa2-4f13-a00a-103e726bab05 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.869173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3d1ec420-ada1-4f2e-add2-c86b1274a6f6 req-367a5ab2-faa2-4f13-a00a-103e726bab05 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.869745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3d1ec420-ada1-4f2e-add2-c86b1274a6f6 req-367a5ab2-faa2-4f13-a00a-103e726bab05 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.872233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.872725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.873160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.873918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.874382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.874947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:56.886368 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-3d1ec420-ada1-4f2e-add2-c86b1274a6f6 req-367a5ab2-faa2-4f13-a00a-103e726bab05 service nova] Creating event network-vif-plugged:6acb8c4d-9089-480a-99ad-6c45fdf5d04c for instance e192d949-f638-4890-ae93-709a7cde5fc9 on n-h2-master-1 Oct 16 01:00:56.892572 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-3d1ec420-ada1-4f2e-add2-c86b1274a6f6 req-367a5ab2-faa2-4f13-a00a-103e726bab05 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047524 Oct 16 01:00:56.894145 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 74/156] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:56.901192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98fecdca-09ce-4a86-84df-5f7b2e95aa03 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:56.926279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98fecdca-09ce-4a86-84df-5f7b2e95aa03 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:56.926812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98fecdca-09ce-4a86-84df-5f7b2e95aa03 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:56.927273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98fecdca-09ce-4a86-84df-5f7b2e95aa03 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:57.150650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:57.160305 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c9855a40-08b6-46dd-84fb-00823470dc40 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1344 microversion: 2.1 time: 0.300645 Oct 16 01:00:57.177694 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 83/157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:56 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1344 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:57.433062 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98fecdca-09ce-4a86-84df-5f7b2e95aa03 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.535161 Oct 16 01:00:57.434595 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 75/158] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:00:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:57.454406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2e7c6890-8c50-41b9-adfd-b7263a9719e9 req-cdb81b9d-1d50-4f97-85df-4d730c118f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8eb156b-c5ff-4581-a5db-bdf211e6485f", "tag": "3c862dac-e606-4f6a-b62e-dd863ceedecd"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:57.468920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e7c6890-8c50-41b9-adfd-b7263a9719e9 req-cdb81b9d-1d50-4f97-85df-4d730c118f87 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:57.470877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e7c6890-8c50-41b9-adfd-b7263a9719e9 req-cdb81b9d-1d50-4f97-85df-4d730c118f87 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:57.471372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e7c6890-8c50-41b9-adfd-b7263a9719e9 req-cdb81b9d-1d50-4f97-85df-4d730c118f87 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:57.485713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-193563f9-2746-47ff-95b5-3a1a68ee7404 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:57.492754 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2e7c6890-8c50-41b9-adfd-b7263a9719e9 req-cdb81b9d-1d50-4f97-85df-4d730c118f87 service nova] Creating event network-changed:3c862dac-e606-4f6a-b62e-dd863ceedecd for instance a8eb156b-c5ff-4581-a5db-bdf211e6485f on n-h1-master-1 Oct 16 01:00:57.496193 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-193563f9-2746-47ff-95b5-3a1a68ee7404 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.316505 Oct 16 01:00:57.497834 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 84/159] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:00:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:57.498840 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2e7c6890-8c50-41b9-adfd-b7263a9719e9 req-cdb81b9d-1d50-4f97-85df-4d730c118f87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062560 Oct 16 01:00:57.499485 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 76/160] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:57.508633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-937bdf9a-17d7-47cd-a3cd-e68a53baaad0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:57.564893 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-937bdf9a-17d7-47cd-a3cd-e68a53baaad0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.065910 Oct 16 01:00:57.566350 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 85/161] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:00:57 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:00:57.581870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c3a8ed12-f2c3-4409-9a23-6cd234850ea4 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1697125882"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:57.586411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-c3a8ed12-f2c3-4409-9a23-6cd234850ea4 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid 117cfaa4-6358-443c-96e5-f14351c5a15d for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:00:57.600336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8d441d5-1a1f-44d1-80ca-742296e4eadb tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-517753163", "id": 86433692, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:57.629049 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c3a8ed12-f2c3-4409-9a23-6cd234850ea4 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050861 Oct 16 01:00:57.629547 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 86/162] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:00:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:57.632712 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8d441d5-1a1f-44d1-80ca-742296e4eadb tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.125262 Oct 16 01:00:57.633300 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 77/163] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:57 2022] POST /compute/v2.1/flavors => generated 418 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:00:57.646998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbd8cb3a-ab27-437c-b839-7b30ffeeb516 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:57.648167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ea95c6f-e3dc-49d4-be3c-6155c05a46c2 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:57.656210 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fbd8cb3a-ab27-437c-b839-7b30ffeeb516 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013490 Oct 16 01:00:57.660408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ea95c6f-e3dc-49d4-be3c-6155c05a46c2 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:57.661289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ea95c6f-e3dc-49d4-be3c-6155c05a46c2 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:57.661918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ea95c6f-e3dc-49d4-be3c-6155c05a46c2 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:57.662519 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 78/164] 10.222.0.39 () {58 vars in 1182 bytes} [Sun Oct 16 01:00:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:57.669710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-492b6607-9bb5-4c86-b0d2-9faa4ec7a75c tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1433457444", "id": 1996775043, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:57.681161 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:RELEASE=1,nova_api:SELECT=92,nova_api:DELETE=5,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:57.692643 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-492b6607-9bb5-4c86-b0d2-9faa4ec7a75c tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.027990 Oct 16 01:00:57.694590 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 79/165] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:00:57 2022] POST /compute/v2.1/flavors => generated 425 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:57.716188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfa21737-d49f-4f57-adc1-ea71f15d0fa0 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:57.725940 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfa21737-d49f-4f57-adc1-ea71f15d0fa0 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017469 Oct 16 01:00:57.726740 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 80/166] 10.222.0.39 () {58 vars in 1182 bytes} [Sun Oct 16 01:00:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:00:57.744705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-192a441e-ca4a-438f-95ba-cac7ed5c2868 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Action: 'create', calling method: .version_select at 0x7fd64ef1ec10>, body: {"keypair": {"name": "tempest-keypair-1379365393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBySi4A4YEhv6hulZvgRoJ/V7mFvia+lX/TfvsnCJyoqzoI3dyaCmwhYd0Sp5siVCIWW6Z8x/+fFwFhUtY9ILpOQKxld/SG6ejHx4H36NPTTkILzX40/8mMgAQlBYepcWg=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:57.776932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-192a441e-ca4a-438f-95ba-cac7ed5c2868 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Getting quotas for project bdbebb3c197640f8b915a091c4277bc8. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:00:57.781629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-192a441e-ca4a-438f-95ba-cac7ed5c2868 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Getting quotas for user ea698e4b461143cfafb17befe69af2a5 and project bdbebb3c197640f8b915a091c4277bc8. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:00:57.834949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-192a441e-ca4a-438f-95ba-cac7ed5c2868 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096731 Oct 16 01:00:57.837177 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 81/167] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:00:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:57.847637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:57.850071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:57.853305 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:57.860085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:57.864117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:57.864796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:57.867398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:57.868056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:57.868700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:57.872323 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ea95c6f-e3dc-49d4-be3c-6155c05a46c2 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.229516 Oct 16 01:00:57.873950 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 87/168] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:00:57 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:57.875723 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:57.888265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:57.890139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:57.907982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:57.912039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:57.912576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:57.913959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:57.915531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:57.917099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:58.191521 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:58.307314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:58.317621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:58.319740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:58.321198 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81ae03eb-430f-4ba3-b0e3-1a382f28809d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1361 microversion: 2.25 time: 0.482854 Oct 16 01:00:58.321919 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 82/169] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:00:57 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1361 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:58.327040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1661f2da-d3e4-4f73-a76a-12d82965a7a0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:58.335732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1661f2da-d3e4-4f73-a76a-12d82965a7a0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.012515 Oct 16 01:00:58.336833 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 83/170] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:00:58 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:58.341705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:58.342503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:58.350266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:58.351340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:58.352015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:58.352957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:58.353756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:58.354385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:58.454664 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:58.466337 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-689501ac-e9b2-4599-a63c-e41fffe38212 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1313 microversion: 2.1 time: 0.591146 Oct 16 01:00:58.483042 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 88/171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:57 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:58.494035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42586448-9fe6-4e32-b4f0-1e99cafe172e tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:58.511773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42586448-9fe6-4e32-b4f0-1e99cafe172e tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:58.512953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42586448-9fe6-4e32-b4f0-1e99cafe172e tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:58.526301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42586448-9fe6-4e32-b4f0-1e99cafe172e tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:58.688350 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42586448-9fe6-4e32-b4f0-1e99cafe172e tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.203877 Oct 16 01:00:58.689240 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 89/172] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:00:58 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:58.700700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eabfe18d-71f8-4220-a912-adf0fc6f5f68 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:58.719378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:58.730252 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eabfe18d-71f8-4220-a912-adf0fc6f5f68 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.033044 Oct 16 01:00:58.731991 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 90/173] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:00:58 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:00:58.733467 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-022afbe4-ba7a-4a4a-9974-46c3b2a11df3 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1323 microversion: 2.1 time: 0.395420 Oct 16 01:00:58.743640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e082c2b8-cd8c-4e34-a0c4-f2f39f54e300 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-914637515"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:58.747477 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 84/174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:58 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:00:58.754342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-e082c2b8-cd8c-4e34-a0c4-f2f39f54e300 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid f27f2f21-f60b-49d2-a84f-63ee1af55bcc for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:00:58.779246 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e082c2b8-cd8c-4e34-a0c4-f2f39f54e300 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040524 Oct 16 01:00:58.780534 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 91/175] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:00:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:00:58.794241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f93e8016-89a8-48bb-9b33-9b0ecea9c206 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:58.812847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f93e8016-89a8-48bb-9b33-9b0ecea9c206 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:58.814669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f93e8016-89a8-48bb-9b33-9b0ecea9c206 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:58.815945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f93e8016-89a8-48bb-9b33-9b0ecea9c206 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.011333 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f93e8016-89a8-48bb-9b33-9b0ecea9c206 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.222136 Oct 16 01:00:59.020186 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 85/176] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:00:58 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:00:59.034679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-754d7544-b943-4c4b-a70d-19e5843c0b10 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:59.058612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-754d7544-b943-4c4b-a70d-19e5843c0b10 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.035369 Oct 16 01:00:59.066755 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 92/177] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:00:59 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:59.079334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7aaf07f7-c2da-4d91-9f3c-11d168caf907 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:59.090600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aaf07f7-c2da-4d91-9f3c-11d168caf907 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.091137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aaf07f7-c2da-4d91-9f3c-11d168caf907 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.091575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aaf07f7-c2da-4d91-9f3c-11d168caf907 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.248111 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7aaf07f7-c2da-4d91-9f3c-11d168caf907 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.173507 Oct 16 01:00:59.249347 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 86/178] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:00:59 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:59.260807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6fbfb2a-beb5-4ced-8396-e2dc36379530 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:59.322504 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6fbfb2a-beb5-4ced-8396-e2dc36379530 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.065603 Oct 16 01:00:59.333209 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 93/179] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:00:59 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:00:59.337316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-677c3566-12ba-4001-b451-18a911993562 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-343060272"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:59.341613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.aggregate [None req-677c3566-12ba-4001-b451-18a911993562 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid 24b94ef5-ddf9-41be-90aa-ccbeaa373a5d for aggregate {{(pid=120546) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:00:59.364239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:59.367640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:59.380430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.380960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.381413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.382288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.382742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.383703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.409369 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-677c3566-12ba-4001-b451-18a911993562 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075473 Oct 16 01:00:59.412760 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 87/180] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:00:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:59.423593 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9fb4fd38-43d2-4617-9260-fd6050b64f8d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:59.441990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fb4fd38-43d2-4617-9260-fd6050b64f8d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.442734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fb4fd38-43d2-4617-9260-fd6050b64f8d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.443388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fb4fd38-43d2-4617-9260-fd6050b64f8d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.624288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:59.645388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:59.650197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:00:59.652597 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f2d47e1-dc31-44d1-b518-7d82f33e86b9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1361 microversion: 2.25 time: 0.307034 Oct 16 01:00:59.678467 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9fb4fd38-43d2-4617-9260-fd6050b64f8d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.259484 Oct 16 01:00:59.679790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 94/181] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:00:59 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:00:59.680965 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 88/182] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:00:59 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:59.691742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:59.692716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:59.695821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22b12ac2-ff1e-4315-8bfd-ade04de582e0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:00:59.700411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.701265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.701770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.702668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.703225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.703720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.719313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b12ac2-ff1e-4315-8bfd-ade04de582e0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.719834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b12ac2-ff1e-4315-8bfd-ade04de582e0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.720362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b12ac2-ff1e-4315-8bfd-ade04de582e0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.942603 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22b12ac2-ff1e-4315-8bfd-ade04de582e0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.254931 Oct 16 01:00:59.943342 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 89/183] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:00:59 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:00:59.960942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:00:59.961748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:00:59.975614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.976557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.977367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:00:59.978469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:00:59.979387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:00:59.980335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:00.023368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:00.031226 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-af7b7633-42b6-4f9a-9444-8a288328dab8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1463 microversion: 2.1 time: 0.348961 Oct 16 01:01:00.033392 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 95/184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:59 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1463 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:00.038247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77025b33-524f-45f9-b665-59bdae6d0848 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:00.063601 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77025b33-524f-45f9-b665-59bdae6d0848 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.028776 Oct 16 01:01:00.064527 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 96/185] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:00 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:00.212768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:00.224517 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4798342d-5035-4e01-b96d-51c1721825f5 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1323 microversion: 2.1 time: 0.279988 Oct 16 01:01:00.231095 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 90/186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:00:59 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1323 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:00.231967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfec62d1-751f-4d9a-8c7d-05ef15bf142b tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-893958914"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:00.243446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.aggregate [None req-dfec62d1-751f-4d9a-8c7d-05ef15bf142b tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid b695e0db-cc52-4375-9399-cf12f4b20fdf for aggregate {{(pid=120546) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:00.270556 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfec62d1-751f-4d9a-8c7d-05ef15bf142b tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.043429 Oct 16 01:01:00.272068 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 91/187] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:00.298108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-636028524", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "1996775043", "adminPass": "***", "networks": [{"uuid": "dfa88975-167b-4864-bdd9-5ec0d01fa189"}], "security_groups": [{"name": "tempest-securitygroup--314481409"}], "key_name": "tempest-keypair-1379365393", "user_data": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:00.481482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] validate_networks() for [('dfa88975-167b-4864-bdd9-5ec0d01fa189', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:00.551253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:00.552146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:00.561249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:00.562832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:00.566542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:00.569602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:00.571146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:00.576595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.087910 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d101a11-2707-4731-a10b-7d18dec02b65 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1614 microversion: 2.1 time: 1.013912 Oct 16 01:01:01.088695 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 97/188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:00 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1614 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:01.093423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78613e33-1fc8-4200-9724-0d7bb975c0cd tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1556362731"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:01.097633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-78613e33-1fc8-4200-9724-0d7bb975c0cd tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Generated uuid 14eaa25c-7f87-4c35-819d-c00b0f68c1ab for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:01.143254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:01.144097 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78613e33-1fc8-4200-9724-0d7bb975c0cd tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.053779 Oct 16 01:01:01.145287 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:01.145944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:01.146508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:01.147404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:01.152528 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 98/189] 10.222.0.39 () {62 vars in 1205 bytes} [Sun Oct 16 01:01:01 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:01.158488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-004de84e-9e47-415b-a4b4-b9f5529456f6 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:01.160089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.160647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.161862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.162650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.163341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.163833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.188566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Getting quotas for project bdbebb3c197640f8b915a091c4277bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:01.194609 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-004de84e-9e47-415b-a4b4-b9f5529456f6 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.040041 Oct 16 01:01:01.195221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Getting quotas for user ea698e4b461143cfafb17befe69af2a5 and project bdbebb3c197640f8b915a091c4277bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:01.195870 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 99/190] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:01 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:01.209619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-8de76b3b-aa8e-4904-81d7-f0824c5265f7 req-3659509a-eb0e-48cb-9d6b-ca060df6b8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0a075a-d3cd-41c7-bf45-14b134b9edbc", "name": "network-vif-plugged", "status": "completed", "tag": "ba7f5844-fb1b-4a88-a6ae-169867236249"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:01.213291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:01.217666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:01.222339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8de76b3b-aa8e-4904-81d7-f0824c5265f7 req-3659509a-eb0e-48cb-9d6b-ca060df6b8f4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.224145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8de76b3b-aa8e-4904-81d7-f0824c5265f7 req-3659509a-eb0e-48cb-9d6b-ca060df6b8f4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.225022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8de76b3b-aa8e-4904-81d7-f0824c5265f7 req-3659509a-eb0e-48cb-9d6b-ca060df6b8f4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.239185 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-8de76b3b-aa8e-4904-81d7-f0824c5265f7 req-3659509a-eb0e-48cb-9d6b-ca060df6b8f4 service nova] Creating event network-vif-plugged:ba7f5844-fb1b-4a88-a6ae-169867236249 for instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc on n-h2-master-1 Oct 16 01:01:01.268157 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-8de76b3b-aa8e-4904-81d7-f0824c5265f7 req-3659509a-eb0e-48cb-9d6b-ca060df6b8f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069141 Oct 16 01:01:01.269357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 100/191] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:01.277100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:01.277827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:01.288746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.289491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.290260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.292056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.292627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.293774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.332848 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3755d361-6590-4958-babe-bcd9f15a0ddb tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.058989 Oct 16 01:01:01.344082 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 92/192] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:01:01.352267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:01.354315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:01.376023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.377428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.378190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.379212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.379579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.380175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.568245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:01.592919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:01.594832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:01.596225 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f23009c4-6282-4610-b495-191dda1f889f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1361 microversion: 2.25 time: 0.325287 Oct 16 01:01:01.598884 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 101/193] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:01 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:01.605762 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-912964f7-1418-4878-a87b-c6ecdc3bab48 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1334504031"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:01.708395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6f6ea3b7518449b89a369107e12ee9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc88035f18493d8c713b47a35517ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:01.708561 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] flavor_id is None. Assuming migration. {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 16 01:01:01.708934 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:01:01.730867 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-912964f7-1418-4878-a87b-c6ecdc3bab48 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.130738 Oct 16 01:01:01.731887 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 102/194] 10.222.0.39 () {62 vars in 1210 bytes} [Sun Oct 16 01:01:01 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:01.746509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-329bb1a5-7f42-4c48-8024-d0191627dd4a tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:01.756615 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-329bb1a5-7f42-4c48-8024-d0191627dd4a tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-329bb1a5-7f42-4c48-8024-d0191627dd4a tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Request method failure captured: Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYTroCwZ31RRjSjDV8MfcZXBRAhRPFtGwEPNgdwpDirV_cYq3Qfb23s2eTneebc341xVnxmzS4SgW1exZp3lBMcXwa9aPqhWXbYjnbwgABBGeDd-kW4lwmWAnZ2NMWLQkNW-RmG1m1rcVApX7e4r-N0mmozsNT7PK0tU5lcPsreZI Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 937e361ce901423a958ae619d74c6369 Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:01.758930 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_937e361ce901423a958ae619d74c6369", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/937e361ce901423a958ae619d74c6369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/937e361ce901423a958ae619d74c6369"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/937e361ce901423a958ae619d74c6369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 937e361ce901423a958ae619d74c6369 Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminTestJSON-362400867-project-admin Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 74d6cb950d4e4bf0ae32a4be90617aaf Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminTestJSON-362400867-project-admin Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: exception: Aggregate 5 could not be found. Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5'} Oct 16 01:01:01.760395 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:01.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:01.762546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-329bb1a5-7f42-4c48-8024-d0191627dd4a tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:01.764900 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-329bb1a5-7f42-4c48-8024-d0191627dd4a tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.031546 Oct 16 01:01:01.765267 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 103/195] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:01:01 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:01:01.770654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:01.771568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:01.779004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.779642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.780166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.781147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:01.781699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:01.782215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:01.939539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:01.948757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fea1d4d8-d888-463f-a9c8-f105a3a8536b tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1323 microversion: 2.1 time: 0.182266 Oct 16 01:01:01.963827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 104/196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:01 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:01.969050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-203b5d82-6915-43e7-8a56-f1c45cfc7166 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:01.969748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-203b5d82-6915-43e7-8a56-f1c45cfc7166 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:01.979883 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd5c84f1-d4c3-4c75-bd4d-6a4a16cf1666 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9/action" status: 202 len: 0 microversion: 2.1 time: 0.631128 Oct 16 01:01:01.980660 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 93/197] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:01:01 2022] POST /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:02.045616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-203b5d82-6915-43e7-8a56-f1c45cfc7166 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:02.058623 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-203b5d82-6915-43e7-8a56-f1c45cfc7166 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1264 microversion: 2.1 time: 0.092365 Oct 16 01:01:02.067952 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 105/198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:01 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1264 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:02.073852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8458e455-a9c8-4bc2-8300-574b2776ba0e tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.087663 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8458e455-a9c8-4bc2-8300-574b2776ba0e tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.018291 Oct 16 01:01:02.088495 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 106/199] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Oct 16 01:01:02 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:02.101416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a987a1ff-7241-438a-b941-362d845aa1b0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.137505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a987a1ff-7241-438a-b941-362d845aa1b0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a987a1ff-7241-438a-b941-362d845aa1b0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Request method failure captured: Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYTroCwZ31RRjSjDV8MfcZXBRAhRPFtGwEPNgdwpDirV_cYq3Qfb23s2eTneebc341xVnxmzS4SgW1exZp3lBMcXwa9aPqhWXbYjnbwgABBGeDd-kW4lwmWAnZ2NMWLQkNW-RmG1m1rcVApX7e4r-N0mmozsNT7PK0tU5lcPsreZI Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 937e361ce901423a958ae619d74c6369 Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:02.144843 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_937e361ce901423a958ae619d74c6369", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/937e361ce901423a958ae619d74c6369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/937e361ce901423a958ae619d74c6369"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/937e361ce901423a958ae619d74c6369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 937e361ce901423a958ae619d74c6369 Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminTestJSON-362400867-project-admin Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 74d6cb950d4e4bf0ae32a4be90617aaf Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminTestJSON-362400867-project-admin Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: exception: Aggregate 5 could not be found. Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5'} Oct 16 01:01:02.146235 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:02.147139 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.148412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:02.151581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:02.151581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:02.151581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:02.151581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 16 01:01:02.151581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.151581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a987a1ff-7241-438a-b941-362d845aa1b0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:02.151581 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a987a1ff-7241-438a-b941-362d845aa1b0 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.048555 Oct 16 01:01:02.154989 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 107/200] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:02 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:01:02.161055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.162605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:02.176272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:02.176930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:02.177468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:02.178165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:02.178621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:02.179114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:02.179592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6995e465-85c2-414f-87a9-004ee26650d7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Calling method '.version_select at 0x7fd64eebcd30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.185179 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:02.287644 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6995e465-85c2-414f-87a9-004ee26650d7 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/2834cc00471d467e997d8df2ff2dc3a0" status: 200 len: 371 microversion: 2.1 time: 0.305513 Oct 16 01:01:02.288428 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 94/201] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:01:01 2022] GET /compute/v2.1/os-quota-sets/2834cc00471d467e997d8df2ff2dc3a0 => generated 371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:02.301480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcb90d31-9313-4c74-b450-56c3e45f11f7 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:02.313427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb90d31-9313-4c74-b450-56c3e45f11f7 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:02.314153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb90d31-9313-4c74-b450-56c3e45f11f7 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:02.314764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb90d31-9313-4c74-b450-56c3e45f11f7 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:02.414024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:02.424170 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d5d44354-3e39-4b40-89e9-6da1ebef7618 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1472 microversion: 2.1 time: 0.267961 Oct 16 01:01:02.426077 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 108/202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:02 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:02.430535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6043f2a-7af1-4d8b-8730-83cd96ba84fc tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1576660473", "name": "tempest-test_aggregate-2024437372"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:02.434120 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-b6043f2a-7af1-4d8b-8730-83cd96ba84fc tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid 93130089-d5cb-4d3b-b89d-2354fcfe73e4 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:02.463897 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bcb90d31-9313-4c74-b450-56c3e45f11f7 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.166883 Oct 16 01:01:02.464732 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 95/203] 10.222.0.39 () {62 vars in 1232 bytes} [Sun Oct 16 01:01:02 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:02.469345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74c5105b-42da-4f95-b215-2a034b26a217 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ef01af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:02.479764 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6043f2a-7af1-4d8b-8730-83cd96ba84fc tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.051962 Oct 16 01:01:02.480798 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 109/204] 10.222.0.39 () {60 vars in 1165 bytes} [Sun Oct 16 01:01:02 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:02.487437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c80685cf-12f3-4794-82a4-8c9e1df8571a tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:02.499936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80685cf-12f3-4794-82a4-8c9e1df8571a tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:02.500438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80685cf-12f3-4794-82a4-8c9e1df8571a tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:02.500871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80685cf-12f3-4794-82a4-8c9e1df8571a tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:02.555339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74c5105b-42da-4f95-b215-2a034b26a217 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:02.556150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74c5105b-42da-4f95-b215-2a034b26a217 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:02.556832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74c5105b-42da-4f95-b215-2a034b26a217 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:02.557732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74c5105b-42da-4f95-b215-2a034b26a217 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:02.558328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74c5105b-42da-4f95-b215-2a034b26a217 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:02.558868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74c5105b-42da-4f95-b215-2a034b26a217 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:02.626124 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74c5105b-42da-4f95-b215-2a034b26a217 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/2834cc00471d467e997d8df2ff2dc3a0" status: 200 len: 328 microversion: 2.1 time: 0.160196 Oct 16 01:01:02.626761 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 96/205] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:02 2022] PUT /compute/v2.1/os-quota-sets/2834cc00471d467e997d8df2ff2dc3a0 => generated 328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:02.632190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6cfffa80-b4cb-4759-9d4e-82298504a003 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.647264 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:02.670128 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6cfffa80-b4cb-4759-9d4e-82298504a003 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.041964 Oct 16 01:01:02.670714 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 97/206] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:02.677314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.677921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:02.686952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:02.687795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:02.688392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:02.689958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:02.690608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:02.691061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:02.697337 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c80685cf-12f3-4794-82a4-8c9e1df8571a tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.214436 Oct 16 01:01:02.698587 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 110/207] 10.222.0.39 () {62 vars in 1232 bytes} [Sun Oct 16 01:01:02 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:02.703503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4cd026f5-adfd-4833-ae66-1bbdb8080b2c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.718473 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4cd026f5-adfd-4833-ae66-1bbdb8080b2c tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-quota-sets/2834cc00471d467e997d8df2ff2dc3a0" status: 202 len: 0 microversion: 2.1 time: 0.018083 Oct 16 01:01:02.722769 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 111/208] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:01:02 2022] DELETE /compute/v2.1/os-quota-sets/2834cc00471d467e997d8df2ff2dc3a0 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:02.727554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e544d0f0-09a2-4fa2-8f12-1927655d8f47 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.734768 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-e544d0f0-09a2-4fa2-8f12-1927655d8f47 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e544d0f0-09a2-4fa2-8f12-1927655d8f47 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Request method failure captured: Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYTroCwZ31RRjSjDV8MfcZXBRAhRPFtGwEPNgdwpDirV_cYq3Qfb23s2eTneebc341xVnxmzS4SgW1exZp3lBMcXwa9aPqhWXbYjnbwgABBGeDd-kW4lwmWAnZ2NMWLQkNW-RmG1m1rcVApX7e4r-N0mmozsNT7PK0tU5lcPsreZI Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 937e361ce901423a958ae619d74c6369 Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:02.736359 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_937e361ce901423a958ae619d74c6369", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/937e361ce901423a958ae619d74c6369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/937e361ce901423a958ae619d74c6369"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/937e361ce901423a958ae619d74c6369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 937e361ce901423a958ae619d74c6369 Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminTestJSON-362400867-project-admin Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 74d6cb950d4e4bf0ae32a4be90617aaf Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminTestJSON-362400867-project-admin Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: exception: Aggregate 7 could not be found. Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7'} Oct 16 01:01:02.738810 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.743504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.748739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e544d0f0-09a2-4fa2-8f12-1927655d8f47 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:02.750118 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e544d0f0-09a2-4fa2-8f12-1927655d8f47 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.014449 Oct 16 01:01:02.750118 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 112/209] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:01:02 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:01:02.750118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e84110d-23b0-48ff-b74c-929e1123da06 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.767242 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e84110d-23b0-48ff-b74c-929e1123da06 tempest-AggregatesAdminTestV241-891230458 tempest-AggregatesAdminTestV241-891230458-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.026881 Oct 16 01:01:02.767867 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 113/210] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Oct 16 01:01:02 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:02.788800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f0c2e60-32b3-48eb-8069-f7afaa3c114f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Calling method '.version_select at 0x7fd64f117550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.872121 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:02.883204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:02.884997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:02.886419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-84923b7d-b2e0-422e-86cd-ff4a3fd0cce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1361 microversion: 2.25 time: 0.214703 Oct 16 01:01:02.895670 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 98/211] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:02 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:02.906709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d0da4c2-9d9e-4c81-8cbb-711e6ea65c28 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.915656 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=80,nova_api:DELETE=14,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:02.923401 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9d0da4c2-9d9e-4c81-8cbb-711e6ea65c28 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d0da4c2-9d9e-4c81-8cbb-711e6ea65c28 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Request method failure captured: Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eYTroCwZ31RRjSjDV8MfcZXBRAhRPFtGwEPNgdwpDirV_cYq3Qfb23s2eTneebc341xVnxmzS4SgW1exZp3lBMcXwa9aPqhWXbYjnbwgABBGeDd-kW4lwmWAnZ2NMWLQkNW-RmG1m1rcVApX7e4r-N0mmozsNT7PK0tU5lcPsreZI Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 937e361ce901423a958ae619d74c6369 Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:01:02.926860 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_937e361ce901423a958ae619d74c6369", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/937e361ce901423a958ae619d74c6369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/937e361ce901423a958ae619d74c6369"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/937e361ce901423a958ae619d74c6369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 937e361ce901423a958ae619d74c6369 Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-362400867 Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AggregatesAdminTestJSON-362400867-project-admin Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 74d6cb950d4e4bf0ae32a4be90617aaf Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AggregatesAdminTestJSON-362400867-project-admin Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: exception: Aggregate 7 could not be found. Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7'} Oct 16 01:01:02.928326 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:02.929267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:02.930588 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:02.932785 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:02.932785 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:02.932785 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:02.932785 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 16 01:01:02.932785 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:02.934116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d0da4c2-9d9e-4c81-8cbb-711e6ea65c28 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:02.936447 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d0da4c2-9d9e-4c81-8cbb-711e6ea65c28 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.037354 Oct 16 01:01:02.937240 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 99/212] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:01:02.944469 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1bf7da75-c18d-41b7-81f2-b04def94773e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-974854044"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:02.948077 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f0c2e60-32b3-48eb-8069-f7afaa3c114f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/2834cc00471d467e997d8df2ff2dc3a0" status: 200 len: 371 microversion: 2.1 time: 0.178819 Oct 16 01:01:02.949181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.aggregate [None req-1bf7da75-c18d-41b7-81f2-b04def94773e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid ee781dbb-93ff-49e2-881d-aa02e3c6e8e8 for aggregate {{(pid=120546) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:02.955590 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 114/213] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:01:02 2022] GET /compute/v2.1/os-quota-sets/2834cc00471d467e997d8df2ff2dc3a0 => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:02.965327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5de2565a-4aa3-4ae3-9b84-6387f26646ac tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1264819012"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:02.969280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-5de2565a-4aa3-4ae3-9b84-6387f26646ac tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid 487b896f-4d58-403b-8607-db99a2eb39d9 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:02.978412 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1bf7da75-c18d-41b7-81f2-b04def94773e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.039705 Oct 16 01:01:02.979117 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 100/214] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:02.987793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:02.994503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:03.012707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.013999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.014454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.016314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.016790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.019261 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5de2565a-4aa3-4ae3-9b84-6387f26646ac tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055798 Oct 16 01:01:03.019527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.020348 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 115/215] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:03.023906 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:03.029675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-036be830-f57c-41e8-b930-1a8810ab0a01 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:03.056698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-036be830-f57c-41e8-b930-1a8810ab0a01 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.057620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-036be830-f57c-41e8-b930-1a8810ab0a01 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.058350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-036be830-f57c-41e8-b930-1a8810ab0a01 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.297971 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-036be830-f57c-41e8-b930-1a8810ab0a01 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.276369 Oct 16 01:01:03.298901 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 116/216] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:01:03 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:03.303607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2de09c8c-5a47-4459-b59f-618f053b0fc7 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:03.327479 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2de09c8c-5a47-4459-b59f-618f053b0fc7 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.026598 Oct 16 01:01:03.334575 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 117/217] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:01:03 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:03.361480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:03.362962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:03.385081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.385639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.386113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.387052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.391123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.391701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.392463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:03.406663 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51ec72e7-43e4-4da2-956d-d8002af329a7 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1323 microversion: 2.1 time: 0.424471 Oct 16 01:01:03.407497 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 101/218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:02 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:03.421777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-228bda94-15ad-4bb2-85f8-cae1397572f4 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Calling method '.version_select at 0x7fd64f06de50>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:03.537885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:03.577405 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f7a4d63c-04e4-4c86-ae54-96775ddca146 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1334 microversion: 2.1 time: 0.246206 Oct 16 01:01:03.591338 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 118/219] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:03 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1334 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:03.591338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-120d5e6d-6d76-43e1-b905-114c920ad997 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:03.607184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120d5e6d-6d76-43e1-b905-114c920ad997 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.607786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120d5e6d-6d76-43e1-b905-114c920ad997 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.608309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120d5e6d-6d76-43e1-b905-114c920ad997 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.634924 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-120d5e6d-6d76-43e1-b905-114c920ad997 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] HTTP exception thrown: Aggregate 8 already has host n-h1-master-1. Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-120d5e6d-6d76-43e1-b905-114c920ad997 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Request method failure captured: Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 39 Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYEhthV3-MwOZ01jypGxI1wl3zVJaumx2WEDWOG9uq0LeSxk10dJ5QvTXN9dMpILKzIjwgaE-5kQOJ66odRS1q3W1GkhnZkWvbCV7x5gQkxMuCv1x5gECOQON4Lpi8Tr2A771OTMfLsjBQsDq1pyU7Mj0jxK_BoMTVEq1sFGMq5t4 Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:03.654036 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6457daceb34f434f8fb5e4e54953cf9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 62f80d17179149ac98c6137089aaa9f4 Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: {"add_host": {"host": "n-h1-master-1"}} Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:03.655286 n-d-master-1 devstack@n-api.service[120545]: exception: Aggregate 8 already has host n-h1-master-1. Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result.read() Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:01:03.656085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-master-1-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi session.flush() Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 01:01:03.657123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 01:01:03.658204 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:01:03.661088 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result.read() Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-master-1-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 16, 1, 1, 3, 626069), 'updated_at': None, 'host': 'n-h1-master-1', 'aggregate_id': 8}] Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:03.662248 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 8 already has host n-h1-master-1. Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.663483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 8 already has host n-h1-master-1. Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:03.668758 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:03.671879 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 already has host n-h1-master-1. Oct 16 01:01:03.671879 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:03.671879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-120d5e6d-6d76-43e1-b905-114c920ad997 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Returning 409 to user: Aggregate 8 already has host n-h1-master-1. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:03.673669 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-120d5e6d-6d76-43e1-b905-114c920ad997 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/8/action" status: 409 len: 95 microversion: 2.1 time: 0.084813 Oct 16 01:01:03.675293 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 119/220] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:01:03 2022] POST /compute/v2.1/os-aggregates/8/action => generated 95 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 16 01:01:03.684472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d6945f3-c55f-4ca5-bc38-61d86285fb05 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:03.719221 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d6945f3-c55f-4ca5-bc38-61d86285fb05 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.038027 Oct 16 01:01:03.720065 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 120/221] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:01:03 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:03.725102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c8970a9a-4928-4158-a9fe-c3738c0e00b1 req-6aa4bf9e-f2d0-4ee0-94f8-a3011367a1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8eb156b-c5ff-4581-a5db-bdf211e6485f", "name": "network-vif-plugged", "status": "completed", "tag": "3c862dac-e606-4f6a-b62e-dd863ceedecd"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:03.736875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8970a9a-4928-4158-a9fe-c3738c0e00b1 req-6aa4bf9e-f2d0-4ee0-94f8-a3011367a1ac service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.737858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8970a9a-4928-4158-a9fe-c3738c0e00b1 req-6aa4bf9e-f2d0-4ee0-94f8-a3011367a1ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.738514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8970a9a-4928-4158-a9fe-c3738c0e00b1 req-6aa4bf9e-f2d0-4ee0-94f8-a3011367a1ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.750283 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c8970a9a-4928-4158-a9fe-c3738c0e00b1 req-6aa4bf9e-f2d0-4ee0-94f8-a3011367a1ac service nova] Creating event network-vif-plugged:3c862dac-e606-4f6a-b62e-dd863ceedecd for instance a8eb156b-c5ff-4581-a5db-bdf211e6485f on n-h1-master-1 Oct 16 01:01:03.756289 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c8970a9a-4928-4158-a9fe-c3738c0e00b1 req-6aa4bf9e-f2d0-4ee0-94f8-a3011367a1ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034869 Oct 16 01:01:03.757464 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 121/222] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:03.764944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:03.766113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:03.775746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.776455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.777102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.778023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.778684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.779347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:03.871906 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-228bda94-15ad-4bb2-85f8-cae1397572f4 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/a5680c7462944e9fa9887d076c380ec2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.463315 Oct 16 01:01:03.872514 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 102/223] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:01:03 2022] GET /compute/v2.1/os-quota-sets/a5680c7462944e9fa9887d076c380ec2/defaults => generated 371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:03.878833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed290c04-8643-472c-b931-c5faa075b7f1 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:03.891700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed290c04-8643-472c-b931-c5faa075b7f1 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:03.892631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed290c04-8643-472c-b931-c5faa075b7f1 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:03.893055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed290c04-8643-472c-b931-c5faa075b7f1 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:04.186938 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed290c04-8643-472c-b931-c5faa075b7f1 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.312774 Oct 16 01:01:04.189585 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 103/224] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Oct 16 01:01:03 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:04.202075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b70754e4-eedd-4f8d-8c96-4dfce19bbf96 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:04.210334 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b70754e4-eedd-4f8d-8c96-4dfce19bbf96 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.019681 Oct 16 01:01:04.218095 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 104/225] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:01:04 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:04.225353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:04.226405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:04.234736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:04.235850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:04.236511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:04.237978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:04.239071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:04.240047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:04.564549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:04.574710 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8887e1af-ffe5-44d2-b3c2-22a1cb2dc55a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1472 microversion: 2.1 time: 0.815829 Oct 16 01:01:04.575634 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 122/226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:03 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1472 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:04.580651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65946951-3b97-40f4-b9da-8a2b391b5b53 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:04.611315 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65946951-3b97-40f4-b9da-8a2b391b5b53 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.034411 Oct 16 01:01:04.619796 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 123/227] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:04 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:04.625719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-846eb153-4c12-4daf-80c6-0f314d5b8621 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:04.658526 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-846eb153-4c12-4daf-80c6-0f314d5b8621 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.037002 Oct 16 01:01:04.663722 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 124/228] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:04 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:04.673126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:04.673699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-693f9122-8208-43b7-85a8-c17a9933150e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Action: 'update', calling method: .version_select at 0x7fd64edaea60>, body: {"quota_set": {"ram": "5120"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:04.686123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:04.687800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:04.689306 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-feb2e5d4-cca4-4297-8078-2abea6f876ea tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1557 microversion: 2.25 time: 0.469838 Oct 16 01:01:04.690028 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 105/229] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:04 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1557 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:04.696645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:04.697506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:04.704031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:04.704849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:04.705573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:04.707847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:04.708770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:04.709352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:04.969644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:04.969788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-693f9122-8208-43b7-85a8-c17a9933150e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:04.973117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-693f9122-8208-43b7-85a8-c17a9933150e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:04.973626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-693f9122-8208-43b7-85a8-c17a9933150e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:04.974446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-693f9122-8208-43b7-85a8-c17a9933150e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:04.978424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-693f9122-8208-43b7-85a8-c17a9933150e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:04.979033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-693f9122-8208-43b7-85a8-c17a9933150e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:04.982541 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35d1cdce-bb14-45bc-b0bb-32cc20fb58f9 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1323 microversion: 2.1 time: 0.291250 Oct 16 01:01:04.983633 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 106/230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:04 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:05.007497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:05.010452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:05.024287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.025030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.025581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.026415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.028713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.029382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.061194 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-693f9122-8208-43b7-85a8-c17a9933150e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/3d4186673bdf4f7fb86c2a95a8d44ae0" status: 200 len: 328 microversion: 2.1 time: 0.395377 Oct 16 01:01:05.061830 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 125/231] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:04 2022] PUT /compute/v2.1/os-quota-sets/3d4186673bdf4f7fb86c2a95a8d44ae0 => generated 328 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:05.067834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f7402be8-b338-4809-b138-8ffbbd154a7a tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1096341859"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:05.072267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-f7402be8-b338-4809-b138-8ffbbd154a7a tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid 9f18dc83-1fef-4013-9d9f-d62f5d414d02 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:05.098202 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f7402be8-b338-4809-b138-8ffbbd154a7a tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.034317 Oct 16 01:01:05.099449 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 126/232] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:05.104800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d6ad5e2-71e1-4aef-8eef-d1af75086e00 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-715993120", "availability_zone": "tempest-test_az-814258319"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:05.109089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-8d6ad5e2-71e1-4aef-8eef-d1af75086e00 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid 77678e09-7ea1-4667-a69c-27b5b63d0654 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:05.138966 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d6ad5e2-71e1-4aef-8eef-d1af75086e00 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.037610 Oct 16 01:01:05.140121 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 127/233] 10.222.0.39 () {60 vars in 1165 bytes} [Sun Oct 16 01:01:05 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:05.199791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:05.217413 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2e57884b-542c-4c5e-8ab3-b47576b08927 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1389 microversion: 2.1 time: 0.232052 Oct 16 01:01:05.218781 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 107/234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:04 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1389 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:05.226430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3bcb8237-8890-4347-9b94-6b98e000fde5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Calling method '.version_select at 0x7fd64f22a550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:05.289126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:05.289736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:05.297755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.298387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.298889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.300146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.300757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.301283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.458300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid ac0a075a-d3cd-41c7-bf45-14b134b9edbc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:05.500234 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=39 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:05.505226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bcb8237-8890-4347-9b94-6b98e000fde5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.505705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bcb8237-8890-4347-9b94-6b98e000fde5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.506137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bcb8237-8890-4347-9b94-6b98e000fde5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.506859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bcb8237-8890-4347-9b94-6b98e000fde5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.507343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bcb8237-8890-4347-9b94-6b98e000fde5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.507763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bcb8237-8890-4347-9b94-6b98e000fde5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.525211 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5bbefcb9-aa44-4cc4-a15b-3197f7734e29 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 2049 microversion: 2.25 time: 0.383840 Oct 16 01:01:05.527532 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3bcb8237-8890-4347-9b94-6b98e000fde5 tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/3d4186673bdf4f7fb86c2a95a8d44ae0/detail" status: 200 len: 916 microversion: 2.1 time: 0.307473 Oct 16 01:01:05.539084 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 128/235] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:05 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 2049 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:05.541127 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 108/236] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:01:05 2022] GET /compute/v2.1/os-quota-sets/3d4186673bdf4f7fb86c2a95a8d44ae0/detail => generated 916 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:05.554943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3ef5467-1962-4337-9636-16762721eb94 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-715993120_new", "availability_zone": "tempest-test_az-814258319_new"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:05.704122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3ef5467-1962-4337-9636-16762721eb94 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.705974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3ef5467-1962-4337-9636-16762721eb94 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.707404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3ef5467-1962-4337-9636-16762721eb94 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.744440 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3ef5467-1962-4337-9636-16762721eb94 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 334 microversion: 2.1 time: 0.201797 Oct 16 01:01:05.745276 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 109/237] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Oct 16 01:01:05 2022] PUT /compute/v2.1/os-aggregates/11 => generated 334 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:05.751149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:05.753948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:05.761049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.761536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.761970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.762806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.763327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.763742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.872413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d01c2dee-4a44-419f-a8c3-c3d19928a159 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:05.880120 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d01c2dee-4a44-419f-a8c3-c3d19928a159 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '782a58482ac54dfbbae0e71cd1c76b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fc95edb31e4dfaa01af9203dad7289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d01c2dee-4a44-419f-a8c3-c3d19928a159 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Request method failure captured: Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 39 Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eWF4pTSOPz8aXWYlGX_ou4GfirA19Tw79cNNZZ__Q40ZMr7wrnzXXhm889fM2mnvVZwFpmLIkyIxqo6nITLN-BGcwf6rwVGggpDVr7iNPivleJoRRqyjagcjeGb6fUmFwDIXFXPpo_f2ApCzsC1p-oz21lUCMGJVcpKlo-pZ_bSHQ Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:05.882192 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09fc95edb31e4dfaa01af9203dad7289", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 782a58482ac54dfbbae0e71cd1c76b7a Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: {"add_host": {"host": "n-h1-master-1"}} Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:05.883668 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-master-1'}}} Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:05.884516 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 16 01:01:05.885850 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:05.888781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d01c2dee-4a44-419f-a8c3-c3d19928a159 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:05.890097 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d01c2dee-4a44-419f-a8c3-c3d19928a159 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.347299 Oct 16 01:01:05.891684 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 129/238] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:01:05 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 351 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:05.898800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:05.899669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:05.908782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.910731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.911399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:05.912392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:05.912997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:05.913482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.190023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid ac0a075a-d3cd-41c7-bf45-14b134b9edbc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:06.209754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:06.219464 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-627f7d5b-23d9-4ce5-a6cd-52030d8e35bc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1472 microversion: 2.1 time: 0.326508 Oct 16 01:01:06.220618 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 130/239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:05 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1472 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:06.226013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e3f272b-da28-4658-b8ee-f4fd53ccbc9d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.243668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e3f272b-da28-4658-b8ee-f4fd53ccbc9d tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 552 microversion: 2.1 time: 0.021924 Oct 16 01:01:06.245129 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 131/240] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:01:06 2022] GET /compute/v2.1/os-aggregates => generated 552 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:06.249979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Action: 'update', calling method: .version_select at 0x7fd64edae5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:06.290001 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-31a5dd13-cdb0-45af-be4c-4a8052fc387d tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 2049 microversion: 2.25 time: 0.543471 Oct 16 01:01:06.290594 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 110/241] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:05 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 2049 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:06.304908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e0f6db58-c348-4f37-921b-11748a44e3ee tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.335932 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e0f6db58-c348-4f37-921b-11748a44e3ee tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.034693 Oct 16 01:01:06.342959 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 111/242] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:06 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:06.353489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.354755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:06.363190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.363954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.364578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.365680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.366326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.367008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.593758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:06.610448 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed30f382-39b1-478d-9f6f-d0143d0dc589 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1471 microversion: 2.1 time: 0.265669 Oct 16 01:01:06.611556 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 112/243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:06 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:06.615685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.616487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.617131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.618333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.618904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.619461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.619989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.620740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:06.628239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.629049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.629655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.630369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.630797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.631257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.699361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.700057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.700483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.701352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.701811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.702230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.784517 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:06.797506 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-09860aeb-edd3-44dd-903a-c3aafea6d8ba tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/3d4186673bdf4f7fb86c2a95a8d44ae0?user_id=b4f1506fa73a49d6ac91d18c5753094e" status: 200 len: 328 microversion: 2.1 time: 0.550674 Oct 16 01:01:06.799116 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 132/244] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:01:06 2022] PUT /compute/v2.1/os-quota-sets/3d4186673bdf4f7fb86c2a95a8d44ae0?user_id=b4f1506fa73a49d6ac91d18c5753094e => generated 328 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:06.811267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0af0b50-2946-4d1e-ba5f-a317c0634bac tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.837584 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0af0b50-2946-4d1e-ba5f-a317c0634bac tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.035986 Oct 16 01:01:06.838737 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 133/245] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:06 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:06.844255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ece457c-b693-4a3a-8a49-cb1c1c9d4079 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.848239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ece457c-b693-4a3a-8a49-cb1c1c9d4079 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.848913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ece457c-b693-4a3a-8a49-cb1c1c9d4079 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.849680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ece457c-b693-4a3a-8a49-cb1c1c9d4079 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.851074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ece457c-b693-4a3a-8a49-cb1c1c9d4079 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.851600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ece457c-b693-4a3a-8a49-cb1c1c9d4079 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.852226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ece457c-b693-4a3a-8a49-cb1c1c9d4079 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.892946 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3ece457c-b693-4a3a-8a49-cb1c1c9d4079 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052269 Oct 16 01:01:06.894687 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 134/246] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Oct 16 01:01:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:06.903416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89eeda16-a342-41f8-8062-ae539b7093fa tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1867513774"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:06.907118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-89eeda16-a342-41f8-8062-ae539b7093fa tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid 181ee16f-8aee-42d4-8e5c-537e26e6a813 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:06.935779 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89eeda16-a342-41f8-8062-ae539b7093fa tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039575 Oct 16 01:01:06.938883 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 135/247] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:06.947821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1092de10-bec7-4949-a50a-e08bbd966fab req-58c09135-6d3d-461b-9bd7-f00d792fd981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147c7739-d5f8-4098-b0a8-837bb131c35c", "tag": "760555cd-9c65-4320-ac61-a2a8e720b843"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:06.958010 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:06.976114 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f2d09f13-75f6-419e-92a1-022f6f4e8e0a tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1389 microversion: 2.1 time: 0.360542 Oct 16 01:01:06.977750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 113/248] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:06 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1389 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:06.980932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1092de10-bec7-4949-a50a-e08bbd966fab req-58c09135-6d3d-461b-9bd7-f00d792fd981 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.981473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1092de10-bec7-4949-a50a-e08bbd966fab req-58c09135-6d3d-461b-9bd7-f00d792fd981 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.984557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:06.984703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1092de10-bec7-4949-a50a-e08bbd966fab req-58c09135-6d3d-461b-9bd7-f00d792fd981 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.985066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:06.992733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.993504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.994085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:06.995058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:06.995659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:06.996518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.004158 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1092de10-bec7-4949-a50a-e08bbd966fab req-58c09135-6d3d-461b-9bd7-f00d792fd981 service nova] Creating event network-changed:760555cd-9c65-4320-ac61-a2a8e720b843 for instance 147c7739-d5f8-4098-b0a8-837bb131c35c on n-h1-master-1 Oct 16 01:01:07.009106 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1092de10-bec7-4949-a50a-e08bbd966fab req-58c09135-6d3d-461b-9bd7-f00d792fd981 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067314 Oct 16 01:01:07.009845 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 136/249] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:07.014744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9631ad48-5893-4d00-8de5-23223ef30e1f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Calling method '.version_select at 0x7fd64edb7430>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:07.073967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Request method failure captured: Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f/diagnostics HTTP/1.1 Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e46avmFDhTncOe_HdUzwZdoaBKgD56USrxZtxwfJja3pGvSbluNSqqL1svpM3OlKWb4zEPXRSGfRE_9lNDt-Nsh2JgRIDNfh-jlfE8byQip_qPA4QTMcVy3ZDu9QZod5my714Ksujf7l0wpHTyRV7E8MFS3gCpgM1TBhoEfdcOg2g Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 9500f36a03e342caa2c0073b801da342 Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1661522824 Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:01:07.076474 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9500f36a03e342caa2c0073b801da342", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9500f36a03e342caa2c0073b801da342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9500f36a03e342caa2c0073b801da342"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9500f36a03e342caa2c0073b801da342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1661522824 Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 9500f36a03e342caa2c0073b801da342 Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1661522824 Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerDiagnosticsNegativeTest-1661522824-project Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 83743824a8004cec9913f112e21f319e Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1661522824-project Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:07.077646 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': 'a8eb156b-c5ff-4581-a5db-bdf211e6485f'} Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:07.078254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.079362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:07.080323 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d3ddfad8-1b28-4024-b559-d3f168416d70 tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.099397 Oct 16 01:01:07.080323 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 114/250] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:01:06 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f/diagnostics => generated 117 bytes in 101 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:07.086147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3fb52d89-2973-4d27-9535-625ca47062e5 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-659585593"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:07.091072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.aggregate [None req-3fb52d89-2973-4d27-9535-625ca47062e5 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Generated uuid f24638df-6272-4c96-9f5a-5dcaeeca90d2 for aggregate {{(pid=120546) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:07.123853 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3fb52d89-2973-4d27-9535-625ca47062e5 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042726 Oct 16 01:01:07.125043 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 115/251] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:07.131524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:07.134409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:07.143534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.144033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.144700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.145910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.146952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.147674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.232568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'flavor' on Instance uuid ac0a075a-d3cd-41c7-bf45-14b134b9edbc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:07.294138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Going to try to live migrate instance to n-h1-master-1 {{(pid=120546) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:01:07.312963 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9631ad48-5893-4d00-8de5-23223ef30e1f tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/3d4186673bdf4f7fb86c2a95a8d44ae0?user_id=b4f1506fa73a49d6ac91d18c5753094e" status: 200 len: 370 microversion: 2.1 time: 0.301603 Oct 16 01:01:07.314167 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 137/252] 10.222.0.39 () {58 vars in 1323 bytes} [Sun Oct 16 01:01:07 2022] GET /compute/v2.1/os-quota-sets/3d4186673bdf4f7fb86c2a95a8d44ae0?user_id=b4f1506fa73a49d6ac91d18c5753094e => generated 370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:07.320114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-457317625"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:07.334637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.335652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.336181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.348467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.348963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.349396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.358075 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-457317625 could not be found. Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Request method failure captured: Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 57 Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYEhthV3-MwOZ01jypGxI1wl3zVJaumx2WEDWOG9uq0LeSxk10dJ5QvTXN9dMpILKzIjwgaE-5kQOJ66odRS1q3W1GkhnZkWvbCV7x5gQkxMuCv1x5gECOQON4Lpi8Tr2A771OTMfLsjBQsDq1pyU7Mj0jxK_BoMTVEq1sFGMq5t4 Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:07.361362 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6457daceb34f434f8fb5e4e54953cf9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 62f80d17179149ac98c6137089aaa9f4 Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: {"add_host": {"host": "tempest-nonexist_host-457317625"}} Oct 16 01:01:07.362692 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: exception: Compute host tempest-nonexist_host-457317625 could not be found. Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-457317625'}}} Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-457317625' is not mapped to any cell Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:07.363440 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 16 01:01:07.364617 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-457317625 could not be found. Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-457317625 could not be found. Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:07.365792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-457317625 could not be found. Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-457317625 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dee2ad8e-ad78-4fb7-982f-cbbd61b7115f tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.047092 Oct 16 01:01:07.367895 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 138/253] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:01:07 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:07.442099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-384140623", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:07.553624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:07.805869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:07.806317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:07.806808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:07.807280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:07.807685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:07.818541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.819084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.819523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.820254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.820709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.821162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.839032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Getting quotas for project 61deedbd92ca45e28838b513114952c8. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:07.843430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Getting quotas for user 7cf9dde9e1de4c7c8592ced74f618bed and project 61deedbd92ca45e28838b513114952c8. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:07.856446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:07.859246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:07.910962 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-112fde54-9c21-4a0b-b3a0-bb596773e214 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545272 Oct 16 01:01:07.911629 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 139/254] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:01:07.916106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:07.916846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:07.923137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.923624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.924196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.924945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:07.925401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:07.925815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:07.955374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:08.053930 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a041c743-0d7e-4fbc-af03-3931f8cd31cc tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 204 len: 0 microversion: 2.1 time: 0.141006 Oct 16 01:01:08.054598 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 140/255] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:07 2022] DELETE /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:08.061121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1090df86-18bd-4cf8-a639-184b89c99371 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.069123 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1090df86-18bd-4cf8-a639-184b89c99371 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.013332 Oct 16 01:01:08.069671 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 141/256] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:01:08 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:08.074190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.074895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:08.081485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.081978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.082642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.083540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.084000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.084426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.261785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:08.270664 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d220f6f1-545a-48ad-b8ac-19f898620244 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.199722 Oct 16 01:01:08.271379 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 142/257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:08 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:08.279055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-924efe5e-f288-4b1b-bde0-2d4293744a91 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.301579 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-924efe5e-f288-4b1b-bde0-2d4293744a91 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.028934 Oct 16 01:01:08.302159 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 143/258] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:08 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:08.307184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cd70de8-64ea-406b-ac31-12939369e80b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Calling method '.version_select at 0x7fd64ed2f670>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.496749 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7cd70de8-64ea-406b-ac31-12939369e80b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/a5680c7462944e9fa9887d076c380ec2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.193472 Oct 16 01:01:08.497528 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 144/259] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:01:08 2022] GET /compute/v2.1/os-quota-sets/a5680c7462944e9fa9887d076c380ec2/defaults => generated 371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:08.507835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.508367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:08.514638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.515157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.515592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.516321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.516733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.517153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.580825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:08.589279 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-11637054-6097-495a-bab3-2fb138984c35 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1215 microversion: 2.1 time: 0.085393 Oct 16 01:01:08.589836 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 145/260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:08 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:08.594214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.594807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:08.600621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.601100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.601526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.602206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.602660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.603117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.741337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:08.749150 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea634c02-0967-4421-8839-3f2f3ea99ae3 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1389 microversion: 2.1 time: 0.158344 Oct 16 01:01:08.749703 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 146/261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:08 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:08.755018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.755712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:08.761975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.762569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.763098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.763900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:08.764430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:08.764923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:08.900253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:08.908034 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-671982ef-fa4d-470b-b20a-73a2c26c3f1e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1477 microversion: 2.1 time: 0.156659 Oct 16 01:01:08.909238 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 147/262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:08 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:08.913478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7778c840-b4eb-40a5-b833-a7edd810b0a1 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:08.933916 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7778c840-b4eb-40a5-b833-a7edd810b0a1 tempest-AggregatesAdminTestJSON-362400867 tempest-AggregatesAdminTestJSON-362400867-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.023740 Oct 16 01:01:08.934535 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 148/263] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:08 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:08.943833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae019267-74f7-402a-abd8-2af7f5d47e28 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae019267-74f7-402a-abd8-2af7f5d47e28 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Request method failure captured: Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 283 Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYEhthV3-MwOZ01jypGxI1wl3zVJaumx2WEDWOG9uq0LeSxk10dJ5QvTXN9dMpILKzIjwgaE-5kQOJ66odRS1q3W1GkhnZkWvbCV7x5gQkxMuCv1x5gECOQON4Lpi8Tr2A771OTMfLsjBQsDq1pyU7Mj0jxK_BoMTVEq1sFGMq5t4 Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:08.947667 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6457daceb34f434f8fb5e4e54953cf9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 62f80d17179149ac98c6137089aaa9f4 Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:08.949089 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:01:08.949704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:08.950435 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:08.951670 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:08.952662 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:01:08.952662 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:01:08.952662 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:01:08.952662 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:08.952662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae019267-74f7-402a-abd8-2af7f5d47e28 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:08.953046 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ae019267-74f7-402a-abd8-2af7f5d47e28 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.009630 Oct 16 01:01:08.953046 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 149/264] 10.222.0.39 () {60 vars in 1165 bytes} [Sun Oct 16 01:01:08 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:01:08.954254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-03ef3f4a-b110-40fd-967e-7db3ba09534b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Action: 'update', calling method: .version_select at 0x7fd64f113430>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:09.015370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03ef3f4a-b110-40fd-967e-7db3ba09534b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.015817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03ef3f4a-b110-40fd-967e-7db3ba09534b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.016247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03ef3f4a-b110-40fd-967e-7db3ba09534b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.016964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03ef3f4a-b110-40fd-967e-7db3ba09534b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.017416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03ef3f4a-b110-40fd-967e-7db3ba09534b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.017834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03ef3f4a-b110-40fd-967e-7db3ba09534b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.137078 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=6,nova_api:INSERT=13,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:09.195538 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-03ef3f4a-b110-40fd-967e-7db3ba09534b tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/a5680c7462944e9fa9887d076c380ec2" status: 200 len: 329 microversion: 2.1 time: 0.244855 Oct 16 01:01:09.196349 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 150/265] 10.222.0.39 () {60 vars in 1263 bytes} [Sun Oct 16 01:01:08 2022] PUT /compute/v2.1/os-quota-sets/a5680c7462944e9fa9887d076c380ec2 => generated 329 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:09.207783 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:09.208267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:09.213935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.215256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.215707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.216391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.216842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.217259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.219788 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:09.233016 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] HTTP exception thrown: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Request method failure captured: Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 HTTP/1.1 Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eV-Rg8_aAXoFAF1LoTk66i7dAU7K2ptuC9oFfG5RatvUSJiGO3pY54fp1_hr0XLc45pQRDf08vdxqvdapop7LgX6VhonEJKDYi7_XJcfy1B--9Hb98Bf76YqJNH02UqSYRoYUd-YDs-UheVlT2ynYnwwB2jxWqx2-efCtrWFMJED8 Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 4e9880e0613c4f87a00daf04c040edb0 Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:09.234539 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e9880e0613c4f87a00daf04c040edb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 4e9880e0613c4f87a00daf04c040edb0 Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminTestJSON-1020923527-project Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b01de0795d2f472ab35e08f4651c19ae Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminTestJSON-1020923527-project Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: exception: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.236097 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ea237879-35ce-4fb1-a360-a421f412d960'} Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:09.236908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.238257 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.239786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Returning 404 to user: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:09.239786 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eb61e2de-b364-4828-ba4b-a70ae096b373 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 404 len: 111 microversion: 2.1 time: 0.032316 Oct 16 01:01:09.239786 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 151/266] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:09 2022] DELETE /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:09.241348 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a08d03f-6771-4b39-a4da-751ec287f012 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a08d03f-6771-4b39-a4da-751ec287f012 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Request method failure captured: Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 27 Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYEhthV3-MwOZ01jypGxI1wl3zVJaumx2WEDWOG9uq0LeSxk10dJ5QvTXN9dMpILKzIjwgaE-5kQOJ66odRS1q3W1GkhnZkWvbCV7x5gQkxMuCv1x5gECOQON4Lpi8Tr2A771OTMfLsjBQsDq1pyU7Mj0jxK_BoMTVEq1sFGMq5t4 Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:09.244798 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6457daceb34f434f8fb5e4e54953cf9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 62f80d17179149ac98c6137089aaa9f4 Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: {"aggregate": {"name": ""}} Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:09.246375 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi '' Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:09.247301 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:01:09.249965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.253269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a08d03f-6771-4b39-a4da-751ec287f012 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:09.253269 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9a08d03f-6771-4b39-a4da-751ec287f012 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008825 Oct 16 01:01:09.253269 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 152/267] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:09 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:01:09.253269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-41cdbf8b-f6be-4d26-b28a-2d40bd3c0f6e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ed2f790>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:09.325916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdbf8b-f6be-4d26-b28a-2d40bd3c0f6e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.326658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdbf8b-f6be-4d26-b28a-2d40bd3c0f6e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.327597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdbf8b-f6be-4d26-b28a-2d40bd3c0f6e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.328444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdbf8b-f6be-4d26-b28a-2d40bd3c0f6e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.328929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdbf8b-f6be-4d26-b28a-2d40bd3c0f6e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.329357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdbf8b-f6be-4d26-b28a-2d40bd3c0f6e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.643896 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:09.677447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-41cdbf8b-f6be-4d26-b28a-2d40bd3c0f6e tempest-QuotasAdminTestJSON-2116612648 tempest-QuotasAdminTestJSON-2116612648-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/a5680c7462944e9fa9887d076c380ec2" status: 200 len: 329 microversion: 2.1 time: 0.429417 Oct 16 01:01:09.678122 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 153/268] 10.222.0.39 () {60 vars in 1263 bytes} [Sun Oct 16 01:01:09 2022] PUT /compute/v2.1/os-quota-sets/a5680c7462944e9fa9887d076c380ec2 => generated 329 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:09.683400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:09.686098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] [instance: ea237879-35ce-4fb1-a360-a421f412d960] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:09.694508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.695181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.695742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.697023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.697589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.698137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.722646 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] HTTP exception thrown: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Request method failure captured: Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 HTTP/1.1 Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eV-Rg8_aAXoFAF1LoTk66i7dAU7K2ptuC9oFfG5RatvUSJiGO3pY54fp1_hr0XLc45pQRDf08vdxqvdapop7LgX6VhonEJKDYi7_XJcfy1B--9Hb98Bf76YqJNH02UqSYRoYUd-YDs-UheVlT2ynYnwwB2jxWqx2-efCtrWFMJED8 Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 4e9880e0613c4f87a00daf04c040edb0 Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:09.723861 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e9880e0613c4f87a00daf04c040edb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e9880e0613c4f87a00daf04c040edb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 4e9880e0613c4f87a00daf04c040edb0 Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1020923527 Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminTestJSON-1020923527-project Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b01de0795d2f472ab35e08f4651c19ae Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminTestJSON-1020923527-project Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: exception: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.725289 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ea237879-35ce-4fb1-a360-a421f412d960'} Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:09.726117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. Oct 16 01:01:09.727502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.728787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] Returning 404 to user: Instance ea237879-35ce-4fb1-a360-a421f412d960 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:09.729637 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e7f7016-4ed9-4107-b573-19c940ddbe68 tempest-AggregatesAdminTestJSON-1020923527 tempest-AggregatesAdminTestJSON-1020923527-project] 10.222.0.39 "GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960" status: 404 len: 111 microversion: 2.1 time: 0.050463 Oct 16 01:01:09.734405 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 154/269] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:09 2022] GET /compute/v2.1/servers/ea237879-35ce-4fb1-a360-a421f412d960 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:09.752150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe474401-f0d7-4dc5-aa66-c9fd839c839d tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-989001067"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:09.763040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe474401-f0d7-4dc5-aa66-c9fd839c839d tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '782a58482ac54dfbbae0e71cd1c76b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fc95edb31e4dfaa01af9203dad7289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe474401-f0d7-4dc5-aa66-c9fd839c839d tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Request method failure captured: Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 59 Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eWF4pTSOPz8aXWYlGX_ou4GfirA19Tw79cNNZZ__Q40ZMr7wrnzXXhm889fM2mnvVZwFpmLIkyIxqo6nITLN-BGcwf6rwVGggpDVr7iNPivleJoRRqyjagcjeGb6fUmFwDIXFXPpo_f2ApCzsC1p-oz21lUCMGJVcpKlo-pZ_bSHQ Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:09.765018 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09fc95edb31e4dfaa01af9203dad7289", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 782a58482ac54dfbbae0e71cd1c76b7a Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: {"aggregate": {"name": "tempest-test_aggregate-989001067"}} Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:09.766430 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-989001067'}}} Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:09.767322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:09.769698 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 16 01:01:09.772158 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:09.773187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe474401-f0d7-4dc5-aa66-c9fd839c839d tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:09.774234 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe474401-f0d7-4dc5-aa66-c9fd839c839d tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.038820 Oct 16 01:01:09.775483 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 155/270] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:09 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:09.781787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:09.782667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:09.792583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.793522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.794379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:09.795548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:09.796221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:09.797615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.247165 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:10.259687 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9a462c6d-c198-44e4-94bc-b8829da70d4a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.482955 Oct 16 01:01:10.260754 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 156/271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:09 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:10.275898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:10.276728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:10.290935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.291600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.292437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.293325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.294121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.295099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.414554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:10.422522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eefd8fdf-0cf3-4d2c-a96c-15f4e7aa1598 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1277 microversion: 2.1 time: 0.150555 Oct 16 01:01:10.423132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 157/272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:10 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:10.433556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:10.434768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:10.451417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.452062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.452908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.454066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.454358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.454951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.697437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:10.706352 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcd027a7-f8af-4280-a709-ba708ec900fc tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1389 microversion: 2.1 time: 0.276243 Oct 16 01:01:10.708001 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 158/273] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:10 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1389 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:10.712477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa93e836-430c-46f3-8761-b6704cdc660c tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2105065451"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:10.716370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-aa93e836-430c-46f3-8761-b6704cdc660c tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid 0c9d6015-9189-494f-b9ef-a3a93620b5f8 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:10.745329 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa93e836-430c-46f3-8761-b6704cdc660c tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035735 Oct 16 01:01:10.745953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 159/274] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:10.750753 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:10.751388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:10.759668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.760159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.760579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.761284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.761766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.762181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.797689 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:INSERT=20,nova_api:SELECT=66,nova_api:UPDATE=14 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:10.875237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83743824a8004cec9913f112e21f319e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9500f36a03e342caa2c0073b801da342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:10.890308 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b0c2259-f3f4-4321-8d7f-f8542faa0c1c tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 200 len: 1435 microversion: 2.1 time: 0.143291 Oct 16 01:01:10.904505 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 160/275] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:10 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 1435 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:10.910849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09c85f0c-3641-4e81-89e2-93289967c82b tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2105065451"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:10.926594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-09c85f0c-3641-4e81-89e2-93289967c82b tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid ba7b0077-7c41-43f5-83f5-e88bd168f6ce for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:10.944018 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-09c85f0c-3641-4e81-89e2-93289967c82b tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2105065451 already exists. Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09c85f0c-3641-4e81-89e2-93289967c82b tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Request method failure captured: Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 60 Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYEhthV3-MwOZ01jypGxI1wl3zVJaumx2WEDWOG9uq0LeSxk10dJ5QvTXN9dMpILKzIjwgaE-5kQOJ66odRS1q3W1GkhnZkWvbCV7x5gQkxMuCv1x5gECOQON4Lpi8Tr2A771OTMfLsjBQsDq1pyU7Mj0jxK_BoMTVEq1sFGMq5t4 Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:10.946563 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6457daceb34f434f8fb5e4e54953cf9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 62f80d17179149ac98c6137089aaa9f4 Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: {"aggregate": {"name": "tempest-test_aggregate-2105065451"}} Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:10.947863 n-d-master-1 devstack@n-api.service[120545]: exception: Aggregate tempest-test_aggregate-2105065451 already exists. Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2105065451'}}} Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 16 01:01:10.948565 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2105065451 already exists. Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:10.949613 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2105065451 already exists. Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2105065451 already exists. Oct 16 01:01:10.950691 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:10.953707 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09c85f0c-3641-4e81-89e2-93289967c82b tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2105065451 already exists. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:10.954813 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-09c85f0c-3641-4e81-89e2-93289967c82b tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.048614 Oct 16 01:01:10.960003 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 161/276] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:10 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:01:10.965320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d1e145ad-df09-4651-9be4-2d5d80adfd24 req-202ff7c7-853c-416f-8baa-085876d6b416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8eb156b-c5ff-4581-a5db-bdf211e6485f", "name": "network-vif-deleted", "tag": "3c862dac-e606-4f6a-b62e-dd863ceedecd"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:10.979979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d1e145ad-df09-4651-9be4-2d5d80adfd24 req-202ff7c7-853c-416f-8baa-085876d6b416 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:10.980460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d1e145ad-df09-4651-9be4-2d5d80adfd24 req-202ff7c7-853c-416f-8baa-085876d6b416 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:10.980887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d1e145ad-df09-4651-9be4-2d5d80adfd24 req-202ff7c7-853c-416f-8baa-085876d6b416 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:10.993155 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d1e145ad-df09-4651-9be4-2d5d80adfd24 req-202ff7c7-853c-416f-8baa-085876d6b416 service nova] Creating event network-vif-deleted:3c862dac-e606-4f6a-b62e-dd863ceedecd for instance a8eb156b-c5ff-4581-a5db-bdf211e6485f on n-h1-master-1 Oct 16 01:01:11.000152 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d1e145ad-df09-4651-9be4-2d5d80adfd24 req-202ff7c7-853c-416f-8baa-085876d6b416 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037281 Oct 16 01:01:11.001245 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 162/277] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:11.008364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0b24c823-cff9-4ced-b3ec-6e4504f5c47d tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:11.037907 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0b24c823-cff9-4ced-b3ec-6e4504f5c47d tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.035167 Oct 16 01:01:11.042769 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 163/278] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:11 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:11.050406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d939d08d-8584-4ff3-9364-1b72c2dabaa9 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1882489962"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:11.054321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-d939d08d-8584-4ff3-9364-1b72c2dabaa9 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid a22883e7-4dcf-485d-b587-afc37cfc01f9 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:11.093458 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d939d08d-8584-4ff3-9364-1b72c2dabaa9 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049358 Oct 16 01:01:11.098267 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 164/279] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:11 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:11.112737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-18930d63-62df-4508-96b2-5518494747a1 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:11.116792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-18930d63-62df-4508-96b2-5518494747a1 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '782a58482ac54dfbbae0e71cd1c76b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fc95edb31e4dfaa01af9203dad7289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-18930d63-62df-4508-96b2-5518494747a1 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Request method failure captured: Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eWF4pTSOPz8aXWYlGX_ou4GfirA19Tw79cNNZZ__Q40ZMr7wrnzXXhm889fM2mnvVZwFpmLIkyIxqo6nITLN-BGcwf6rwVGggpDVr7iNPivleJoRRqyjagcjeGb6fUmFwDIXFXPpo_f2ApCzsC1p-oz21lUCMGJVcpKlo-pZ_bSHQ Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:11.120075 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09fc95edb31e4dfaa01af9203dad7289", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 782a58482ac54dfbbae0e71cd1c76b7a Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 16 01:01:11.121255 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '15'} Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:11.121892 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 16 01:01:11.123475 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.126435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-18930d63-62df-4508-96b2-5518494747a1 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:11.127999 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-18930d63-62df-4508-96b2-5518494747a1 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.024129 Oct 16 01:01:11.144557 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 165/280] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:11 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:01:11.154989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6645c7f5-e441-469f-9137-e531df33cced tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:11.198668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6645c7f5-e441-469f-9137-e531df33cced tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.048292 Oct 16 01:01:11.199411 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 166/281] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:11 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:11.211523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ada341d-7c28-4ac1-b2c2-76071c572dee tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:11.244091 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-7ada341d-7c28-4ac1-b2c2-76071c572dee tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ada341d-7c28-4ac1-b2c2-76071c572dee tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Request method failure captured: Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eYEhthV3-MwOZ01jypGxI1wl3zVJaumx2WEDWOG9uq0LeSxk10dJ5QvTXN9dMpILKzIjwgaE-5kQOJ66odRS1q3W1GkhnZkWvbCV7x5gQkxMuCv1x5gECOQON4Lpi8Tr2A771OTMfLsjBQsDq1pyU7Mj0jxK_BoMTVEq1sFGMq5t4 Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:01:11.245994 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6457daceb34f434f8fb5e4e54953cf9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 62f80d17179149ac98c6137089aaa9f4 Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: exception: Aggregate -1 could not be found. Oct 16 01:01:11.247935 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '-1'} Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 16 01:01:11.248751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.250042 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:11.252920 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:11.252920 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:11.252920 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:11.252920 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:11.252920 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 16 01:01:11.252920 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.252920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ada341d-7c28-4ac1-b2c2-76071c572dee tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:11.267415 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ada341d-7c28-4ac1-b2c2-76071c572dee tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.046818 Oct 16 01:01:11.272365 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 167/282] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:11 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:01:11.279878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c618f84e-f10e-408e-b7a2-f3f5976a8df4 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-448264861"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:11.297315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-c618f84e-f10e-408e-b7a2-f3f5976a8df4 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid 44cbcd69-7888-49b6-b50e-4b6be830c492 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:11.340051 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c618f84e-f10e-408e-b7a2-f3f5976a8df4 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064018 Oct 16 01:01:11.343241 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 168/283] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:11.351063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:11.351810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:11.367328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:11.367902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:11.368367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:11.369103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:11.371394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:11.372112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:11.874045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:11.886889 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b99bf667-cd7b-4b0a-9a87-a0d3ceb41b0b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.542526 Oct 16 01:01:11.905987 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 169/284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:11 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:11.918567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-faa35476-6076-4ada-888b-ce3c9e2c6865 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:11.921525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-faa35476-6076-4ada-888b-ce3c9e2c6865 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '782a58482ac54dfbbae0e71cd1c76b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fc95edb31e4dfaa01af9203dad7289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-faa35476-6076-4ada-888b-ce3c9e2c6865 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Request method failure captured: Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1eWF4pTSOPz8aXWYlGX_ou4GfirA19Tw79cNNZZ__Q40ZMr7wrnzXXhm889fM2mnvVZwFpmLIkyIxqo6nITLN-BGcwf6rwVGggpDVr7iNPivleJoRRqyjagcjeGb6fUmFwDIXFXPpo_f2ApCzsC1p-oz21lUCMGJVcpKlo-pZ_bSHQ Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:11.931709 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09fc95edb31e4dfaa01af9203dad7289", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 782a58482ac54dfbbae0e71cd1c76b7a Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 16 01:01:11.933041 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '16'} Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:11.933714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:11.934958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-faa35476-6076-4ada-888b-ce3c9e2c6865 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:11.936019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-faa35476-6076-4ada-888b-ce3c9e2c6865 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] 10.222.0.39 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.024048 Oct 16 01:01:11.939582 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 170/285] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:11 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:11.952023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:11.952765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:11.963921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:11.966997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:11.967619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:11.968393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:11.968861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:11.969378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.191291 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d7163af5-9c24-4871-9aa5-25597ac0b063 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc/action" status: 202 len: 0 microversion: 2.25 time: 5.063301 Oct 16 01:01:12.197209 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 116/286] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:01:07 2022] POST /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc/action => generated 0 bytes in 5071 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:12.205286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:12.208103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:12.217023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.218128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.218774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.220140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.221082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.221884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.457835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:12.468051 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0bfceb8-6399-4407-b7b1-e49b9d795556 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1319 microversion: 2.1 time: 0.527252 Oct 16 01:01:12.468846 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 171/287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:11 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:12.478643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:12.480126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] [instance: a8eb156b-c5ff-4581-a5db-bdf211e6485f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:12.488878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.489995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.489995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.491565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.491565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.491825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.507340 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] HTTP exception thrown: Instance a8eb156b-c5ff-4581-a5db-bdf211e6485f could not be found. Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Request method failure captured: Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f HTTP/1.1 Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1e46avmFDhTncOe_HdUzwZdoaBKgD56USrxZtxwfJja3pGvSbluNSqqL1svpM3OlKWb4zEPXRSGfRE_9lNDt-Nsh2JgRIDNfh-jlfE8byQip_qPA4QTMcVy3ZDu9QZod5my714Ksujf7l0wpHTyRV7E8MFS3gCpgM1TBhoEfdcOg2g Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 9500f36a03e342caa2c0073b801da342 Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1661522824 Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:12.508811 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9500f36a03e342caa2c0073b801da342", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9500f36a03e342caa2c0073b801da342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9500f36a03e342caa2c0073b801da342"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9500f36a03e342caa2c0073b801da342"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1661522824 Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 9500f36a03e342caa2c0073b801da342 Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1661522824 Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerDiagnosticsNegativeTest-1661522824-project Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 83743824a8004cec9913f112e21f319e Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1661522824-project Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: exception: Instance a8eb156b-c5ff-4581-a5db-bdf211e6485f could not be found. Oct 16 01:01:12.510005 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'a8eb156b-c5ff-4581-a5db-bdf211e6485f'} Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8eb156b-c5ff-4581-a5db-bdf211e6485f could not be found. Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:12.510745 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8eb156b-c5ff-4581-a5db-bdf211e6485f could not be found. Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8eb156b-c5ff-4581-a5db-bdf211e6485f could not be found. Oct 16 01:01:12.513509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.514470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] Returning 404 to user: Instance a8eb156b-c5ff-4581-a5db-bdf211e6485f could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:12.514470 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-db702176-3369-4735-a1d7-4759867aa17e tempest-ServerDiagnosticsNegativeTest-1661522824 tempest-ServerDiagnosticsNegativeTest-1661522824-project] 10.222.0.39 "GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f" status: 404 len: 111 microversion: 2.1 time: 0.040452 Oct 16 01:01:12.516591 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 172/288] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:12 2022] GET /compute/v2.1/servers/a8eb156b-c5ff-4581-a5db-bdf211e6485f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:12.530938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc6acb7b-2083-4fa1-b198-132f8426498e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:12.570693 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc6acb7b-2083-4fa1-b198-132f8426498e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.049402 Oct 16 01:01:12.573323 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 173/289] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:12 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:12.579823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:12.581711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:12.591807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.592910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.593565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.594499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.595167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.595771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.665897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:12.678256 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-899c8fbf-47be-42f4-b102-09e664c66982 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1389 microversion: 2.1 time: 0.478620 Oct 16 01:01:12.679641 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 117/290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:12 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1389 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:12.687134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6b0752b-6148-447f-a235-0e5c3899319e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:12.700952 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-a6b0752b-6148-447f-a235-0e5c3899319e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6b0752b-6148-447f-a235-0e5c3899319e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Request method failure captured: Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eYEhthV3-MwOZ01jypGxI1wl3zVJaumx2WEDWOG9uq0LeSxk10dJ5QvTXN9dMpILKzIjwgaE-5kQOJ66odRS1q3W1GkhnZkWvbCV7x5gQkxMuCv1x5gECOQON4Lpi8Tr2A771OTMfLsjBQsDq1pyU7Mj0jxK_BoMTVEq1sFGMq5t4 Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:01:12.703566 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6457daceb34f434f8fb5e4e54953cf9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 62f80d17179149ac98c6137089aaa9f4 Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: exception: Aggregate -1 could not be found. Oct 16 01:01:12.705102 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '-1'} Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.706649 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 16 01:01:12.708173 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.710799 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6b0752b-6148-447f-a235-0e5c3899319e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:12.711952 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a6b0752b-6148-447f-a235-0e5c3899319e tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031101 Oct 16 01:01:12.712610 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 118/291] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:01:12 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:01:12.726350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-51280bc5-47ee-4bae-b38b-d23bab31fcd2 req-be5177c9-25dc-46df-ba69-991dd6b1e6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf069461-fb58-4e25-9e57-ce50a12a2fa6", "tag": "930b99fe-2c88-4d91-af07-e682d5edf840"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:12.742908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51280bc5-47ee-4bae-b38b-d23bab31fcd2 req-be5177c9-25dc-46df-ba69-991dd6b1e6ac service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.744250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51280bc5-47ee-4bae-b38b-d23bab31fcd2 req-be5177c9-25dc-46df-ba69-991dd6b1e6ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.745483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51280bc5-47ee-4bae-b38b-d23bab31fcd2 req-be5177c9-25dc-46df-ba69-991dd6b1e6ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:12.759004 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-51280bc5-47ee-4bae-b38b-d23bab31fcd2 req-be5177c9-25dc-46df-ba69-991dd6b1e6ac service nova] Creating event network-changed:930b99fe-2c88-4d91-af07-e682d5edf840 for instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 on n-h2-master-1 Oct 16 01:01:12.767659 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-51280bc5-47ee-4bae-b38b-d23bab31fcd2 req-be5177c9-25dc-46df-ba69-991dd6b1e6ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045589 Oct 16 01:01:12.769055 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 119/292] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:12.776225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7862802e-eb0c-4d5f-bb19-bea2e02cf06c tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:12.779365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7862802e-eb0c-4d5f-bb19-bea2e02cf06c tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '782a58482ac54dfbbae0e71cd1c76b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fc95edb31e4dfaa01af9203dad7289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7862802e-eb0c-4d5f-bb19-bea2e02cf06c tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Request method failure captured: Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eWF4pTSOPz8aXWYlGX_ou4GfirA19Tw79cNNZZ__Q40ZMr7wrnzXXhm889fM2mnvVZwFpmLIkyIxqo6nITLN-BGcwf6rwVGggpDVr7iNPivleJoRRqyjagcjeGb6fUmFwDIXFXPpo_f2ApCzsC1p-oz21lUCMGJVcpKlo-pZ_bSHQ Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:01:12.781931 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09fc95edb31e4dfaa01af9203dad7289", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 782a58482ac54dfbbae0e71cd1c76b7a Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 16 01:01:12.783501 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:12.784587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 16 01:01:12.785812 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:12.788526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7862802e-eb0c-4d5f-bb19-bea2e02cf06c tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:12.789538 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7862802e-eb0c-4d5f-bb19-bea2e02cf06c tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.019198 Oct 16 01:01:12.799081 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 120/293] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:01:12 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:12.815848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d19da84-319a-4169-ac62-ca19490d6192 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1094788329"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:12.822442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.aggregate [None req-1d19da84-319a-4169-ac62-ca19490d6192 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid bbc566dc-300c-41f0-9f91-2ae18a2dba2a for aggregate {{(pid=120546) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:12.873448 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d19da84-319a-4169-ac62-ca19490d6192 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072225 Oct 16 01:01:12.876654 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 121/294] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:12.900358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7282885-f853-4511-8e63-45b774e956f9 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:12.931383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7282885-f853-4511-8e63-45b774e956f9 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:12.932071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7282885-f853-4511-8e63-45b774e956f9 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:12.933677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7282885-f853-4511-8e63-45b774e956f9 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:13.109348 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:13.148966 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:13.152081 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:13.153760 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c1ed03d9-90a3-40b4-9fd4-d5039dfdfce2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1567 microversion: 2.25 time: 0.579064 Oct 16 01:01:13.169700 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 174/295] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:12 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1567 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:13.193824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:13.195491 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:13.202567 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7282885-f853-4511-8e63-45b774e956f9 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.319019 Oct 16 01:01:13.203754 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 122/296] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:01:12 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:13.215903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ee88dd2-9103-4ce4-8f49-e83139981c87 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:13.220841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0ee88dd2-9103-4ce4-8f49-e83139981c87 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '782a58482ac54dfbbae0e71cd1c76b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fc95edb31e4dfaa01af9203dad7289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ee88dd2-9103-4ce4-8f49-e83139981c87 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Request method failure captured: Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 42 Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eWF4pTSOPz8aXWYlGX_ou4GfirA19Tw79cNNZZ__Q40ZMr7wrnzXXhm889fM2mnvVZwFpmLIkyIxqo6nITLN-BGcwf6rwVGggpDVr7iNPivleJoRRqyjagcjeGb6fUmFwDIXFXPpo_f2ApCzsC1p-oz21lUCMGJVcpKlo-pZ_bSHQ Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:01:13.223130 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09fc95edb31e4dfaa01af9203dad7289", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09fc95edb31e4dfaa01af9203dad7289"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 09fc95edb31e4dfaa01af9203dad7289 Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695 Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 782a58482ac54dfbbae0e71cd1c76b7a Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1230924695-project Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: {"remove_host": {"host": "n-h1-master-1"}} Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:13.224567 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-master-1'}}} Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:13.225474 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 16 01:01:13.226797 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:13.228217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ee88dd2-9103-4ce4-8f49-e83139981c87 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:13.228217 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0ee88dd2-9103-4ce4-8f49-e83139981c87 tempest-AggregatesAdminNegativeTestJSON-1230924695 tempest-AggregatesAdminNegativeTestJSON-1230924695-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.012650 Oct 16 01:01:13.228217 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 123/297] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:01:13 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:01:13.231514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:13.232379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:13.232965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:13.235378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:13.236246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:13.238562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:13.243193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-073fba93-884f-43b5-a998-57572986a077 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:13.296595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-073fba93-884f-43b5-a998-57572986a077 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:13.297159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-073fba93-884f-43b5-a998-57572986a077 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:13.297589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-073fba93-884f-43b5-a998-57572986a077 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:13.468705 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-073fba93-884f-43b5-a998-57572986a077 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.229464 Oct 16 01:01:13.471446 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 124/298] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:01:13 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:13.494048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-3935366d-bae2-44a5-9325-b0638d0c751c req-e6330b29-3a62-4afc-a098-c004ace8c7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147c7739-d5f8-4098-b0a8-837bb131c35c", "name": "network-vif-plugged", "status": "completed", "tag": "760555cd-9c65-4320-ac61-a2a8e720b843"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:13.504913 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:13.512569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3935366d-bae2-44a5-9325-b0638d0c751c req-e6330b29-3a62-4afc-a098-c004ace8c7df service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:13.517469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3935366d-bae2-44a5-9325-b0638d0c751c req-e6330b29-3a62-4afc-a098-c004ace8c7df service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:13.522477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3935366d-bae2-44a5-9325-b0638d0c751c req-e6330b29-3a62-4afc-a098-c004ace8c7df service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:13.551118 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-3935366d-bae2-44a5-9325-b0638d0c751c req-e6330b29-3a62-4afc-a098-c004ace8c7df service nova] Creating event network-vif-plugged:760555cd-9c65-4320-ac61-a2a8e720b843 for instance 147c7739-d5f8-4098-b0a8-837bb131c35c on n-h1-master-1 Oct 16 01:01:13.556845 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-3935366d-bae2-44a5-9325-b0638d0c751c req-e6330b29-3a62-4afc-a098-c004ace8c7df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083874 Oct 16 01:01:13.557502 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 125/299] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:13.564490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98e77b6d-9171-435f-9bef-1174a5cd1efc tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:13.594308 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98e77b6d-9171-435f-9bef-1174a5cd1efc tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.035078 Oct 16 01:01:13.595801 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 126/300] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:13 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:13.621848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:13.623496 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:13.653444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:13.653830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:13.654416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:13.655299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:13.655793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:13.656218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:13.955379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:13.978555 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abf66172-650a-41d6-bade-d088829b355f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.804414 Oct 16 01:01:13.979555 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 175/301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:13 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:14.027612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6d24e02e-11c5-45aa-a5ee-64871490ddd3 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1373641702"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:14.027612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-6d24e02e-11c5-45aa-a5ee-64871490ddd3 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Generated uuid 5bea4458-0f79-4ece-9c33-67eff3672f03 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:01:14.057839 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6d24e02e-11c5-45aa-a5ee-64871490ddd3 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066056 Oct 16 01:01:14.059298 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 176/302] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:01:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:14.075362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:14.080189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:14.087563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:14.088132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:14.089401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:14.090270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:14.090948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:14.091496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:14.300064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:14.323158 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6fe53d51-8d9b-47f4-86d6-8a66437d695b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1319 microversion: 2.1 time: 0.725164 Oct 16 01:01:14.323993 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 127/303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:13 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:14.348785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:14.366741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:14.367274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:14.367714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:14.376697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:14.377263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:14.377878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:14.397596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:14.407715 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ec37075-b3a1-4270-8def-4681ac900e13 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1389 microversion: 2.1 time: 0.346619 Oct 16 01:01:14.410024 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 177/304] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:14 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1389 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:14.413038 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.compute.aggregates [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 16 01:01:14.413647 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Request method failure captured: Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 42 Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1eYEhthV3-MwOZ01jypGxI1wl3zVJaumx2WEDWOG9uq0LeSxk10dJ5QvTXN9dMpILKzIjwgaE-5kQOJ66odRS1q3W1GkhnZkWvbCV7x5gQkxMuCv1x5gECOQON4Lpi8Tr2A771OTMfLsjBQsDq1pyU7Mj0jxK_BoMTVEq1sFGMq5t4 Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:01:14.415870 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6457daceb34f434f8fb5e4e54953cf9b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6457daceb34f434f8fb5e4e54953cf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 6457daceb34f434f8fb5e4e54953cf9b Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776 Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 62f80d17179149ac98c6137089aaa9f4 Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: {"remove_host": {"host": "nonexist_host"}} Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:14.417342 n-d-master-1 devstack@n-api.service[120546]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 16 01:01:14.418073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 16 01:01:14.419168 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.421338 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:14.424052 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:14.424052 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:14.424052 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:14.424052 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:14.424052 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 16 01:01:14.424052 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:14.424052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:14.424052 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a92a68e-96d3-4980-843f-9a83b744dfff tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.073204 Oct 16 01:01:14.425282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:14.425387 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 128/305] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:01:14 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:01:14.425481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:14.426879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d1b5eb77-a81f-4f5b-b6c4-3587dc2a4476 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:14.435788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:14.437588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:14.438123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:14.439179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:14.439886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:14.440931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:14.450532 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d1b5eb77-a81f-4f5b-b6c4-3587dc2a4476 tempest-AggregatesAdminNegativeTestJSON-1540947776 tempest-AggregatesAdminNegativeTestJSON-1540947776-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.027201 Oct 16 01:01:14.459719 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 129/306] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:14 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:01:14.616195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:14.630789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:14.633057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:14.634594 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c3e16069-0078-4cce-afcb-d44e069331cf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1567 microversion: 2.25 time: 0.222953 Oct 16 01:01:14.637301 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 178/307] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:14 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:15.035869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:15.036502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:15.058625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:15.059479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:15.060106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:15.061012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:15.061653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:15.062280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:15.066168 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:15.358442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:15.359935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:15.377419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:15.379291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:15.382939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:15.384045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:15.384808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:15.385496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:15.508864 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:15.629389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:15.638085 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3c1019b1-7a32-46af-82b9-bd383e7ae34c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.606875 Oct 16 01:01:15.639335 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 130/308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:15 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:15.644791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:15.646545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:15.660491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:15.663000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:15.664544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:15.665917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:15.668582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:15.669219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.155748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:16.173319 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:16.183597 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-898cbb97-98bf-4b97-a004-68e8f1fb99b7 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1587 microversion: 2.1 time: 0.543033 Oct 16 01:01:16.188051 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 131/309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:15 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1587 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:16.194131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:16.196422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:16.196971 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7a76bf4b-1836-4d46-9359-ddd0202abb4e tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1319 microversion: 2.1 time: 0.850024 Oct 16 01:01:16.200624 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 179/310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:15 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1319 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:16.224450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.224947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.225383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.226092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.226548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.226997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.531186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38d3bd84-938e-45ce-af60-5f3a28e86e47 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-895983962", "ram": 512, "vcpus": 1, "disk": 10, "id": 66066558, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:16.572034 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-38d3bd84-938e-45ce-af60-5f3a28e86e47 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.369790 Oct 16 01:01:16.585215 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 180/311] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:16.592055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:16.592949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:16.602606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.603721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.605462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.606368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.607088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.607725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.641369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:16.656868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:16.659730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:16.661179 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bbc0e4d4-6916-4e07-9068-8eecba8bc104 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1567 microversion: 2.25 time: 0.471645 Oct 16 01:01:16.662337 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 132/312] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:16 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:16.667669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-deebabec-e963-4243-a2a8-b68dc4fb624e req-69cbc86b-a0e1-4ae9-bf96-b5a1556ce3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0a075a-d3cd-41c7-bf45-14b134b9edbc", "name": "network-vif-unplugged", "status": "completed", "tag": "ba7f5844-fb1b-4a88-a6ae-169867236249"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:16.680280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-deebabec-e963-4243-a2a8-b68dc4fb624e req-69cbc86b-a0e1-4ae9-bf96-b5a1556ce3e3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.684718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-deebabec-e963-4243-a2a8-b68dc4fb624e req-69cbc86b-a0e1-4ae9-bf96-b5a1556ce3e3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.685304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-deebabec-e963-4243-a2a8-b68dc4fb624e req-69cbc86b-a0e1-4ae9-bf96-b5a1556ce3e3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.712169 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-deebabec-e963-4243-a2a8-b68dc4fb624e req-69cbc86b-a0e1-4ae9-bf96-b5a1556ce3e3 service nova] Creating event network-vif-unplugged:ba7f5844-fb1b-4a88-a6ae-169867236249 for instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc on n-h2-master-1 Oct 16 01:01:16.718833 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-deebabec-e963-4243-a2a8-b68dc4fb624e req-69cbc86b-a0e1-4ae9-bf96-b5a1556ce3e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054477 Oct 16 01:01:16.720804 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 133/313] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:16.821824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e4875b9-1760-4714-983b-4bd5f2a60159 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235152 Oct 16 01:01:16.822907 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 181/314] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:01:16 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c/os-interface => generated 284 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:16.828765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b4e9dab5-4f19-4d6c-8446-ecead419f46b tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:16.904116 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b4e9dab5-4f19-4d6c-8446-ecead419f46b tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/66066558/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079807 Oct 16 01:01:16.913279 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 182/315] 10.222.0.39 () {60 vars in 1218 bytes} [Sun Oct 16 01:01:16 2022] POST /compute/v2.1/flavors/66066558/os-extra_specs => generated 66 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:16.921215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:16.922094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:16.932107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.933021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.933564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:16.934694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:16.935399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:16.936099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.101206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9234f39-f554-4ecb-864f-419d4534d39e tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Calling method '.version_select at 0x7fd64ea69d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:17.215094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:17.230292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-275d2dd0-8a11-4e04-94ac-700a8de74ccb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.314221 Oct 16 01:01:17.231344 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 183/316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:16 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:17.402498 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f9234f39-f554-4ecb-864f-419d4534d39e tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 371 microversion: 2.1 time: 0.679050 Oct 16 01:01:17.404324 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 134/317] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:01:16 2022] GET /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 371 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:17.418814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:17.421477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:17.433770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:17.435998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-70b036c5-d9b4-44e1-a92d-40eaea88edf8 tempest-FlavorsExtraSpecsTestJSON-714190724 tempest-FlavorsExtraSpecsTestJSON-714190724-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:17.440535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:17.441369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.443550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:17.444248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:17.444920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.449303 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-70b036c5-d9b4-44e1-a92d-40eaea88edf8 tempest-FlavorsExtraSpecsTestJSON-714190724 tempest-FlavorsExtraSpecsTestJSON-714190724-project] 10.222.0.39 "GET /compute/v2.1/flavors/66066558/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.216107 Oct 16 01:01:17.450093 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 184/318] 10.222.0.39 () {58 vars in 1197 bytes} [Sun Oct 16 01:01:17 2022] GET /compute/v2.1/flavors/66066558/os-extra_specs => generated 66 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:17.466693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed6a49cc-5a9e-4f2d-aef9-fa55db3a2e08 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ed2f430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:17.662452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:17.673792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d116c8b-2859-4be2-9d02-d9a21575db55 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1319 microversion: 2.1 time: 0.261384 Oct 16 01:01:17.676348 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 135/319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:17 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:17.680949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4687c46d-04ad-4883-bc68-5f579652b0bc tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:17.708960 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4687c46d-04ad-4883-bc68-5f579652b0bc tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/66066558/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031325 Oct 16 01:01:17.710250 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 136/320] 10.222.0.39 () {60 vars in 1218 bytes} [Sun Oct 16 01:01:17 2022] POST /compute/v2.1/flavors/66066558/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:17.721186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:17.722620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:17.732424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:17.732928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:17.733364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.734064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:17.734518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:17.734949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.764272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed6a49cc-5a9e-4f2d-aef9-fa55db3a2e08 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:17.767772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed6a49cc-5a9e-4f2d-aef9-fa55db3a2e08 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:17.769874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed6a49cc-5a9e-4f2d-aef9-fa55db3a2e08 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.772826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed6a49cc-5a9e-4f2d-aef9-fa55db3a2e08 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:17.775655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed6a49cc-5a9e-4f2d-aef9-fa55db3a2e08 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:17.776739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed6a49cc-5a9e-4f2d-aef9-fa55db3a2e08 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:17.880211 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ed6a49cc-5a9e-4f2d-aef9-fa55db3a2e08 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 328 microversion: 2.1 time: 0.429120 Oct 16 01:01:17.883497 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 185/321] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:17 2022] PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 328 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:17.890234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-01c90c25-427d-4268-8332-1cb10ed0529c tempest-FlavorsExtraSpecsTestJSON-714190724 tempest-FlavorsExtraSpecsTestJSON-714190724-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:17.919518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:17.927144 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-01c90c25-427d-4268-8332-1cb10ed0529c tempest-FlavorsExtraSpecsTestJSON-714190724 tempest-FlavorsExtraSpecsTestJSON-714190724-project] 10.222.0.39 "GET /compute/v2.1/flavors/66066558/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.041826 Oct 16 01:01:17.929196 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 186/322] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:17 2022] GET /compute/v2.1/flavors/66066558/os-extra_specs/hw:numa_nodes => generated 22 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:17.929605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:17.931962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:17.934636 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6aebf48-b8c5-4b4d-a40e-a54c05d28f66 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1567 microversion: 2.25 time: 0.223135 Oct 16 01:01:17.939259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-298ad0af-fc1f-4757-9211-8a0e8109e403 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:17.949224 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 137/323] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:17 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:17.975761 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=6,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:17.977406 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-298ad0af-fc1f-4757-9211-8a0e8109e403 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/66066558/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042137 Oct 16 01:01:17.978011 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 187/324] 10.222.0.39 () {60 vars in 1218 bytes} [Sun Oct 16 01:01:17 2022] POST /compute/v2.1/flavors/66066558/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:01:17.988103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39212b59-7cb7-4546-9813-86b68306af5e tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:17.996243 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39212b59-7cb7-4546-9813-86b68306af5e tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/66066558/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012263 Oct 16 01:01:17.997306 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 138/325] 10.222.0.39 () {58 vars in 1197 bytes} [Sun Oct 16 01:01:17 2022] GET /compute/v2.1/flavors/66066558/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:18.008573 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78181937-54aa-44e4-91b9-854379b4e2ce tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:18.065279 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78181937-54aa-44e4-91b9-854379b4e2ce tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/66066558/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.061146 Oct 16 01:01:18.066133 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 188/326] 10.222.0.39 () {60 vars in 1259 bytes} [Sun Oct 16 01:01:18 2022] PUT /compute/v2.1/flavors/66066558/os-extra_specs/hw:numa_nodes => generated 22 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:01:18.076591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7560a2f3-1d5a-404f-869f-525e056cdd2f tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.090767 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7560a2f3-1d5a-404f-869f-525e056cdd2f tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/66066558/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019651 Oct 16 01:01:18.092306 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 189/327] 10.222.0.39 () {58 vars in 1197 bytes} [Sun Oct 16 01:01:18 2022] GET /compute/v2.1/flavors/66066558/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:18.106079 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bff0e928-64dd-4c38-8848-1518b208bd52 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.140120 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bff0e928-64dd-4c38-8848-1518b208bd52 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/66066558/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.041110 Oct 16 01:01:18.140703 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 190/328] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:01:18 2022] DELETE /compute/v2.1/flavors/66066558/os-extra_specs/hw:numa_nodes => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 16 01:01:18.151476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa8ca5c8-4f14-4c5d-a5aa-8262d4791edc tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.186322 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa8ca5c8-4f14-4c5d-a5aa-8262d4791edc tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/66066558/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.039195 Oct 16 01:01:18.187864 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 191/329] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:01:18 2022] DELETE /compute/v2.1/flavors/66066558/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 16 01:01:18.197705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-308ac5bb-b415-49ba-81fe-a387ec8b631b tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.208443 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-308ac5bb-b415-49ba-81fe-a387ec8b631b tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/66066558/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016442 Oct 16 01:01:18.209237 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 192/330] 10.222.0.39 () {58 vars in 1197 bytes} [Sun Oct 16 01:01:18 2022] GET /compute/v2.1/flavors/66066558/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:01:18.223170 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9b14b6ec-c2be-4f1e-9c31-72fd68825828 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.231091 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1627608174", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:18.276905 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9b14b6ec-c2be-4f1e-9c31-72fd68825828 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/66066558" status: 202 len: 0 microversion: 2.1 time: 0.059639 Oct 16 01:01:18.278655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 193/331] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:01:18 2022] DELETE /compute/v2.1/flavors/66066558 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:01:18.287710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.288340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:18.312160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.312600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.313031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:18.313914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.314796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.316141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:18.324843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:18.628763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:18.646364 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f02bbf14-cdcd-4999-abbc-c2b9dbf4535a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.367525 Oct 16 01:01:18.649544 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 194/332] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:18 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:18.652647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5b4004a-e339-4b9c-8c41-2d84ce4fb4b5 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.690177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5b4004a-e339-4b9c-8c41-2d84ce4fb4b5 tempest-FlavorsExtraSpecsTestJSON-88609083 tempest-FlavorsExtraSpecsTestJSON-88609083-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.041597 Oct 16 01:01:18.694975 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 195/333] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:01:18 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:18.711556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:18.712542 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:18.713679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:18.714099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:18.714532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:18.736025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.736530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.739143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:18.741540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.742017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.742447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:18.767597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Getting quotas for project 5267a09ec9a540a7a0400700f8bceb80. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:18.772257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Getting quotas for user dd6cb0f17cf24e8cac44ff9ec732146a and project 5267a09ec9a540a7a0400700f8bceb80. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:18.784606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.utils [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] cores quota exceeded for 5267a09ec9a540a7a0400700f8bceb80, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120546) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 16 01:01:18.785433 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Request method failure captured: Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 145 Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fbxCYSouPp-6eal-5VQmE2DtSdvrGcRKHozLfS1OyfHVJGjp8uSDt3Ik4dIsVp55k77SXlMTdiIOmXMPVQJYR7eFNb_-rMDPxLvAh0H6UTLDN0kLrAjFLf1bR-Q5pTpubfvpM-TzgOb6kZhfoh2wmH9UaZysYHxJ5Id2VN8umcXLo Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 5267a09ec9a540a7a0400700f8bceb80 Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:01:18.791428 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5267a09ec9a540a7a0400700f8bceb80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 5267a09ec9a540a7a0400700f8bceb80 Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-QuotasAdminNegativeTest-806501563-project Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: dd6cb0f17cf24e8cac44ff9ec732146a Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-QuotasAdminNegativeTest-806501563-project Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1627608174", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} Oct 16 01:01:18.793396 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1627608174', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452'}}} Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 16 01:01:18.794206 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:18.795445 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:18.798266 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:18.801960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:18.801960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:18.801960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:18.801960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:18.801960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 16 01:01:18.801960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:18.801960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:18.801960 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-72058bd7-b522-4f5b-8108-e760bff021d9 tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.760615 Oct 16 01:01:18.805677 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 139/334] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:18 2022] POST /compute/v2.1/servers => generated 111 bytes in 769 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:18.814883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:18.814883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:18.824913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.825408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.825934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:18.828872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:18.829361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:18.829798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.040295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1824341163", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": "none"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:19.071464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:19.094108 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a1bea60-3304-464d-a38e-dd28bf36031f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1319 microversion: 2.1 time: 0.284481 Oct 16 01:01:19.095214 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 140/335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:18 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:19.105938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e6bba7d5-81f5-47bf-99dc-824bc9c4314a req-78b8a517-df53-41e3-9e12-732464d8e179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0a075a-d3cd-41c7-bf45-14b134b9edbc", "tag": "ba7f5844-fb1b-4a88-a6ae-169867236249"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:19.124472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e6bba7d5-81f5-47bf-99dc-824bc9c4314a req-78b8a517-df53-41e3-9e12-732464d8e179 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.125294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e6bba7d5-81f5-47bf-99dc-824bc9c4314a req-78b8a517-df53-41e3-9e12-732464d8e179 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.125906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e6bba7d5-81f5-47bf-99dc-824bc9c4314a req-78b8a517-df53-41e3-9e12-732464d8e179 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.140822 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e6bba7d5-81f5-47bf-99dc-824bc9c4314a req-78b8a517-df53-41e3-9e12-732464d8e179 service nova] Creating event network-changed:ba7f5844-fb1b-4a88-a6ae-169867236249 for instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc on n-h2-master-1 Oct 16 01:01:19.160364 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e6bba7d5-81f5-47bf-99dc-824bc9c4314a req-78b8a517-df53-41e3-9e12-732464d8e179 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061885 Oct 16 01:01:19.160883 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 141/336] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:19.172674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd539ebc-6d49-4d91-9b6f-e0bc58bb7c23 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ea9a9d0>, body: {"quota_set": {"cores": 20}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:19.177426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:19.177886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:19.178355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:19.178761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:19.179219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:19.198464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.199948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.204012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.204902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.205444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.207219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.233774 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Getting quotas for project 5a5af1e6e5fa46bc9bfa0aa213204ac4. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:19.241803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Getting quotas for user fb4ac632e9e84d6eacd7bb276a93de52 and project 5a5af1e6e5fa46bc9bfa0aa213204ac4. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:19.260712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:19.264319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:19.337482 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a73006b5-d89c-4854-82ad-94fff84016fa tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.645123 Oct 16 01:01:19.339802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 196/337] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:01:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:01:19.347714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:19.348721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:19.357096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.357870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.358584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.365394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.366081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.366887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.826865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:19.829873 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:19.840400 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-63996971-c2c7-461e-8d87-ef8f4d14030f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 200 len: 1587 microversion: 2.1 time: 0.499227 Oct 16 01:01:19.841385 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 197/338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:19 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 1587 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:19.854628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd539ebc-6d49-4d91-9b6f-e0bc58bb7c23 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.855484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd539ebc-6d49-4d91-9b6f-e0bc58bb7c23 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.855957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd539ebc-6d49-4d91-9b6f-e0bc58bb7c23 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.856685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd539ebc-6d49-4d91-9b6f-e0bc58bb7c23 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.857140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd539ebc-6d49-4d91-9b6f-e0bc58bb7c23 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.860910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd539ebc-6d49-4d91-9b6f-e0bc58bb7c23 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.864692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:19.865431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:19.872253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.872755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.873190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.882068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.882649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.884384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.952666 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd539ebc-6d49-4d91-9b6f-e0bc58bb7c23 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 329 microversion: 2.1 time: 0.786041 Oct 16 01:01:19.954162 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 142/339] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:19 2022] PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 329 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:19.959863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5e16c0c5-be4c-4463-9c18-8feaa02df4d3 req-45e5c80b-62bd-4319-b848-b595cfa0f291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147c7739-d5f8-4098-b0a8-837bb131c35c", "tag": "760555cd-9c65-4320-ac61-a2a8e720b843"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:19.972782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5e16c0c5-be4c-4463-9c18-8feaa02df4d3 req-45e5c80b-62bd-4319-b848-b595cfa0f291 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:19.973484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5e16c0c5-be4c-4463-9c18-8feaa02df4d3 req-45e5c80b-62bd-4319-b848-b595cfa0f291 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:19.974066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5e16c0c5-be4c-4463-9c18-8feaa02df4d3 req-45e5c80b-62bd-4319-b848-b595cfa0f291 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:19.991302 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5e16c0c5-be4c-4463-9c18-8feaa02df4d3 req-45e5c80b-62bd-4319-b848-b595cfa0f291 service nova] Creating event network-changed:760555cd-9c65-4320-ac61-a2a8e720b843 for instance 147c7739-d5f8-4098-b0a8-837bb131c35c on n-h1-master-1 Oct 16 01:01:19.997904 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5e16c0c5-be4c-4463-9c18-8feaa02df4d3 req-45e5c80b-62bd-4319-b848-b595cfa0f291 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041768 Oct 16 01:01:19.998670 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 143/340] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:20.015375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-89ccde6f-5a44-4bdc-b15c-aa7f1215b087 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:20.024263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-89ccde6f-5a44-4bdc-b15c-aa7f1215b087 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:20.437236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-89ccde6f-5a44-4bdc-b15c-aa7f1215b087 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:20.445328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-89ccde6f-5a44-4bdc-b15c-aa7f1215b087 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:20.446690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-89ccde6f-5a44-4bdc-b15c-aa7f1215b087 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:20.470498 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-89ccde6f-5a44-4bdc-b15c-aa7f1215b087 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "PUT /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1359 microversion: 2.75 time: 0.470285 Oct 16 01:01:20.472370 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 144/341] 10.222.0.39 () {62 vars in 1297 bytes} [Sun Oct 16 01:01:19 2022] PUT /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1359 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:20.492476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:20.497905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:20.512815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:20.513531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:20.514142 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:20.515055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:20.515704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:20.524673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:20.760667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:20.775494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:20.779025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:20.783494 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ed33030-f5d8-4eaa-b03d-0700d768204a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1567 microversion: 2.25 time: 0.922066 Oct 16 01:01:20.786244 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 198/342] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:19 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1567 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:20.791138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5a94ac5-8032-4bb3-ab01-fd4780cb7037 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Calling method '.version_select at 0x7fd64ed2f670>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:20.931452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:20.956834 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b440c48f-a73d-403e-8316-456e4fe3d3f7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.483120 Oct 16 01:01:20.959882 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 145/343] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:20 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:20.971121 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:20.972165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:20.990040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:20.990565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:20.991109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:20.992000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:20.992462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:20.992934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.214084 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5a94ac5-8032-4bb3-ab01-fd4780cb7037 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 371 microversion: 2.1 time: 0.426293 Oct 16 01:01:21.217127 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 199/344] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:01:20 2022] GET /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 371 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:21.334195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:21.343349 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f17639e4-c034-483d-88e5-82aad2c4c88b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1319 microversion: 2.1 time: 0.380769 Oct 16 01:01:21.344772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 146/345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:20 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:21.355735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-59400c16-537b-457d-9521-3918f424e8a7 req-c90f25f1-4878-4251-b381-55294baf2454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf069461-fb58-4e25-9e57-ce50a12a2fa6", "name": "network-vif-plugged", "status": "completed", "tag": "930b99fe-2c88-4d91-af07-e682d5edf840"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:21.380420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-59400c16-537b-457d-9521-3918f424e8a7 req-c90f25f1-4878-4251-b381-55294baf2454 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.380999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-59400c16-537b-457d-9521-3918f424e8a7 req-c90f25f1-4878-4251-b381-55294baf2454 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.382759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-59400c16-537b-457d-9521-3918f424e8a7 req-c90f25f1-4878-4251-b381-55294baf2454 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.397817 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-59400c16-537b-457d-9521-3918f424e8a7 req-c90f25f1-4878-4251-b381-55294baf2454 service nova] Creating event network-vif-plugged:930b99fe-2c88-4d91-af07-e682d5edf840 for instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 on n-h2-master-1 Oct 16 01:01:21.403604 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-59400c16-537b-457d-9521-3918f424e8a7 req-c90f25f1-4878-4251-b381-55294baf2454 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057254 Oct 16 01:01:21.405075 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 147/346] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:21.412022 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:21.412786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:21.420782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.421335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.421864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.423049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.423780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.424310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.588371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac76c237-2786-4d31-867f-ff58647dc273 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1659873036", "id": 797583897, "os-flavor-access:is_public": "False"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:21.595161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:21.604764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:21.606214 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:21.607930 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac76c237-2786-4d31-867f-ff58647dc273 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.381285 Oct 16 01:01:21.608732 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 200/347] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:21 2022] POST /compute/v2.1/flavors => generated 428 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:21.611715 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-673c5b0d-878b-4a17-9ace-7d0ba787029d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1417 microversion: 2.75 time: 0.205236 Oct 16 01:01:21.612987 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 148/348] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:21 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1417 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:21.613993 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ccdfcce-9c93-4b9a-8d14-c59460c769e0 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ecd6700>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:21.628322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3cbb0dcc-ea7d-414e-b839-771a2186c7ab tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a0d11ee6626d4880a518d6eabf565d84"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:21.702752 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:21.720886 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3cbb0dcc-ea7d-414e-b839-771a2186c7ab tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/797583897/action" status: 200 len: 96 microversion: 2.1 time: 0.096185 Oct 16 01:01:21.722778 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 149/349] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Oct 16 01:01:21 2022] POST /compute/v2.1/flavors/797583897/action => generated 96 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:21.751325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ccdfcce-9c93-4b9a-8d14-c59460c769e0 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.751889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ccdfcce-9c93-4b9a-8d14-c59460c769e0 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.752602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ccdfcce-9c93-4b9a-8d14-c59460c769e0 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.753463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ccdfcce-9c93-4b9a-8d14-c59460c769e0 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.753926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ccdfcce-9c93-4b9a-8d14-c59460c769e0 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.754363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ccdfcce-9c93-4b9a-8d14-c59460c769e0 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.817689 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ccdfcce-9c93-4b9a-8d14-c59460c769e0 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 328 microversion: 2.1 time: 0.207638 Oct 16 01:01:21.818314 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 201/350] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:21 2022] PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 328 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:21.823760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:21.824370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:21.836234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.836717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.837142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.837833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:21.838282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:21.838699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:21.875921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1f872c6-f30d-44fd-a0e0-628b1bc57e43 tempest-FlavorsAccessTestJSON-589579468 tempest-FlavorsAccessTestJSON-589579468-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:21.914879 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1f872c6-f30d-44fd-a0e0-628b1bc57e43 tempest-FlavorsAccessTestJSON-589579468 tempest-FlavorsAccessTestJSON-589579468-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.1 time: 0.186429 Oct 16 01:01:21.915534 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 150/351] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:01:21 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:21.938931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cafdf3e-c6ba-4294-b4e6-70c55283870e tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a0d11ee6626d4880a518d6eabf565d84"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:22.011899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:22.020881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:22.022341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:22.023558 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b152a76-9d55-47bb-8d29-9e1c788d107e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1567 microversion: 2.25 time: 0.204325 Oct 16 01:01:22.024098 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 202/352] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:21 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:22.028672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1914043295", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:22.085439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:22.198563 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2cafdf3e-c6ba-4294-b4e6-70c55283870e tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/797583897/action" status: 200 len: 21 microversion: 2.1 time: 0.262355 Oct 16 01:01:22.198563 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 151/353] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Oct 16 01:01:21 2022] POST /compute/v2.1/flavors/797583897/action => generated 21 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:01:22.203924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:22.204659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:22.211208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.211772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.212337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.213111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.213755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.214185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.348851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:22.349340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:22.349815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:22.350343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:22.350756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:22.361079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.361561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.363266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.364003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.364531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.365200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.383935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Getting quotas for project 5267a09ec9a540a7a0400700f8bceb80. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:22.387813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Getting quotas for user dd6cb0f17cf24e8cac44ff9ec732146a and project 5267a09ec9a540a7a0400700f8bceb80. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:22.395266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:22.400614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.utils [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] instances quota exceeded for 5267a09ec9a540a7a0400700f8bceb80, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120545) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 16 01:01:22.401605 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 16 01:01:22.405062 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-24e231f7-863c-495b-a6eb-78371e15fe96 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.208300 Oct 16 01:01:22.405629 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 152/354] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:22 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Request method failure captured: Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 145 Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fbxCYSouPp-6eal-5VQmE2DtSdvrGcRKHozLfS1OyfHVJGjp8uSDt3Ik4dIsVp55k77SXlMTdiIOmXMPVQJYR7eFNb_-rMDPxLvAh0H6UTLDN0kLrAjFLf1bR-Q5pTpubfvpM-TzgOb6kZhfoh2wmH9UaZysYHxJ5Id2VN8umcXLo Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 5267a09ec9a540a7a0400700f8bceb80 Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:22.405841 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5267a09ec9a540a7a0400700f8bceb80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 5267a09ec9a540a7a0400700f8bceb80 Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-QuotasAdminNegativeTest-806501563-project Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: dd6cb0f17cf24e8cac44ff9ec732146a Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-QuotasAdminNegativeTest-806501563-project Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1914043295", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} Oct 16 01:01:22.407408 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1914043295', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452'}}} Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 16 01:01:22.408195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:22.409694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:22.411310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:22.412704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:22.412704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:22.412704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:22.412704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:22.412704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 16 01:01:22.412704 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:22.413905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:22.414978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-76b3a983-6a68-410e-87ed-9d275891408e tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.389769 Oct 16 01:01:22.416008 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 203/355] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:22 2022] POST /compute/v2.1/servers => generated 119 bytes in 391 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:22.425180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d07cf369-ee30-40c1-a5b6-5710ede1589c tempest-FlavorsAccessTestJSON-589579468 tempest-FlavorsAccessTestJSON-589579468-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:22.425364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:22.426098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:22.429793 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:22.437099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.437706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.438125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.438821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.439303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.439728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.450874 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d07cf369-ee30-40c1-a5b6-5710ede1589c tempest-FlavorsAccessTestJSON-589579468 tempest-FlavorsAccessTestJSON-589579468-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.029915 Oct 16 01:01:22.452009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 153/356] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:01:22 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:22.458119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-016c17a6-8e16-4a27-9983-af6fd9a83bd2 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ea0caf0>, body: {"quota_set": {"instances": 10}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:22.776166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:22.787391 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-87ca742e-93a5-4b37-9b98-6dbb57b320f2 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1319 microversion: 2.1 time: 0.369500 Oct 16 01:01:22.788715 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 204/357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:22 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:22.794545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e741365-beaa-466b-aa90-f252b4fb3f55 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:22.816474 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e741365-beaa-466b-aa90-f252b4fb3f55 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/797583897" status: 202 len: 0 microversion: 2.1 time: 0.026011 Oct 16 01:01:22.817063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 205/358] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:01:22 2022] DELETE /compute/v2.1/flavors/797583897 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:22.824420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-016c17a6-8e16-4a27-9983-af6fd9a83bd2 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.824980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-016c17a6-8e16-4a27-9983-af6fd9a83bd2 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.825485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-016c17a6-8e16-4a27-9983-af6fd9a83bd2 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.826327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-016c17a6-8e16-4a27-9983-af6fd9a83bd2 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.826843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-016c17a6-8e16-4a27-9983-af6fd9a83bd2 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.827436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-016c17a6-8e16-4a27-9983-af6fd9a83bd2 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.828526 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:22.830084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:22.841920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.844265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.844901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.845772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:22.847088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:22.847563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:22.913919 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-016c17a6-8e16-4a27-9983-af6fd9a83bd2 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 329 microversion: 2.1 time: 0.460459 Oct 16 01:01:22.915082 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 154/359] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:22 2022] PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 329 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:22.922806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e2536a2e-bec2-4022-ab45-603f5c857410 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:22.950764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e2536a2e-bec2-4022-ab45-603f5c857410 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.034532 Oct 16 01:01:22.955374 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 155/360] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:01:22 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:22.962075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bce676da-810d-4d70-ada9-5056063dc1d8 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Calling method '.version_select at 0x7fd64f06d820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.024506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.038148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.040090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.051206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f3993921-866c-4f4a-9542-fc71bf819a90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1417 microversion: 2.75 time: 0.229888 Oct 16 01:01:23.052053 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 206/361] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:22 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1417 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:23.058046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f02826c-7d8c-410f-aa8f-c810de7d6d2d tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1012545211", "id": 1735213740, "os-flavor-access:is_public": "False"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:23.084426 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f02826c-7d8c-410f-aa8f-c810de7d6d2d tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.031085 Oct 16 01:01:23.085637 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 207/362] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:23 2022] POST /compute/v2.1/flavors => generated 431 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:23.092027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.093064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:23.100199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.101131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.101953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.103422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.104150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.104952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.306848 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bce676da-810d-4d70-ada9-5056063dc1d8 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 371 microversion: 2.1 time: 0.349053 Oct 16 01:01:23.307479 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 156/363] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:01:22 2022] GET /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:23.312360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5e82501f-80d4-4701-a50c-153225494b28 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.327367 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5e82501f-80d4-4701-a50c-153225494b28 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1735213740/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018370 Oct 16 01:01:23.328936 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 157/364] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/flavors/1735213740/os-flavor-access => generated 21 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:23.335532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8cb7cf4c-a1e5-4d9b-9bd4-517b769170af tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Action: 'update', calling method: .version_select at 0x7fd64eab4550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:23.376072 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.399440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.401681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.403814 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c5162561-18ea-4301-8c0b-1552ae095024 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1567 microversion: 2.25 time: 0.316658 Oct 16 01:01:23.404490 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 208/365] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:23.426561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-741ddbd4-2ef9-405c-b347-38fa90384abe tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.452160 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-741ddbd4-2ef9-405c-b347-38fa90384abe tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1735213740" status: 202 len: 0 microversion: 2.1 time: 0.046250 Oct 16 01:01:23.453131 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 209/366] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:01:23 2022] DELETE /compute/v2.1/flavors/1735213740 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:01:23.459352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.460448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:23.467995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.468757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.469343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.470281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.470745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.471830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.561605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cb7cf4c-a1e5-4d9b-9bd4-517b769170af tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.562104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cb7cf4c-a1e5-4d9b-9bd4-517b769170af tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.562541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cb7cf4c-a1e5-4d9b-9bd4-517b769170af tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.563449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cb7cf4c-a1e5-4d9b-9bd4-517b769170af tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.563917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cb7cf4c-a1e5-4d9b-9bd4-517b769170af tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.564347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cb7cf4c-a1e5-4d9b-9bd4-517b769170af tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.613596 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8cb7cf4c-a1e5-4d9b-9bd4-517b769170af tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 325 microversion: 2.1 time: 0.283517 Oct 16 01:01:23.626954 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 158/367] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:23 2022] PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 325 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:23.626954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b741ff56-0ba8-47ae-9df2-909483d7ef41 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.645798 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b741ff56-0ba8-47ae-9df2-909483d7ef41 tempest-FlavorsAccessTestJSON-2128486057 tempest-FlavorsAccessTestJSON-2128486057-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030386 Oct 16 01:01:23.651119 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 159/368] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:23.658336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.669992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7577a65c-8b67-4e5c-a5f3-b41683e49b3a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.215142 Oct 16 01:01:23.682443 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 210/369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:23.722338 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Calling method '.version_select at 0x7fd64eb03040>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.724134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.724726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.725040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.739802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.740283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.740720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.751932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.752418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.752893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.760982 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-648aeb57-686f-4582-9e1f-c5bdecf8b4ca tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.107718 Oct 16 01:01:23.761579 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 160/370] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:23.812920 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.813187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:23.820211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.820692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.821119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.821813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:23.822262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:23.822677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:23.949479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71409abf-899a-496b-b32f-c738a78409bc tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] Calling method '.version_select at 0x7fd64ecde670>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:23.951715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-71409abf-899a-496b-b32f-c738a78409bc tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '2449bc319a574b8f8ac34ec117a3e4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914ef2056b2c46de8a01372e1a071f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71409abf-899a-496b-b32f-c738a78409bc tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] Request method failure captured: Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-hypervisors/n-h1-master-1/search HTTP/1.1 Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fiCYFwv450yoHiWrcxhADIJCgYd2VipMvQ1ikp3FQPo5gXbe6Ero40enMgzBQIo0GJ8utH6i2tTJ2FAWiEb0Pb7AJDwFRzPDXgKgtP3YcembRcbu0_Zp7YaBrQxHmUxklC1Uzu0o8jF_Tag1KRF5JnJyGr_LzL2Yvb2yPm9VfVL5Y Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 914ef2056b2c46de8a01372e1a071f50 Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810563358 Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:23.953397 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_914ef2056b2c46de8a01372e1a071f50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/914ef2056b2c46de8a01372e1a071f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/914ef2056b2c46de8a01372e1a071f50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/914ef2056b2c46de8a01372e1a071f50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1810563358 Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 914ef2056b2c46de8a01372e1a071f50 Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810563358 Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2449bc319a574b8f8ac34ec117a3e4d9 Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 16 01:01:23.954622 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'n-h1-master-1'} Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:23.955368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 16 01:01:23.956998 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:23.958604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71409abf-899a-496b-b32f-c738a78409bc tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:23.958604 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71409abf-899a-496b-b32f-c738a78409bc tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.184073 Oct 16 01:01:23.958604 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 211/371] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/os-hypervisors/n-h1-master-1/search => generated 117 bytes in 186 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:23.965481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-761979372", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:23.980627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:23.999080 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-99ede44d-70d4-47e1-b9dc-30e9747bbe5f tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1469 microversion: 2.1 time: 0.190723 Oct 16 01:01:24.026152 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 161/372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:23 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1469 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:24.032724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85703753-aef5-4636-bea5-18d5dadc32f4 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Calling method '.version_select at 0x7fd64ea0c8b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:24.034983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85703753-aef5-4636-bea5-18d5dadc32f4 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.035896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85703753-aef5-4636-bea5-18d5dadc32f4 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.036490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85703753-aef5-4636-bea5-18d5dadc32f4 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.040204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:24.046825 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-85703753-aef5-4636-bea5-18d5dadc32f4 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85703753-aef5-4636-bea5-18d5dadc32f4 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Request method failure captured: Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fjvgAKTtf4N2VcJHC9ehQ8n0D43zGvG5fn3SeVxrYpM1n-W_1k3NeonNvkEy3FOOPRG7ZzzqgbUNGPGWSN6X5R9SndtVAzUlwNYw4eDL8AptC-DZv-TlZqzh6y4XOL8FJDoGw-oCEYgj2QJlZIesLS0QTSdFwHNgf_nTwX6C8GYmc Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 53b379ac62c349109ec9613e2e938f6e Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-487519996 Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:01:24.048326 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_53b379ac62c349109ec9613e2e938f6e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/53b379ac62c349109ec9613e2e938f6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53b379ac62c349109ec9613e2e938f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53b379ac62c349109ec9613e2e938f6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-487519996 Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 53b379ac62c349109ec9613e2e938f6e Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-487519996 Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e78527760c384f85b7709522c1c0f14b Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 16 01:01:24.050259 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:24.051197 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:24.052951 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:24.052951 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:24.052951 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:24.052951 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 16 01:01:24.052951 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.052951 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85703753-aef5-4636-bea5-18d5dadc32f4 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:24.052951 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85703753-aef5-4636-bea5-18d5dadc32f4 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.021878 Oct 16 01:01:24.055142 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 162/373] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:01:24 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:24.260044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:24.260577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:24.268937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.269758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.270409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.271311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.271780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.272230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.298044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:24.334158 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:24.386989 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-49fd7f86-0c4f-456d-940a-8770512b1072 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 204 len: 0 microversion: 2.1 time: 0.330472 Oct 16 01:01:24.387924 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 163/374] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:24 2022] DELETE /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:24.394285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Calling method '.version_select at 0x7fd64f06de50>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:24.396161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.396660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.397095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.412618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.413208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.413644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.425029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.425519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.425949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.432420 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1103c9e5-46ef-48ac-abb3-49ce91908aee tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043130 Oct 16 01:01:24.433028 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 164/375] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:01:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:24.438277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:24.439112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:24.447059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.447600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.448040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.448792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.449276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.449717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.637103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:24.646321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:24.648028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:24.653464 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4285a5e9-ff5e-4c1c-a8f2-56809a7254a1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1438 microversion: 2.75 time: 0.219456 Oct 16 01:01:24.667444 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 165/376] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:24 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1438 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:24.673744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:24.678208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:24.678659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:24.679434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:24.679931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:24.680377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:24.683747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:24.690841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.691523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.692223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.692923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.693565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.694000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.694976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.695464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.695896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.696618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.697069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.697712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.715853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Getting quotas for project 5267a09ec9a540a7a0400700f8bceb80. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:24.719548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Getting quotas for user dd6cb0f17cf24e8cac44ff9ec732146a and project 5267a09ec9a540a7a0400700f8bceb80. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:24.732443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.utils [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] ram quota exceeded for 5267a09ec9a540a7a0400700f8bceb80, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120545) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 16 01:01:24.732981 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Request method failure captured: Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 144 Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fbxCYSouPp-6eal-5VQmE2DtSdvrGcRKHozLfS1OyfHVJGjp8uSDt3Ik4dIsVp55k77SXlMTdiIOmXMPVQJYR7eFNb_-rMDPxLvAh0H6UTLDN0kLrAjFLf1bR-Q5pTpubfvpM-TzgOb6kZhfoh2wmH9UaZysYHxJ5Id2VN8umcXLo Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 5267a09ec9a540a7a0400700f8bceb80 Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:24.734908 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5267a09ec9a540a7a0400700f8bceb80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 5267a09ec9a540a7a0400700f8bceb80 Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-QuotasAdminNegativeTest-806501563-project Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: dd6cb0f17cf24e8cac44ff9ec732146a Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-QuotasAdminNegativeTest-806501563-project Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-761979372", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} Oct 16 01:01:24.736111 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-761979372', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452'}}} Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 16 01:01:24.736757 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:24.737938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.739782 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0d656f5-9fc4-478d-91cc-d0dcb2c5cacb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.774691 Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 212/377] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:23 2022] POST /compute/v2.1/servers => generated 110 bytes in 781 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:24.742127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:24.743300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:24.748809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.749297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.749738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:24.750416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:24.750873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:24.751323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.090213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.091400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.103999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.105431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.106571 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-549b9e66-ccef-4e43-9215-b7a8fdca8ea7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1567 microversion: 2.25 time: 0.368735 Oct 16 01:01:25.107156 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 213/378] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:24 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1567 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:25.109127 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac50c5d7-5668-4f9b-b0dc-8dd04e32ca59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1475 microversion: 2.1 time: 0.438818 Oct 16 01:01:25.128683 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 166/379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:24 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:25.132044 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b94c166f-cae0-451d-8da9-4527566d0450 tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] Calling method '.version_select at 0x7fd64f11de50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:25.133798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b94c166f-cae0-451d-8da9-4527566d0450 tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '2449bc319a574b8f8ac34ec117a3e4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914ef2056b2c46de8a01372e1a071f50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.134426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b94c166f-cae0-451d-8da9-4527566d0450 tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] Request method failure captured: Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fiCYFwv450yoHiWrcxhADIJCgYd2VipMvQ1ikp3FQPo5gXbe6Ero40enMgzBQIo0GJ8utH6i2tTJ2FAWiEb0Pb7AJDwFRzPDXgKgtP3YcembRcbu0_Zp7YaBrQxHmUxklC1Uzu0o8jF_Tag1KRF5JnJyGr_LzL2Yvb2yPm9VfVL5Y Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 914ef2056b2c46de8a01372e1a071f50 Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810563358 Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:25.135363 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_914ef2056b2c46de8a01372e1a071f50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/914ef2056b2c46de8a01372e1a071f50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/914ef2056b2c46de8a01372e1a071f50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/914ef2056b2c46de8a01372e1a071f50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1810563358 Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 914ef2056b2c46de8a01372e1a071f50 Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810563358 Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2449bc319a574b8f8ac34ec117a3e4d9 Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 16 01:01:25.136636 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1'} Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:25.137352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 16 01:01:25.138504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:25.140820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b94c166f-cae0-451d-8da9-4527566d0450 tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:25.140820 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b94c166f-cae0-451d-8da9-4527566d0450 tempest-HypervisorAdminNegativeUnderV252Test-1810563358 tempest-HypervisorAdminNegativeUnderV252Test-1810563358-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.024571 Oct 16 01:01:25.140820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 214/380] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:01:25 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:25.142154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:25.143025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:25.148251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:25.157270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.157791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.158252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.159875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.160359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.161033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.161475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.161628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.162284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.163195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.164135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.166002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.286885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:25.287603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:25.288307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:25.288930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:25.291069 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:25.375926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:25.384782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.385549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.386313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.387557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.388232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.388737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.512762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.522816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.523103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.525447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.535191 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ffccb0cf-4346-4672-a35c-f9e409f745c6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.395180 Oct 16 01:01:25.536419 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 215/381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:25 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:25.552681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b7bc7dd5-575e-44a1-8b65-6ee645584711 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "POST /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687/action" status: 202 len: 1495 microversion: 2.75 time: 0.422456 Oct 16 01:01:25.554757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8a6018f5-d461-48d1-983d-dbad80507e78 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Action: 'update', calling method: .version_select at 0x7fd64ec060d0>, body: {"quota_set": {"ram": 51200}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:25.556100 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 167/382] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:01:25 2022] POST /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687/action => generated 1495 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 16 01:01:25.600494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ad18a37-0520-4efc-8723-ad82a50c6352 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Calling method '.version_select at 0x7fd64e934280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:25.605208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ad18a37-0520-4efc-8723-ad82a50c6352 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.606074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ad18a37-0520-4efc-8723-ad82a50c6352 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.606976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ad18a37-0520-4efc-8723-ad82a50c6352 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.618217 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9ad18a37-0520-4efc-8723-ad82a50c6352 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] HTTP exception thrown: No hypervisor matching '5cb1034e-5b72-4e83-968a-b6a590d96260' could be found. Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ad18a37-0520-4efc-8723-ad82a50c6352 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Request method failure captured: Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-hypervisors/5cb1034e-5b72-4e83-968a-b6a590d96260/servers HTTP/1.1 Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fjvgAKTtf4N2VcJHC9ehQ8n0D43zGvG5fn3SeVxrYpM1n-W_1k3NeonNvkEy3FOOPRG7ZzzqgbUNGPGWSN6X5R9SndtVAzUlwNYw4eDL8AptC-DZv-TlZqzh6y4XOL8FJDoGw-oCEYgj2QJlZIesLS0QTSdFwHNgf_nTwX6C8GYmc Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 53b379ac62c349109ec9613e2e938f6e Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-487519996 Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:01:25.619812 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_53b379ac62c349109ec9613e2e938f6e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/53b379ac62c349109ec9613e2e938f6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53b379ac62c349109ec9613e2e938f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/53b379ac62c349109ec9613e2e938f6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-487519996 Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 53b379ac62c349109ec9613e2e938f6e Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-487519996 Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e78527760c384f85b7709522c1c0f14b Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: exception: No hypervisor matching '5cb1034e-5b72-4e83-968a-b6a590d96260' could be found. Oct 16 01:01:25.621177 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5cb1034e-5b72-4e83-968a-b6a590d96260'} Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5cb1034e-5b72-4e83-968a-b6a590d96260' could be found. Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:25.621854 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5cb1034e-5b72-4e83-968a-b6a590d96260' could be found. Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ad18a37-0520-4efc-8723-ad82a50c6352 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] Returning 404 to user: No hypervisor matching '5cb1034e-5b72-4e83-968a-b6a590d96260' could be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ad18a37-0520-4efc-8723-ad82a50c6352 tempest-HypervisorAdminNegativeUnderV252Test-487519996 tempest-HypervisorAdminNegativeUnderV252Test-487519996-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/5cb1034e-5b72-4e83-968a-b6a590d96260/servers" status: 404 len: 123 microversion: 2.1 time: 0.051435 Oct 16 01:01:25.629508 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 168/383] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Oct 16 01:01:25 2022] GET /compute/v2.1/os-hypervisors/5cb1034e-5b72-4e83-968a-b6a590d96260/servers => generated 123 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:25.630165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:25.630165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:25.636408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.637146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.637614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.639006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:25.639523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:25.640284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:25.733492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.745845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.747694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:25.770985 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1119324e-40c2-44f2-8d76-7603681eec07 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.147734 Oct 16 01:01:25.771769 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 169/384] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:25 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:26.112013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a6018f5-d461-48d1-983d-dbad80507e78 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.113583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a6018f5-d461-48d1-983d-dbad80507e78 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.114095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a6018f5-d461-48d1-983d-dbad80507e78 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.124726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a6018f5-d461-48d1-983d-dbad80507e78 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.127577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a6018f5-d461-48d1-983d-dbad80507e78 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.128075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a6018f5-d461-48d1-983d-dbad80507e78 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.137234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:26.139409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:26.149343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.150154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.150803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.151819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.152466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.153305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.214558 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8a6018f5-d461-48d1-983d-dbad80507e78 tempest-QuotasAdminNegativeTest-255766463 tempest-QuotasAdminNegativeTest-255766463-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 200 len: 329 microversion: 2.1 time: 0.677048 Oct 16 01:01:26.215770 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 216/385] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:25 2022] PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 329 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:26.226735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:26.228458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:26.238788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.240186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.240845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.241818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.242552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.243276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.682324 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.694992 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2a6c6ae3-602b-422c-88b5-0b0d5f6db425 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1475 microversion: 2.1 time: 0.563373 Oct 16 01:01:26.710111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.711487 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 170/386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:26 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1475 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:26.718653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eff93427-fbd2-41eb-b99e-f6d09cf3b3bb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Action: 'update', calling method: .version_select at 0x7fd64e934b80>, body: {"quota_set": {"ram": 0}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:26.719582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.721067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.722746 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7f693653-4bcc-4712-8d95-f3e1fb974773 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1557 microversion: 2.25 time: 0.505723 Oct 16 01:01:26.724051 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 217/387] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:26 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1557 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:26.730327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:26.730951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:26.746527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.747433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.748176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.749310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eff93427-fbd2-41eb-b99e-f6d09cf3b3bb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'dd6cb0f17cf24e8cac44ff9ec732146a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5267a09ec9a540a7a0400700f8bceb80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.749478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.750107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.750941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eff93427-fbd2-41eb-b99e-f6d09cf3b3bb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Request method failure captured: Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 HTTP/1.1 Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 25 Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fbxCYSouPp-6eal-5VQmE2DtSdvrGcRKHozLfS1OyfHVJGjp8uSDt3Ik4dIsVp55k77SXlMTdiIOmXMPVQJYR7eFNb_-rMDPxLvAh0H6UTLDN0kLrAjFLf1bR-Q5pTpubfvpM-TzgOb6kZhfoh2wmH9UaZysYHxJ5Id2VN8umcXLo Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 5267a09ec9a540a7a0400700f8bceb80 Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:01:26.752846 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5267a09ec9a540a7a0400700f8bceb80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5267a09ec9a540a7a0400700f8bceb80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 5267a09ec9a540a7a0400700f8bceb80 Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-806501563 Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-QuotasAdminNegativeTest-806501563-project Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: dd6cb0f17cf24e8cac44ff9ec732146a Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-QuotasAdminNegativeTest-806501563-project Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: {"quota_set": {"ram": 0}} Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 16 01:01:26.754099 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5267a09ec9a540a7a0400700f8bceb80', 'body': {'quota_set': {'ram': 0}}} Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:26.755048 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:26.756178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:26.757306 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:26.757306 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:26.757306 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:26.757306 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:26.757306 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 16 01:01:26.757306 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:26.760149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eff93427-fbd2-41eb-b99e-f6d09cf3b3bb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:26.761474 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eff93427-fbd2-41eb-b99e-f6d09cf3b3bb tempest-QuotasAdminNegativeTest-806501563 tempest-QuotasAdminNegativeTest-806501563-project] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80" status: 403 len: 116 microversion: 2.1 time: 0.048005 Oct 16 01:01:26.766630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 171/388] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:01:26 2022] PUT /compute/v2.1/os-quota-sets/5267a09ec9a540a7a0400700f8bceb80 => generated 116 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:26.773117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d7c5f48-a056-4f74-8370-61ea4a4b7f2c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '.version_select at 0x7fd64e912940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:26.777978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d7c5f48-a056-4f74-8370-61ea4a4b7f2c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.778744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d7c5f48-a056-4f74-8370-61ea4a4b7f2c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.779479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d7c5f48-a056-4f74-8370-61ea4a4b7f2c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.808259 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0d7c5f48-a056-4f74-8370-61ea4a4b7f2c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.039943 Oct 16 01:01:26.811376 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 172/389] 10.222.0.39 () {60 vars in 1184 bytes} [Sun Oct 16 01:01:26 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:26.819599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:26.821286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:26.834514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.835554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.836324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.837189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:26.837869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:26.838466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:26.947240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.963851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.966491 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:26.983349 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8de8a014-7850-44a2-9a6f-11cc05d3bc90 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.169491 Oct 16 01:01:26.999855 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 173/390] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:26 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:27.012964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:27.013598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:27.017060 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:27.022460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.022988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.023514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.024262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.024813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.025382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.027445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:27.039469 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7aa8a299-463c-41ac-a90a-b50a104f7641 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.313793 Oct 16 01:01:27.051362 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 218/391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:26 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:27.211876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e2653cf4-283a-4777-ba70-3aea2c3f141c req-14eeb09b-1879-491c-bd41-c22de5b45ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf069461-fb58-4e25-9e57-ce50a12a2fa6", "name": "network-vif-deleted", "tag": "930b99fe-2c88-4d91-af07-e682d5edf840"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:27.237100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2653cf4-283a-4777-ba70-3aea2c3f141c req-14eeb09b-1879-491c-bd41-c22de5b45ebc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.242539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2653cf4-283a-4777-ba70-3aea2c3f141c req-14eeb09b-1879-491c-bd41-c22de5b45ebc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.244898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2653cf4-283a-4777-ba70-3aea2c3f141c req-14eeb09b-1879-491c-bd41-c22de5b45ebc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.282777 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e2653cf4-283a-4777-ba70-3aea2c3f141c req-14eeb09b-1879-491c-bd41-c22de5b45ebc service nova] Creating event network-vif-deleted:930b99fe-2c88-4d91-af07-e682d5edf840 for instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 on n-h2-master-1 Oct 16 01:01:27.300448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid ac0a075a-d3cd-41c7-bf45-14b134b9edbc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:27.312203 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e2653cf4-283a-4777-ba70-3aea2c3f141c req-14eeb09b-1879-491c-bd41-c22de5b45ebc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109784 Oct 16 01:01:27.324670 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 219/392] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:27.341712 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-482bde78-1dca-4288-8951-7ad65ce587e4 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 2049 microversion: 2.25 time: 0.340344 Oct 16 01:01:27.343179 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 174/393] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:27 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 2049 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:27.545858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-423181501", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "d8ca3633-753d-4a02-9054-6faae6f93606"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:27.637953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] validate_networks() for [('d8ca3633-753d-4a02-9054-6faae6f93606', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:27.720136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:27.721005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:27.740775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.741471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.741961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.742868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.743470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.743983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.788909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:27.789757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:27.790396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:27.791129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lazy-loading 'fault' on Instance uuid cf069461-fb58-4e25-9e57-ce50a12a2fa6 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:27.872190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:27.881072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4bdb79e-3470-43f4-a0d2-d8fc1d49e721 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1309 microversion: 2.1 time: 0.166489 Oct 16 01:01:27.885411 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 175/394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:27 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1309 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:28.021534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:28.022426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:28.031736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.032283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.032897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.039721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.040724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.041901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.147149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.157212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.158842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.163871 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a78c6088-3255-4653-a122-c02e1a1b392f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.149532 Oct 16 01:01:28.178950 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 176/395] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:28 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:28.183388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:28.184129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:28.190759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.192298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.192796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.193613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.194131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.194954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.352282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.359912 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-46d69e38-f45c-4dbc-8cff-3e3395aaadba tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.194124 Oct 16 01:01:28.360790 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 177/396] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:28 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:28.659066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:28.660066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:28.660733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:28.661342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:28.661932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:28.674830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.678649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.679615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.680694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.681373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.682009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.693561 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=30 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:28.707021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for project e9173928e9c94d31b8d2eca240e28d50. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:28.711442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for user 5f46ddd0268d44bfacff0400e3f38e7e and project e9173928e9c94d31b8d2eca240e28d50. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:28.724430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:28.726961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:28.794905 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f393a19-2f67-4936-a16e-206b01653db4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.253451 Oct 16 01:01:28.800678 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 220/397] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:01:28.812581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-70c76007-6598-471c-b1a6-a06bdd9e598d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:28.813191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-70c76007-6598-471c-b1a6-a06bdd9e598d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:28.908222 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:28.909462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:28.922992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-70c76007-6598-471c-b1a6-a06bdd9e598d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.923894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.926961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.927422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.929856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:28.930329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:28.930756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:28.936092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-70c76007-6598-471c-b1a6-a06bdd9e598d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.937965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-70c76007-6598-471c-b1a6-a06bdd9e598d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:28.941582 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-70c76007-6598-471c-b1a6-a06bdd9e598d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1261 microversion: 2.25 time: 0.133196 Oct 16 01:01:28.941724 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 178/398] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:28 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:29.002253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:29.004040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:29.004560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:29.005197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lazy-loading 'fault' on Instance uuid cf069461-fb58-4e25-9e57-ce50a12a2fa6 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:29.070791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:29.095170 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0895c8ad-2e8e-408a-b024-9df4d2e534f7 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1309 microversion: 2.1 time: 0.174852 Oct 16 01:01:29.098894 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 221/399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:28 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:29.193199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:29.193801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:29.200903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:29.202425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:29.202866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:29.203746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:29.204263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:29.204834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:29.286356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:29.297105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:29.298901 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:29.310014 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6edcf331-b3a5-46a4-b583-0a0e195c70fc tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.121294 Oct 16 01:01:29.311258 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 179/400] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:29 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:29.383416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:29.384012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:29.391877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:29.394385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:29.395552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:29.396817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:29.398182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:29.399447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:29.563373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:29.570194 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4935f6ac-b0c2-4c16-8b0d-fb43c3a58a17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1477 microversion: 2.1 time: 0.190548 Oct 16 01:01:29.574950 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 222/401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:29 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1477 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:29.712754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-131586c8-2a81-4b06-bb2e-496bb7d0639e tempest-FlavorsV255TestJSON-1934947111 tempest-FlavorsV255TestJSON-1934947111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1623823851", "id": 1254914607, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:29.739919 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-131586c8-2a81-4b06-bb2e-496bb7d0639e tempest-FlavorsV255TestJSON-1934947111 tempest-FlavorsV255TestJSON-1934947111-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.280148 Oct 16 01:01:29.740654 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 180/402] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:01:29 2022] POST /compute/v2.1/flavors => generated 449 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 01:01:29.968339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:29.969072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:29.976424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:29.977038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:29.977469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:29.978159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:29.978608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:29.979180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:29.983973 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:30.000591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b88c36cc-93e7-4180-b4cf-af50b8a070cb tempest-FlavorsV255TestJSON-887947235 tempest-FlavorsV255TestJSON-887947235-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.014494 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b88c36cc-93e7-4180-b4cf-af50b8a070cb tempest-FlavorsV255TestJSON-887947235 tempest-FlavorsV255TestJSON-887947235-project] 10.222.0.39 "GET /compute/v2.1/flavors/1254914607" status: 200 len: 449 microversion: 2.55 time: 0.261884 Oct 16 01:01:30.015832 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 223/403] 10.222.0.39 () {60 vars in 1199 bytes} [Sun Oct 16 01:01:29 2022] GET /compute/v2.1/flavors/1254914607 => generated 449 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:30.034900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b9b5a66-dd9f-4f16-b185-2d984d0d7ae5 tempest-FlavorsV255TestJSON-1934947111 tempest-FlavorsV255TestJSON-1934947111-project-admin] Action: 'update', calling method: .version_select at 0x7fd650376d30>, body: {"flavor": {"description": "new"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:30.051418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:30.061936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:30.064536 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:30.066488 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b6cebf3-e31d-4dc2-82e8-8fa38f513225 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1257 microversion: 2.25 time: 0.102294 Oct 16 01:01:30.081319 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 181/404] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:29 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1257 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:30.089682 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2b9b5a66-dd9f-4f16-b185-2d984d0d7ae5 tempest-FlavorsV255TestJSON-1934947111 tempest-FlavorsV255TestJSON-1934947111-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/1254914607" status: 200 len: 450 microversion: 2.55 time: 0.059799 Oct 16 01:01:30.090700 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 224/405] 10.222.0.39 () {62 vars in 1219 bytes} [Sun Oct 16 01:01:30 2022] PUT /compute/v2.1/flavors/1254914607 => generated 450 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:30.107434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76fce1f4-bd9a-4275-a60a-4d680b8e2326 tempest-FlavorsV255TestJSON-887947235 tempest-FlavorsV255TestJSON-887947235-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.119292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.119991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:30.128438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.129100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.129533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.130264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.130717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.131171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.195714 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76fce1f4-bd9a-4275-a60a-4d680b8e2326 tempest-FlavorsV255TestJSON-887947235 tempest-FlavorsV255TestJSON-887947235-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6590 microversion: 2.55 time: 0.088854 Oct 16 01:01:30.200548 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 182/406] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:01:30 2022] GET /compute/v2.1/flavors/detail => generated 6590 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:30.208717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.209386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.210040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.210692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lazy-loading 'fault' on Instance uuid cf069461-fb58-4e25-9e57-ce50a12a2fa6 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:30.225410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-363b20ae-46f2-47ff-9acf-d398cce1fb89 tempest-FlavorsV255TestJSON-887947235 tempest-FlavorsV255TestJSON-887947235-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.255641 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-363b20ae-46f2-47ff-9acf-d398cce1fb89 tempest-FlavorsV255TestJSON-887947235 tempest-FlavorsV255TestJSON-887947235-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.55 time: 0.037857 Oct 16 01:01:30.256815 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 183/407] 10.222.0.39 () {60 vars in 1166 bytes} [Sun Oct 16 01:01:30 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:01:30.275812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57b8a1e6-4f18-42fc-b048-017d50624f4f tempest-FlavorsV255TestJSON-1934947111 tempest-FlavorsV255TestJSON-1934947111-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.304582 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57b8a1e6-4f18-42fc-b048-017d50624f4f tempest-FlavorsV255TestJSON-1934947111 tempest-FlavorsV255TestJSON-1934947111-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1254914607" status: 202 len: 0 microversion: 2.55 time: 0.033489 Oct 16 01:01:30.305899 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 184/408] 10.222.0.39 () {60 vars in 1202 bytes} [Sun Oct 16 01:01:30 2022] DELETE /compute/v2.1/flavors/1254914607 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:30.313999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d76094df-53a7-4d74-8b40-af333eabda9a tempest-FlavorsV255TestJSON-1934947111 tempest-FlavorsV255TestJSON-1934947111-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.372432 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d76094df-53a7-4d74-8b40-af333eabda9a tempest-FlavorsV255TestJSON-1934947111 tempest-FlavorsV255TestJSON-1934947111-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.061454 Oct 16 01:01:30.374355 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 185/409] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:01:30 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:30.390073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.391736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:30.404818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.405774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.406681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.408200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.410572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.411698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.428076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:30.440946 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-faaaac9b-87bd-4edb-853a-c0b577a063a1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 200 len: 1309 microversion: 2.1 time: 0.325266 Oct 16 01:01:30.442179 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 225/410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:30 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:30.564054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:30.575928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:30.577938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:30.585493 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9438ec6d-93cf-4e94-a9ad-2bac405bba4c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.208553 Oct 16 01:01:30.587008 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 186/411] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:30 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:30.603872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:30.604986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:30.607813 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:30.615167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.615545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.616114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.617242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:30.618094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:30.618797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:30.848782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:30.851795 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:30.863742 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ea42627-4b62-490c-90f8-94db555a43c5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1476 microversion: 2.1 time: 0.264930 Oct 16 01:01:30.864604 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 226/412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:30 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1476 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:31.043247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce5740a3-7b1d-4c78-87e2-763c79d09963 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.050754 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-ce5740a3-7b1d-4c78-87e2-763c79d09963 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce5740a3-7b1d-4c78-87e2-763c79d09963 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516-project-admin] Request method failure captured: Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fq0tPLKzkwgDVmKqxzmH4MH4vvcJJe0tFZs2RiJwyAGEDcWD2OQpRnwrGfKxVM1TrQeRgRvK9HvsWTArOLKya9UpcqrRbAcNePYodnN_sz-V5_FT1kUiwNzSQpiZsgmyT_44tsCgvQI28hjTh940TpPAdGvjX8cW6Yir9Pgc49NWg Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 8e6c7aa43aae479fb846e1639baf2e3f Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516 Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:01:31.059578 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8e6c7aa43aae479fb846e1639baf2e3f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8e6c7aa43aae479fb846e1639baf2e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8e6c7aa43aae479fb846e1639baf2e3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8e6c7aa43aae479fb846e1639baf2e3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516 Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 8e6c7aa43aae479fb846e1639baf2e3f Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516 Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516-project-admin Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 399d975fe48049e5b187b69037315629 Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516-project-admin Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:31.060740 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid timestamp for date invalid_time Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'invalid_time'} Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:31.061475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 16 01:01:31.063308 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.075543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce5740a3-7b1d-4c78-87e2-763c79d09963 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:31.080324 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce5740a3-7b1d-4c78-87e2-763c79d09963 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516 tempest-InstanceUsageAuditLogNegativeTestJSON-1441673516-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.184765 Oct 16 01:01:31.081273 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 187/413] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Oct 16 01:01:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:31.097153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.098626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:31.107491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.108453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.109149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.111757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.113040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.113711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.300681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd20aa58-41c9-4055-b0d6-bc1225e30ebe tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.304181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd20aa58-41c9-4055-b0d6-bc1225e30ebe tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '23c825fb97f145bdb04d32e89242edca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a75c141a604c8e835745f0452854b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd20aa58-41c9-4055-b0d6-bc1225e30ebe tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] Request method failure captured: Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fpjIrS-TlY222QIFMZgfGYGZ8GtYrfKYCjA3lJEoC81_z2XTTg0TdOGolGTDdCLtuQrhftH97z67u2VI3IjDFlxUT7_NsvTVw3mEt1FoSISq66e9NjMCiVgBYR67n3JIVUUQBnU0MINRTjA-x8N3HcEkntLMFXo0XCQw5CThX4VBg Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 80a75c141a604c8e835745f0452854b6 Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:31.309470 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_80a75c141a604c8e835745f0452854b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/80a75c141a604c8e835745f0452854b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/80a75c141a604c8e835745f0452854b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/80a75c141a604c8e835745f0452854b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 80a75c141a604c8e835745f0452854b6 Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 23c825fb97f145bdb04d32e89242edca Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project Oct 16 01:01:31.311011 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: action_args: {} Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:31.311721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 16 01:01:31.312837 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.315933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd20aa58-41c9-4055-b0d6-bc1225e30ebe tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:31.318799 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd20aa58-41c9-4055-b0d6-bc1225e30ebe tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.230158 Oct 16 01:01:31.319403 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 227/414] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Oct 16 01:01:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:31.330178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7f68491-cc7a-4139-bc97-46bf98f89127 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.332716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b7f68491-cc7a-4139-bc97-46bf98f89127 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '23c825fb97f145bdb04d32e89242edca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a75c141a604c8e835745f0452854b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7f68491-cc7a-4139-bc97-46bf98f89127 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] Request method failure captured: Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-16%2001:01:31 HTTP/1.1 Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fpjIrS-TlY222QIFMZgfGYGZ8GtYrfKYCjA3lJEoC81_z2XTTg0TdOGolGTDdCLtuQrhftH97z67u2VI3IjDFlxUT7_NsvTVw3mEt1FoSISq66e9NjMCiVgBYR67n3JIVUUQBnU0MINRTjA-x8N3HcEkntLMFXo0XCQw5CThX4VBg Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 80a75c141a604c8e835745f0452854b6 Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:31.334318 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_80a75c141a604c8e835745f0452854b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/80a75c141a604c8e835745f0452854b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/80a75c141a604c8e835745f0452854b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/80a75c141a604c8e835745f0452854b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 80a75c141a604c8e835745f0452854b6 Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 23c825fb97f145bdb04d32e89242edca Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project Oct 16 01:01:31.335855 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '2022-10-16 01:01:31'} Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:31.336406 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 16 01:01:31.337470 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.340494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7f68491-cc7a-4139-bc97-46bf98f89127 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:31.341565 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b7f68491-cc7a-4139-bc97-46bf98f89127 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110 tempest-InstanceUsageAuditLogNegativeTestJSON-1396174110-project] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-16 01:01:31" status: 403 len: 128 microversion: 2.1 time: 0.016917 Oct 16 01:01:31.343044 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 228/415] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:01:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-16%2001%3A01%3A31 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:31.479913 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.480563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:31.487538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.489204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.489987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.490892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.492469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.493086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.510598 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] HTTP exception thrown: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Request method failure captured: Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 HTTP/1.1 Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fR1xs0LWrFsJFgAFkcEOT0qV40ssbq3Vd8HQI7VuAYBP7MmqxbGlqVChPELXOs6vbr3dG-e-QLuB8IyLqwGYI_j7YXdHe2d1PUt1qsLvsriRwrffs0-nlVZ35cQUtEG8_Lm2sQoK579eCCyFDsYoCy-0cFz5cHyrlmtLx2gJUzlSE Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:01:31.512184 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61deedbd92ca45e28838b513114952c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61deedbd92ca45e28838b513114952c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7cf9dde9e1de4c7c8592ced74f618bed Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: exception: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:01:31.513506 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'cf069461-fb58-4e25-9e57-ce50a12a2fa6'} Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:31.514275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:01:31.515412 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:01:31.516616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Returning 404 to user: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:31.516616 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-290310a4-2f6f-4d27-952a-9104c98c86eb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 404 len: 111 microversion: 2.1 time: 0.050006 Oct 16 01:01:31.516616 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 229/416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:31 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:31.567979 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.576623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.578075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.579211 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-54efc605-7ab0-4beb-9cf2-f03c43c13212 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1321 microversion: 2.25 time: 0.488745 Oct 16 01:01:31.582809 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 188/417] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:31 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:31.620924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:31.621645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:31.628999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.629590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.630132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.632110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:31.632996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:31.633643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:31.774310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.782653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.785094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:31.790310 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be3dff88-89b9-4be4-8510-d4456dcf8c27 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.174496 Oct 16 01:01:31.791793 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 230/418] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:31 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:31.796983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1591984968", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:31.862971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:32.039444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c4ba7f0-41be-401e-b54b-b7e461dcf9b9 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.043442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c4ba7f0-41be-401e-b54b-b7e461dcf9b9 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.044032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c4ba7f0-41be-401e-b54b-b7e461dcf9b9 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.045628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c4ba7f0-41be-401e-b54b-b7e461dcf9b9 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.046654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c4ba7f0-41be-401e-b54b-b7e461dcf9b9 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.048731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c4ba7f0-41be-401e-b54b-b7e461dcf9b9 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.050846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c4ba7f0-41be-401e-b54b-b7e461dcf9b9 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.062417 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=17 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:32.083463 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c4ba7f0-41be-401e-b54b-b7e461dcf9b9 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.397429 Oct 16 01:01:32.092159 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 189/419] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:01:31 2022] GET /compute/v2.1/os-services => generated 944 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:32.097971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0eff1ca6-03c0-4da9-9c36-b613bc7bc734 req-c001f1db-7d2f-498c-87db-67c69e3b5b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192d949-f638-4890-ae93-709a7cde5fc9", "name": "network-vif-unplugged", "status": "completed", "tag": "6acb8c4d-9089-480a-99ad-6c45fdf5d04c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:32.107477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0eff1ca6-03c0-4da9-9c36-b613bc7bc734 req-c001f1db-7d2f-498c-87db-67c69e3b5b46 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.108255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0eff1ca6-03c0-4da9-9c36-b613bc7bc734 req-c001f1db-7d2f-498c-87db-67c69e3b5b46 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.108886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0eff1ca6-03c0-4da9-9c36-b613bc7bc734 req-c001f1db-7d2f-498c-87db-67c69e3b5b46 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.121352 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0eff1ca6-03c0-4da9-9c36-b613bc7bc734 req-c001f1db-7d2f-498c-87db-67c69e3b5b46 service nova] Creating event network-vif-unplugged:6acb8c4d-9089-480a-99ad-6c45fdf5d04c for instance e192d949-f638-4890-ae93-709a7cde5fc9 on n-h1-master-1 Oct 16 01:01:32.131187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-0eff1ca6-03c0-4da9-9c36-b613bc7bc734 req-c001f1db-7d2f-498c-87db-67c69e3b5b46 service nova] Instance e192d949-f638-4890-ae93-709a7cde5fc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:01:32.143639 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0eff1ca6-03c0-4da9-9c36-b613bc7bc734 req-c001f1db-7d2f-498c-87db-67c69e3b5b46 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049313 Oct 16 01:01:32.145245 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 190/420] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:32.150581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.152072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:32.159950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.160662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.161250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.162134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.162740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.163346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.430661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:32.431851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:32.432481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:32.433111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:32.433478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:32.443352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.444292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.444893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.445627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.446081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.446682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.467616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Getting quotas for project 61deedbd92ca45e28838b513114952c8. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:32.473270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Getting quotas for user 7cf9dde9e1de4c7c8592ced74f618bed and project 61deedbd92ca45e28838b513114952c8. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:32.485339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:32.488588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:32.553326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:32.568948 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-29b74fd2-a317-4bc5-bbc7-ca3ff9ff16ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1476 microversion: 2.1 time: 0.416187 Oct 16 01:01:32.569552 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 191/421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:32 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:32.587860 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-09b443fb-687b-4f6b-9756-42d2a153ee3c tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794470 Oct 16 01:01:32.588574 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 231/422] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:01:32.594728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01657ae7-1b07-472f-b73a-07e5193a0dc3 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.596027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01657ae7-1b07-472f-b73a-07e5193a0dc3 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.597012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01657ae7-1b07-472f-b73a-07e5193a0dc3 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.597199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01657ae7-1b07-472f-b73a-07e5193a0dc3 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.598173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01657ae7-1b07-472f-b73a-07e5193a0dc3 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.598825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01657ae7-1b07-472f-b73a-07e5193a0dc3 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.599625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01657ae7-1b07-472f-b73a-07e5193a0dc3 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.602199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a280f752-bc47-48c3-a556-6c1cde79b2bc tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.603963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a280f752-bc47-48c3-a556-6c1cde79b2bc tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:32.649748 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01657ae7-1b07-472f-b73a-07e5193a0dc3 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.062541 Oct 16 01:01:32.650627 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 192/423] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Oct 16 01:01:32 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:32.656340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.660483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:32.667461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.668399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.669188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.671081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.671704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.672336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.842487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a280f752-bc47-48c3-a556-6c1cde79b2bc tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:32.855035 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a280f752-bc47-48c3-a556-6c1cde79b2bc tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1220 microversion: 2.1 time: 0.256913 Oct 16 01:01:32.867810 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 232/424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:32 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1220 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:32.878512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-575430da-1027-483e-8e81-393e1051a2b6 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.883114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-575430da-1027-483e-8e81-393e1051a2b6 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.883869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-575430da-1027-483e-8e81-393e1051a2b6 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.884506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-575430da-1027-483e-8e81-393e1051a2b6 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.885436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-575430da-1027-483e-8e81-393e1051a2b6 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.886079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-575430da-1027-483e-8e81-393e1051a2b6 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.886708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-575430da-1027-483e-8e81-393e1051a2b6 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.915094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:32.928014 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-575430da-1027-483e-8e81-393e1051a2b6 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.058754 Oct 16 01:01:32.929474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:32.930022 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 233/425] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:01:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:32.933516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:32.935541 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-788c658c-4d00-4463-a841-cc2c73e6b27d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1319 microversion: 2.25 time: 0.283764 Oct 16 01:01:32.937108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.938439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:32.947739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.948523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.949854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.951326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.951854 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 193/426] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:32 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:32.952443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.953097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.971419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f5a48ef9-9636-414e-923d-79848703425f tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:32.984211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5a48ef9-9636-414e-923d-79848703425f tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.985560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5a48ef9-9636-414e-923d-79848703425f tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.986431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5a48ef9-9636-414e-923d-79848703425f tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:32.989642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5a48ef9-9636-414e-923d-79848703425f tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:32.991113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5a48ef9-9636-414e-923d-79848703425f tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:32.996671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5a48ef9-9636-414e-923d-79848703425f tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.098767 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f5a48ef9-9636-414e-923d-79848703425f tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.141952 Oct 16 01:01:33.101169 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 194/427] 10.222.0.39 () {58 vars in 1194 bytes} [Sun Oct 16 01:01:32 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:33.112586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8d41847-fe01-45d6-aced-c613782b9a05 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:33.119515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8d41847-fe01-45d6-aced-c613782b9a05 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.120068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8d41847-fe01-45d6-aced-c613782b9a05 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.120411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8d41847-fe01-45d6-aced-c613782b9a05 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.121219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8d41847-fe01-45d6-aced-c613782b9a05 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.121558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8d41847-fe01-45d6-aced-c613782b9a05 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.121976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8d41847-fe01-45d6-aced-c613782b9a05 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.180968 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8d41847-fe01-45d6-aced-c613782b9a05 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.072470 Oct 16 01:01:33.182782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 195/428] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:01:33 2022] GET /compute/v2.1/os-services => generated 944 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:33.199666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-27c7362f-179d-4f1b-8af0-9acc27cd5877 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:33.203448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27c7362f-179d-4f1b-8af0-9acc27cd5877 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.207675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27c7362f-179d-4f1b-8af0-9acc27cd5877 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.208910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27c7362f-179d-4f1b-8af0-9acc27cd5877 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.210703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27c7362f-179d-4f1b-8af0-9acc27cd5877 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.211956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27c7362f-179d-4f1b-8af0-9acc27cd5877 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.212636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27c7362f-179d-4f1b-8af0-9acc27cd5877 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.243972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:33.245858 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-27c7362f-179d-4f1b-8af0-9acc27cd5877 tempest-ServicesAdminNegativeTestJSON-633570891 tempest-ServicesAdminNegativeTestJSON-633570891-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.054196 Oct 16 01:01:33.247493 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 196/429] 10.222.0.39 () {58 vars in 1198 bytes} [Sun Oct 16 01:01:33 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:01:33.253762 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:33.255438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:33.272847 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f511ec3-ac78-421e-9be2-8ac91dba7930 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.341514 Oct 16 01:01:33.274333 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 234/430] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:32 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:33.595692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:33.598024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:33.616200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.617070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.620175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.621660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.622641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.623390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.721938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b17a22b-fdaa-4be2-8293-fe23a73e1d0f tempest-ServicesAdminNegativeTestJSON-2125101776 tempest-ServicesAdminNegativeTestJSON-2125101776-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:33.727623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8b17a22b-fdaa-4be2-8293-fe23a73e1d0f tempest-ServicesAdminNegativeTestJSON-2125101776 tempest-ServicesAdminNegativeTestJSON-2125101776-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fc40f12d9bee4f26adb09753b5590bf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48f2ef261914d849e20edb861c30b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b17a22b-fdaa-4be2-8293-fe23a73e1d0f tempest-ServicesAdminNegativeTestJSON-2125101776 tempest-ServicesAdminNegativeTestJSON-2125101776-project] Request method failure captured: Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fq2P15NY3hdukyP0YGLw_jCVW1jnvi-VWwCv6fOO7nxxbNoH5w-czLgL83idFkPIx_JST_RUmJLJA9T0oGFPr31DhjM6-y33CZwouR5djgRAS8WDULR5Hg0-XSeBLRXwV8QMYSq6s8AGG4zsDUEln0bNpCaC9I7krk9vEIo-gtMm0 Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e48f2ef261914d849e20edb861c30b20 Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2125101776 Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:01:33.745489 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e48f2ef261914d849e20edb861c30b20", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e48f2ef261914d849e20edb861c30b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e48f2ef261914d849e20edb861c30b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e48f2ef261914d849e20edb861c30b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2125101776 Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e48f2ef261914d849e20edb861c30b20 Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2125101776 Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServicesAdminNegativeTestJSON-2125101776-project Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: fc40f12d9bee4f26adb09753b5590bf8 Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2125101776-project Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 16 01:01:33.746728 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:01:33.747478 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 16 01:01:33.753813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:01:33.755159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b17a22b-fdaa-4be2-8293-fe23a73e1d0f tempest-ServicesAdminNegativeTestJSON-2125101776 tempest-ServicesAdminNegativeTestJSON-2125101776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:01:33.755159 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b17a22b-fdaa-4be2-8293-fe23a73e1d0f tempest-ServicesAdminNegativeTestJSON-2125101776 tempest-ServicesAdminNegativeTestJSON-2125101776-project] 10.222.0.39 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.488771 Oct 16 01:01:33.755159 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 197/431] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:01:33 2022] GET /compute/v2.1/os-services => generated 112 bytes in 492 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:01:33.881767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:33.882777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:33.894032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.900839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.902047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:33.904100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:33.905907 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:33.907703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:34.062617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.075898 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f9f58d69-fd1b-4c9b-93d6-99f241b11f23 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1272 microversion: 2.1 time: 0.197993 Oct 16 01:01:34.076597 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 198/432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:33 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:34.081807 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:34.082419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:34.094775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:34.095322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:34.095740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:34.096972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:34.097433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:34.097857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:34.224158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.236006 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c462893f-cefa-4924-b4de-12ac756faac7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1476 microversion: 2.1 time: 0.646831 Oct 16 01:01:34.238272 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 235/433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:33 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1476 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:34.244815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-939f2370-c170-4897-a76b-276e7cd0ee08 req-abcdf742-1114-423c-a846-e89e6977c03b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e192d949-f638-4890-ae93-709a7cde5fc9", "tag": "6acb8c4d-9089-480a-99ad-6c45fdf5d04c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:34.257100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-939f2370-c170-4897-a76b-276e7cd0ee08 req-abcdf742-1114-423c-a846-e89e6977c03b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:34.258174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-939f2370-c170-4897-a76b-276e7cd0ee08 req-abcdf742-1114-423c-a846-e89e6977c03b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:34.259088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-939f2370-c170-4897-a76b-276e7cd0ee08 req-abcdf742-1114-423c-a846-e89e6977c03b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:34.298016 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-939f2370-c170-4897-a76b-276e7cd0ee08 req-abcdf742-1114-423c-a846-e89e6977c03b service nova] Creating event network-changed:6acb8c4d-9089-480a-99ad-6c45fdf5d04c for instance e192d949-f638-4890-ae93-709a7cde5fc9 on n-h1-master-1 Oct 16 01:01:34.318637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-939f2370-c170-4897-a76b-276e7cd0ee08 req-abcdf742-1114-423c-a846-e89e6977c03b service nova] Instance e192d949-f638-4890-ae93-709a7cde5fc9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:01:34.334316 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-939f2370-c170-4897-a76b-276e7cd0ee08 req-abcdf742-1114-423c-a846-e89e6977c03b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093592 Oct 16 01:01:34.335441 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 236/434] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:34.343094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:34.344164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:34.353316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:34.354190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:34.354972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:34.356107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:34.357633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:34.358285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:34.619078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.633274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.637551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.648527 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-735e903d-f21f-40c4-bc2e-e07f4b0bce46 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.311650 Oct 16 01:01:34.649835 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 237/435] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:34 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:34.671650 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.685022 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.688742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:34.692405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d3452fdb-7659-4a21-a4ef-321f630af581 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1361 microversion: 2.25 time: 0.613529 Oct 16 01:01:34.693016 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 199/436] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:34 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1361 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:35.100484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:35.101089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:35.109963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.113302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.114021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.114947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.115638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.118028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.261136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:35.262297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:35.277268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.281963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.283790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.290122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.291074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.292062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.590186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:35.599221 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0b3f343a-b0a3-4208-a655-48f93100aa31 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1278 microversion: 2.1 time: 0.502934 Oct 16 01:01:35.600078 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 238/437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:35 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1278 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:35.677283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:35.678559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:35.684647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.685394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.686022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.686717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.687385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.688025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.821723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:35.830894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:35.832596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:35.843630 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-720e4e65-a103-4e7f-aa09-ccbd73509d59 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.169669 Oct 16 01:01:35.845963 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 239/438] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:35 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:01:35.852624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:35.853270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:35.861641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.863044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.863700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.864679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:35.865414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:35.866052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:35.919783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:35.931554 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d5e625f-f966-4005-92e6-2561cfe51dc3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1474 microversion: 2.1 time: 0.675058 Oct 16 01:01:35.949772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 200/439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:35 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1474 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:36.163143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:36.171934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:36.176257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:36.183447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e8c2cb80-8470-4373-8576-ef4a350b67ed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1361 microversion: 2.25 time: 0.331790 Oct 16 01:01:36.184414 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 240/440] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:35 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1361 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:36.383073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9d9409aa-c2c5-4160-8b8e-9f7cec3c6b17 req-d1a912b6-d7ed-4093-911b-abb46dc1a8bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcd2fd0-7e22-4fd8-8351-40036992c044", "tag": "999d0092-14b3-4ca8-9e4f-4b440ec19b20"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:36.407916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9d9409aa-c2c5-4160-8b8e-9f7cec3c6b17 req-d1a912b6-d7ed-4093-911b-abb46dc1a8bf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:36.408497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9d9409aa-c2c5-4160-8b8e-9f7cec3c6b17 req-d1a912b6-d7ed-4093-911b-abb46dc1a8bf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:36.410871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9d9409aa-c2c5-4160-8b8e-9f7cec3c6b17 req-d1a912b6-d7ed-4093-911b-abb46dc1a8bf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:36.452493 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9d9409aa-c2c5-4160-8b8e-9f7cec3c6b17 req-d1a912b6-d7ed-4093-911b-abb46dc1a8bf service nova] Creating event network-changed:999d0092-14b3-4ca8-9e4f-4b440ec19b20 for instance efcd2fd0-7e22-4fd8-8351-40036992c044 on n-h2-master-1 Oct 16 01:01:36.461057 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9d9409aa-c2c5-4160-8b8e-9f7cec3c6b17 req-d1a912b6-d7ed-4093-911b-abb46dc1a8bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085041 Oct 16 01:01:36.463243 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 201/441] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:36.621551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:36.622157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:36.645336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:36.645889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:36.646443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:36.649288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:36.649804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:36.650243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:36.877213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:36.878636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:36.890996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:36.892765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:36.894820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:36.897609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:36.906127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:36.908502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:37.147663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:37.161764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:37.163337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:37.173953 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a73fcc13-5ec2-4fe1-82a6-0665fd931d48 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.303915 Oct 16 01:01:37.175621 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 202/442] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:36 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:37.187256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:37.188613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:37.217331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:37.219373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:37.220202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:37.221812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:37.222646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:37.223174 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:37.224648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:37.235605 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a42d0c21-ece8-4e28-8fc6-426a41d7bbe4 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 0.617712 Oct 16 01:01:37.236454 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 241/443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:36 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:37.692334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:37.704863 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a2a4ae9-3cd3-4858-82f8-bd761e120b79 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1471 microversion: 2.1 time: 0.527592 Oct 16 01:01:37.706237 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 203/444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:37 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1471 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:37.713013 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:37.713835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:37.727168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:37.736631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:37.738062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:37.739623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:37.740303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:37.740882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:37.794980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b45df793-5972-4998-98e0-ffe138da2b32 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Action: 'create', calling method: .version_select at 0x7fd64ecdeb80>, body: {"keypair": {"name": "tempest-keypair-288042390", "type": "ssh", "user_id": "04a64f25f091497ea9f5dec42ad3cecc", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoTY2pTBQGuo3F2IzMq+F8Fx0k4ijijWhHU9tIfy6UMjQugwmjCDDNuNg9ZKp7oouKgKqTwfE4Pk1aEeBENj5l+e2CXbYJThtNNqlP2H4fPJtSZnMiMFY4gfom2EYZ/Hw=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:37.857974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b45df793-5972-4998-98e0-ffe138da2b32 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Getting quotas for project a2582367c3a340f8bce00a4517a17c14. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:37.875065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b45df793-5972-4998-98e0-ffe138da2b32 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Getting quotas for user 767deea0bd28443fa71c996a75e7fbc9 and project a2582367c3a340f8bce00a4517a17c14. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:37.954297 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b45df793-5972-4998-98e0-ffe138da2b32 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.715746 Oct 16 01:01:37.966941 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 242/445] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:01:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 729 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:01:37.973915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:37.974692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:37.982560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:37.983345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:37.983938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:37.984807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:37.985423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:37.986021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.083895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.098568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.100740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.102584 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fa97f3fc-3ba2-4839-8ec5-2c72e4597425 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1361 microversion: 2.25 time: 0.394022 Oct 16 01:01:38.104068 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 204/446] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:37 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1361 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:38.109047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b7d81211-3c5f-47ee-9ce8-b9f254fe50cd tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Action: 'create', calling method: .version_select at 0x7fd64ea9a310>, body: {"keypair": {"name": "tempest-keypair-888566565", "type": "ssh", "user_id": "04a64f25f091497ea9f5dec42ad3cecc", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbY2m4wZDHeMnDvzbzuVRqtDzVy9+erlqKOr9DjJY28XEO+jGltwvbFemVNacZfuDdLVZCNbSvr48NIJ9t1j2/GV1RR2NZN8q7dpL92fYsYxhRxaP8zVWFMQW/hnjdnkg=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:38.117717 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a49bfec-f99a-41f8-b339-f10fdfe0f3d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9/action" status: 204 len: 0 microversion: 2.1 time: 0.149350 Oct 16 01:01:38.121315 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 243/447] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:01:37 2022] POST /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9/action => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:38.129458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.129458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:38.141064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.141562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.142001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.148589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.150313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.151514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.155884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b7d81211-3c5f-47ee-9ce8-b9f254fe50cd tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Getting quotas for project a2582367c3a340f8bce00a4517a17c14. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:38.161620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b7d81211-3c5f-47ee-9ce8-b9f254fe50cd tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Getting quotas for user 767deea0bd28443fa71c996a75e7fbc9 and project a2582367c3a340f8bce00a4517a17c14. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:38.205355 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b7d81211-3c5f-47ee-9ce8-b9f254fe50cd tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.099905 Oct 16 01:01:38.207265 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 205/448] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:01:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:01:38.219010 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.220222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:38.228166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.228980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.229665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.230597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.231402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.232170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.363938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.372720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.374471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.377914 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:38.382177 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-42358e04-d103-4085-bdac-0dbd8410bbbe tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.173528 Oct 16 01:01:38.383776 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 206/449] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:38 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:38.388696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-67caca5f-c7a0-4ada-abdf-b8203d8f02b5 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Calling method '.version_select at 0x7fd64e8248b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.401744 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-67caca5f-c7a0-4ada-abdf-b8203d8f02b5 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-288042390?user_id=04a64f25f091497ea9f5dec42ad3cecc" status: 200 len: 511 microversion: 2.10 time: 0.016525 Oct 16 01:01:38.412202 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 207/450] 10.222.0.39 () {60 vars in 1337 bytes} [Sun Oct 16 01:01:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-288042390?user_id=04a64f25f091497ea9f5dec42ad3cecc => generated 511 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:38.420654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.420654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:38.435584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.436119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.436868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.437685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.438400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.439076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.457660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.473450 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-18407ffa-8de8-4b10-b6e7-28760f6f95fd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1471 microversion: 2.1 time: 0.350047 Oct 16 01:01:38.474777 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 244/451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:38 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:38.480035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e3e55c9-185d-4213-9dc1-704553c30da1 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Action: 'create', calling method: .version_select at 0x7fd64ed2f4c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1038444114", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9Vy+RDcGZDnE/k5vWTbg/OH2h4qxxYmvewJ2G2L+IWF0au5+6IthHwlFpjEEmCz9vO6arQ/4R3O+QW4RpPTWU9Kq0AdiWxJWgREXEaxUlenPNtokQlDFj2DgOo+xXfzw=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:38.496429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4e3e55c9-185d-4213-9dc1-704553c30da1 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Getting quotas for project a2582367c3a340f8bce00a4517a17c14. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:38.500799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4e3e55c9-185d-4213-9dc1-704553c30da1 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Getting quotas for user 767deea0bd28443fa71c996a75e7fbc9 and project a2582367c3a340f8bce00a4517a17c14. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:38.531658 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4e3e55c9-185d-4213-9dc1-704553c30da1 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.055392 Oct 16 01:01:38.532466 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 245/452] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:01:38 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:01:38.562990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-549a0d5b-8442-4f97-a39d-211837498157 req-e82f63c8-8f0c-40ec-abc8-89665f0cafcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6", "tag": "2aad5d5c-fca7-43f5-b503-0a5d8c7aedc4"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:38.576906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-549a0d5b-8442-4f97-a39d-211837498157 req-e82f63c8-8f0c-40ec-abc8-89665f0cafcf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:38.577827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-549a0d5b-8442-4f97-a39d-211837498157 req-e82f63c8-8f0c-40ec-abc8-89665f0cafcf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:38.578472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-549a0d5b-8442-4f97-a39d-211837498157 req-e82f63c8-8f0c-40ec-abc8-89665f0cafcf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:38.590833 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-549a0d5b-8442-4f97-a39d-211837498157 req-e82f63c8-8f0c-40ec-abc8-89665f0cafcf service nova] Creating event network-changed:2aad5d5c-fca7-43f5-b503-0a5d8c7aedc4 for instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 on n-h2-master-1 Oct 16 01:01:38.596612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-549a0d5b-8442-4f97-a39d-211837498157 req-e82f63c8-8f0c-40ec-abc8-89665f0cafcf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055634 Oct 16 01:01:38.597590 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 246/453] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:38.604107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30d43df1-203f-4685-b21b-0c8301115c30 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Calling method '.version_select at 0x7fd64eb79f70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.608502 n-d-master-1 devstack@n-api.service[120545]: WARNING oslo_db.sqlalchemy.utils [None req-30d43df1-203f-4685-b21b-0c8301115c30 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 16 01:01:38.618177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30d43df1-203f-4685-b21b-0c8301115c30 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] 10.222.0.39 "GET /compute/v2.1/os-keypairs?user_id=04a64f25f091497ea9f5dec42ad3cecc" status: 200 len: 724 microversion: 2.10 time: 0.019054 Oct 16 01:01:38.624966 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 247/454] 10.222.0.39 () {60 vars in 1259 bytes} [Sun Oct 16 01:01:38 2022] GET /compute/v2.1/os-keypairs?user_id=04a64f25f091497ea9f5dec42ad3cecc => generated 724 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:38.630384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8535ef1-b4b3-4799-a188-e3140ccd0da1 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Calling method '.version_select at 0x7fd64ec061f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.655121 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8535ef1-b4b3-4799-a188-e3140ccd0da1 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1038444114" status: 204 len: 0 microversion: 2.10 time: 0.028111 Oct 16 01:01:38.655807 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 248/455] 10.222.0.39 () {60 vars in 1325 bytes} [Sun Oct 16 01:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1038444114 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:01:38.665073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca66fc95-6892-4390-94ce-ffd807f4af3a tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Calling method '.version_select at 0x7fd64eb680d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.687077 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca66fc95-6892-4390-94ce-ffd807f4af3a tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888566565?user_id=04a64f25f091497ea9f5dec42ad3cecc" status: 204 len: 0 microversion: 2.10 time: 0.025928 Oct 16 01:01:38.687931 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 249/456] 10.222.0.39 () {60 vars in 1340 bytes} [Sun Oct 16 01:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888566565?user_id=04a64f25f091497ea9f5dec42ad3cecc => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 16 01:01:38.698406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7090aec1-41af-443f-ad35-841dd2205716 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] Calling method '.version_select at 0x7fd64eb79af0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:38.702109 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:38.720397 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7090aec1-41af-443f-ad35-841dd2205716 tempest-KeyPairsV210TestJSON-764856420 tempest-KeyPairsV210TestJSON-764856420-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288042390?user_id=04a64f25f091497ea9f5dec42ad3cecc" status: 204 len: 0 microversion: 2.10 time: 0.026505 Oct 16 01:01:38.726317 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 250/457] 10.222.0.39 () {60 vars in 1340 bytes} [Sun Oct 16 01:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288042390?user_id=04a64f25f091497ea9f5dec42ad3cecc => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 16 01:01:38.726642 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6272ded7-eb1a-48ad-8491-d8cac75a81ec tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 0.308933 Oct 16 01:01:38.736950 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 208/458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:38 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:39.136006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:39.137895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:39.152921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:39.153416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:39.153853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:39.158326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:39.160393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:39.163013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:39.414678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:39.415328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:39.430084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:39.436450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:39.436901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:39.437655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:39.438119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:39.438550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:39.767448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:39.784600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:39.786273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:39.801197 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b30cddec-29fd-47cc-b8c4-72aa5478dc6c tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.390517 Oct 16 01:01:39.802216 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 209/459] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:39 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:39.806880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:39.807792 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:39.814167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:39.815015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:39.815832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:39.816758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:39.817443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:39.818079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:39.821313 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:40.124492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:40.140845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:40.142617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:40.151683 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1937caff-1704-4026-84c6-10857f9e656b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1361 microversion: 2.25 time: 1.021367 Oct 16 01:01:40.152718 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 251/460] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:39 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1361 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:40.157704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:40.159796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:40.164637 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:40.176546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:40.177403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:40.179322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:40.180268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:40.182395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:40.183097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:40.508735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:40.523442 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fca12ff-8d6e-4c50-a3a7-88534476c3f6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1471 microversion: 2.1 time: 0.720040 Oct 16 01:01:40.553487 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 210/461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:39 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1471 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:40.661728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:40.681410 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c04f319e-e86e-4351-98f4-fc77c26996ed tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 0.526509 Oct 16 01:01:40.683641 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 252/462] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:40 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:40.837499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:40.839634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:40.847760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:40.848938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:40.849536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:40.852120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:40.853264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:40.853865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.091365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:41.103253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:41.105400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:41.111898 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b0bb9ad-f504-4e39-9746-59935f56b4de tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.279180 Oct 16 01:01:41.124136 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 211/463] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:40 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:41.183315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:41.183922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:41.196349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.197480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.199945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.203878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.204613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.205216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.567633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:41.568259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:41.580953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:41.597397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.598031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.598396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:41.598551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.603412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:41.605599 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-66481b45-a788-4261-b337-929dc1fdf806 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1361 microversion: 2.25 time: 0.427430 Oct 16 01:01:41.606281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.609470 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 253/464] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:41 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1361 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:41.619797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.621338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.711756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:41.712674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:41.729860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.732077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.732638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.735007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:41.739390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:41.741743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:41.776923 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:42.160000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:42.166322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:42.175936 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19f32d45-ae6e-47ea-90d3-bc3ce77e197b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1471 microversion: 2.1 time: 0.617225 Oct 16 01:01:42.179126 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 212/465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:41 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1471 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:42.179612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f2b85f8-1913-43da-8d91-a7efe1817703 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 0.473294 Oct 16 01:01:42.180245 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 254/466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:41 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:42.209027 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:42.209791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:42.225582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:42.228516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:42.229007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:42.229792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:42.231959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:42.233294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:42.245814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-dd1c926f-39cd-4177-b42c-08c3428c0ac6 req-110b309e-7fb6-42fe-bc71-aeb385811952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192d949-f638-4890-ae93-709a7cde5fc9", "name": "network-vif-plugged", "status": "completed", "tag": "6acb8c4d-9089-480a-99ad-6c45fdf5d04c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:42.264477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-dd1c926f-39cd-4177-b42c-08c3428c0ac6 req-110b309e-7fb6-42fe-bc71-aeb385811952 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:42.266563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-dd1c926f-39cd-4177-b42c-08c3428c0ac6 req-110b309e-7fb6-42fe-bc71-aeb385811952 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:42.268455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-dd1c926f-39cd-4177-b42c-08c3428c0ac6 req-110b309e-7fb6-42fe-bc71-aeb385811952 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:42.296907 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-dd1c926f-39cd-4177-b42c-08c3428c0ac6 req-110b309e-7fb6-42fe-bc71-aeb385811952 service nova] Creating event network-vif-plugged:6acb8c4d-9089-480a-99ad-6c45fdf5d04c for instance e192d949-f638-4890-ae93-709a7cde5fc9 on n-h1-master-1 Oct 16 01:01:42.309872 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-dd1c926f-39cd-4177-b42c-08c3428c0ac6 req-110b309e-7fb6-42fe-bc71-aeb385811952 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067755 Oct 16 01:01:42.312357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 255/467] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:42.530285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:42.546947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:42.552368 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:42.560772 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-621a4be1-3de1-494f-af88-b6c31bef3c58 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.378286 Oct 16 01:01:42.563184 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 213/468] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:42 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:42.635988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:42.637024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:42.646145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:42.646861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:42.647575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:42.648742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:42.649588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:42.650304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:42.894010 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=5 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:43.036721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:43.068463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:43.070322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:43.071737 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-12cea604-4f33-470e-a459-1827f37d0929 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1361 microversion: 2.25 time: 0.440281 Oct 16 01:01:43.072488 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 256/469] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:42 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1361 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:43.219665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:43.220316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:43.231944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:43.244597 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:43.248363 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=9 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:43.251934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:43.254398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:43.255114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:43.258737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:43.259453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:43.263116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:43.265158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:43.265720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:43.266087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:43.266791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:43.277896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:43.278352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:43.945574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:43.965914 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-52ec7424-8fd6-4723-be9d-72bcc8957197 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1463 microversion: 2.1 time: 0.752723 Oct 16 01:01:43.968102 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 214/470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:43 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1463 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:43.996958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:43.999026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:44.018784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.019376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.023342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.024338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.025031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.025682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.043907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:44.056738 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e79fe5ec-206e-4ba7-be95-24fa699d1c3b tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 0.842639 Oct 16 01:01:44.057476 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 257/471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:43 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:44.065773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:44.066421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:44.110418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.111478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.112790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.113689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.114520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.115150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.254842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:44.267099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:44.283453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:44.302739 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88d9f9c1-3e5c-4cd8-8e39-56d0fdb2b5c1 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.331461 Oct 16 01:01:44.303386 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 215/472] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:43 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:44.320871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:44.322079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:44.352952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.355959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.356407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.357729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.357897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.361332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.620305 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52ee06fb-8351-4333-94bb-7989117426fc tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1614 microversion: 2.1 time: 0.559886 Oct 16 01:01:44.640921 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 258/473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:44 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1614 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:44.662238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1068cd68-043a-4ba8-ae07-2bd2ff31d93b req-6d8cdb43-d028-4a4e-b025-ef8980a3e427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcd2fd0-7e22-4fd8-8351-40036992c044", "name": "network-vif-plugged", "status": "completed", "tag": "999d0092-14b3-4ca8-9e4f-4b440ec19b20"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:44.677958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1068cd68-043a-4ba8-ae07-2bd2ff31d93b req-6d8cdb43-d028-4a4e-b025-ef8980a3e427 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.678718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1068cd68-043a-4ba8-ae07-2bd2ff31d93b req-6d8cdb43-d028-4a4e-b025-ef8980a3e427 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.679451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1068cd68-043a-4ba8-ae07-2bd2ff31d93b req-6d8cdb43-d028-4a4e-b025-ef8980a3e427 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.704948 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1068cd68-043a-4ba8-ae07-2bd2ff31d93b req-6d8cdb43-d028-4a4e-b025-ef8980a3e427 service nova] Creating event network-vif-plugged:999d0092-14b3-4ca8-9e4f-4b440ec19b20 for instance efcd2fd0-7e22-4fd8-8351-40036992c044 on n-h2-master-1 Oct 16 01:01:44.713059 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1068cd68-043a-4ba8-ae07-2bd2ff31d93b req-6d8cdb43-d028-4a4e-b025-ef8980a3e427 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069881 Oct 16 01:01:44.714376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 259/474] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:44.723438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e4c1993-fc22-43e1-b88d-360b90769f57 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '.version_select at 0x7fd64ed2f4c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:44.728744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e4c1993-fc22-43e1-b88d-360b90769f57 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:44.730065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e4c1993-fc22-43e1-b88d-360b90769f57 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:44.730818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e4c1993-fc22-43e1-b88d-360b90769f57 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:44.747424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4e4c1993-fc22-43e1-b88d-360b90769f57 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.030511 Oct 16 01:01:44.752174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:44.764286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:44.765736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:44.766870 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac1bed8d-ada2-46e9-ad78-8e092ac89913 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1361 microversion: 2.25 time: 0.459558 Oct 16 01:01:44.768906 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 260/475] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:01:44 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:44.775257 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 216/476] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:44 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:45.074696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1429486256", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:45.080217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:45.082926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:45.100362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.100861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.101290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.104942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.105604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.107137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.157388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:45.522655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:45.538490 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16c598fc-2d27-46a7-a78e-78bb45691024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 0.462418 Oct 16 01:01:45.539111 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 217/477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:45 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:45.546744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:45.550107 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:45.572224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.574002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.575106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.578672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.582210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.582210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.766691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:45.787545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:45.791979 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:45.816412 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-279b5576-4cc2-41a2-974f-58631ed43198 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.274600 Oct 16 01:01:45.818182 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 218/478] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:45 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:45.839140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:45.841142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:45.852436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.853960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.854366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:45.855361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.855485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:45.856013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:45.856594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:45.856849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.857078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:45.857804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.858441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.879260 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=69 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:45.879260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.879260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.879260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.879597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:45.880134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:45.880751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:45.960846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:45.976462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for user f3b14e05c41648159d8ed97719c68862 and project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:46.002086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:46.006353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:46.099944 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97596eab-0124-4d81-b0a2-71c986d466d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025923 Oct 16 01:01:46.111496 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 261/479] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:01:46.129149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d3172f8b-c491-4456-87a3-127f122382a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.129930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d3172f8b-c491-4456-87a3-127f122382a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:46.150300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:46.162816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:46.165570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:46.166901 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4de3e29-269f-4619-ae88-b8a6256ac5af tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1361 microversion: 2.25 time: 0.347563 Oct 16 01:01:46.196415 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 219/480] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:45 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1361 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:46.293301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d3172f8b-c491-4456-87a3-127f122382a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:46.301974 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d3172f8b-c491-4456-87a3-127f122382a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1213 microversion: 2.1 time: 0.189019 Oct 16 01:01:46.302548 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 262/481] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:46.521851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f362cd74-82cc-4d35-be64-10524be42e60 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.528644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f362cd74-82cc-4d35-be64-10524be42e60 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.530100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f362cd74-82cc-4d35-be64-10524be42e60 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.532891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f362cd74-82cc-4d35-be64-10524be42e60 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.535429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f362cd74-82cc-4d35-be64-10524be42e60 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.537117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f362cd74-82cc-4d35-be64-10524be42e60 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.539222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f362cd74-82cc-4d35-be64-10524be42e60 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.573945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.575036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:46.588094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.590722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.591380 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.592502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.594078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.594570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.616670 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f362cd74-82cc-4d35-be64-10524be42e60 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.418300 Oct 16 01:01:46.620213 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 220/482] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:46.633115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bfa7856b-2520-4cd8-bbb5-90c01ff3667d tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.645860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfa7856b-2520-4cd8-bbb5-90c01ff3667d tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.646360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfa7856b-2520-4cd8-bbb5-90c01ff3667d tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.647092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfa7856b-2520-4cd8-bbb5-90c01ff3667d tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.647986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfa7856b-2520-4cd8-bbb5-90c01ff3667d tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.648616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfa7856b-2520-4cd8-bbb5-90c01ff3667d tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.649441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfa7856b-2520-4cd8-bbb5-90c01ff3667d tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.717065 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bfa7856b-2520-4cd8-bbb5-90c01ff3667d tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.086806 Oct 16 01:01:46.719195 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 221/483] 10.222.0.39 () {58 vars in 1172 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:46.735159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c28e4ef3-bfd3-4370-9b15-63af4f270b93 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.742444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28e4ef3-bfd3-4370-9b15-63af4f270b93 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.747113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28e4ef3-bfd3-4370-9b15-63af4f270b93 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.748511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28e4ef3-bfd3-4370-9b15-63af4f270b93 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.752061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28e4ef3-bfd3-4370-9b15-63af4f270b93 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.753700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28e4ef3-bfd3-4370-9b15-63af4f270b93 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.754455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28e4ef3-bfd3-4370-9b15-63af4f270b93 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.812151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c28e4ef3-bfd3-4370-9b15-63af4f270b93 tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083034 Oct 16 01:01:46.813340 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 222/484] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:46.829365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-09785ca2-9c2c-4e89-8e68-3c60d5c8029e tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.842611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09785ca2-9c2c-4e89-8e68-3c60d5c8029e tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.843159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09785ca2-9c2c-4e89-8e68-3c60d5c8029e tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.848104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09785ca2-9c2c-4e89-8e68-3c60d5c8029e tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.849085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09785ca2-9c2c-4e89-8e68-3c60d5c8029e tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.849673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09785ca2-9c2c-4e89-8e68-3c60d5c8029e tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:46.850010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09785ca2-9c2c-4e89-8e68-3c60d5c8029e tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:46.926674 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-09785ca2-9c2c-4e89-8e68-3c60d5c8029e tempest-ServicesAdminTestJSON-1163312525 tempest-ServicesAdminTestJSON-1163312525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.102439 Oct 16 01:01:46.927383 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 223/485] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:01:46.962730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:46.966517 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:46.985858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:46.987383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.000026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.001988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.006952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.007551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.041498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.059966 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2b4c39c-ba94-4c3f-8921-2c198abf17e5 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 0.491472 Oct 16 01:01:47.065097 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 263/486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:47.199258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:47.200210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:47.217307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.224606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.225253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.226311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.228337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.229070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.231315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.232913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.233461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.252185 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-790040ab-7ae3-4af9-930c-acdec6bc9a9f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.310053 Oct 16 01:01:47.256995 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 224/487] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:46 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:47.332362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:47.333085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:47.348549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.350046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.350739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.351715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.352407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.353044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.506883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.528338 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c2f8b7c-56d2-49e6-a9aa-f97fe6722259 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1217 microversion: 2.1 time: 0.202711 Oct 16 01:01:47.529430 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 225/488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:47 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:47.751472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.770428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.772295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:47.785200 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8eb6ca8-1e8b-4885-9bc2-39be33be382a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1557 microversion: 2.25 time: 0.580288 Oct 16 01:01:47.799960 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 264/489] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:47 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1557 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:47.813733 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:47.815257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:47.828738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.831778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.833281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:47.840595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:47.842690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:47.843485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.085431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:48.086202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:48.095186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.095681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.096193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.097086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:48.097542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:48.097964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:48.181124 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=42 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:49.165047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid efcd2fd0-7e22-4fd8-8351-40036992c044 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:49.191282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-50c1b367-57be-47a6-8f11-ef22e1244286 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 2049 microversion: 2.25 time: 1.380390 Oct 16 01:01:49.192584 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 226/490] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:47 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 2049 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:49.198621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:49.199457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:49.210730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.211520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.212127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.214018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.214813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.215453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.321546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:49.335681 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f9e6352-f584-499d-9335-7a606d60973a tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 1.253427 Oct 16 01:01:49.341073 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 265/491] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:48 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:49.346503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:49.347342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:49.362325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.363206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.363331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.364056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.364459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.368101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.368314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:49.394627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:49.396576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:49.406031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ee645fbe-790a-4250-b635-466cd0b3d41d tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.212161 Oct 16 01:01:49.406975 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 227/492] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:49 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:49.539683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:49.557526 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f64cf957-66fa-4c6e-a76e-af3ec4dd6081 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1271 microversion: 2.1 time: 0.215163 Oct 16 01:01:49.575488 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 266/493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:49 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:49.591048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:49.592750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:49.599202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1447052619", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "d913236b-fc96-417f-b3dc-f721aca4db73"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:49.600704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.601487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.602135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.603114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:49.603768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:49.604382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:49.657003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] validate_networks() for [('d913236b-fc96-417f-b3dc-f721aca4db73', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:50.125630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid efcd2fd0-7e22-4fd8-8351-40036992c044 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:50.179171 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2bcb210a-9245-4faf-a953-374dd0dcd0e0 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 2049 microversion: 2.25 time: 0.600356 Oct 16 01:01:50.198488 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 267/494] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:49 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 2049 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:50.211989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c63b89ee-96a0-4b1b-903f-cdb254bb42e1 req-5dc98974-7541-41d9-9e41-7915aeec4145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6", "name": "network-vif-plugged", "status": "completed", "tag": "2aad5d5c-fca7-43f5-b503-0a5d8c7aedc4"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:50.251443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c63b89ee-96a0-4b1b-903f-cdb254bb42e1 req-5dc98974-7541-41d9-9e41-7915aeec4145 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.255118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c63b89ee-96a0-4b1b-903f-cdb254bb42e1 req-5dc98974-7541-41d9-9e41-7915aeec4145 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.258910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c63b89ee-96a0-4b1b-903f-cdb254bb42e1 req-5dc98974-7541-41d9-9e41-7915aeec4145 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.293048 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c63b89ee-96a0-4b1b-903f-cdb254bb42e1 req-5dc98974-7541-41d9-9e41-7915aeec4145 service nova] Creating event network-vif-plugged:2aad5d5c-fca7-43f5-b503-0a5d8c7aedc4 for instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 on n-h2-master-1 Oct 16 01:01:50.303228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c63b89ee-96a0-4b1b-903f-cdb254bb42e1 req-5dc98974-7541-41d9-9e41-7915aeec4145 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104261 Oct 16 01:01:50.304358 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 268/495] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:50.312866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1b6cdf9-2fc8-40b1-b494-6ff0e469b663 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:50.318611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1b6cdf9-2fc8-40b1-b494-6ff0e469b663 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.319398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1b6cdf9-2fc8-40b1-b494-6ff0e469b663 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.319996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1b6cdf9-2fc8-40b1-b494-6ff0e469b663 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.320966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1b6cdf9-2fc8-40b1-b494-6ff0e469b663 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.321601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1b6cdf9-2fc8-40b1-b494-6ff0e469b663 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.322661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1b6cdf9-2fc8-40b1-b494-6ff0e469b663 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.384562 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1b6cdf9-2fc8-40b1-b494-6ff0e469b663 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.076615 Oct 16 01:01:50.385494 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 269/496] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Oct 16 01:01:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:01:50.390821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:50.391765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:50.412423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.417150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.420086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:50.420890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:50.421514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:50.421956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.153336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:51.161607 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b919854-d1fd-49df-be28-56e73af141b8 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1320 microversion: 2.1 time: 0.775056 Oct 16 01:01:51.162595 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 270/497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:50 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1320 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:51.168841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:51.169962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:51.179864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.180439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.180946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.181782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.182355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.182885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.436427 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2d80714d-3c02-42e1-9638-7d16c8ffda74 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044/action" status: 202 len: 0 microversion: 2.25 time: 0.264442 Oct 16 01:01:51.438304 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 271/498] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:01:51 2022] POST /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:51.453218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:51.461486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:51.469007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.469813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.470638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.472139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.472838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.473538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.509518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:01:51.511252 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:01:51.511945 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:01:51.512641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:01:51.513209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:01:51.528962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.529978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.531911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.534155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.534637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.535103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.579344 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Getting quotas for project 8b4ef535b0684c0180329169a5765107. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:01:51.584761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Getting quotas for user 37a61a57ad4448eba9c1bd8762d3a149 and project 8b4ef535b0684c0180329169a5765107. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:01:51.607340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:01:51.609827 n-d-master-1 devstack@n-api.service[120546]: WARNING nova.utils [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1447052619 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-144705261 Oct 16 01:01:51.610837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:01:51.706107 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f7bcd4c2-18da-494d-aeb0-05b423ec4964 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.297516 Oct 16 01:01:51.707534 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 228/499] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:01:51.718215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:51.719627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:51.734111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.734609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.735158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.735865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:51.736321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:51.737278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:51.957355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:51.966929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:51.978264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:51.992104 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4467cec4-3405-47cc-819d-951908edce29 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.552082 Oct 16 01:01:51.992706 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 272/500] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:51 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:52.022892 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:52.023893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:52.035671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.036538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.037209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.038540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.039706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.041859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.138433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:52.140933 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:52.153845 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c0c210a6-6d34-4a2b-84b0-ad3c2ab7d918 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1271 microversion: 2.1 time: 0.444891 Oct 16 01:01:52.160928 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 229/501] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:51 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1271 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:52.179594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8e615d2-6756-431d-819c-39aca504ce33 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:52.184485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d8e615d2-6756-431d-819c-39aca504ce33 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:52.535334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d8e615d2-6756-431d-819c-39aca504ce33 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:52.547096 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8e615d2-6756-431d-819c-39aca504ce33 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1232 microversion: 2.1 time: 0.384709 Oct 16 01:01:52.547974 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 230/502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:52 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1232 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:52.570521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:52.571755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:52.579415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.580306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.581566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.582651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:52.583493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:52.584150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:52.665582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid efcd2fd0-7e22-4fd8-8351-40036992c044 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:52.698102 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c5ea4c85-ef3c-47fe-b179-d7b4d3583fe7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 2054 microversion: 2.25 time: 0.679292 Oct 16 01:01:52.700820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 273/503] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:51 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 2054 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:53.015205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:53.023914 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3261b7e2-68eb-497e-80f1-361c0eea2d30 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1469 microversion: 2.1 time: 0.457755 Oct 16 01:01:53.024520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:53.025299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:53.026814 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 231/504] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:52 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1469 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:53.036660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.040519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.041142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.044009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.044634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.045212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.054705 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:53.058710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:53.061474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:53.076229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.076801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.083765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.084695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.085244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.086003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.261637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:53.274379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:53.278150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:53.290742 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fbc0d766-280c-4439-879e-c72cc197f3d0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.269816 Oct 16 01:01:53.294344 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 274/505] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:53 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:01:53.302406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:53.303402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:53.312770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.314065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.315235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.316856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.317554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.318240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.318602 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c726d808-86e4-4103-8d6d-e8e7b81016d7 tempest-DeleteServersAdminTestJSON-1525935955 tempest-DeleteServersAdminTestJSON-1525935955-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6/action" status: 202 len: 0 microversion: 2.1 time: 0.264116 Oct 16 01:01:53.319426 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 232/506] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:01:53 2022] POST /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:01:53.329878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:53.331810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:53.349708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.350195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.350637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.354031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.354764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.355497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.425338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.426020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.426606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.427557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lazy-loading 'fault' on Instance uuid cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:53.928696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:53.942171 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8e33ec7-e256-4fbc-83aa-8951f2a633fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1313 microversion: 2.1 time: 0.645904 Oct 16 01:01:53.942822 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 275/507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:53 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:53.948934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:53.949776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:53.961731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.962636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.963231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:53.963942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:53.965317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:53.965759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.005508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:54.014224 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-17a21ac2-6053-4294-afeb-43fc63c1c024 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1452 microversion: 2.1 time: 0.689552 Oct 16 01:01:54.014981 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 233/508] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:53 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1452 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:54.020054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:54.021430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:54.027643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.028253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.028943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.029741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.030549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.031143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.098859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:54.108924 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f70b1cd-0f23-422d-9dae-d7e39da2cca5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1302 microversion: 2.1 time: 0.164854 Oct 16 01:01:54.109763 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 276/509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:53 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:54.115832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:54.116331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:54.122170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.122662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.123159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.123853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.124307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.124729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.155110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:54.254835 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5b4157d2-9aa7-4f1b-b8a1-d84fe0652f89 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 204 len: 0 microversion: 2.1 time: 0.140312 Oct 16 01:01:54.256697 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 277/510] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:54 2022] DELETE /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:54.265316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:54.266154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:54.273816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.274536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.275243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.276511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.277100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.277882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.316387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.316997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.317535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.319146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lazy-loading 'fault' on Instance uuid cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:54.848526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid efcd2fd0-7e22-4fd8-8351-40036992c044 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:54.864728 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2ac8f486-d6b6-48dd-be05-c5a7d61845bc tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 2034 microversion: 2.25 time: 0.848478 Oct 16 01:01:54.865545 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 234/511] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:54 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 2034 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:54.878892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:54.879885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:54.889323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.889928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.890452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:54.891488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:54.892648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:54.893316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.055668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:55.077541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:55.091817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:55.099811 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:55.108824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:55.112132 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a52aad46-5361-4f2f-af20-16a0ad5b0b57 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.243785 Oct 16 01:01:55.114869 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 235/512] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:54 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:55.130538 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e436f66-3d44-4b6b-b9b9-3f0a5b4268bb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1458 microversion: 2.1 time: 0.869617 Oct 16 01:01:55.131632 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 278/513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:54 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1458 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:01:55.137160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:55.137969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:55.145745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:55.152423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.153215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.153840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.154322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:55.154804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.164953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.165519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.166545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.167037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.168184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.168930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.169401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.169827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.204249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'flavor' on Instance uuid efcd2fd0-7e22-4fd8-8351-40036992c044 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:55.218446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Going to try to live migrate instance to n-h1-master-1 {{(pid=120546) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:01:55.581602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:55.596173 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e60f3312-f531-4c35-b7b2-90a5c3ebc87d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1313 microversion: 2.1 time: 0.462503 Oct 16 01:01:55.597778 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 279/514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:55 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:55.617507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:55.619121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:55.633369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.634477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.635357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.636871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:55.637702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:55.638404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:55.845083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:55.860960 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3fd37e85-1a3f-4e0d-9f1a-ef2a611ce9a6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1290 microversion: 2.1 time: 0.260852 Oct 16 01:01:55.864089 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 280/515] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:55 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1290 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:56.149541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:56.151427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:56.204596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.206283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.209692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:56.222226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.225999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.229691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:56.298304 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=7 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:56.323685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:01:56.460383 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e9cb186-e1a5-4484-806b-d5b126799d4d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 204 len: 0 microversion: 2.1 time: 0.329081 Oct 16 01:01:56.461673 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 281/516] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:01:56 2022] DELETE /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:56.468982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:56.469940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:56.479640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.481366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.481968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:56.483665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.484284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.484889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:56.904541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:56.920947 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:56.922846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:56.934785 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-25f580ea-f26e-4646-baac-5a191c9c3389 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1447 microversion: 2.75 time: 0.471396 Oct 16 01:01:56.953541 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 282/517] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:56 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1447 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:01:56.969228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:56.970258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:56.979723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.980229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.980719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:56.981485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:56.981950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:56.982377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:57.028364 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:57.035766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:57.036217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:57.036742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:57.037775 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lazy-loading 'fault' on Instance uuid cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:01:57.632351 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b15aba2-a485-4695-b304-6edb2888f299 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044/action" status: 202 len: 0 microversion: 2.25 time: 2.507851 Oct 16 01:01:57.632989 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 236/518] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:01:55 2022] POST /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044/action => generated 0 bytes in 2518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:01:57.639143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a5b75204-b32f-489e-97d6-71457c0ebc63 req-6f210dd8-8eb4-46c3-9206-d9d71ef2422d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f22d93f-cfd6-4917-932e-9373f71dcb72", "tag": "8f9e0a66-1573-4e6d-88da-36e0c3c25b99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:57.685180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a5b75204-b32f-489e-97d6-71457c0ebc63 req-6f210dd8-8eb4-46c3-9206-d9d71ef2422d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:57.693477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a5b75204-b32f-489e-97d6-71457c0ebc63 req-6f210dd8-8eb4-46c3-9206-d9d71ef2422d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:57.693975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a5b75204-b32f-489e-97d6-71457c0ebc63 req-6f210dd8-8eb4-46c3-9206-d9d71ef2422d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:57.742326 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a5b75204-b32f-489e-97d6-71457c0ebc63 req-6f210dd8-8eb4-46c3-9206-d9d71ef2422d service nova] Creating event network-changed:8f9e0a66-1573-4e6d-88da-36e0c3c25b99 for instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 on n-h1-master-1 Oct 16 01:01:57.749635 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a5b75204-b32f-489e-97d6-71457c0ebc63 req-6f210dd8-8eb4-46c3-9206-d9d71ef2422d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114504 Oct 16 01:01:57.752812 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 237/519] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:01:57.761198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:57.765805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:57.775365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:57.776489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:57.777156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:57.778375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:57.779176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:57.779821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:58.114611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf9dde9e1de4c7c8592ced74f618bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61deedbd92ca45e28838b513114952c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:58.124338 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4df7f42f-fdf7-4fb2-ab08-1ee655081e34 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 200 len: 1458 microversion: 2.1 time: 1.169701 Oct 16 01:01:58.135858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 283/520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:56 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 1458 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:58.147257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-480036765", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "86433692", "adminPass": "***", "networks": [{"uuid": "dfa88975-167b-4864-bdd9-5ec0d01fa189"}], "security_groups": [{"name": "tempest-securitygroup--314481409"}], "key_name": "tempest-keypair-1379365393", "user_data": "}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:01:58.456019 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:58.465410 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-035afdc2-a405-434f-b492-1d23a9a61df1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1313 microversion: 2.1 time: 0.711027 Oct 16 01:01:58.466013 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 238/521] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:57 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:58.494324 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:58.496483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:58.518434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:58.519258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:58.520474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:58.521571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:58.523803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:58.524418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:58.997830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] validate_networks() for [('dfa88975-167b-4864-bdd9-5ec0d01fa189', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:01:59.901577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:01:59.916110 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dc53f08e-2abf-4f95-89c0-4b43240258a7 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1332 microversion: 2.1 time: 1.441539 Oct 16 01:01:59.931656 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 239/522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:01:58 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1332 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:01:59.943742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:01:59.944667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:01:59.957226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:59.958107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:59.958737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:01:59.960606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:01:59.961583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:01:59.962194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:00.356253 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:00.610191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:00.624095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:00.625551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:00.626738 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f2885ff3-27f8-43d5-af66-1afbb5ea1b32 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 0.693753 Oct 16 01:02:00.627400 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 240/523] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:01:59 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:00.635678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-77313769-9edd-4352-add6-311fecc30808 req-039e3a10-649b-4325-a2f5-4f0b1de3b180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6", "name": "network-vif-deleted", "tag": "2aad5d5c-fca7-43f5-b503-0a5d8c7aedc4"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:00.659268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-77313769-9edd-4352-add6-311fecc30808 req-039e3a10-649b-4325-a2f5-4f0b1de3b180 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:00.666314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-77313769-9edd-4352-add6-311fecc30808 req-039e3a10-649b-4325-a2f5-4f0b1de3b180 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:00.667013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-77313769-9edd-4352-add6-311fecc30808 req-039e3a10-649b-4325-a2f5-4f0b1de3b180 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:00.686957 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-77313769-9edd-4352-add6-311fecc30808 req-039e3a10-649b-4325-a2f5-4f0b1de3b180 service nova] Creating event network-vif-deleted:2aad5d5c-fca7-43f5-b503-0a5d8c7aedc4 for instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 on n-h2-master-1 Oct 16 01:02:00.708796 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-77313769-9edd-4352-add6-311fecc30808 req-039e3a10-649b-4325-a2f5-4f0b1de3b180 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076450 Oct 16 01:02:00.709707 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 241/524] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:00.715479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:00.716899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:00.730305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:00.731545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:00.733725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:00.736090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:00.737264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:00.740033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:00.959908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:00.976709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:00.978591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:00.985693 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-604d3bd1-94d8-4a57-bb3b-a8c2707f8b30 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1453 microversion: 2.75 time: 0.274140 Oct 16 01:02:00.988173 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 242/525] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:00 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1453 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:00.994760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:00.996149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:01.007088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:01.007809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:01.008852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:01.009636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:01.010306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:01.012386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:01.032618 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] HTTP exception thrown: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Request method failure captured: Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 HTTP/1.1 Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fR1xs0LWrFsJFgAFkcEOT0qV40ssbq3Vd8HQI7VuAYBP7MmqxbGlqVChPELXOs6vbr3dG-e-QLuB8IyLqwGYI_j7YXdHe2d1PUt1qsLvsriRwrffs0-nlVZ35cQUtEG8_Lm2sQoK579eCCyFDsYoCy-0cFz5cHyrlmtLx2gJUzlSE Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:02:01.037108 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61deedbd92ca45e28838b513114952c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61deedbd92ca45e28838b513114952c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 7cf9dde9e1de4c7c8592ced74f618bed Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: exception: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:01.038511 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6'} Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:01.039270 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:01.040821 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:01.043193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Returning 404 to user: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:01.043193 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1214ce0d-84f8-4c11-b78a-b76b3b54c523 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 404 len: 111 microversion: 2.1 time: 0.051614 Oct 16 01:02:01.043193 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 243/526] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:00 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:01.051352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:01.052209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:01.066822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:01.067600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:01.068710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:01.069696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:01.070313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:01.070965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:01.561442 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=10 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:01.775659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:01.776139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:01.776553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:01.776982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:01.777378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:01.794757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:01.795290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:01.795730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:01.797814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:01.798287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:01.798719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:01.851048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Getting quotas for project bdbebb3c197640f8b915a091c4277bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:01.860650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Getting quotas for user ea698e4b461143cfafb17befe69af2a5 and project bdbebb3c197640f8b915a091c4277bc8. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:01.887573 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:02:01.891016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:02:02.012486 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6c51d693-1953-4fc5-b18d-5b9bd6ab86b2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.868597 Oct 16 01:02:02.019166 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 284/527] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:01:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 3878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:02:02.049315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:02.050162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:02.076195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.076708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.078556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.079328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.079773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.087919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.362374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:02.371279 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ffb9b4d-72b2-4452-95ac-385d42cdcf94 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1313 microversion: 2.1 time: 1.328196 Oct 16 01:02:02.391579 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 244/528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:01 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1313 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:02.412307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:02.417127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:02.438111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.441226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.442287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.443606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.444227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.447805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.452482 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:02.477110 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] HTTP exception thrown: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Request method failure captured: Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 HTTP/1.1 Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fR1xs0LWrFsJFgAFkcEOT0qV40ssbq3Vd8HQI7VuAYBP7MmqxbGlqVChPELXOs6vbr3dG-e-QLuB8IyLqwGYI_j7YXdHe2d1PUt1qsLvsriRwrffs0-nlVZ35cQUtEG8_Lm2sQoK579eCCyFDsYoCy-0cFz5cHyrlmtLx2gJUzlSE Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:02:02.485920 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61deedbd92ca45e28838b513114952c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61deedbd92ca45e28838b513114952c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 7cf9dde9e1de4c7c8592ced74f618bed Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: exception: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:02.487546 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6'} Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:02.488391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:02.489738 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:02.493702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Returning 404 to user: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:02.495086 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a01b99e-9760-42ec-ba2d-c07d19c8a92d tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 404 len: 111 microversion: 2.1 time: 0.102259 Oct 16 01:02:02.498985 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 245/529] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:02:02 2022] DELETE /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:02.515683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:02.516477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:02.526257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.528889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.529960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.532169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.536141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.536869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.572742 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:02.776681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:02.788931 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-40dd6ce2-9126-4908-92aa-2ebc18188d70 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1332 microversion: 2.1 time: 0.771278 Oct 16 01:02:02.790634 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 285/530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:02 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1332 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:02.811916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:02.812530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:02.823453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.823957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.824389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:02.825094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:02.825551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:02.825973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:03.138023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:03.151578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:03.154118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:03.160978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97d6a2e3-70b8-4208-9803-a29324ec7fe7 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1438 microversion: 2.75 time: 0.369200 Oct 16 01:02:03.162228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 286/531] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:02 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1438 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:03.168442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:03.169515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:03.177476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.178517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.179214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:03.180274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.180947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.181588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:03.223501 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:03.525543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:03.576776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:03.583510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:03.586501 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6734c015-bc4b-4659-b3a5-a7f2ab36e9e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 1.084017 Oct 16 01:02:03.590514 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 246/532] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:02 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:03.613091 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-aa2e25e8-20ed-422a-8263-9cc723b3f4dd req-4caae084-71e3-4256-9756-3ce5beb3bfbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd3dce6-a862-4679-98ca-dfcce6e1771c", "tag": "2ea40e62-88f4-4829-868e-a6415dc26ec0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:03.641441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aa2e25e8-20ed-422a-8263-9cc723b3f4dd req-4caae084-71e3-4256-9756-3ce5beb3bfbc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.644055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aa2e25e8-20ed-422a-8263-9cc723b3f4dd req-4caae084-71e3-4256-9756-3ce5beb3bfbc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.646302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aa2e25e8-20ed-422a-8263-9cc723b3f4dd req-4caae084-71e3-4256-9756-3ce5beb3bfbc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:03.677674 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-aa2e25e8-20ed-422a-8263-9cc723b3f4dd req-4caae084-71e3-4256-9756-3ce5beb3bfbc service nova] Creating event network-changed:2ea40e62-88f4-4829-868e-a6415dc26ec0 for instance efd3dce6-a862-4679-98ca-dfcce6e1771c on n-h2-master-1 Oct 16 01:02:03.690971 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-aa2e25e8-20ed-422a-8263-9cc723b3f4dd req-4caae084-71e3-4256-9756-3ce5beb3bfbc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097981 Oct 16 01:02:03.691876 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 247/533] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:03.697296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:03.697951 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:03.721832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.722175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.722705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:03.726829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.727407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.727855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:03.755794 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] HTTP exception thrown: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Request method failure captured: Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 HTTP/1.1 Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fR1xs0LWrFsJFgAFkcEOT0qV40ssbq3Vd8HQI7VuAYBP7MmqxbGlqVChPELXOs6vbr3dG-e-QLuB8IyLqwGYI_j7YXdHe2d1PUt1qsLvsriRwrffs0-nlVZ35cQUtEG8_Lm2sQoK579eCCyFDsYoCy-0cFz5cHyrlmtLx2gJUzlSE Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:02:03.757470 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61deedbd92ca45e28838b513114952c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61deedbd92ca45e28838b513114952c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 7cf9dde9e1de4c7c8592ced74f618bed Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: exception: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:03.758859 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6'} Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:03.759764 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. Oct 16 01:02:03.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:03.762638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Returning 404 to user: Instance cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:03.762638 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c2d050a8-feac-4336-ad7d-c2211df5e3b1 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6" status: 404 len: 111 microversion: 2.1 time: 0.065713 Oct 16 01:02:03.765726 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 248/534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:03 2022] GET /compute/v2.1/servers/cdc9a0a4-00cc-4cca-a7e7-bc376b2a04b6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:03.829055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:03.849583 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-066961f3-f5f1-44cf-8dfa-8d2e6b9e40d8 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1264 microversion: 2.1 time: 0.684044 Oct 16 01:02:03.850388 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 287/535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:03 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1264 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:03.860923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:03.863949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:03.875261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.876010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.876647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:03.877656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:03.878447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:03.879057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:04.255947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:04.259781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:04.293341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:04.294296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:04.297020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:04.298144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:04.299301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:04.301296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:04.450863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:04.451824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:04.452463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:04.453071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:04.453640 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:04.553776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:04.582892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:04.588551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:04.589007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:04.590430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:04.596811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:04.599984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.428395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:05.495312 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0a3d2999-bd49-4b6c-81b4-4bd9c4ea3013 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687/action" status: 202 len: 1942 microversion: 2.75 time: 1.728029 Oct 16 01:02:05.503092 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 249/536] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:02:03 2022] POST /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687/action => generated 1942 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 16 01:02:05.508656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:05.511918 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:05.529011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.532948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.535291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.538826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.545692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.546638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.574829 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] HTTP exception thrown: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Request method failure captured: Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 HTTP/1.1 Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fR1xs0LWrFsJFgAFkcEOT0qV40ssbq3Vd8HQI7VuAYBP7MmqxbGlqVChPELXOs6vbr3dG-e-QLuB8IyLqwGYI_j7YXdHe2d1PUt1qsLvsriRwrffs0-nlVZ35cQUtEG8_Lm2sQoK579eCCyFDsYoCy-0cFz5cHyrlmtLx2gJUzlSE Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:02:05.579086 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61deedbd92ca45e28838b513114952c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61deedbd92ca45e28838b513114952c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 7cf9dde9e1de4c7c8592ced74f618bed Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: exception: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:05.580776 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'cf069461-fb58-4e25-9e57-ce50a12a2fa6'} Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:05.581517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:05.582692 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:05.586506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Returning 404 to user: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:05.589002 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a47e342-21d9-4eac-b8dd-60b55d4472cb tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 404 len: 111 microversion: 2.1 time: 0.090871 Oct 16 01:02:05.590341 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 250/537] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:02:05 2022] DELETE /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:05.596780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:05.597927 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:05.605754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.606872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.608176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:05.609514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:05.610501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:05.611426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.088489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:06.098007 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef253484-d4cb-434f-ad3e-f3ae85768c3f tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1332 microversion: 2.1 time: 0.506227 Oct 16 01:02:06.104166 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 251/538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:05 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1332 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:06.112041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-152487c1-b2d9-44a3-b531-83d5c63bde51 req-694feee9-51a1-4d5e-b240-164c4b346852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147c7739-d5f8-4098-b0a8-837bb131c35c", "name": "network-vif-unplugged", "status": "completed", "tag": "760555cd-9c65-4320-ac61-a2a8e720b843"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:06.142488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-152487c1-b2d9-44a3-b531-83d5c63bde51 req-694feee9-51a1-4d5e-b240-164c4b346852 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.143580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-152487c1-b2d9-44a3-b531-83d5c63bde51 req-694feee9-51a1-4d5e-b240-164c4b346852 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.144026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-152487c1-b2d9-44a3-b531-83d5c63bde51 req-694feee9-51a1-4d5e-b240-164c4b346852 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.148536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:06.169261 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83fd74ec-f786-48de-9a35-220cfcb87148 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1313 microversion: 2.1 time: 2.307186 Oct 16 01:02:06.169952 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 288/539] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:03 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1313 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:06.186779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:06.187433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:06.227045 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-152487c1-b2d9-44a3-b531-83d5c63bde51 req-694feee9-51a1-4d5e-b240-164c4b346852 service nova] Creating event network-vif-unplugged:760555cd-9c65-4320-ac61-a2a8e720b843 for instance 147c7739-d5f8-4098-b0a8-837bb131c35c on n-h1-master-1 Oct 16 01:02:06.229052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.229566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.230002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.232269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.234105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.235110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.238676 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-152487c1-b2d9-44a3-b531-83d5c63bde51 req-694feee9-51a1-4d5e-b240-164c4b346852 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133205 Oct 16 01:02:06.244797 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 252/540] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:06.269916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:06.270642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:06.308431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.308913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.309349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.321691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.333748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.334067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.756628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:06.766234 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2a468db-54bb-4502-ac7f-506720a8e7f0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1318 microversion: 2.1 time: 0.519908 Oct 16 01:02:06.770223 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 253/541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:06 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:06.779138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:06.798470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:06.809252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.809733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.810157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:06.817661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:06.818522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:06.821564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.091392 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:07.156931 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a6664c23-57a8-4eab-9c74-498b9bcbb248 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.383892 Oct 16 01:02:07.157527 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 254/542] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:06 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:07.184629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:07.191263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] [instance: cf069461-fb58-4e25-9e57-ce50a12a2fa6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:07.207576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.210660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.215493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.216498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.218226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.220653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.260544 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] HTTP exception thrown: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Request method failure captured: Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 HTTP/1.1 Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1fR1xs0LWrFsJFgAFkcEOT0qV40ssbq3Vd8HQI7VuAYBP7MmqxbGlqVChPELXOs6vbr3dG-e-QLuB8IyLqwGYI_j7YXdHe2d1PUt1qsLvsriRwrffs0-nlVZ35cQUtEG8_Lm2sQoK579eCCyFDsYoCy-0cFz5cHyrlmtLx2gJUzlSE Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:02:07.262153 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_61deedbd92ca45e28838b513114952c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/61deedbd92ca45e28838b513114952c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/61deedbd92ca45e28838b513114952c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 61deedbd92ca45e28838b513114952c8 Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1447797245 Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 7cf9dde9e1de4c7c8592ced74f618bed Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersAdminTestJSON-1447797245-project Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: exception: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:07.265023 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'cf069461-fb58-4e25-9e57-ce50a12a2fa6'} Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:07.265983 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. Oct 16 01:02:07.267633 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:07.269548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] Returning 404 to user: Instance cf069461-fb58-4e25-9e57-ce50a12a2fa6 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:07.269548 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e477e6bd-a932-4fe3-81ab-a5b13e18de59 tempest-DeleteServersAdminTestJSON-1447797245 tempest-DeleteServersAdminTestJSON-1447797245-project] 10.222.0.39 "GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6" status: 404 len: 111 microversion: 2.1 time: 0.099722 Oct 16 01:02:07.269548 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 255/543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:07 2022] GET /compute/v2.1/servers/cf069461-fb58-4e25-9e57-ce50a12a2fa6 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:07.285497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2b6d6f91-a757-4361-9cdb-fe6692c5390f req-9ba6a5af-ba4a-486d-9698-f6f981171caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147c7739-d5f8-4098-b0a8-837bb131c35c", "name": "network-vif-deleted", "tag": "760555cd-9c65-4320-ac61-a2a8e720b843"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:07.323209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b6d6f91-a757-4361-9cdb-fe6692c5390f req-9ba6a5af-ba4a-486d-9698-f6f981171caa service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.341414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b6d6f91-a757-4361-9cdb-fe6692c5390f req-9ba6a5af-ba4a-486d-9698-f6f981171caa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.351687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b6d6f91-a757-4361-9cdb-fe6692c5390f req-9ba6a5af-ba4a-486d-9698-f6f981171caa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.387319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2b6d6f91-a757-4361-9cdb-fe6692c5390f req-9ba6a5af-ba4a-486d-9698-f6f981171caa service nova] Creating event network-vif-deleted:760555cd-9c65-4320-ac61-a2a8e720b843 for instance 147c7739-d5f8-4098-b0a8-837bb131c35c on n-h1-master-1 Oct 16 01:02:07.406899 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2b6d6f91-a757-4361-9cdb-fe6692c5390f req-9ba6a5af-ba4a-486d-9698-f6f981171caa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126402 Oct 16 01:02:07.416413 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 256/544] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:07.434562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:07.437634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:07.452581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.454797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.456851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.459084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.460219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.461245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.689767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:07.699313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:07.700749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:07.712413 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1382e0e5-59f8-4e63-b92c-9f9abe017a03 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 1.531014 Oct 16 01:02:07.713729 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 289/545] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:06 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:07.727238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:07.728407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:07.744854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.746166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.753906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:07.754893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:07.758884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:07.759738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.298392 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:08.309118 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8bd1f54e-a5b9-43b3-a156-a5d2c1d5a2b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1332 microversion: 2.1 time: 0.890966 Oct 16 01:02:08.310212 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 257/546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:07 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1332 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:08.328343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:08.330708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:08.347653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.349369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.350513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.356565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.357265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.359041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.540448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:08.543132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:08.559067 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df8cc522-164d-4ab2-b93b-489c5b47ef83 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1318 microversion: 2.1 time: 0.243569 Oct 16 01:02:08.560275 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 258/547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:08 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:08.572547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:08.573081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:08.578344 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a2351419-798b-4207-a673-6ccec7922f7c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1313 microversion: 2.1 time: 0.862488 Oct 16 01:02:08.579460 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 290/548] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:07 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1313 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:08.598257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.600350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.601252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.602323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.603202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.603806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.740767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:08.742024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:08.759446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.760637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.761296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.762262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:08.762981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:08.763623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:08.964044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:09.002338 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98df7cb3-3f6a-4e3b-898d-662f2b5c48d2 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.435658 Oct 16 01:02:09.017633 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 259/549] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:08 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:09.335698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:09.338624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:09.340139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:09.347098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:09.355482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:09.357303 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-29af6c5c-1072-42e4-802c-c4fd567a0945 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 0.620293 Oct 16 01:02:09.358605 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 291/550] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:08 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:02:09.382391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:09.388418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:09.393376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:09.394381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:09.394882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:09.395485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:09.538217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c14e0b09-32f3-433a-af20-ad3fb9688336 req-7b2d986f-ade9-4261-9b26-bf121fdbb09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcd2fd0-7e22-4fd8-8351-40036992c044", "name": "network-vif-unplugged", "status": "completed", "tag": "999d0092-14b3-4ca8-9e4f-4b440ec19b20"}, {"name": "network-changed", "server_uuid": "efcd2fd0-7e22-4fd8-8351-40036992c044", "tag": "999d0092-14b3-4ca8-9e4f-4b440ec19b20"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:09.567170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c14e0b09-32f3-433a-af20-ad3fb9688336 req-7b2d986f-ade9-4261-9b26-bf121fdbb09d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:09.569895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c14e0b09-32f3-433a-af20-ad3fb9688336 req-7b2d986f-ade9-4261-9b26-bf121fdbb09d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:09.571187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c14e0b09-32f3-433a-af20-ad3fb9688336 req-7b2d986f-ade9-4261-9b26-bf121fdbb09d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:09.595549 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c14e0b09-32f3-433a-af20-ad3fb9688336 req-7b2d986f-ade9-4261-9b26-bf121fdbb09d service nova] Creating event network-vif-unplugged:999d0092-14b3-4ca8-9e4f-4b440ec19b20 for instance efcd2fd0-7e22-4fd8-8351-40036992c044 on n-h2-master-1 Oct 16 01:02:09.596806 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c14e0b09-32f3-433a-af20-ad3fb9688336 req-7b2d986f-ade9-4261-9b26-bf121fdbb09d service nova] Creating event network-changed:999d0092-14b3-4ca8-9e4f-4b440ec19b20 for instance efcd2fd0-7e22-4fd8-8351-40036992c044 on n-h2-master-1 Oct 16 01:02:09.603475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c14e0b09-32f3-433a-af20-ad3fb9688336 req-7b2d986f-ade9-4261-9b26-bf121fdbb09d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.069940 Oct 16 01:02:09.611773 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 292/551] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:09.623442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:09.624390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:09.637686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:09.640521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:09.640982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:09.641697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:09.643563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:09.644008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:09.684462 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:09.696651 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-66a328aa-3037-4e39-a887-a7b451222840 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1332 microversion: 2.1 time: 0.363674 Oct 16 01:02:09.697870 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 260/552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:09 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1332 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:09.704572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:09.706274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:09.713914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:09.714673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:09.715838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:09.716797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:09.717606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:09.718430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.016754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:10.045440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:10.056649 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-686ddc03-4ef3-4728-b033-865ae2cbf293 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1385 microversion: 2.1 time: 0.432206 Oct 16 01:02:10.069389 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 293/553] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:09 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1385 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:10.087999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:10.088614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:10.089942 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-653b8f6d-636b-4874-9af8-9275bd9143fe tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1313 microversion: 2.1 time: 0.388264 Oct 16 01:02:10.110370 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 261/554] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:09 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:10.122554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.123351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.123951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.124818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.126217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.129475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.273633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-cee6b0b1-5c56-43e3-b472-60c1b9438911 req-5f192091-5411-4965-bf98-d808b7e85906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f22d93f-cfd6-4917-932e-9373f71dcb72", "name": "network-vif-plugged", "status": "completed", "tag": "8f9e0a66-1573-4e6d-88da-36e0c3c25b99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:10.305570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cee6b0b1-5c56-43e3-b472-60c1b9438911 req-5f192091-5411-4965-bf98-d808b7e85906 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.308161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cee6b0b1-5c56-43e3-b472-60c1b9438911 req-5f192091-5411-4965-bf98-d808b7e85906 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.311119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cee6b0b1-5c56-43e3-b472-60c1b9438911 req-5f192091-5411-4965-bf98-d808b7e85906 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.337612 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-cee6b0b1-5c56-43e3-b472-60c1b9438911 req-5f192091-5411-4965-bf98-d808b7e85906 service nova] Creating event network-vif-plugged:8f9e0a66-1573-4e6d-88da-36e0c3c25b99 for instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 on n-h1-master-1 Oct 16 01:02:10.361261 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-cee6b0b1-5c56-43e3-b472-60c1b9438911 req-5f192091-5411-4965-bf98-d808b7e85906 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093021 Oct 16 01:02:10.367526 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 262/555] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:10.391796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:10.392490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:10.406771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.407871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.408282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.409693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.410164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.410594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.781247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:10.829056 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78d1cc78-0a5b-4b6f-9889-4e59b735afcc tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.758225 Oct 16 01:02:10.830424 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 294/556] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:10 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:10.835346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:10.836189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:10.856738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.857246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.857685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:10.858399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:10.858857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:10.859304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.071170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:11.074753 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:11.084219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:11.086266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:11.088822 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af1d207c-8ca8-40e7-b29a-4c60326f3fcc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 0.702206 Oct 16 01:02:11.090065 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 263/557] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:10 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:11.103689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:11.107221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:11.118620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.119171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.119634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.120379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.120839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.121265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.231698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:11.244470 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-034fb90a-1190-49f7-b04d-b92dd446849e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1332 microversion: 2.1 time: 0.412619 Oct 16 01:02:11.245871 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 295/558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:10 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1332 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:11.251927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:11.252996 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:11.263343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.264281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.265035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.266129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.266825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.267533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.564347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:11.578955 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd2ebc33-aab6-4ec2-980b-bfdf97c6bfc0 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1385 microversion: 2.1 time: 0.485062 Oct 16 01:02:11.579891 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 264/559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:11 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1385 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:11.635101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:11.643031 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac2e0b64-7b71-4597-b2f1-6159379cedcf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1313 microversion: 2.1 time: 0.395711 Oct 16 01:02:11.651897 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 296/560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:11 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:11.865313 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:11.866133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:11.879693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.880402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.881002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:11.882090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:11.882748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:11.884270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.008714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:12.033056 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2f6829c5-17f1-4cb2-9de9-30412dc06809 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.175002 Oct 16 01:02:12.033874 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 265/561] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:11 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:12.117905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:12.118516 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:12.120501 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:12.121151 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:12.131737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.132187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.132648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.133368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.133833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.134263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.198862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2382c62b-bae2-4d26-a63b-2f55111be2e8 req-3e88d20c-2f0e-4e5b-9280-bc49f63d0047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde1b8e8-35b6-4ebf-8cc4-81cf210059dd", "tag": "738e577f-1f71-4f81-923f-ac52284e87a9"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:12.229544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2382c62b-bae2-4d26-a63b-2f55111be2e8 req-3e88d20c-2f0e-4e5b-9280-bc49f63d0047 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.230280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2382c62b-bae2-4d26-a63b-2f55111be2e8 req-3e88d20c-2f0e-4e5b-9280-bc49f63d0047 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.231357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2382c62b-bae2-4d26-a63b-2f55111be2e8 req-3e88d20c-2f0e-4e5b-9280-bc49f63d0047 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.272510 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2382c62b-bae2-4d26-a63b-2f55111be2e8 req-3e88d20c-2f0e-4e5b-9280-bc49f63d0047 service nova] Creating event network-changed:738e577f-1f71-4f81-923f-ac52284e87a9 for instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd on n-h1-master-1 Oct 16 01:02:12.289269 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2382c62b-bae2-4d26-a63b-2f55111be2e8 req-3e88d20c-2f0e-4e5b-9280-bc49f63d0047 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096642 Oct 16 01:02:12.290424 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 266/562] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:02:12.296160 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:12.297888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:12.306515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.307273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.308006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.308944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.310054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.310712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.527061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:12.541552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:12.543384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:12.549002 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-facaafed-e518-43b0-bc4a-769112c9601c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 0.434842 Oct 16 01:02:12.552457 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 297/563] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:12 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:12.577280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-53695dd6-2c9a-4276-afb1-24f0b723d5b1 req-5a9a847f-0e39-4a15-8e0e-2b8d51a1c94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd3dce6-a862-4679-98ca-dfcce6e1771c", "name": "network-vif-plugged", "status": "completed", "tag": "2ea40e62-88f4-4829-868e-a6415dc26ec0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:12.637992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-53695dd6-2c9a-4276-afb1-24f0b723d5b1 req-5a9a847f-0e39-4a15-8e0e-2b8d51a1c94b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.640270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-53695dd6-2c9a-4276-afb1-24f0b723d5b1 req-5a9a847f-0e39-4a15-8e0e-2b8d51a1c94b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.641332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-53695dd6-2c9a-4276-afb1-24f0b723d5b1 req-5a9a847f-0e39-4a15-8e0e-2b8d51a1c94b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.683127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:12.719416 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-53695dd6-2c9a-4276-afb1-24f0b723d5b1 req-5a9a847f-0e39-4a15-8e0e-2b8d51a1c94b service nova] Creating event network-vif-plugged:2ea40e62-88f4-4829-868e-a6415dc26ec0 for instance efd3dce6-a862-4679-98ca-dfcce6e1771c on n-h2-master-1 Oct 16 01:02:12.723018 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7cf4f415-57c6-4b50-9ced-f453a5f97d00 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1332 microversion: 2.1 time: 0.431051 Oct 16 01:02:12.725459 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 267/564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:12 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1332 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:12.740453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:12.743361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:12.743505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-53695dd6-2c9a-4276-afb1-24f0b723d5b1 req-5a9a847f-0e39-4a15-8e0e-2b8d51a1c94b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176264 Oct 16 01:02:12.745218 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 298/565] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:12.750588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:12.751444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:12.760717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.761219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.761498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.761653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.762003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.762435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.765487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.766060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:12.766587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.767101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:12.767221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:12.767556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:13.135668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:13.145285 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1176fb9c-925d-4dae-81d2-7b0e11ac164e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1463 microversion: 2.1 time: 0.398854 Oct 16 01:02:13.152674 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 299/566] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:12 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1463 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:13.163935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:13.164575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:13.178798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:13.181273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:13.181736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:13.182481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:13.190741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:13.191242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:13.242360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:13.263460 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e702363-4ba8-4b54-9b2d-7bfc2ce777df tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1385 microversion: 2.1 time: 0.531670 Oct 16 01:02:13.266207 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 268/567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:12 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1385 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:13.297951 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:13.315284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:13.346830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:13.347365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:13.347812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:13.350859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:13.352245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:13.352905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:13.407474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:13.462866 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-32c34d0d-d030-44da-a975-329af5d83d6d tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.304744 Oct 16 01:02:13.474952 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 300/568] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:13 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:13.583577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:13.585622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:13.600013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:13.600898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:13.603399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:13.604342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:13.605906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:13.606600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:13.607744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:13.621439 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Old instance type m1.heat2, new instance type m1.heat {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:02:13.639295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:13.639819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:13.640537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:13.642164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:13.644319 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:14.206898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:14.223859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:14.228729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:14.231690 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d8e785e1-18f0-4d3c-9dde-3001bd314aca tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 0.654007 Oct 16 01:02:14.258326 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 301/569] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:13 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:14.265178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:14.265795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:14.293865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:14.294362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:14.294794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:14.295538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:14.295995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:14.296414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:14.460822 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d2e3495e-781e-456f-aad4-833f30a13b25 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72/action" status: 202 len: 0 microversion: 2.1 time: 1.191103 Oct 16 01:02:14.461980 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 269/570] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:02:13 2022] POST /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72/action => generated 0 bytes in 1195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:14.652432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:14.663820 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-32e321f2-d046-445a-b667-bbec04e059b2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1332 microversion: 2.1 time: 0.404285 Oct 16 01:02:14.672707 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 302/571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:14 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1332 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:14.685987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:14.686709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:14.698051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:14.698627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:14.700451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:14.700725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:14.701426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:14.703399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.032585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-079ce666-c93a-495a-bc4f-740ec3c22d73 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-35365048", "id": 470115020, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:15.072941 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-079ce666-c93a-495a-bc4f-740ec3c22d73 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.606429 Oct 16 01:02:15.073646 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 270/572] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:14 2022] POST /compute/v2.1/flavors => generated 425 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:15.086980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:15.088667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:15.106937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:15.107702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:15.108254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.109157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:15.109978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:15.111085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.144323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:15.156943 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c42f9f88-5efe-4560-90c7-f084fafa1157 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1385 microversion: 2.1 time: 0.481760 Oct 16 01:02:15.157706 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 303/573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:14 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1385 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:15.188107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:15.190363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:15.205015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:15.206249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:15.206716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.208933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:15.210619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:15.211768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.450207 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:15.456083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:15.501130 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2b70a1e0-0312-4804-9dac-14042f24700a tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.326156 Oct 16 01:02:15.503735 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 304/574] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:15 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:15.512789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da4bd69d-46cc-47d3-ba8a-566a94de5e37 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:15.547905 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da4bd69d-46cc-47d3-ba8a-566a94de5e37 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/470115020" status: 202 len: 0 microversion: 2.1 time: 0.038553 Oct 16 01:02:15.548571 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 305/575] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:02:15 2022] DELETE /compute/v2.1/flavors/470115020 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:15.558125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:15.564096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:15.577012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:15.581502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:15.582022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.582899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:15.583475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:15.583976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.685163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:15.696861 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a64f30d-37b0-417a-a261-f4977f2a55fb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1472 microversion: 2.1 time: 0.621220 Oct 16 01:02:15.698816 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 271/576] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:15 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1472 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:15.717331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c941e705-97bd-45a2-8e82-48131d940b35 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:15.807817 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c941e705-97bd-45a2-8e82-48131d940b35 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.105601 Oct 16 01:02:15.809208 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 272/577] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:15.817362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:15.818201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:15.833003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:15.833847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:15.834576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.835678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:15.836457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:15.837396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:15.879459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:15.897878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:15.908163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:15.912871 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7b6b6ee8-cd4c-4a83-b432-db3b686996f1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 0.359476 Oct 16 01:02:15.913490 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 306/578] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:15 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:15.921446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-937c7c05-ab79-46b8-9fc3-efaf534b7d8d tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1961042024", "id": 1496848730, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:16.010202 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-937c7c05-ab79-46b8-9fc3-efaf534b7d8d tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.091546 Oct 16 01:02:16.026217 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 307/579] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:15 2022] POST /compute/v2.1/flavors => generated 417 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:16.036048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c49006b9-1a2f-4027-8303-6f1265775a9a tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:16.079283 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c49006b9-1a2f-4027-8303-6f1265775a9a tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.050910 Oct 16 01:02:16.082010 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 308/580] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:16 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:16.106991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42c052f7-2872-41fa-9a35-c9b1548b987a tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:16.152231 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42c052f7-2872-41fa-9a35-c9b1548b987a tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1496848730" status: 202 len: 0 microversion: 2.1 time: 0.050664 Oct 16 01:02:16.153115 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 309/581] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:02:16 2022] DELETE /compute/v2.1/flavors/1496848730 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:16.168751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-21599a59-9e2b-4b62-a14c-3dc5d010a349 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:16.218527 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:16.219253 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-21599a59-9e2b-4b62-a14c-3dc5d010a349 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.060745 Oct 16 01:02:16.223284 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 310/582] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:16.241733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:16.243296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:16.244681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c49f60f-a764-4dd8-9956-e98e2c7bfe30 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1535 microversion: 2.1 time: 0.433866 Oct 16 01:02:16.249235 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 273/583] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:15 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1535 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:16.250740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:16.251575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:16.252716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:16.253856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:16.254467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:16.255080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:16.261335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83bebd3f-5b9a-4b2a-a889-e7f8bbd1a431 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1157325319", "id": 1269458851, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:16.275389 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:16.292445 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-83bebd3f-5b9a-4b2a-a889-e7f8bbd1a431 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.041678 Oct 16 01:02:16.294013 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 274/584] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:16 2022] POST /compute/v2.1/flavors => generated 429 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:16.299672 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df31a222-c448-428a-9040-d5c061aa971a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'create', calling method: .version_select at 0x7fd64e8a1ca0>, body: {"pool": "a05b7879-f267-4cd4-857d-0be01dfc12b3"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:16.682274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:16.699775 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8a9aa24b-0da5-4aa4-b3c9-7fef296e8bb1 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1385 microversion: 2.1 time: 0.474027 Oct 16 01:02:16.723249 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 311/585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:16 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1385 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:16.729453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f82b414-51c3-413f-8a84-d2fb60abec6c tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:16.755004 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:16.769169 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f82b414-51c3-413f-8a84-d2fb60abec6c tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1269458851" status: 202 len: 0 microversion: 2.1 time: 0.043508 Oct 16 01:02:16.773203 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 312/586] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:02:16 2022] DELETE /compute/v2.1/flavors/1269458851 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:16.811090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:16.813371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:16.831518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:16.832193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:16.832636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:16.833364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:16.833822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:16.834222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:17.402445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:17.438511 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-450b58d1-7617-425a-9b3d-13fe0e2729c4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.661697 Oct 16 01:02:17.447993 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 313/587] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:16 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:17.453012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:17.453803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:17.466886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:17.467806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:17.468297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:17.469014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:17.469503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:17.469927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:18.046300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:18.055667 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e2f4adff-0d40-4966-9f11-10a01ee7066f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1472 microversion: 2.1 time: 0.606312 Oct 16 01:02:18.060830 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 314/588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:17 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1472 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:18.074991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2749dbd7-074e-49d9-8cf3-20c334a9cd9a tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:18.115793 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2749dbd7-074e-49d9-8cf3-20c334a9cd9a tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.053595 Oct 16 01:02:18.116726 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 315/589] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:18 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:18.127823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:18.128896 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:18.143473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:18.144043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:18.144477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:18.145182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:18.145630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:18.146388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:18.772782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:18.792092 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:18.795115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:18.809795 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eaf46656-e7dd-4afd-821e-c219809bf595 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1567 microversion: 2.25 time: 0.683279 Oct 16 01:02:18.826896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 316/590] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:18 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1567 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:18.832640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:18.833677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:18.848731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:18.849672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:18.850463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:18.853382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:18.854144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:18.854841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:19.330400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:19.346487 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa97ed31-50bc-4962-8bc0-5b6e59a0b31b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1385 microversion: 2.1 time: 0.532451 Oct 16 01:02:19.347131 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 317/591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:18 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1385 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:19.367330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6782f163-520b-4fec-8da1-53365903bda3 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-236131670", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:19.416737 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6782f163-520b-4fec-8da1-53365903bda3 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.068525 Oct 16 01:02:19.417350 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 318/592] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:19 2022] POST /compute/v2.1/flavors => generated 506 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:19.432266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:19.438812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:19.446853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:19.447595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:19.448392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:19.454476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:19.456077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:19.456749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:19.666847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:19.697516 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-858481c7-bbe9-474c-b580-44b2d00e67e0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.270746 Oct 16 01:02:19.698705 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 319/593] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:19 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:19.704076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:19.705055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:19.711977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:19.712685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:19.713298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:19.714159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:19.714768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:19.715365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:20.034861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:20.048536 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-678a0baf-4b53-4ee1-9eaf-2cc7a0e4167a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1477 microversion: 2.1 time: 0.348403 Oct 16 01:02:20.051241 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 320/594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:19 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1477 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:20.056135 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26b3f9d7-92b9-488e-a284-659c1b55ddaa tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:20.079778 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-26b3f9d7-92b9-488e-a284-659c1b55ddaa tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/8f6395f1-7652-4345-ae0e-e9e2ba80ff71" status: 202 len: 0 microversion: 2.1 time: 0.027127 Oct 16 01:02:20.081436 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 321/595] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:02:20 2022] DELETE /compute/v2.1/flavors/8f6395f1-7652-4345-ae0e-e9e2ba80ff71 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:20.093323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:20.094306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:20.108413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:20.109150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:20.109807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:20.110876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:20.116586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:20.117235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.007324 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:21.019602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:21.041233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:21.045131 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df31a222-c448-428a-9040-d5c061aa971a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.749684 Oct 16 01:02:21.046059 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 275/596] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:02:16 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:21.046474 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c86d7cf4-a961-4f9c-9c0e-6a6b92d288fc tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1542 microversion: 2.25 time: 0.961432 Oct 16 01:02:21.055381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a5b3d8e6-cd92-47b9-831f-a434f36c2f60 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:21.065924 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 322/597] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:20 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1542 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:21.085690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:21.095314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:21.099988 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a5b3d8e6-cd92-47b9-831f-a434f36c2f60 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.052597 Oct 16 01:02:21.111189 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 276/598] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:21 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:21.117281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.118744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.119952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.121520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.121855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:21.122622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.122897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:21.123499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.142254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.144065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.145361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.146457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.148611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.151587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.348064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:21.370572 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5092a7e0-c268-43a3-9000-f8fa6f23e59e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.256885 Oct 16 01:02:21.371456 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 277/599] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:21 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:21.376994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'action', calling method: .version_select at 0x7fd6507ca3a0>, body: {"addFloatingIp": {"address": "172.35.4.90"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:21.379927 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:21.386702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.387622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.388310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.389258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.389931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.390565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.476403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:02:21.477367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquired lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:02:21.496746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:21.509177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f8d0277a-9dcf-413c-be5b-47dc9ccc7e35 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1385 microversion: 2.1 time: 0.440519 Oct 16 01:02:21.510260 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 323/600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:21 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1385 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:21.517364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-136c694e-8d80-472a-95e5-97f51d6d9ddd tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '.version_select at 0x7fd64ea7f5e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:21.524724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-136c694e-8d80-472a-95e5-97f51d6d9ddd tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.525742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-136c694e-8d80-472a-95e5-97f51d6d9ddd tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.528407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-136c694e-8d80-472a-95e5-97f51d6d9ddd tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.572913 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-136c694e-8d80-472a-95e5-97f51d6d9ddd tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.057231 Oct 16 01:02:21.581694 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 324/601] 10.222.0.39 () {60 vars in 1184 bytes} [Sun Oct 16 01:02:21 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:21.593213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:21.594251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:21.602471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.603469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.604108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.604973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:21.605587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:21.606988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:21.996746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:22.007070 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9df3d632-f70b-4bdd-8256-c83b9bcd7ea7 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1477 microversion: 2.1 time: 0.423621 Oct 16 01:02:22.008589 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 325/602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:21 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:22.013194 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-70871fee-ff5c-4446-af70-969da93532a8 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-858260472", "id": "bf958a33-dc86-4287-a063-a497a6d96049", "os-flavor-access:is_public": "True"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:22.047493 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-70871fee-ff5c-4446-af70-969da93532a8 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.037233 Oct 16 01:02:22.049822 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 326/603] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:22 2022] POST /compute/v2.1/flavors => generated 506 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:22.057300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:22.058304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:22.064279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:22.065508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:22.066039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:22.066811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:22.067361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:22.067847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:22.496782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid efcd2fd0-7e22-4fd8-8351-40036992c044 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:22.517117 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ac53795-5247-4a5a-83dd-540c42de3daf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 2034 microversion: 2.25 time: 0.465925 Oct 16 01:02:22.526958 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 327/604] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:22 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 2034 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:22.530889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-fa80a207-aef2-4cf7-9847-e28605ac3ff7 req-2be72e4a-34a7-45bb-9bb1-94f6e8273c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde1b8e8-35b6-4ebf-8cc4-81cf210059dd", "name": "network-vif-plugged", "status": "completed", "tag": "738e577f-1f71-4f81-923f-ac52284e87a9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:22.556093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fa80a207-aef2-4cf7-9847-e28605ac3ff7 req-2be72e4a-34a7-45bb-9bb1-94f6e8273c0c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:22.557168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fa80a207-aef2-4cf7-9847-e28605ac3ff7 req-2be72e4a-34a7-45bb-9bb1-94f6e8273c0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:22.557706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fa80a207-aef2-4cf7-9847-e28605ac3ff7 req-2be72e4a-34a7-45bb-9bb1-94f6e8273c0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:22.613368 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-fa80a207-aef2-4cf7-9847-e28605ac3ff7 req-2be72e4a-34a7-45bb-9bb1-94f6e8273c0c service nova] Creating event network-vif-plugged:738e577f-1f71-4f81-923f-ac52284e87a9 for instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd on n-h1-master-1 Oct 16 01:02:22.636679 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-fa80a207-aef2-4cf7-9847-e28605ac3ff7 req-2be72e4a-34a7-45bb-9bb1-94f6e8273c0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116598 Oct 16 01:02:22.637492 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 328/605] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:22.650818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1c28a77-1053-4154-a55b-582d3d26cb00 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:22.702822 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c1c28a77-1053-4154-a55b-582d3d26cb00 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/bf958a33-dc86-4287-a063-a497a6d96049" status: 202 len: 0 microversion: 2.1 time: 0.055873 Oct 16 01:02:22.716748 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 329/606] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:02:22 2022] DELETE /compute/v2.1/flavors/bf958a33-dc86-4287-a063-a497a6d96049 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:22.743521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:22.744826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:22.777524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:22.778019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:22.778452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:22.779203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:22.782142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:22.782595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:23.007844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:23.029331 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-70e514f2-a569-4dbb-8390-f0e248d43ba0 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.310033 Oct 16 01:02:23.044104 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 330/607] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:22 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:23.049988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:23.051408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:23.058456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:23.058997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:23.059665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:23.060557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:23.061175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:23.061763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:23.621443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:23.631417 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ba70dee-a36b-477a-8f17-2659b6e99f64 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1385 microversion: 2.1 time: 0.586122 Oct 16 01:02:23.632175 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 331/608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:23 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1385 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:23.637622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-764e65e7-6f63-45a7-95df-602ca7a154e1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Action: 'create', calling method: .version_select at 0x7fd64ec85040>, body: {"keypair": {"name": "tempest-keypair-702599486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTKPz34ExqWW6htopLeJKSwbybrDAak1G6ZUOGs+OzfyUW0eKyrTQ9EafGCesJjVWrN7AaJP/fVhhhLjO58sfp0W9tYdA4WCoBjl1bVHVA+IjAFP4n/3PIGiXn22OpT+Q=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:23.655175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-764e65e7-6f63-45a7-95df-602ca7a154e1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for project e9173928e9c94d31b8d2eca240e28d50. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:23.660154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-764e65e7-6f63-45a7-95df-602ca7a154e1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for user 5f46ddd0268d44bfacff0400e3f38e7e and project e9173928e9c94d31b8d2eca240e28d50. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:23.689836 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-764e65e7-6f63-45a7-95df-602ca7a154e1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.055941 Oct 16 01:02:23.691102 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 332/609] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:02:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:02:23.696456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bffe499a-32dd-4fb8-9e17-f213563b4156 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:23.726500 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bffe499a-32dd-4fb8-9e17-f213563b4156 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.033984 Oct 16 01:02:23.727479 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 333/610] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:23 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:23.749045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:23.750031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:23.758558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:23.759505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:23.760504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:23.761865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:23.762499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:23.762967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:23.768864 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:24.145903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:24.154377 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b4c4ad8-a4b8-4e10-8c93-e0eb355f460a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1477 microversion: 2.1 time: 0.410074 Oct 16 01:02:24.155303 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 334/611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:23 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1477 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:24.301556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1459290501", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:24.373202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:02:24.544591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:02:25.061507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:25.061929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:25.062393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:25.062793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:25.063284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:25.083997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:25.084489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:25.084919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:25.090876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:25.091326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:25.096484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:25.144684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Getting quotas for project 65ddfc9041e44055be492260cb2f1ae9. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:25.155025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Getting quotas for user 4352b314efdf413d940755f4cb0dbbda and project 65ddfc9041e44055be492260cb2f1ae9. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:25.184389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:02:25.191009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:02:25.335330 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-103c2a95-b38b-4eb9-9727-740a7c37d19c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178692 Oct 16 01:02:25.339141 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 335/612] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:02:25.359286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad49a6b5-8602-4d38-99ce-b708160d1eed tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-414797096", "id": 1302738229, "os-flavor-access:is_public": "True"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:25.404521 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad49a6b5-8602-4d38-99ce-b708160d1eed tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.063987 Oct 16 01:02:25.411128 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 336/613] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:25 2022] POST /compute/v2.1/flavors => generated 413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:25.422625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:25.425904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:25.444949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:25.445779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:25.446376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:25.449215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:25.450101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:25.451248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:25.625923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:25.657574 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f24744a-c696-42e6-bc2a-dae36ca76db4 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.244823 Oct 16 01:02:25.659690 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 337/614] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:25 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:25.665517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-30c0707b-a924-43a2-940f-38babff03f3f req-9c98a969-974e-4282-90e0-0f75e9c7861c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd3dce6-a862-4679-98ca-dfcce6e1771c", "tag": "2ea40e62-88f4-4829-868e-a6415dc26ec0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:25.678529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-30c0707b-a924-43a2-940f-38babff03f3f req-9c98a969-974e-4282-90e0-0f75e9c7861c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:25.679479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-30c0707b-a924-43a2-940f-38babff03f3f req-9c98a969-974e-4282-90e0-0f75e9c7861c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:25.680220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-30c0707b-a924-43a2-940f-38babff03f3f req-9c98a969-974e-4282-90e0-0f75e9c7861c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:25.694896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-30c0707b-a924-43a2-940f-38babff03f3f req-9c98a969-974e-4282-90e0-0f75e9c7861c service nova] Creating event network-changed:2ea40e62-88f4-4829-868e-a6415dc26ec0 for instance efd3dce6-a862-4679-98ca-dfcce6e1771c on n-h2-master-1 Oct 16 01:02:25.701238 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-30c0707b-a924-43a2-940f-38babff03f3f req-9c98a969-974e-4282-90e0-0f75e9c7861c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040078 Oct 16 01:02:25.702768 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 338/615] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:25.709377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:25.710425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:25.716922 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:25.720093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:25.720928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:25.721695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:25.723112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:25.723825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:25.724510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:26.464920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:26.481356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2a314988-efe4-437e-a71e-87fdc66d541f tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1583 microversion: 2.1 time: 0.773309 Oct 16 01:02:26.482681 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 339/616] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:25 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1583 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:26.500075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:26.500695 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:26.527814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:26.532691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:26.533822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:26.536610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:26.537308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:26.538038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:26.846349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Updating instance_info_cache with network_info: [{"id": "2ea40e62-88f4-4829-868e-a6415dc26ec0", "address": "fa:16:3e:1d:1a:ec", "network": {"id": "d913236b-fc96-417f-b3dc-f721aca4db73", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-242711426-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8b4ef535b0684c0180329169a5765107", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2ea40e62-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:02:26.863398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Releasing lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:02:26.865307 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa5d76b1-4a29-4888-ab0a-3f203bfc2eb6 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action" status: 202 len: 0 microversion: 2.1 time: 5.491953 Oct 16 01:02:26.867016 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 278/617] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:02:21 2022] POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action => generated 0 bytes in 5494 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:02:26.874024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:26.874995 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:26.880244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:26.881987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:26.882722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:26.883348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:26.884247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:26.885096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:26.885686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:26.888896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30a7a11e-aa60-4518-a24a-1aa31ec1a4ea tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1477 microversion: 2.1 time: 0.404969 Oct 16 01:02:26.889475 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 340/618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:26 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:26.895137 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c9a5a9c9-0cc7-4cee-8104-13439dd740cd tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:26.902151 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c9a5a9c9-0cc7-4cee-8104-13439dd740cd tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1302738229" status: 200 len: 413 microversion: 2.1 time: 0.011184 Oct 16 01:02:26.909910 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 341/619] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:02:26 2022] GET /compute/v2.1/flavors/1302738229 => generated 413 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:26.915032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-606890853", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "d8ca3633-753d-4a02-9054-6faae6f93606"}], "security_groups": [{"name": "tempest-securitygroup--928968097"}], "key_name": "tempest-keypair-702599486", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:26.958136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:26.967523 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d3479b79-863b-4f87-84fb-28736c45f085 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1271 microversion: 2.1 time: 0.099261 Oct 16 01:02:26.968454 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 279/620] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:26 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:27.098684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b56bbc43-ae4e-4538-977e-acd9b8239b30 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Action: 'create', calling method: .version_select at 0x7fd64ea9a8b0>, body: {"keypair": {"name": "tempest-keypair-1205828961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnYr1huFEwoLz4WfLRyTUyoZ2BK8qGl0YMefwLX9QBuvLDz2jnKtJegX18uGJh9CBSIUY05E2sQ9WZEJIwh1VZHLbDs7y8L5V/QeviHK7RD9E7o6aiJymHjkWem4Xo7DA=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:27.117412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b56bbc43-ae4e-4538-977e-acd9b8239b30 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Getting quotas for project 5eec6e034df149f8863b1b9ebacfaa81. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:27.121359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b56bbc43-ae4e-4538-977e-acd9b8239b30 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Getting quotas for user aceec71835c14681a2ff7d7285d87776 and project 5eec6e034df149f8863b1b9ebacfaa81. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:27.149615 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b56bbc43-ae4e-4538-977e-acd9b8239b30 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179416 Oct 16 01:02:27.151167 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 280/621] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:02:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:27.157457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:27.158262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:27.161506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] validate_networks() for [('d8ca3633-753d-4a02-9054-6faae6f93606', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:02:27.165342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:27.166287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:27.167107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:27.167964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:27.169033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:27.169843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:27.287158 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e7eb1523-9873-43dc-b71f-a9a46fa50f3d tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134581 Oct 16 01:02:27.287860 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 281/622] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:02:27 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:27.294056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:27.294683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:27.304611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:27.305387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:27.306004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:27.306932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:27.307537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:27.308132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:27.449154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:27.481072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6d0d4003-42d6-466d-ae90-f82c9490ae4f tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.191571 Oct 16 01:02:27.494944 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 282/623] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:27 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:27.494944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5bb0df6-6f2e-40be-96ec-a0b1f1ca5ba2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'create', calling method: .version_select at 0x7fd64e8dfb80>, body: {"pool": "a05b7879-f267-4cd4-857d-0be01dfc12b3"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:28.333882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:28.335481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:28.336029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:28.336848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:28.337292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:28.347319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:28.348051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:28.348656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:28.349584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:28.350056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:28.350480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:28.372293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for project e9173928e9c94d31b8d2eca240e28d50. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:28.381248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for user 5f46ddd0268d44bfacff0400e3f38e7e and project e9173928e9c94d31b8d2eca240e28d50. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:28.397879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:02:28.400769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:02:28.489064 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da84d309-eb74-400f-a50c-c90005bd2ea0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.574742 Oct 16 01:02:28.489987 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 342/624] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:02:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:02:28.793951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a5143687-d8c2-477c-8665-3774f4c9b638 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:28.899924 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a5143687-d8c2-477c-8665-3774f4c9b638 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.403172 Oct 16 01:02:28.901137 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 343/625] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:28 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:28.909860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:28.910663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:28.917266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:28.918617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:28.919106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:28.919825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:28.920289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:28.920712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:29.280873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:29.301788 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4fba98ab-22ce-4119-8ec3-3572c4cf528d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1477 microversion: 2.1 time: 0.399381 Oct 16 01:02:29.302394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 344/626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:28 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:29.315834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:29.318841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:29.352595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:29.355495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:29.355981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:29.356727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:29.369281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:29.370240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:29.500545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:29.511316 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0488562-4442-4f82-8a72-5a5f378c69b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1277 microversion: 2.1 time: 0.199673 Oct 16 01:02:29.511907 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 345/627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:29 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:29.516379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:29.516978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:29.538661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:29.539110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:29.539993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:29.540244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:29.541147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:29.541613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:29.744998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:29.762945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:29.767035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:29.772125 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0ac202e-b634-4645-8ac1-59cd6371a286 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1288 microversion: 2.25 time: 0.258343 Oct 16 01:02:29.779896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 346/628] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:29 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1288 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:29.792279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:29.792813 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5bb0df6-6f2e-40be-96ec-a0b1f1ca5ba2 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.308690 Oct 16 01:02:29.793535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:29.794419 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 283/629] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:02:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:29.807579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f633133-616a-495c-919a-3b790d1c1544 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:29.812653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:29.818780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:29.819804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:29.827375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:29.828113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:29.828714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:29.874248 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f633133-616a-495c-919a-3b790d1c1544 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1302738229" status: 202 len: 0 microversion: 2.1 time: 0.071803 Oct 16 01:02:29.876352 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 284/630] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:02:29 2022] DELETE /compute/v2.1/flavors/1302738229 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:29.896529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:29.898403 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:29.925955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:29.926882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:29.927369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:29.928215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:29.929438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:29.930147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:30.093868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:30.141985 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2e83dd60-d852-42ff-81a0-1af2d9fdf413 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.360889 Oct 16 01:02:30.156419 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 347/631] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:29 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:30.174303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3c451262-43f2-454f-ab8b-9fd0b94a300c req-26a78391-20ee-4c99-a777-ee5f7a9dff25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde1b8e8-35b6-4ebf-8cc4-81cf210059dd", "tag": "738e577f-1f71-4f81-923f-ac52284e87a9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:30.204926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3c451262-43f2-454f-ab8b-9fd0b94a300c req-26a78391-20ee-4c99-a777-ee5f7a9dff25 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:30.205942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3c451262-43f2-454f-ab8b-9fd0b94a300c req-26a78391-20ee-4c99-a777-ee5f7a9dff25 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:30.206374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3c451262-43f2-454f-ab8b-9fd0b94a300c req-26a78391-20ee-4c99-a777-ee5f7a9dff25 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:30.223667 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3c451262-43f2-454f-ab8b-9fd0b94a300c req-26a78391-20ee-4c99-a777-ee5f7a9dff25 service nova] Creating event network-changed:738e577f-1f71-4f81-923f-ac52284e87a9 for instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd on n-h1-master-1 Oct 16 01:02:30.231204 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3c451262-43f2-454f-ab8b-9fd0b94a300c req-26a78391-20ee-4c99-a777-ee5f7a9dff25 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072984 Oct 16 01:02:30.233814 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 348/632] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:30.256500 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'action', calling method: .version_select at 0x7fd650bf0a60>, body: {"addFloatingIp": {"address": "172.35.4.33"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:30.262720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:30.276934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:30.277800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:30.278512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:30.279659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:30.280418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:30.281220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:30.415171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:02:30.415824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquired lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:02:30.790225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:30.807074 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5669e391-414b-44e9-98c2-dc42d652b1e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1583 microversion: 2.1 time: 0.927918 Oct 16 01:02:30.810474 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 285/633] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:29 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1583 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:30.820839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19c1ad81-ad44-413c-9b0c-6e9698297875 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:30.856575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19c1ad81-ad44-413c-9b0c-6e9698297875 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.043980 Oct 16 01:02:30.857236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 286/634] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:30.871876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:30.876005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:30.897432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:30.898277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:30.898973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:30.899914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:30.900577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:30.901630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:30.930648 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:31.469052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:31.479097 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d61f821-a57d-4f1c-aa6f-4099a5288b1e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1477 microversion: 2.1 time: 0.617654 Oct 16 01:02:31.479693 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 287/635] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:30 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1477 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:31.496209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:31.496841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:31.505013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:31.505752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:31.506517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:31.507443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:31.508478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:31.508913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:31.899596 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.33 (341f4393-e133-4431-8180-b685f1eebd68) with port 2ea40e62-88f4-4829-868e-a6415dc26ec0 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network a05b7879-f267-4cd4-857d-0be01dfc12b3.", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:02:31.900186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Releasing lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:02:31.901150 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.33 (341f4393-e133-4431-8180-b685f1eebd68) with port 2ea40e62-88f4-4829-868e-a6415dc26ec0 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network a05b7879-f267-4cd4-857d-0be01dfc12b3. Oct 16 01:02:31.901150 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-7a746226-a422-429b-8f86-9ddd4065761a'] Oct 16 01:02:31.914526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Request method failure captured: Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action HTTP/1.1 Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 45 Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1f8zoCmo8VCBH7RO4XGm9SalX4dVJkXRKPzqeWpZln1CeD89xnRWZuPU-sc5J5LCwvJpr9volK4f-8YjAh-fp5NzVWtUKhzJSAGGQEVJIddbhTON492GXN-do-amhohZedDixuqEY999WwAYoSS_LNXfamTslpeIOfekQ1SwmL4cFk Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:02:31.917790 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8b4ef535b0684c0180329169a5765107", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8b4ef535b0684c0180329169a5765107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 37a61a57ad4448eba9c1bd8762d3a149 Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: {"addFloatingIp": {"address": "172.35.4.33"}} Oct 16 01:02:31.919484 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot associate floating IP 172.35.4.33 (341f4393-e133-4431-8180-b685f1eebd68) with port 2ea40e62-88f4-4829-868e-a6415dc26ec0 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network a05b7879-f267-4cd4-857d-0be01dfc12b3. Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-7a746226-a422-429b-8f86-9ddd4065761a'] Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'efd3dce6-a862-4679-98ca-dfcce6e1771c', 'body': {'addFloatingIp': {'address': '172.35.4.33'}}} Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:02:31.920258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:02:31.922559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.33 (341f4393-e133-4431-8180-b685f1eebd68) with port 2ea40e62-88f4-4829-868e-a6415dc26ec0 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network a05b7879-f267-4cd4-857d-0be01dfc12b3. Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a746226-a422-429b-8f86-9ddd4065761a'] Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.33 (341f4393-e133-4431-8180-b685f1eebd68) with port 2ea40e62-88f4-4829-868e-a6415dc26ec0 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network a05b7879-f267-4cd4-857d-0be01dfc12b3. Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a746226-a422-429b-8f86-9ddd4065761a'] Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:31.924872 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.33 (341f4393-e133-4431-8180-b685f1eebd68) with port 2ea40e62-88f4-4829-868e-a6415dc26ec0 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network a05b7879-f267-4cd4-857d-0be01dfc12b3. Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a746226-a422-429b-8f86-9ddd4065761a'] Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:31.927332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.33 (341f4393-e133-4431-8180-b685f1eebd68) with port 2ea40e62-88f4-4829-868e-a6415dc26ec0 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network a05b7879-f267-4cd4-857d-0be01dfc12b3. Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a746226-a422-429b-8f86-9ddd4065761a'] Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Returning 400 to user: Cannot associate floating IP 172.35.4.33 (341f4393-e133-4431-8180-b685f1eebd68) with port 2ea40e62-88f4-4829-868e-a6415dc26ec0 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network a05b7879-f267-4cd4-857d-0be01dfc12b3. Oct 16 01:02:31.929722 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-7a746226-a422-429b-8f86-9ddd4065761a'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:31.930565 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-509d9a54-9632-4a1e-ae00-9ae4f878b1f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action" status: 400 len: 380 microversion: 2.1 time: 1.684710 Oct 16 01:02:31.930565 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 349/636] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:02:30 2022] POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action => generated 380 bytes in 1686 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:02:31.930565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:31.930565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:31.930891 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03e10216-f73a-47ab-9569-aff0c8cf16c8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1319 microversion: 2.1 time: 0.448182 Oct 16 01:02:31.935358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:31.935590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:31.936153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:31.936958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:31.937509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:31.938026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:31.945358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 288/637] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:31 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:31.951767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-69de05ef-6c69-4197-9f92-8830ee4a559f tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1605209198", "id": 446954287, "os-flavor-access:is_public": "False"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:31.974161 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-69de05ef-6c69-4197-9f92-8830ee4a559f tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.029631 Oct 16 01:02:31.974786 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 289/638] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:31 2022] POST /compute/v2.1/flavors => generated 427 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:31.979232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:31.979832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:31.986475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:31.986994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:31.987429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:31.988126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:31.988577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:31.989281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:32.065394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:32.074153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:32.075684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:32.076812 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2792f991-fe97-467a-961c-3d790522cf28 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1342 microversion: 2.25 time: 0.155332 Oct 16 01:02:32.077383 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 350/639] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:31 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:32.094774 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7f38e9d9-e450-49fe-b7f9-b7b5f3076077 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '.version_select at 0x7fd64e8ff8b0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.110480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:32.128182 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-787249c6-898e-4a8f-9eed-e6025f342f83 tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1929 microversion: 2.75 time: 0.152252 Oct 16 01:02:32.128770 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 290/640] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:31 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1929 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:32.133356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bba98721-db0a-4f62-b44b-fee1228197f4 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "446954287"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:32.144467 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-bba98721-db0a-4f62-b44b-fee1228197f4 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] HTTP exception thrown: Flavor 446954287 could not be found. Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bba98721-db0a-4f62-b44b-fee1228197f4 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] Request method failure captured: Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 106 Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1gU_IvIZlHq3xaHYUxxRyfkv148alN9-MuyGbDfTEDc4X8fWgahPJxRDougxfJPErLrrYLi1CGZkzxq14LDvihPtgDwLCi5XOd9QrXG4-o9-Pf9cCQDVRjDIACd-fgebqsQ5eLtPevgNmMJr5xZ_8TmKdVIG1dji_1EHyCwBlxbxXE Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0abbbe62bd7f4ecaaa9c6c9f80da251b Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FlavorsAdminTestJSON-1114260254 Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:02:32.146895 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0abbbe62bd7f4ecaaa9c6c9f80da251b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0abbbe62bd7f4ecaaa9c6c9f80da251b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0abbbe62bd7f4ecaaa9c6c9f80da251b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0abbbe62bd7f4ecaaa9c6c9f80da251b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FlavorsAdminTestJSON-1114260254 Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0abbbe62bd7f4ecaaa9c6c9f80da251b Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1114260254 Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FlavorsAdminTestJSON-1114260254-project Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 4302f49e3704464aa2fd7c66cf6244bc Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FlavorsAdminTestJSON-1114260254-project Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "test", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "446954287"}} Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:02:32.148337 n-d-master-1 devstack@n-api.service[120546]: exception: Flavor 446954287 could not be found. Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '446954287'}}} Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 446954287 could not be found. Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:32.149177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 446954287 could not be found. Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:32.150540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:32.152614 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:32.152614 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:32.152614 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:32.152614 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 446954287 could not be found. Oct 16 01:02:32.152614 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:32.152614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bba98721-db0a-4f62-b44b-fee1228197f4 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] Returning 400 to user: Flavor 446954287 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:32.152614 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bba98721-db0a-4f62-b44b-fee1228197f4 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.018720 Oct 16 01:02:32.152614 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 291/641] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:32 2022] POST /compute/v2.1/servers => generated 80 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:32.156615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7824c56f-91a4-4f40-af0b-413fe6e61e48 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.175830 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7824c56f-91a4-4f40-af0b-413fe6e61e48 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/446954287" status: 202 len: 0 microversion: 2.1 time: 0.022439 Oct 16 01:02:32.176531 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 292/642] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:02:32 2022] DELETE /compute/v2.1/flavors/446954287 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:32.184036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6000d326-a316-4bbe-9370-6890407cb3fc tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.204595 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6000d326-a316-4bbe-9370-6890407cb3fc tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.023943 Oct 16 01:02:32.205743 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 293/643] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:32.224949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b24018de-4bee-441c-ae58-35580953efaa tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1874159360", "id": 995128746, "os-flavor-access:is_public": "False"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:32.244087 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b24018de-4bee-441c-ae58-35580953efaa tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.022657 Oct 16 01:02:32.244890 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 294/644] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:32 2022] POST /compute/v2.1/flavors => generated 412 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:02:32.258112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03839fc5-83d6-459a-a305-eefbed67ba0c tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-429930803", "id": 1388634778, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:32.279841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03839fc5-83d6-459a-a305-eefbed67ba0c tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.025766 Oct 16 01:02:32.280741 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 295/645] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:32 2022] POST /compute/v2.1/flavors => generated 413 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:02:32.293090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f75cec50-706b-4b2b-aa73-5dcb3c146b18 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.311989 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f75cec50-706b-4b2b-aa73-5dcb3c146b18 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.022506 Oct 16 01:02:32.312776 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 296/646] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:02:32.326279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64c0c22c-bc9a-439a-a917-bd8c2344b907 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.338372 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64c0c22c-bc9a-439a-a917-bd8c2344b907 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.015719 Oct 16 01:02:32.347984 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 297/647] 10.222.0.39 () {58 vars in 1177 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:32.357100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-35ed29d4-5919-4cba-9ed3-d1bad9de0048 req-303aa527-9c4b-408f-8494-8d2a7fbd48ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f108bb-6f59-4710-a3d0-5f0b49ee7f92", "tag": "55dae9fc-e894-4862-915e-111559c59140"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:32.367479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35ed29d4-5919-4cba-9ed3-d1bad9de0048 req-303aa527-9c4b-408f-8494-8d2a7fbd48ab service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:32.368057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35ed29d4-5919-4cba-9ed3-d1bad9de0048 req-303aa527-9c4b-408f-8494-8d2a7fbd48ab service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:32.368550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35ed29d4-5919-4cba-9ed3-d1bad9de0048 req-303aa527-9c4b-408f-8494-8d2a7fbd48ab service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:32.380534 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-35ed29d4-5919-4cba-9ed3-d1bad9de0048 req-303aa527-9c4b-408f-8494-8d2a7fbd48ab service nova] Creating event network-changed:55dae9fc-e894-4862-915e-111559c59140 for instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 on n-h2-master-1 Oct 16 01:02:32.387474 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-35ed29d4-5919-4cba-9ed3-d1bad9de0048 req-303aa527-9c4b-408f-8494-8d2a7fbd48ab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035840 Oct 16 01:02:32.388189 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 298/648] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:32.395186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e88354d-a230-4bcc-bb8a-865573326096 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.406390 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e88354d-a230-4bcc-bb8a-865573326096 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.016712 Oct 16 01:02:32.407004 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 299/649] 10.222.0.39 () {58 vars in 1171 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:32.420643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6739886-4f00-4d4e-b738-3a3bb9e8243b tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.432170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6739886-4f00-4d4e-b738-3a3bb9e8243b tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.015970 Oct 16 01:02:32.432678 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 300/650] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:02:32.446513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4439ccea-3602-423f-8618-a0d2de87a11e tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.467824 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4439ccea-3602-423f-8618-a0d2de87a11e tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.024917 Oct 16 01:02:32.471407 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 301/651] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:32.489180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1f6748ed-2eb7-4c86-bff2-7243260d7e53 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.512165 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1f6748ed-2eb7-4c86-bff2-7243260d7e53 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.027712 Oct 16 01:02:32.512768 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 302/652] 10.222.0.39 () {58 vars in 1175 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:32.517231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.518001 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:32.524699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:32.525312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:32.526242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:32.526619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:32.527190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:32.527632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:32.946308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:32.955174 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-031dfb3e-3b1c-4742-8990-5f391ee71b77 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1477 microversion: 2.1 time: 0.441311 Oct 16 01:02:32.956105 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 303/653] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:32.961337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-047c2989-97f2-428c-83ad-65e64c18d34f tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:32.985494 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-047c2989-97f2-428c-83ad-65e64c18d34f tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.027987 Oct 16 01:02:32.986095 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 304/654] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Oct 16 01:02:32 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:32.993098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-787265499", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "86231cee-28c1-455e-8b68-73fb209e04d9"}], "security_groups": [{"name": "tempest-securitygroup--1971090526"}], "key_name": "tempest-keypair-1205828961", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:33.395759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] validate_networks() for [('86231cee-28c1-455e-8b68-73fb209e04d9', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:02:34.446496 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7f38e9d9-e450-49fe-b7f9-b7b5f3076077 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/341f4393-e133-4431-8180-b685f1eebd68" status: 202 len: 0 microversion: 2.1 time: 2.368050 Oct 16 01:02:34.447535 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 351/655] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:02:32 2022] DELETE /compute/v2.1/os-floating-ips/341f4393-e133-4431-8180-b685f1eebd68 => generated 0 bytes in 2370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:34.452974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:34.453660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:34.460386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.460870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.461304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.461993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.462447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.462869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.565314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:34.565818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:34.566180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:34.566587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:34.568129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:34.575992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.577382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.578179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.578910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.579388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.579802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.601899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Getting quotas for project 5eec6e034df149f8863b1b9ebacfaa81. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:34.604689 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=89,nova_api:DELETE=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:34.607541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Getting quotas for user aceec71835c14681a2ff7d7285d87776 and project 5eec6e034df149f8863b1b9ebacfaa81. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:34.624596 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:02:34.627792 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:02:34.681991 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4589d70a-ba5e-40cf-a5df-f0a124fa5b5a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.692345 Oct 16 01:02:34.688913 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 305/656] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:02:34.688913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c01140e-f52f-4a57-9a41-3277b5c8f092 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:34.694231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:34.712574 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c01140e-f52f-4a57-9a41-3277b5c8f092 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.028176 Oct 16 01:02:34.712929 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 306/657] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Oct 16 01:02:34 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:34.718608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:34.719412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:34.731236 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-81305e9f-e117-471a-83ff-7661e3aa72bd tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1319 microversion: 2.1 time: 0.274402 Oct 16 01:02:34.732070 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 352/658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:34 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:34.738718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:34.739347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:34.741930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.742502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.742993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.744157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.744826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.745267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.746354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.747040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.747636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.748475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.749077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.749648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.883900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:34.905976 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-86352ab8-5043-4df3-9d67-a9fb158a205e tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1935 microversion: 2.75 time: 0.173032 Oct 16 01:02:34.906809 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 353/659] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:34 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1935 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:34.912585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:34.913509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:34.920237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.920956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.921584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:34.922480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:34.923294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:34.924379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:35.049642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:35.058585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:35.060071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:35.061522 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6948246a-f9c2-43b9-aef3-c37312c77de2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1409 microversion: 2.25 time: 0.346709 Oct 16 01:02:35.075218 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 307/660] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:34 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1409 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:35.081626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'action', calling method: .version_select at 0x7fd6507ca0d0>, body: {"removeFloatingIp": {"address": "172.35.4.90"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:35.224895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:35.234371 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d4a7609-c545-43e1-a91c-4dd7441b178d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1477 microversion: 2.1 time: 0.325670 Oct 16 01:02:35.247428 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 354/661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:34 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1477 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:35.247428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:35.247428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:35.247428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:35.247853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:35.247853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:35.247853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:35.248263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:35.248685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:35.327283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:35.336442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:35.337177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:35.337793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:35.339695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:35.341910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:35.342544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:35.373705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:35.388637 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-194bc4f5-cd2d-4b3d-b9ea-04e26eb99dc0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1245 microversion: 2.1 time: 0.152125 Oct 16 01:02:35.389459 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 355/662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:35 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:35.395591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c25ddfbd-384d-4673-9e8e-b7703e8c9564 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:35.429523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c25ddfbd-384d-4673-9e8e-b7703e8c9564 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1388634778" status: 202 len: 0 microversion: 2.1 time: 0.038240 Oct 16 01:02:35.430739 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 356/663] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:02:35 2022] DELETE /compute/v2.1/flavors/1388634778 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:35.436161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ab10de6f-68a2-4bd3-960e-a4e89e5453cb req-c27d8602-fc5d-4ce8-bb0f-e75e061ea26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981200a2-5a9d-469f-9f65-ad75dbe1b422", "tag": "f0442b98-20e1-4888-8035-39c00f3965ce"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:35.449893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ab10de6f-68a2-4bd3-960e-a4e89e5453cb req-c27d8602-fc5d-4ce8-bb0f-e75e061ea26a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:35.450802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ab10de6f-68a2-4bd3-960e-a4e89e5453cb req-c27d8602-fc5d-4ce8-bb0f-e75e061ea26a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:35.451605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ab10de6f-68a2-4bd3-960e-a4e89e5453cb req-c27d8602-fc5d-4ce8-bb0f-e75e061ea26a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:35.464794 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ab10de6f-68a2-4bd3-960e-a4e89e5453cb req-c27d8602-fc5d-4ce8-bb0f-e75e061ea26a service nova] Creating event network-changed:f0442b98-20e1-4888-8035-39c00f3965ce for instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 on n-h2-master-1 Oct 16 01:02:35.470564 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ab10de6f-68a2-4bd3-960e-a4e89e5453cb req-c27d8602-fc5d-4ce8-bb0f-e75e061ea26a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037833 Oct 16 01:02:35.471944 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 357/664] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:35.477440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-98d4b4a1-4be6-42d3-b8fe-6235a42fc279 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:35.501019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-98d4b4a1-4be6-42d3-b8fe-6235a42fc279 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.027801 Oct 16 01:02:35.501603 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 358/665] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:35.521524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b87c1546-364c-4612-b85f-0de53c9c2329 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:35.540447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b87c1546-364c-4612-b85f-0de53c9c2329 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/995128746" status: 202 len: 0 microversion: 2.1 time: 0.023689 Oct 16 01:02:35.541297 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 359/666] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:02:35 2022] DELETE /compute/v2.1/flavors/995128746 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:02:35.554157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22994367-0ab9-4613-bcd3-d88f4b38c05a tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:35.579889 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22994367-0ab9-4613-bcd3-d88f4b38c05a tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.033570 Oct 16 01:02:35.583155 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 360/667] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:35.607974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1aee9229-3d21-4dd3-98e9-fee4f480f216 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1398193537", "id": 1777289309, "os-flavor-access:is_public": "False"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:35.633557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1aee9229-3d21-4dd3-98e9-fee4f480f216 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.032520 Oct 16 01:02:35.634470 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 361/668] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:35 2022] POST /compute/v2.1/flavors => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:35.647591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8a6ce4e6-8d5b-4cb1-90d5-9afdad5974d0 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:35.671428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8a6ce4e6-8d5b-4cb1-90d5-9afdad5974d0 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028591 Oct 16 01:02:35.672399 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 362/669] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:35.694894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f8f1143-1aa1-45a2-b685-2b7ca8137a6e tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:35.711842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:02:35.712971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquired lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:02:35.731046 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f8f1143-1aa1-45a2-b685-2b7ca8137a6e tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.041790 Oct 16 01:02:35.740046 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 363/670] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:35.759147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:35.759971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:35.768930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:35.769511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:35.769999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:35.770765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:35.771338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:35.771832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:35.793162 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:36.361623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:36.373488 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2ab66a3a-eb13-40c0-ba62-3605c4dacb1f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1319 microversion: 2.1 time: 0.618124 Oct 16 01:02:36.391011 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 364/671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:35 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:36.397053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8925bd26-4aa9-4d1e-a2dd-dc196d2b00c0 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:36.420563 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8925bd26-4aa9-4d1e-a2dd-dc196d2b00c0 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1777289309" status: 202 len: 0 microversion: 2.1 time: 0.027231 Oct 16 01:02:36.421338 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 365/672] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:02:36 2022] DELETE /compute/v2.1/flavors/1777289309 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:36.428827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:36.429725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:36.436310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:36.437178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:36.437837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:36.438749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:36.441226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:36.442146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:36.622590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] Lazy-loading 'services' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:36.642670 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b3c2504b-d752-4a5d-9999-5d540a1643ae tempest-ServersAdmin275Test-202901713 tempest-ServersAdmin275Test-202901713-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1920 microversion: 2.75 time: 0.219248 Oct 16 01:02:36.662992 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 366/673] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:36 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1920 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:36.662992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:36.662992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:36.662992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:36.663721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:36.663721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:36.663721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:36.663721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:36.664085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:36.919915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:36.933052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:36.935393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:36.937868 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2e21c2e-83a2-4ceb-bf6c-e146185d7f93 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1409 microversion: 2.25 time: 0.291251 Oct 16 01:02:36.938624 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 367/674] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:36 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1409 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:36.944439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:36.947616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:36.954223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:36.955565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:36.956240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:36.957511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:36.958812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:36.960015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:37.148381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:02:37.190943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:37.200702 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f8b6a79d-04ae-4557-bfce-79ad86273522 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1476 microversion: 2.1 time: 0.260512 Oct 16 01:02:37.202094 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 368/675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:36 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:37.213084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:37.213702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:37.222115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:37.222804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:37.223344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:37.224134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:37.224673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:37.225095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:37.518635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:37.530175 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c1b51db7-4e72-4148-9993-aab2dfa8b4d8 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1367 microversion: 2.1 time: 0.324493 Oct 16 01:02:37.531760 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 369/676] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:37 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:37.539593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c9099d25-4c50-4dda-80f7-0be83c15803f tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:37.580792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c9099d25-4c50-4dda-80f7-0be83c15803f tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.046480 Oct 16 01:02:37.581718 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 370/677] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:37 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:37.586660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:37.587265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:37.592815 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:37.594408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:37.595060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:37.595642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:37.597557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:37.597557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:37.598118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:37.637157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:02:37.732236 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1df396b5-0977-4177-94dd-facd994ff4ce tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "DELETE /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 204 len: 0 microversion: 2.75 time: 0.148211 Oct 16 01:02:37.734256 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 371/678] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:02:37 2022] DELETE /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:02:37.741921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:37.742634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:37.749458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:37.749954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:37.750395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:37.751134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:37.751594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:37.752055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.182852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Updating instance_info_cache with network_info: [{"id": "2ea40e62-88f4-4829-868e-a6415dc26ec0", "address": "fa:16:3e:1d:1a:ec", "network": {"id": "d913236b-fc96-417f-b3dc-f721aca4db73", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-242711426-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8b4ef535b0684c0180329169a5765107", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2ea40e62-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:02:38.205551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Releasing lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:02:38.206655 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b5d55171-8264-4c58-87ce-7b62c4add0bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action" status: 202 len: 0 microversion: 2.1 time: 3.130165 Oct 16 01:02:38.207863 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 308/679] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:02:35 2022] POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action => generated 0 bytes in 3132 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:02:38.208395 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:38.214673 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9939e4ad-ad5c-47b5-ab49-7c400275bcfb req-075f5e99-b6e9-4e03-9aa3-c9d2d4fef30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd3dce6-a862-4679-98ca-dfcce6e1771c", "tag": "2ea40e62-88f4-4829-868e-a6415dc26ec0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:38.220400 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bb321bf6-5e6d-465b-9c2b-ff120a735667 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1319 microversion: 2.1 time: 0.482023 Oct 16 01:02:38.221458 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 372/680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:37 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:38.227302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9939e4ad-ad5c-47b5-ab49-7c400275bcfb req-075f5e99-b6e9-4e03-9aa3-c9d2d4fef30c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:38.228145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9939e4ad-ad5c-47b5-ab49-7c400275bcfb req-075f5e99-b6e9-4e03-9aa3-c9d2d4fef30c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:38.228287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5014be79-0572-4330-8816-565e16e4dd12 req-10114c14-6391-428c-acfb-1b99fa83e773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f108bb-6f59-4710-a3d0-5f0b49ee7f92", "name": "network-vif-plugged", "status": "completed", "tag": "55dae9fc-e894-4862-915e-111559c59140"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:38.228987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9939e4ad-ad5c-47b5-ab49-7c400275bcfb req-075f5e99-b6e9-4e03-9aa3-c9d2d4fef30c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.240806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5014be79-0572-4330-8816-565e16e4dd12 req-10114c14-6391-428c-acfb-1b99fa83e773 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:38.243169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5014be79-0572-4330-8816-565e16e4dd12 req-10114c14-6391-428c-acfb-1b99fa83e773 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:38.244356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5014be79-0572-4330-8816-565e16e4dd12 req-10114c14-6391-428c-acfb-1b99fa83e773 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.246992 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9939e4ad-ad5c-47b5-ab49-7c400275bcfb req-075f5e99-b6e9-4e03-9aa3-c9d2d4fef30c service nova] Creating event network-changed:2ea40e62-88f4-4829-868e-a6415dc26ec0 for instance efd3dce6-a862-4679-98ca-dfcce6e1771c on n-h2-master-1 Oct 16 01:02:38.260252 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5014be79-0572-4330-8816-565e16e4dd12 req-10114c14-6391-428c-acfb-1b99fa83e773 service nova] Creating event network-vif-plugged:55dae9fc-e894-4862-915e-111559c59140 for instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 on n-h2-master-1 Oct 16 01:02:38.262715 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9939e4ad-ad5c-47b5-ab49-7c400275bcfb req-075f5e99-b6e9-4e03-9aa3-c9d2d4fef30c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048737 Oct 16 01:02:38.264408 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 309/681] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:38.272533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-24b362e2-eddd-42b7-acdc-6f47e6c37655 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1914836093", "id": 452375912, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:38.273262 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5014be79-0572-4330-8816-565e16e4dd12 req-10114c14-6391-428c-acfb-1b99fa83e773 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050260 Oct 16 01:02:38.279690 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 373/682] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:38.287558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:38.288913 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:38.301121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:38.301904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:38.302803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.303768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:38.304321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:38.304957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.322015 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-24b362e2-eddd-42b7-acdc-6f47e6c37655 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.055015 Oct 16 01:02:38.327952 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 310/683] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:38 2022] POST /compute/v2.1/flavors => generated 411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:38.335512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:38.338459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:38.353391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:38.354180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:38.354869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.355886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:38.356541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:38.358090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.369029 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:38.389373 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:38.458148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:38.467152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:38.468964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:38.475186 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05ef94ab-9be4-42ab-9eb0-041e9fcfb0c0 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1444 microversion: 2.75 time: 0.193867 Oct 16 01:02:38.487338 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 374/684] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:38 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1444 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:38.487338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17a26bea-fb52-456b-bc51-d679b862404e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '.version_select at 0x7fd64e91d670>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:38.664425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:38.676205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:38.682108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:38.686666 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4ba0c924-960d-4b08-a5db-d12acf4736e5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1409 microversion: 2.25 time: 0.357396 Oct 16 01:02:38.687787 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 311/685] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:38 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1409 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:38.693791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:38.694686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:38.702896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:38.703500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:38.704040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.704853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:38.706806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:38.707398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:38.972236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:38.981638 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85e4b85d-8609-4ec8-aa63-c2945d747745 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1476 microversion: 2.1 time: 0.292414 Oct 16 01:02:38.983392 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 312/686] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:38 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:38.988941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aef60801-5d75-4175-8308-fb0c39d0cbb8 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:39.015758 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aef60801-5d75-4175-8308-fb0c39d0cbb8 tempest-FlavorsAdminTestJSON-1114260254 tempest-FlavorsAdminTestJSON-1114260254-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6215 microversion: 2.1 time: 0.030646 Oct 16 01:02:39.016467 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 313/687] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:38 2022] GET /compute/v2.1/flavors/detail => generated 6215 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:39.023082 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:39.024438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:39.032031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:39.032833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:39.034230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:39.035446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:39.036120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:39.036802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:39.621104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:39.637609 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8363633b-06b8-424c-bcc0-9900653f87b6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1367 microversion: 2.1 time: 0.619559 Oct 16 01:02:39.651533 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 314/688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:39 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1367 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:39.663468 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3697d83a-92a5-40f7-a5c0-01e9ccec7230 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:39.682847 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3697d83a-92a5-40f7-a5c0-01e9ccec7230 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/452375912" status: 202 len: 0 microversion: 2.1 time: 0.030254 Oct 16 01:02:39.684056 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 315/689] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:02:39 2022] DELETE /compute/v2.1/flavors/452375912 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:39.688859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-18036a20-8521-42e6-b2de-87a32cd5032f req-df5ac1d4-4b72-4d32-9843-4acbe7794f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f22d93f-cfd6-4917-932e-9373f71dcb72", "name": "network-vif-unplugged", "status": "completed", "tag": "8f9e0a66-1573-4e6d-88da-36e0c3c25b99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:39.698792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-18036a20-8521-42e6-b2de-87a32cd5032f req-df5ac1d4-4b72-4d32-9843-4acbe7794f8c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:39.699843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-18036a20-8521-42e6-b2de-87a32cd5032f req-df5ac1d4-4b72-4d32-9843-4acbe7794f8c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:39.700279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-18036a20-8521-42e6-b2de-87a32cd5032f req-df5ac1d4-4b72-4d32-9843-4acbe7794f8c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:39.715979 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-18036a20-8521-42e6-b2de-87a32cd5032f req-df5ac1d4-4b72-4d32-9843-4acbe7794f8c service nova] Creating event network-vif-unplugged:8f9e0a66-1573-4e6d-88da-36e0c3c25b99 for instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 on n-h2-master-1 Oct 16 01:02:39.723453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-18036a20-8521-42e6-b2de-87a32cd5032f req-df5ac1d4-4b72-4d32-9843-4acbe7794f8c service nova] Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:02:39.734522 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-18036a20-8521-42e6-b2de-87a32cd5032f req-df5ac1d4-4b72-4d32-9843-4acbe7794f8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049387 Oct 16 01:02:39.735161 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 316/690] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:39.740531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:39.741453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:39.747923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:39.748417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:39.748851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:39.749550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:39.750159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:39.750734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:39.985738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:39.997507 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d30f5b0c-b9f0-4aa8-8383-e79de285c510 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1319 microversion: 2.1 time: 0.260806 Oct 16 01:02:40.000976 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 317/691] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:39 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:40.011913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:40.012776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:40.021257 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-17a26bea-fb52-456b-bc51-d679b862404e tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/9c2f2ae6-5e74-4654-9bf5-8f89a0fc1ce1" status: 202 len: 0 microversion: 2.1 time: 1.537736 Oct 16 01:02:40.022540 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 375/692] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:02:38 2022] DELETE /compute/v2.1/os-floating-ips/9c2f2ae6-5e74-4654-9bf5-8f89a0fc1ce1 => generated 0 bytes in 1540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:02:40.023020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.023744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.024695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.025686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.026571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.027306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.033312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-208c19f5-aa31-422f-b8f0-dd33e1f23d25 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:40.065716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-208c19f5-aa31-422f-b8f0-dd33e1f23d25 tempest-FlavorsAdminTestJSON-893903248 tempest-FlavorsAdminTestJSON-893903248-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.036227 Oct 16 01:02:40.067462 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 376/693] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:02:40 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:40.072475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:40.073134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:40.079576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.080467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.081143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.082054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.082730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.083393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.083720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.084209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.084687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.085141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lazy-loading 'fault' on Instance uuid 957cfe31-d958-4d7f-a3eb-8ad94578a687 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:40.199757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:40.216053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:40.217728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb4ac632e9e84d6eacd7bb276a93de52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5af1e6e5fa46bc9bfa0aa213204ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:40.226450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fe439c9b-7c99-48cd-8940-d9b3867bd54f tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 200 len: 1449 microversion: 2.75 time: 0.222812 Oct 16 01:02:40.227496 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 318/694] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:40 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 1449 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:40.234626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:40.235540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:40.242250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.243009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.243686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.244877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.245532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.246178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.378552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:40.389183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:40.391108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:40.393085 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9b095b98-ec4b-43ba-9152-1ada8f1a6049 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1409 microversion: 2.25 time: 0.323856 Oct 16 01:02:40.394286 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 377/695] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:40 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1409 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:40.415070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3407e9c6-4f5b-4fd2-9562-0543e27b2e17 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3407e9c6-4f5b-4fd2-9562-0543e27b2e17 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Request method failure captured: Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action HTTP/1.1 Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 34 Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1f8zoCmo8VCBH7RO4XGm9SalX4dVJkXRKPzqeWpZln1CeD89xnRWZuPU-sc5J5LCwvJpr9volK4f-8YjAh-fp5NzVWtUKhzJSAGGQEVJIddbhTON492GXN-do-amhohZedDixuqEY999WwAYoSS_LNXfamTslpeIOfekQ1SwmL4cFk Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:02:40.422723 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8b4ef535b0684c0180329169a5765107", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8b4ef535b0684c0180329169a5765107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 37a61a57ad4448eba9c1bd8762d3a149 Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: {"addFloatingIp": {"address": ""}} Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:02:40.425632 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'efd3dce6-a862-4679-98ca-dfcce6e1771c', 'body': {'addFloatingIp': {'address': ''}}} Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi '' Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:40.426496 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:02:40.428124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:02:40.429658 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 16 01:02:40.429658 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.429839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3407e9c6-4f5b-4fd2-9562-0543e27b2e17 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:40.431149 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3407e9c6-4f5b-4fd2-9562-0543e27b2e17 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action" status: 400 len: 142 microversion: 2.1 time: 0.035524 Oct 16 01:02:40.432193 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 378/696] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:02:40 2022] POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action => generated 142 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:02:40.444070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:40.447958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:40.459381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.460072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.460614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.461587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.462151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.462704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.475815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:40.487986 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1392da42-5358-4b06-89f0-ecb322558701 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1476 microversion: 2.1 time: 0.259112 Oct 16 01:02:40.488676 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 319/697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:40 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1476 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:40.495171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:02:40.495676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquired lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:02:40.609465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Releasing lock "refresh_cache-efd3dce6-a862-4679-98ca-dfcce6e1771c" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:02:40.610802 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] HTTP exception thrown: floating IP not found Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Request method failure captured: Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action HTTP/1.1 Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 41 Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1f8zoCmo8VCBH7RO4XGm9SalX4dVJkXRKPzqeWpZln1CeD89xnRWZuPU-sc5J5LCwvJpr9volK4f-8YjAh-fp5NzVWtUKhzJSAGGQEVJIddbhTON492GXN-do-amhohZedDixuqEY999WwAYoSS_LNXfamTslpeIOfekQ1SwmL4cFk Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:02:40.612873 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8b4ef535b0684c0180329169a5765107", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8b4ef535b0684c0180329169a5765107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 37a61a57ad4448eba9c1bd8762d3a149 Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:02:40.614387 n-d-master-1 devstack@n-api.service[120545]: exception: floating IP not found Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'efd3dce6-a862-4679-98ca-dfcce6e1771c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:40.615302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 16 01:02:40.617332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.624792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Returning 404 to user: floating IP not found {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:40.628161 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d80fc27a-3269-4c56-8b12-e856bc52c5f5 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action" status: 404 len: 67 microversion: 2.1 time: 0.191036 Oct 16 01:02:40.629006 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 379/698] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:02:40 2022] POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action => generated 67 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:02:40.638026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1c10f3c-ac50-4bec-bad2-9566147132bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:40.662097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:40.663013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:40.669849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.670592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.671268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.672248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.672867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.673314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.727592 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e1c10f3c-ac50-4bec-bad2-9566147132bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1c10f3c-ac50-4bec-bad2-9566147132bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Request method failure captured: Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action HTTP/1.1 Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 44 Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1f8zoCmo8VCBH7RO4XGm9SalX4dVJkXRKPzqeWpZln1CeD89xnRWZuPU-sc5J5LCwvJpr9volK4f-8YjAh-fp5NzVWtUKhzJSAGGQEVJIddbhTON492GXN-do-amhohZedDixuqEY999WwAYoSS_LNXfamTslpeIOfekQ1SwmL4cFk Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:02:40.732749 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8b4ef535b0684c0180329169a5765107", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8b4ef535b0684c0180329169a5765107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 37a61a57ad4448eba9c1bd8762d3a149 Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:02:40.734403 n-d-master-1 devstack@n-api.service[120546]: exception: Floating IP not found for address 0.0.0.0. Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'efd3dce6-a862-4679-98ca-dfcce6e1771c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:40.735432 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 16 01:02:40.736944 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:40.743610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1c10f3c-ac50-4bec-bad2-9566147132bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:40.743610 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1c10f3c-ac50-4bec-bad2-9566147132bf tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action" status: 404 len: 88 microversion: 2.1 time: 0.100382 Oct 16 01:02:40.743610 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 320/699] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:02:40 2022] POST /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c/action => generated 88 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:02:40.748595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:40.749106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:40.758634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.759617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.760262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.761277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.761924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.762516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.804035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:02:40.856820 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:40.876759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:40.887196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f679c063-189b-4141-8e98-08a5c0170034 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1367 microversion: 2.1 time: 0.229117 Oct 16 01:02:40.887863 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 380/700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:40 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:40.925575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f0c7589f-accd-4b0d-87eb-3ac1b1755aaa tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 204 len: 0 microversion: 2.1 time: 0.181408 Oct 16 01:02:40.926601 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 321/701] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:02:40 2022] DELETE /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:02:40.935134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:40.935356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:40.942776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.943455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.943952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:40.944717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:40.945371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:40.958378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.028314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:41.029012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:41.035244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.035888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.036856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.037567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.038026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.038448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.194992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:41.203100 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-470bb63b-c5f3-4009-81c7-fbfb021aaa59 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1541 microversion: 2.1 time: 0.272524 Oct 16 01:02:41.203893 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 381/702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:40 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1541 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:41.241250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:41.249589 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74d0f4c5-13bb-4378-b61b-0b06fa5b66ec tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1468 microversion: 2.1 time: 0.225563 Oct 16 01:02:41.250162 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 322/703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:41 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1468 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:41.258850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:41.259498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] [instance: 957cfe31-d958-4d7f-a3eb-8ad94578a687] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:41.267687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.268344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.269064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.269921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.270375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.271031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.292142 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] HTTP exception thrown: Instance 957cfe31-d958-4d7f-a3eb-8ad94578a687 could not be found. Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Request method failure captured: Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 HTTP/1.1 Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1fcdOgR08CBcJ0vVT3_J-U25QLnWVBCx6-9j7oXrZUXFe_3wyJgcDIlFTuO-3nNw_3IxdmDYNgLTvL8AdYPVFi0Paxhs1vt1m-R4VYxIjYkgBlYptZGjIILGB7mTfNpkZGqPsSJuYDYZ7ZNI9kj9iFHvyMr97F2vOlsDYNl-OB8EaM Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.75 Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 5a5af1e6e5fa46bc9bfa0aa213204ac4 Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersAdmin275Test-451453049 Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:02:41.293944 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5a5af1e6e5fa46bc9bfa0aa213204ac4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5a5af1e6e5fa46bc9bfa0aa213204ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a5af1e6e5fa46bc9bfa0aa213204ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a5af1e6e5fa46bc9bfa0aa213204ac4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersAdmin275Test-451453049 Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 5a5af1e6e5fa46bc9bfa0aa213204ac4 Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersAdmin275Test-451453049 Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersAdmin275Test-451453049-project Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: fb4ac632e9e84d6eacd7bb276a93de52 Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersAdmin275Test-451453049-project Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 957cfe31-d958-4d7f-a3eb-8ad94578a687 could not be found. Oct 16 01:02:41.295571 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '957cfe31-d958-4d7f-a3eb-8ad94578a687'} Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 957cfe31-d958-4d7f-a3eb-8ad94578a687 could not be found. Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:41.296479 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 957cfe31-d958-4d7f-a3eb-8ad94578a687 could not be found. Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 957cfe31-d958-4d7f-a3eb-8ad94578a687 could not be found. Oct 16 01:02:41.297858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.300470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] Returning 404 to user: Instance 957cfe31-d958-4d7f-a3eb-8ad94578a687 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:41.301313 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc1732ad-6370-4b38-9072-2e57eedefd66 tempest-ServersAdmin275Test-451453049 tempest-ServersAdmin275Test-451453049-project] 10.222.0.39 "GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687" status: 404 len: 111 microversion: 2.75 time: 0.046594 Oct 16 01:02:41.301861 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 382/704] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:41 2022] GET /compute/v2.1/servers/957cfe31-d958-4d7f-a3eb-8ad94578a687 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:02:41.424743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:41.425889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:41.434875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.436018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.436856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.437745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.438352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.439005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.575826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-81293267", "block_migration": true, "disk_over_commit": false}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:41.578606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:41.596786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.598489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.602519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.603425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.603902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.604343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.613165 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:41.622836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:41.624794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:41.626015 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-447e69d1-309e-4683-a353-b9e40120eae3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1409 microversion: 2.25 time: 0.208353 Oct 16 01:02:41.639808 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 383/705] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:41 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1409 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:02:41.651302 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:41.651924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:41.657473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lazy-loading 'flavor' on Instance uuid 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:41.665286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.665848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.666313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.667051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.667527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.667935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.673162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Going to try to live migrate instance to tempest-host-81293267 {{(pid=120546) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:02:41.683052 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] HTTP exception thrown: Compute host tempest-host-81293267 could not be found. Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Request method failure captured: Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92/action HTTP/1.1 Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 105 Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1gfsv506wxu93nGTc3j4YEmFXuqAnXK9rKfV5ZcRs24XoUVYAvWPrewbq6MzslW9-LGi5tgWFlVw9eRp6qcwiIGNeyW0X6dZmjm32nhA28-evinGNeQyXjtRvsLQraveARhbbmPsLMTd_KqECjz1YowDCQMEphx4j3IvfdMIAC4NOQ Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: ef8095cdcd604edfbdf0222181e7203e Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-LiveMigrationNegativeTest-1956921451 Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:02:41.686967 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ef8095cdcd604edfbdf0222181e7203e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ef8095cdcd604edfbdf0222181e7203e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef8095cdcd604edfbdf0222181e7203e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef8095cdcd604edfbdf0222181e7203e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-LiveMigrationNegativeTest-1956921451 Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: ef8095cdcd604edfbdf0222181e7203e Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1956921451 Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-LiveMigrationNegativeTest-1956921451-project-admin Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 87f382afa9194618a94663d350549f76 Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-LiveMigrationNegativeTest-1956921451-project-admin Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: {"os-migrateLive": {"host": "tempest-host-81293267", "block_migration": true, "disk_over_commit": false}} Oct 16 01:02:41.688552 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: exception: Compute host tempest-host-81293267 could not be found. Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '68f108bb-6f59-4710-a3d0-5f0b49ee7f92', 'body': {'os-migrateLive': {'host': 'tempest-host-81293267', 'block_migration': True, 'disk_over_commit': False}}} Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:02:41.689440 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-81293267 could not be found. Oct 16 01:02:41.690814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-81293267 could not be found. Oct 16 01:02:41.692380 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-81293267 could not be found. Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Returning 400 to user: Compute host tempest-host-81293267 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f5d05a52-8f2b-4b8b-ae83-0d48172ee78a tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92/action" status: 400 len: 98 microversion: 2.1 time: 0.417736 Oct 16 01:02:41.693869 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 323/706] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Oct 16 01:02:41 2022] POST /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92/action => generated 98 bytes in 419 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:41.699059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:41.699780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:41.709225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.710477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.712012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.713327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.713958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.714522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.904725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:41.913435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6633228b-f606-435c-bffc-81709d324a8a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1476 microversion: 2.1 time: 0.271735 Oct 16 01:02:41.914007 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 384/707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:41 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:41.918869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-55f775ac-b4b3-469d-9dec-1c418e333ae0 req-191d9f5b-ae7e-4b07-ab02-bf5c3b8d0886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032f3033-6ed6-434b-a124-9edf48c5554e", "tag": "6e78da3e-5f4c-4325-b58e-57cc18086ccb"}, {"name": "network-changed", "server_uuid": "7f22d93f-cfd6-4917-932e-9373f71dcb72", "tag": "8f9e0a66-1573-4e6d-88da-36e0c3c25b99"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:41.936097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-55f775ac-b4b3-469d-9dec-1c418e333ae0 req-191d9f5b-ae7e-4b07-ab02-bf5c3b8d0886 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.937055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-55f775ac-b4b3-469d-9dec-1c418e333ae0 req-191d9f5b-ae7e-4b07-ab02-bf5c3b8d0886 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.937710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-55f775ac-b4b3-469d-9dec-1c418e333ae0 req-191d9f5b-ae7e-4b07-ab02-bf5c3b8d0886 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.954482 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-55f775ac-b4b3-469d-9dec-1c418e333ae0 req-191d9f5b-ae7e-4b07-ab02-bf5c3b8d0886 service nova] Creating event network-changed:6e78da3e-5f4c-4325-b58e-57cc18086ccb for instance 032f3033-6ed6-434b-a124-9edf48c5554e on n-h2-master-1 Oct 16 01:02:41.955999 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-55f775ac-b4b3-469d-9dec-1c418e333ae0 req-191d9f5b-ae7e-4b07-ab02-bf5c3b8d0886 service nova] Creating event network-changed:8f9e0a66-1573-4e6d-88da-36e0c3c25b99 for instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 on n-h2-master-1 Oct 16 01:02:41.962027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-55f775ac-b4b3-469d-9dec-1c418e333ae0 req-191d9f5b-ae7e-4b07-ab02-bf5c3b8d0886 service nova] Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:02:41.976234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:41.976811 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-55f775ac-b4b3-469d-9dec-1c418e333ae0 req-191d9f5b-ae7e-4b07-ab02-bf5c3b8d0886 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060719 Oct 16 01:02:41.977784 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 385/708] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:41.982995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:41.983885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:41.990853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.991377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.991656 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db70a31f-4256-4d6f-8d89-d529fd43cbd9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1468 microversion: 2.1 time: 0.296467 Oct 16 01:02:41.991803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.992245 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 324/709] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:41 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1468 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:41.993075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:41.993681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:41.994105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:41.999674 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:42.188912 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2135899208", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:42.253993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:02:42.339653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:42.348743 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-274c7d13-427a-4b29-b634-38bdde20b3c3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1367 microversion: 2.1 time: 0.369507 Oct 16 01:02:42.350074 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 386/710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:41 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:42.355595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:42.356414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:42.363438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:42.364737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:42.365439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:42.366216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:42.366766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:42.367280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:42.731797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:42.740053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ccf89d79-df02-48e7-9acf-234dc539f807 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1541 microversion: 2.1 time: 0.388345 Oct 16 01:02:42.740782 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 387/711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:42 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1541 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:42.745416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:42.746005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:42.757914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:42.758620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:42.759296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:42.760057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:42.760571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:42.761132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:42.912518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:42.917239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:42.919412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:42.920080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:42.920847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:42.935836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:42.936700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:42.937400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:42.938476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:42.941099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:42.941990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:42.971796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Getting quotas for project 65ddfc9041e44055be492260cb2f1ae9. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:42.979530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Getting quotas for user 4352b314efdf413d940755f4cb0dbbda and project 65ddfc9041e44055be492260cb2f1ae9. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:42.999481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:02:43.003139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:02:43.054842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:43.066453 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57d31d87-c85c-47a4-a4fb-941bb2225e37 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886155 Oct 16 01:02:43.067840 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 325/712] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:02:43.074361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:43.075524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:43.083649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:43.084527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:43.085135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:43.086209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:43.086832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:43.087496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:43.093342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:43.107105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:43.108337 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-09aad8cf-cfb7-4cf4-b84f-35ad0c079800 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1409 microversion: 2.25 time: 0.366451 Oct 16 01:02:43.109303 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 388/713] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:42 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1409 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:43.117712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-481a4314-53fa-4fcf-b663-0012a0510ae3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:43.118589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-481a4314-53fa-4fcf-b663-0012a0510ae3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:43.264098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-481a4314-53fa-4fcf-b663-0012a0510ae3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:43.272104 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-481a4314-53fa-4fcf-b663-0012a0510ae3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1219 microversion: 2.1 time: 0.159974 Oct 16 01:02:43.274451 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 389/714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:43 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:43.372862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:43.373570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:43.388006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:43.388505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:43.388942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:43.395204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:43.395720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:43.398520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:43.456771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:43.468703 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e8378eb8-64b0-4fa4-901a-6fe26d551afa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1476 microversion: 2.1 time: 0.398646 Oct 16 01:02:43.470139 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 326/715] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:43 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:43.681911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:43.692305 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97d8cb0b-7898-4137-822b-fd3aa8adf51a tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1367 microversion: 2.1 time: 0.324008 Oct 16 01:02:43.693288 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 390/716] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:43 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:43.769408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:43.771171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:43.794488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:43.796199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:43.801155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:43.804069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:43.805362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:43.806637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:43.931297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-561185cf-9ac7-4609-8cd1-7fe6f32a9b06 req-5d81c025-d06e-4188-9881-3cae3781653b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981200a2-5a9d-469f-9f65-ad75dbe1b422", "name": "network-vif-plugged", "status": "completed", "tag": "f0442b98-20e1-4888-8035-39c00f3965ce"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:43.946129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-561185cf-9ac7-4609-8cd1-7fe6f32a9b06 req-5d81c025-d06e-4188-9881-3cae3781653b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:43.946905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-561185cf-9ac7-4609-8cd1-7fe6f32a9b06 req-5d81c025-d06e-4188-9881-3cae3781653b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:43.947556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-561185cf-9ac7-4609-8cd1-7fe6f32a9b06 req-5d81c025-d06e-4188-9881-3cae3781653b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:43.962805 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-561185cf-9ac7-4609-8cd1-7fe6f32a9b06 req-5d81c025-d06e-4188-9881-3cae3781653b service nova] Creating event network-vif-plugged:f0442b98-20e1-4888-8035-39c00f3965ce for instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 on n-h2-master-1 Oct 16 01:02:43.969182 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-561185cf-9ac7-4609-8cd1-7fe6f32a9b06 req-5d81c025-d06e-4188-9881-3cae3781653b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041914 Oct 16 01:02:43.971378 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 391/717] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:44.071474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:44.079365 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e21902a-da74-4c39-8dda-4a630205a9e8 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1541 microversion: 2.1 time: 0.319390 Oct 16 01:02:44.080192 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 327/718] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:43 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1541 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:44.140250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:44.141263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:44.163644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.164929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.165746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.167637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.168314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.169042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.301831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:44.302570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:44.309534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.310787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.311513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.313334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.314099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.320088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.342360 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:44.353669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:44.357034 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:44.359640 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5f84f08-e11e-42fe-a855-61c955253538 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1409 microversion: 2.25 time: 0.224064 Oct 16 01:02:44.360676 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 392/719] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:44 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1409 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:44.420194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:44.431480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-92d9604a-5d0a-48fe-b769-8c7f9ec7ec40 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1271 microversion: 2.1 time: 0.136696 Oct 16 01:02:44.435931 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 328/720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:44 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:44.494523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:44.495340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:44.501471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.502500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.502944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.503804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.504257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.504679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.665808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:44.676243 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ff95fb1-6f1a-431b-b944-57f00871ae8d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1474 microversion: 2.1 time: 0.186922 Oct 16 01:02:44.677076 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 393/721] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:44 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1474 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:44.718654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:44.719289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:44.726297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.726776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.727232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.727925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:44.728377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:44.728789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:44.958930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:44.981423 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c0a04a6-ecdd-4553-a80d-f2601b894bf4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1367 microversion: 2.1 time: 0.267489 Oct 16 01:02:44.988230 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 329/722] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:44 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:45.103440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:45.105024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:45.113786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:45.114614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:45.115342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:45.116234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:45.117005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:45.117744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:45.171025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea1db0df-bf02-4a1c-abbf-74a6c66f2a29 tempest-FlavorsV261TestJSON-1745964402 tempest-FlavorsV261TestJSON-1745964402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1267149434", "id": 2103664665, "os-flavor-access:is_public": "True"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:45.196358 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea1db0df-bf02-4a1c-abbf-74a6c66f2a29 tempest-FlavorsV261TestJSON-1745964402 tempest-FlavorsV261TestJSON-1745964402-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.452108 Oct 16 01:02:45.198309 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 394/723] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:02:44 2022] POST /compute/v2.1/flavors => generated 468 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 01:02:45.399701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:45.414766 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f551107-3953-4ddf-92f7-f144fd6bb30a tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1541 microversion: 2.1 time: 0.316259 Oct 16 01:02:45.415427 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 330/724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:45 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1541 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:45.423558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:45.426658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:45.438755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:45.440831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:45.441483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:45.443008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:45.444554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:45.447133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:45.532633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0c3efc4f-11ef-4bde-94aa-7d7c530f6912 tempest-FlavorsV261TestJSON-1515687566 tempest-FlavorsV261TestJSON-1515687566-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:45.546149 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0c3efc4f-11ef-4bde-94aa-7d7c530f6912 tempest-FlavorsV261TestJSON-1515687566 tempest-FlavorsV261TestJSON-1515687566-project] 10.222.0.39 "GET /compute/v2.1/flavors/2103664665" status: 200 len: 468 microversion: 2.61 time: 0.316406 Oct 16 01:02:45.562304 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 395/725] 10.222.0.39 () {60 vars in 1199 bytes} [Sun Oct 16 01:02:45 2022] GET /compute/v2.1/flavors/2103664665 => generated 468 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:02:45.575977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:45.577641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:45.594351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:45.594857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:45.596254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:45.597502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:45.598388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:45.598388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:45.729397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:45.746780 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5774f3e6-6d52-488f-aaa2-7f0ca9240ea5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1277 microversion: 2.1 time: 0.183251 Oct 16 01:02:45.750698 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 396/726] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:45 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:45.763658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7573bbeb-42a7-41a7-bd4e-2dddc5bdcda1 tempest-FlavorsV261TestJSON-1745964402 tempest-FlavorsV261TestJSON-1745964402-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:45.807143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:45.827849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:45.828452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7573bbeb-42a7-41a7-bd4e-2dddc5bdcda1 tempest-FlavorsV261TestJSON-1745964402 tempest-FlavorsV261TestJSON-1745964402-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/2103664665" status: 200 len: 469 microversion: 2.61 time: 0.076213 Oct 16 01:02:45.832983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:45.834668 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4b149ccc-0148-4776-8f6a-3affd1a8436a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1409 microversion: 2.25 time: 0.418147 Oct 16 01:02:45.838755 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 331/727] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:45 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:45.839334 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 397/728] 10.222.0.39 () {62 vars in 1219 bytes} [Sun Oct 16 01:02:45 2022] PUT /compute/v2.1/flavors/2103664665 => generated 469 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:02:45.848541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:45.850382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:45.855525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b202d732-22e2-45b4-b503-0d846e069084 tempest-FlavorsV261TestJSON-1515687566 tempest-FlavorsV261TestJSON-1515687566-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:45.860125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:45.861054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:45.862684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:45.864084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:45.864973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:45.865653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:45.931686 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b202d732-22e2-45b4-b503-0d846e069084 tempest-FlavorsV261TestJSON-1515687566 tempest-FlavorsV261TestJSON-1515687566-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.091173 Oct 16 01:02:45.947538 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 398/729] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:02:45 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:45.957973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f094be86-0225-46ac-aa3e-c3e12df17afc tempest-FlavorsV261TestJSON-1515687566 tempest-FlavorsV261TestJSON-1515687566-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:45.995633 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f094be86-0225-46ac-aa3e-c3e12df17afc tempest-FlavorsV261TestJSON-1515687566 tempest-FlavorsV261TestJSON-1515687566-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.044961 Oct 16 01:02:45.996261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 399/730] 10.222.0.39 () {60 vars in 1166 bytes} [Sun Oct 16 01:02:45 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:46.011054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:46.011681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:46.033714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.034423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.035107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.036011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.036655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.037271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.220133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:46.229102 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-907c9ea8-d832-4140-939b-ed80100cc231 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1471 microversion: 2.1 time: 0.388724 Oct 16 01:02:46.230011 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 332/731] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:45 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:46.234811 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-21c1d82a-b7cf-401c-925d-410ce33e6c93 tempest-FlavorsV261TestJSON-1745964402 tempest-FlavorsV261TestJSON-1745964402-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:46.256667 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-21c1d82a-b7cf-401c-925d-410ce33e6c93 tempest-FlavorsV261TestJSON-1745964402 tempest-FlavorsV261TestJSON-1745964402-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2103664665" status: 202 len: 0 microversion: 2.61 time: 0.025230 Oct 16 01:02:46.258179 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 333/732] 10.222.0.39 () {60 vars in 1202 bytes} [Sun Oct 16 01:02:46 2022] DELETE /compute/v2.1/flavors/2103664665 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:02:46.263398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c88775dc-c112-4ef8-81d1-56788483770b req-531952fd-a646-49ff-820e-fa6a76a5b73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd3dce6-a862-4679-98ca-dfcce6e1771c", "name": "network-vif-deleted", "tag": "2ea40e62-88f4-4829-868e-a6415dc26ec0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:46.271493 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:46.276669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c88775dc-c112-4ef8-81d1-56788483770b req-531952fd-a646-49ff-820e-fa6a76a5b73d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.277685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c88775dc-c112-4ef8-81d1-56788483770b req-531952fd-a646-49ff-820e-fa6a76a5b73d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.278309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c88775dc-c112-4ef8-81d1-56788483770b req-531952fd-a646-49ff-820e-fa6a76a5b73d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.287121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:46.297581 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e465549-5da1-49c5-8109-b95bc9b69ff5 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1367 microversion: 2.1 time: 0.296950 Oct 16 01:02:46.298454 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 400/733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:45 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:46.322023 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c88775dc-c112-4ef8-81d1-56788483770b req-531952fd-a646-49ff-820e-fa6a76a5b73d service nova] Creating event network-vif-deleted:2ea40e62-88f4-4829-868e-a6415dc26ec0 for instance efd3dce6-a862-4679-98ca-dfcce6e1771c on n-h2-master-1 Oct 16 01:02:46.329262 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c88775dc-c112-4ef8-81d1-56788483770b req-531952fd-a646-49ff-820e-fa6a76a5b73d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069425 Oct 16 01:02:46.331800 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 334/734] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:46.339779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:46.340493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:46.349825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.351248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.351877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.352988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.353646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.355244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.470794 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-642c50d9-6fe9-4766-b9b3-c142c6eca659 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72/action" status: 204 len: 0 microversion: 2.1 time: 0.136089 Oct 16 01:02:46.472059 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 335/735] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:02:46 2022] POST /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72/action => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:02:46.483256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a9ce016c-1726-4a0b-922f-0ac5a38ebc99 tempest-FlavorsV261TestJSON-1745964402 tempest-FlavorsV261TestJSON-1745964402-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:46.561332 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a9ce016c-1726-4a0b-922f-0ac5a38ebc99 tempest-FlavorsV261TestJSON-1745964402 tempest-FlavorsV261TestJSON-1745964402-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.087842 Oct 16 01:02:46.564949 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 336/736] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:02:46 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:46.572181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:46.574119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:46.587139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-856105906", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:46.592824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.593322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.596794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.600156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.603505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.603965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.648589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:46.649194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:46.649743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:46.650208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lazy-loading 'fault' on Instance uuid efd3dce6-a862-4679-98ca-dfcce6e1771c {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:02:46.712219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:02:47.273446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a61a57ad4448eba9c1bd8762d3a149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef535b0684c0180329169a5765107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:47.288602 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-946bb987-e401-4a05-a9a9-73ca14de7c29 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 200 len: 1322 microversion: 2.1 time: 0.722271 Oct 16 01:02:47.289630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 337/737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:46 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:47.295707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:47.296667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:47.308206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.308777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:47.309320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:47.310093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.310683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:47.311201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:47.620735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:47.656976 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-28eaa67d-0b05-4502-8bf8-1b0f09fd61cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1471 microversion: 2.1 time: 0.364141 Oct 16 01:02:47.673665 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 338/738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:47 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1471 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:47.703176 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:47.703795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:47.734545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.734956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:47.735393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:47.736100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.736629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:47.737054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:47.761866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:47.762957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:47.763797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:47.764394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:47.765059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:47.766905 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:47.789490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.790177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:47.792016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:47.794463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.795349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:47.795942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:47.842976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Getting quotas for project 9f15cb6a79194375bd48a2af095e9374. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:47.849793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Getting quotas for user 57612f6a347e49be96d699e76bd9bead and project 9f15cb6a79194375bd48a2af095e9374. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:47.864806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:02:47.867179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:02:47.951567 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc3090e3-190a-4bdf-aa3d-6a698085179c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.650650 Oct 16 01:02:47.954168 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 401/739] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:02:47.972494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:47.973380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:47.989249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:47.990286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.007404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.010218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.010834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.011408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.249246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:48.271605 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ea7febaa-2abd-40f3-b797-346f1be4d5a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1319 microversion: 2.1 time: 0.587441 Oct 16 01:02:48.273860 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 339/740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:47 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:48.281904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:48.283625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:48.294441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.295094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.295536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.296994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.297619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.297923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.473599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:48.485551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:48.488086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:48.494114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0333c251-5709-4c03-b17d-b679cbc717d3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1605 microversion: 2.25 time: 0.536321 Oct 16 01:02:48.507020 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 402/741] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:02:47 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1605 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:02:48.507020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2bd6a61b-97fe-46da-a318-ffec0a3b813a req-24e7340c-a4e1-4a22-a769-c0447baf885d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032f3033-6ed6-434b-a124-9edf48c5554e", "name": "network-vif-plugged", "status": "completed", "tag": "6e78da3e-5f4c-4325-b58e-57cc18086ccb"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:48.540079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2bd6a61b-97fe-46da-a318-ffec0a3b813a req-24e7340c-a4e1-4a22-a769-c0447baf885d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.540572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2bd6a61b-97fe-46da-a318-ffec0a3b813a req-24e7340c-a4e1-4a22-a769-c0447baf885d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.544806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2bd6a61b-97fe-46da-a318-ffec0a3b813a req-24e7340c-a4e1-4a22-a769-c0447baf885d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.574655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2bd6a61b-97fe-46da-a318-ffec0a3b813a req-24e7340c-a4e1-4a22-a769-c0447baf885d service nova] Creating event network-vif-plugged:6e78da3e-5f4c-4325-b58e-57cc18086ccb for instance 032f3033-6ed6-434b-a124-9edf48c5554e on n-h2-master-1 Oct 16 01:02:48.589057 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2bd6a61b-97fe-46da-a318-ffec0a3b813a req-24e7340c-a4e1-4a22-a769-c0447baf885d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087574 Oct 16 01:02:48.590004 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 403/742] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:48.598097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-644976351", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:48.697317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:02:48.711907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:48.722419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a467da0d-c2b8-41aa-b400-8a3c53118d67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1367 microversion: 2.1 time: 0.446426 Oct 16 01:02:48.723903 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 340/743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:48 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:48.729070 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:48.729682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] [instance: efd3dce6-a862-4679-98ca-dfcce6e1771c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:48.736565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.737310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.737945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.739177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.739664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.740176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.756647 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] HTTP exception thrown: Instance efd3dce6-a862-4679-98ca-dfcce6e1771c could not be found. Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Request method failure captured: Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c HTTP/1.1 Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1f8zoCmo8VCBH7RO4XGm9SalX4dVJkXRKPzqeWpZln1CeD89xnRWZuPU-sc5J5LCwvJpr9volK4f-8YjAh-fp5NzVWtUKhzJSAGGQEVJIddbhTON492GXN-do-amhohZedDixuqEY999WwAYoSS_LNXfamTslpeIOfekQ1SwmL4cFk Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:02:48.758897 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8b4ef535b0684c0180329169a5765107", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8b4ef535b0684c0180329169a5765107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8b4ef535b0684c0180329169a5765107"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 8b4ef535b0684c0180329169a5765107 Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839 Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 37a61a57ad4448eba9c1bd8762d3a149 Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:02:48.760517 n-d-master-1 devstack@n-api.service[120546]: exception: Instance efd3dce6-a862-4679-98ca-dfcce6e1771c could not be found. Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'efd3dce6-a862-4679-98ca-dfcce6e1771c'} Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd3dce6-a862-4679-98ca-dfcce6e1771c could not be found. Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:02:48.761282 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd3dce6-a862-4679-98ca-dfcce6e1771c could not be found. Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd3dce6-a862-4679-98ca-dfcce6e1771c could not be found. Oct 16 01:02:48.763067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:02:48.768795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] Returning 404 to user: Instance efd3dce6-a862-4679-98ca-dfcce6e1771c could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:02:48.769941 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-facd4b25-5423-48d1-abda-be84f5152636 tempest-FloatingIPsAssociationNegativeTestJSON-958136839 tempest-FloatingIPsAssociationNegativeTestJSON-958136839-project] 10.222.0.39 "GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c" status: 404 len: 111 microversion: 2.1 time: 0.044803 Oct 16 01:02:48.774592 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 341/744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:48 2022] GET /compute/v2.1/servers/efd3dce6-a862-4679-98ca-dfcce6e1771c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:02:48.780794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:48.781965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:48.792123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.792931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.793568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:48.795355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:48.796017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:48.796639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:49.089928 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-31bc3d9a-eda3-4026-ad93-0347fd0bf074 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.313954 Oct 16 01:02:49.098752 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 342/745] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Oct 16 01:02:48 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-interface => generated 284 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:02:49.103949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:49.104893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:49.112367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:49.113176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:49.113844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:49.114793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:49.115514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:49.116142 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:49.873131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:02:49.873923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:02:49.874399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:02:49.874900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:02:49.875537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:02:49.898629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:49.899372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:49.899796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:49.900715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:49.901166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:49.901752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:49.920546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Getting quotas for project 9f15cb6a79194375bd48a2af095e9374. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:49.925089 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:49.926443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Getting quotas for user 57612f6a347e49be96d699e76bd9bead and project 9f15cb6a79194375bd48a2af095e9374. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:49.939101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:02:49.946491 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:02:50.030196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05769b0a-b9ed-439b-b51f-a9a31919e201 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433379 Oct 16 01:02:50.031471 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 404/746] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:02:50.037972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-970e4796-6127-414a-b438-311b1b45f02a req-61fa05fe-8ede-4a13-847e-c2b53a247d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93edfeaa-bb47-49b5-a772-114760eed0c9", "tag": "104f04cd-60c8-4aaf-b277-55a6a4c14c2f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:50.052251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-970e4796-6127-414a-b438-311b1b45f02a req-61fa05fe-8ede-4a13-847e-c2b53a247d53 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.053675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-970e4796-6127-414a-b438-311b1b45f02a req-61fa05fe-8ede-4a13-847e-c2b53a247d53 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.054321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-970e4796-6127-414a-b438-311b1b45f02a req-61fa05fe-8ede-4a13-847e-c2b53a247d53 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.069213 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-970e4796-6127-414a-b438-311b1b45f02a req-61fa05fe-8ede-4a13-847e-c2b53a247d53 service nova] Creating event network-changed:104f04cd-60c8-4aaf-b277-55a6a4c14c2f for instance 93edfeaa-bb47-49b5-a772-114760eed0c9 on n-h1-master-1 Oct 16 01:02:50.074287 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-970e4796-6127-414a-b438-311b1b45f02a req-61fa05fe-8ede-4a13-847e-c2b53a247d53 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041425 Oct 16 01:02:50.075178 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 405/747] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:50.081558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:50.082571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:50.092798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.093730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.094394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.095364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.097293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.097942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.170657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:50.184647 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1878c63d-e8b1-4ba4-8ccc-bf4f3717cf86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1471 microversion: 2.1 time: 1.084271 Oct 16 01:02:50.191528 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 343/748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:49 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1471 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:50.212880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:50.213490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:50.219849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.220717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.222025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.222986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.223634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.224241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.503956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:50.518292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-260ef1db-7e8b-4587-8d79-5117a831ed3c tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1319 microversion: 2.1 time: 0.440427 Oct 16 01:02:50.521453 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 406/749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:50 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:50.545116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2673021-436a-469f-b5bb-1aaa181b4619 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:50.545872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2673021-436a-469f-b5bb-1aaa181b4619 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:50.781435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2673021-436a-469f-b5bb-1aaa181b4619 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:50.790875 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2673021-436a-469f-b5bb-1aaa181b4619 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1213 microversion: 2.1 time: 0.267441 Oct 16 01:02:50.793080 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 407/750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:50 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1213 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:50.802405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f22d93f-cfd6-4917-932e-9373f71dcb72", "name": "network-vif-plugged", "status": "completed", "tag": "8f9e0a66-1573-4e6d-88da-36e0c3c25b99"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:50.848001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.849001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.851360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.876676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:50.885137 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a58f8980-a0d7-4054-94dc-1f8dc13fbb2c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1557 microversion: 2.1 time: 0.676240 Oct 16 01:02:50.885750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 344/751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:50 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1557 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:50.890022 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] Creating event network-vif-plugged:8f9e0a66-1573-4e6d-88da-36e0c3c25b99 for instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 on n-h2-master-1 Oct 16 01:02:50.901481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d7dcdc99-4a4f-447d-beab-5f5763c49c62 req-32583e35-7918-40b3-8330-97f98022f741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981200a2-5a9d-469f-9f65-ad75dbe1b422", "tag": "f0442b98-20e1-4888-8035-39c00f3965ce"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:50.918071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d7dcdc99-4a4f-447d-beab-5f5763c49c62 req-32583e35-7918-40b3-8330-97f98022f741 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.918557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d7dcdc99-4a4f-447d-beab-5f5763c49c62 req-32583e35-7918-40b3-8330-97f98022f741 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.919262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d7dcdc99-4a4f-447d-beab-5f5763c49c62 req-32583e35-7918-40b3-8330-97f98022f741 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.925651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:02:50.950519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d7dcdc99-4a4f-447d-beab-5f5763c49c62 req-32583e35-7918-40b3-8330-97f98022f741 service nova] Creating event network-changed:f0442b98-20e1-4888-8035-39c00f3965ce for instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 on n-h2-master-1 Oct 16 01:02:50.951588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156740 Oct 16 01:02:50.958070 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 408/752] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:50.959276 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d7dcdc99-4a4f-447d-beab-5f5763c49c62 req-32583e35-7918-40b3-8330-97f98022f741 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071648 Oct 16 01:02:50.959734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:50.962694 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-75b84e21-01e5-46e1-9e82-d3923ce661f9 req-980517ac-bf80-4761-ab4f-ca0d06f1d9c1 service nova] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003222 Oct 16 01:02:50.963510 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 409/753] 10.222.0.39 () {56 vars in 886 bytes} [Sun Oct 16 01:02:50 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 16 01:02:50.969792 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 345/754] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:50.973156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:50.976875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:50.985999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.987420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.988109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:50.989314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:50.989865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:50.990503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:51.097708 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d0847b77-4a02-4459-88bb-2babdebee653 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128904 Oct 16 01:02:51.098310 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 410/755] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:02:50 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:51.217210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:51.217944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:51.230534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:51.231082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:51.231503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:51.232214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:51.232672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:51.233098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:51.548628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:51.549327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:51.567199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:51.567674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:51.568114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:51.568846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:51.569367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:51.570015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:51.715735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:51.726078 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8be5c8f7-4695-47fd-b8ee-1951e077682d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1471 microversion: 2.1 time: 0.512665 Oct 16 01:02:51.740482 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 346/756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:51 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1471 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:51.822153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:51.823140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:51.856854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:51.858367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:51.859728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:51.863074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:51.865404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:51.866115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:52.019786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:52.032784 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a8e7afd8-eaf0-4141-b76c-f28c6d3efec5 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1319 microversion: 2.1 time: 0.487657 Oct 16 01:02:52.034488 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 411/757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:51 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:52.062548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:52.076436 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e795a7be-321f-450d-ad6c-321cf2ff1869 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1265 microversion: 2.1 time: 0.260013 Oct 16 01:02:52.091428 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 347/758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:51 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:52.755112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:52.755112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:52.765257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:52.766370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:52.766811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:52.767846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:52.768839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:52.769268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:53.060479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:53.061084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:53.081456 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:53.082208 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=16 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:53.083725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:53.084212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:53.084646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:53.085373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:53.085789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:53.086214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:53.597099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:53.606292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a2485a79-6425-476e-947f-25aea1daf0e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1463 microversion: 2.1 time: 0.857329 Oct 16 01:02:53.626373 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 412/759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:52 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1463 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:53.636004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:53.636710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:53.643063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:53.643757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:53.644917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:53.646020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:53.646606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:53.647180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:53.831171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:53.843179 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e12b1f69-bb16-412b-9954-6303e6bc5809 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1271 microversion: 2.1 time: 0.213353 Oct 16 01:02:53.851163 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 413/760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:53 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:53.867928 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:53.870484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:53.880579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:53.882175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:53.884025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:53.891211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:53.892059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:53.893588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:53.977732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:53.994433 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3001610f-b9b5-4163-8050-4535b9b79fe4 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1319 microversion: 2.1 time: 0.937593 Oct 16 01:02:53.995744 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 348/761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:53 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1319 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:54.389595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:54.398724 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:54.407286 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6baab7f-1323-4ae3-89a0-700240453401 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1463 microversion: 2.1 time: 0.554056 Oct 16 01:02:54.408002 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 414/762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:53 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1463 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:54.441895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8851225c-4ee2-4ab3-ac50-0b5b7a4746aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'create', calling method: .version_select at 0x7fd64e736430>, body: {"keypair": {"name": "tempest-keypair-976747058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9V1ptXeylgaz0Qka7FcXpbkKDontpSWiSIe11KJU9ya/hKOkkpMEvpyD7AW+Fdv1lzbBHYqVlFP1CDm418lFUMkFd9f+cXlELZAwsl3cqpdD+AMRZOUbqjexLQHJcL9Q=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:54.473046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8851225c-4ee2-4ab3-ac50-0b5b7a4746aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for project f6556287cca54d74b4971ef3e666cc1e. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:02:54.479100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8851225c-4ee2-4ab3-ac50-0b5b7a4746aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for user f3b14e05c41648159d8ed97719c68862 and project f6556287cca54d74b4971ef3e666cc1e. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:02:54.531606 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8851225c-4ee2-4ab3-ac50-0b5b7a4746aa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095077 Oct 16 01:02:54.541819 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 349/763] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:02:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:54.688754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-18d72dc6-8d4b-4f23-a348-0fd5cfe7a58c req-e65533c0-68b2-4848-95b1-03d6f8872347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032f3033-6ed6-434b-a124-9edf48c5554e", "tag": "6e78da3e-5f4c-4325-b58e-57cc18086ccb"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:54.713163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-18d72dc6-8d4b-4f23-a348-0fd5cfe7a58c req-e65533c0-68b2-4848-95b1-03d6f8872347 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:54.713645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-18d72dc6-8d4b-4f23-a348-0fd5cfe7a58c req-e65533c0-68b2-4848-95b1-03d6f8872347 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:54.714073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-18d72dc6-8d4b-4f23-a348-0fd5cfe7a58c req-e65533c0-68b2-4848-95b1-03d6f8872347 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:54.726047 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-18d72dc6-8d4b-4f23-a348-0fd5cfe7a58c req-e65533c0-68b2-4848-95b1-03d6f8872347 service nova] Creating event network-changed:6e78da3e-5f4c-4325-b58e-57cc18086ccb for instance 032f3033-6ed6-434b-a124-9edf48c5554e on n-h2-master-1 Oct 16 01:02:54.732838 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-18d72dc6-8d4b-4f23-a348-0fd5cfe7a58c req-e65533c0-68b2-4848-95b1-03d6f8872347 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Oct 16 01:02:54.741174 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 415/764] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:02:54.882283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:54.883263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:54.895981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:54.897079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:54.899214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:54.901233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:54.903861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:54.904626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:55.020145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:55.021012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:55.036141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:55.037238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:55.042890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:55.044856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:55.048159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:55.051912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:55.257119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:55.265797 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3801bc46-a7ee-4ff9-af11-56449f23ba33 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1271 microversion: 2.1 time: 0.389065 Oct 16 01:02:55.266367 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 350/765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:54 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1271 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:55.505720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:55.518552 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-302c547c-2c11-4521-b38c-341279df053f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1319 microversion: 2.1 time: 0.502915 Oct 16 01:02:55.521901 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 416/766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:55 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:56.297465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:56.299792 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:56.325876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:56.326372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:56.326810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:56.327572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:56.331448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:56.331999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:56.557503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:56.559120 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:56.568792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:56.569437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:56.570180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:56.571414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:56.572003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:56.572486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:57.218569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:57.229150 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ee179c91-4560-4ea0-9bbc-58062f8f2ca4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1313 microversion: 2.1 time: 0.943031 Oct 16 01:02:57.230068 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 351/767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:56 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1313 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:57.234802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-556f79b5-241b-4609-9c1a-a6d3b79eb0ac req-b5a1a612-cc11-454d-97d5-334d9e7d01ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5", "tag": "62f88490-3555-4b72-88e6-cee67ed2ea99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:57.248097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-556f79b5-241b-4609-9c1a-a6d3b79eb0ac req-b5a1a612-cc11-454d-97d5-334d9e7d01ce service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:57.248707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-556f79b5-241b-4609-9c1a-a6d3b79eb0ac req-b5a1a612-cc11-454d-97d5-334d9e7d01ce service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:57.249261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-556f79b5-241b-4609-9c1a-a6d3b79eb0ac req-b5a1a612-cc11-454d-97d5-334d9e7d01ce service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:57.268194 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-556f79b5-241b-4609-9c1a-a6d3b79eb0ac req-b5a1a612-cc11-454d-97d5-334d9e7d01ce service nova] Creating event network-changed:62f88490-3555-4b72-88e6-cee67ed2ea99 for instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 on n-h2-master-1 Oct 16 01:02:57.274739 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-556f79b5-241b-4609-9c1a-a6d3b79eb0ac req-b5a1a612-cc11-454d-97d5-334d9e7d01ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043062 Oct 16 01:02:57.276345 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 352/768] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:57.309217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:57.323235 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ce46bc0-a3b2-415f-9c0e-f8a73b2b0d7a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1319 microversion: 2.1 time: 0.777034 Oct 16 01:02:57.324874 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 417/769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:56 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1319 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:57.471092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9f94f02f-9af0-4afb-91b1-ee0f37124133 tempest-InstanceUsageAuditLogTestJSON-1587071425 tempest-InstanceUsageAuditLogTestJSON-1587071425-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:57.495279 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9f94f02f-9af0-4afb-91b1-ee0f37124133 tempest-InstanceUsageAuditLogTestJSON-1587071425 tempest-InstanceUsageAuditLogTestJSON-1587071425-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-16 01:02:57" status: 200 len: 318 microversion: 2.1 time: 0.217563 Oct 16 01:02:57.496539 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 353/770] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:02:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-16%2001%3A02%3A57 => generated 318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:57.510155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcd070ac-afaa-45f5-8a86-93db53e21fe4 tempest-InstanceUsageAuditLogTestJSON-1587071425 tempest-InstanceUsageAuditLogTestJSON-1587071425-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:57.532762 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcd070ac-afaa-45f5-8a86-93db53e21fe4 tempest-InstanceUsageAuditLogTestJSON-1587071425 tempest-InstanceUsageAuditLogTestJSON-1587071425-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.026237 Oct 16 01:02:57.549794 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 418/771] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Oct 16 01:02:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:57.798129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f7991f56-826d-4b06-972a-cefcf4fce771 req-7d38bcf1-3302-4d93-97cb-4254555c830a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93edfeaa-bb47-49b5-a772-114760eed0c9", "name": "network-vif-plugged", "status": "completed", "tag": "104f04cd-60c8-4aaf-b277-55a6a4c14c2f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:57.815540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7991f56-826d-4b06-972a-cefcf4fce771 req-7d38bcf1-3302-4d93-97cb-4254555c830a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:57.816478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7991f56-826d-4b06-972a-cefcf4fce771 req-7d38bcf1-3302-4d93-97cb-4254555c830a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:57.817518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7991f56-826d-4b06-972a-cefcf4fce771 req-7d38bcf1-3302-4d93-97cb-4254555c830a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:57.838050 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f7991f56-826d-4b06-972a-cefcf4fce771 req-7d38bcf1-3302-4d93-97cb-4254555c830a service nova] Creating event network-vif-plugged:104f04cd-60c8-4aaf-b277-55a6a4c14c2f for instance 93edfeaa-bb47-49b5-a772-114760eed0c9 on n-h1-master-1 Oct 16 01:02:57.849062 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f7991f56-826d-4b06-972a-cefcf4fce771 req-7d38bcf1-3302-4d93-97cb-4254555c830a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055593 Oct 16 01:02:57.849933 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 354/772] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:58.254175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:58.255696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:58.262379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:58.262863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:58.263537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:58.264405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:58.264862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:58.265277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:58.350204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:58.351167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:58.360078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:58.360580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:58.361712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:58.362309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:58.362782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:58.363242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:58.829258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:58.837709 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7fdb357-1434-411d-b0e4-6d63839e41ad tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1313 microversion: 2.1 time: 0.588682 Oct 16 01:02:58.838454 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 419/773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:58 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:58.843278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ccdf948a-0d6c-4c11-95a5-d09ab4c8a4f2 req-5b1546af-868c-46d7-8323-1a3341790e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028af892-d8f0-4da9-92a9-01722179aede", "tag": "b65f4d91-18d9-4f8e-a0bb-9908531d28c6"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:58.858126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ccdf948a-0d6c-4c11-95a5-d09ab4c8a4f2 req-5b1546af-868c-46d7-8323-1a3341790e05 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:58.858496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ccdf948a-0d6c-4c11-95a5-d09ab4c8a4f2 req-5b1546af-868c-46d7-8323-1a3341790e05 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:58.859415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ccdf948a-0d6c-4c11-95a5-d09ab4c8a4f2 req-5b1546af-868c-46d7-8323-1a3341790e05 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:58.870791 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ccdf948a-0d6c-4c11-95a5-d09ab4c8a4f2 req-5b1546af-868c-46d7-8323-1a3341790e05 service nova] Creating event network-changed:b65f4d91-18d9-4f8e-a0bb-9908531d28c6 for instance 028af892-d8f0-4da9-92a9-01722179aede on n-h1-master-1 Oct 16 01:02:58.875532 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ccdf948a-0d6c-4c11-95a5-d09ab4c8a4f2 req-5b1546af-868c-46d7-8323-1a3341790e05 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035638 Oct 16 01:02:58.876193 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 420/774] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:58.966195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:02:58.974456 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fc3782e3-dbbe-49a9-b545-197f620d9d29 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1319 microversion: 2.1 time: 0.628313 Oct 16 01:02:58.975373 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 355/775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:58 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1319 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:02:59.636951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-007ee509-1875-42bc-b11d-c43603e1dbf5 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '.version_select at 0x7fd64e8ffa60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:59.640633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007ee509-1875-42bc-b11d-c43603e1dbf5 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:59.641311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007ee509-1875-42bc-b11d-c43603e1dbf5 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:59.641909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007ee509-1875-42bc-b11d-c43603e1dbf5 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:59.652021 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-007ee509-1875-42bc-b11d-c43603e1dbf5 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.018960 Oct 16 01:02:59.663521 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 421/776] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:02:59 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:02:59.673248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-47e8cfb6-f419-4ccf-abb3-54d67624bbd2 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:59.687343 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-47e8cfb6-f419-4ccf-abb3-54d67624bbd2 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018245 Oct 16 01:02:59.692424 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 356/777] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:02:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:59.704715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc0b5a96-b8df-4395-8aee-03e05e9fbb8e tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1892442813", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:59.729528 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc0b5a96-b8df-4395-8aee-03e05e9fbb8e tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.028732 Oct 16 01:02:59.730344 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 422/778] 10.222.0.39 () {60 vars in 1146 bytes} [Sun Oct 16 01:02:59 2022] POST /compute/v2.1/flavors => generated 499 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:02:59.742642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25cb45b1-f345-4f2d-bc5a-9a57f9a5f8e1 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:59.752812 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-25cb45b1-f345-4f2d-bc5a-9a57f9a5f8e1 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012603 Oct 16 01:02:59.767385 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 357/779] 10.222.0.39 () {58 vars in 1182 bytes} [Sun Oct 16 01:02:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:02:59.862955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:02:59.865132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:02:59.880512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:59.882949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:59.883620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:59.884588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:02:59.885636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:02:59.886283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:02:59.906271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-633185263", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "71b7ff9b-5345-4015-976b-8e9511ad18fc"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:02:59.912858 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:59.977168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:03:00.507946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:00.522381 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-41673553-87ae-4890-bb41-30e2fcc044dd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1313 microversion: 2.1 time: 0.663749 Oct 16 01:03:00.522381 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 423/780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:02:59 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:00.533858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:00.534801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:00.541905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.543855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.545129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.551165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.555477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.557244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.594355 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:00.594780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:00.595311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:00.595972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:00.596394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:00.606864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.607641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.608270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.609184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.609702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.610302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.631249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:03:00.635258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for user f3b14e05c41648159d8ed97719c68862 and project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:03:00.649289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:03:00.651614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:03:00.711623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db0a3c35-784a-4138-982e-1bcf29e03f2c tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809764 Oct 16 01:03:00.712589 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 358/781] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:03:00.725838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-43035828-d034-4dfd-9d8d-421f739aa2bb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:00.726839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-43035828-d034-4dfd-9d8d-421f739aa2bb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:00.743279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:00.753108 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ed888db-64b5-41da-af1b-c48a5712db32 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1469 microversion: 2.1 time: 0.231679 Oct 16 01:03:00.768313 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 424/782] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:00 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1469 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:00.795587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:00.796332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:00.798684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-43035828-d034-4dfd-9d8d-421f739aa2bb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:00.804494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.805166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.805765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.806648 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-43035828-d034-4dfd-9d8d-421f739aa2bb tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1278 microversion: 2.1 time: 0.087145 Oct 16 01:03:00.821533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.822014 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 359/783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:00 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:00.823174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.823844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.851342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lazy-loading 'flavor' on Instance uuid 93edfeaa-bb47-49b5-a772-114760eed0c9 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:00.970000 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1884b70-911b-4b7e-8652-0b1701922a2f tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9/action" status: 202 len: 0 microversion: 2.1 time: 0.179435 Oct 16 01:03:00.973361 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 425/784] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:00 2022] POST /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:00.981095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:00.982549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:00.991710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.992379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.992980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:00.993969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:00.994705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:00.995189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:01.156458 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:01.165350 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dc977c62-54bf-4411-8480-b18430ea72f7 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1477 microversion: 2.1 time: 0.188625 Oct 16 01:03:01.165937 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 360/785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:00 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:01.543923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:01.545266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:01.562256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:01.563792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:01.568207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:01.569596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:01.570177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:01.570710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:01.597842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0a7c5749-c09d-4add-ab4c-1a1e2baca424 tempest-QuotaClassesAdmin257Test-1307569006 tempest-QuotaClassesAdmin257Test-1307569006-project-admin] Calling method '.version_select at 0x7fd64ecd6700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:01.638353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0a7c5749-c09d-4add-ab4c-1a1e2baca424 tempest-QuotaClassesAdmin257Test-1307569006 tempest-QuotaClassesAdmin257Test-1307569006-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.186495 Oct 16 01:03:01.639276 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 426/786] 10.222.0.39 () {60 vars in 1226 bytes} [Sun Oct 16 01:03:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:01.654394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b4e43f1-c1b0-4ca5-b2b7-4f0894ac60af tempest-QuotaClassesAdmin257Test-1307569006 tempest-QuotaClassesAdmin257Test-1307569006-project-admin] Action: 'update', calling method: .version_select at 0x7fd64e890f70>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:01.784042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:01.793933 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7590134f-3096-4685-838d-55c62fc6d1bc tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1313 microversion: 2.1 time: 0.253820 Oct 16 01:03:01.794856 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 361/787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:01 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:01.831465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:01.832261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:01.838836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:01.839355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:01.839785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:01.840474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:01.840925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:01.841339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:01.882863 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b4e43f1-c1b0-4ca5-b2b7-4f0894ac60af tempest-QuotaClassesAdmin257Test-1307569006 tempest-QuotaClassesAdmin257Test-1307569006-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.236263 Oct 16 01:03:01.883603 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 427/788] 10.222.0.39 () {62 vars in 1247 bytes} [Sun Oct 16 01:03:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:01.894614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-75bc147a-271d-4053-a631-63d1439c9897 tempest-QuotaClassesAdmin257Test-1307569006 tempest-QuotaClassesAdmin257Test-1307569006-project-admin] Calling method '.version_select at 0x7fd64e91d9d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:01.905029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-75bc147a-271d-4053-a631-63d1439c9897 tempest-QuotaClassesAdmin257Test-1307569006 tempest-QuotaClassesAdmin257Test-1307569006-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.014760 Oct 16 01:03:01.905593 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 428/789] 10.222.0.39 () {60 vars in 1226 bytes} [Sun Oct 16 01:03:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 01:03:01.912983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:01.917302 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85601bb7-51c6-4521-99e3-79ebda99d83d tempest-QuotaClassesAdmin257Test-1307569006 tempest-QuotaClassesAdmin257Test-1307569006-project-admin] Action: 'update', calling method: .version_select at 0x7fd64e8b5ee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:01.921275 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-946cb01c-0edc-4578-96c1-5af490512e20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1330 microversion: 2.1 time: 0.093724 Oct 16 01:03:01.921846 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 362/790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:01 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:01.959714 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=11,nova_api:UPDATE=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:01.982641 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85601bb7-51c6-4521-99e3-79ebda99d83d tempest-QuotaClassesAdmin257Test-1307569006 tempest-QuotaClassesAdmin257Test-1307569006-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.068904 Oct 16 01:03:01.983400 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 429/791] 10.222.0.39 () {62 vars in 1247 bytes} [Sun Oct 16 01:03:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:02.189028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:02.190206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:02.199487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:02.200022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:02.200463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:02.201171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:02.205719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:02.206479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:02.520439 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:02.534841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73d5bbb6-441f-47fc-a743-a6bf5bc6b0b8 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1460 microversion: 2.1 time: 0.349374 Oct 16 01:03:02.535982 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 363/792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:02 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1460 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:02.559541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:02.560556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:02.577470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:02.577998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:02.578444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:02.579195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:02.579657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:02.580122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:02.818440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:02.819118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:02.830217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:02.830821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:02.831399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:02.832159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:02.832744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:02.833175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.042423 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4aa92d86-1837-4e8b-af96-f6db8c31ba29 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1611 microversion: 2.1 time: 0.486742 Oct 16 01:03:03.043159 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 430/793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:02 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1611 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:03.049518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-25e8cae1-c3c2-42ea-a9a9-c8e28200066e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e905d30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:03.097516 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-25e8cae1-c3c2-42ea-a9a9-c8e28200066e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/cd366a96-798c-400c-97db-ef15e599bade" status: 200 len: 662 microversion: 2.1 time: 0.052599 Oct 16 01:03:03.098408 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 431/794] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:03 2022] GET /compute/v2.1/images/cd366a96-798c-400c-97db-ef15e599bade => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:03.103410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:03.104107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:03.110831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.111528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.112187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.112995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.113562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.114089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.133877 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:03.140849 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:03.144617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76831b8e-b858-41c6-8090-fe673e07ab27 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1313 microversion: 2.1 time: 0.330677 Oct 16 01:03:03.145686 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 364/795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:02 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:03.151058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-67705c69-3640-4d63-aae5-f56df0dd3181 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:03.155262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67705c69-3640-4d63-aae5-f56df0dd3181 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.155914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67705c69-3640-4d63-aae5-f56df0dd3181 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.156349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67705c69-3640-4d63-aae5-f56df0dd3181 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.157072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67705c69-3640-4d63-aae5-f56df0dd3181 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.157523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67705c69-3640-4d63-aae5-f56df0dd3181 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.158519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67705c69-3640-4d63-aae5-f56df0dd3181 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.184227 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-67705c69-3640-4d63-aae5-f56df0dd3181 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037081 Oct 16 01:03:03.187648 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 365/796] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:03:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:03.188658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:03.189778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c68e24e5-a36c-4e56-b2b3-0e74c037f49b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e77b3a0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:03.197460 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec132f00-8442-40d8-b094-7c530461c067 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1336 microversion: 2.1 time: 0.097011 Oct 16 01:03:03.200554 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 432/797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:03 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:03.212488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:03.215459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:03.223488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.223992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.224497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.225117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.225569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.226121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.237438 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c68e24e5-a36c-4e56-b2b3-0e74c037f49b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/cd366a96-798c-400c-97db-ef15e599bade" status: 200 len: 662 microversion: 2.1 time: 0.051234 Oct 16 01:03:03.238017 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 366/798] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:03 2022] GET /compute/v2.1/images/cd366a96-798c-400c-97db-ef15e599bade => generated 662 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:03.310858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Lazy-loading 'flavor' on Instance uuid 93edfeaa-bb47-49b5-a772-114760eed0c9 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:03.326032 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 93edfeaa-bb47-49b5-a772-114760eed0c9 while it is in vm_state suspended Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Request method failure captured: Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9/action HTTP/1.1 Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 97 Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1gfsv506wxu93nGTc3j4YEmFXuqAnXK9rKfV5ZcRs24XoUVYAvWPrewbq6MzslW9-LGi5tgWFlVw9eRp6qcwiIGNeyW0X6dZmjm32nhA28-evinGNeQyXjtRvsLQraveARhbbmPsLMTd_KqECjz1YowDCQMEphx4j3IvfdMIAC4NOQ Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: ef8095cdcd604edfbdf0222181e7203e Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-LiveMigrationNegativeTest-1956921451 Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:03:03.328589 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ef8095cdcd604edfbdf0222181e7203e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ef8095cdcd604edfbdf0222181e7203e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef8095cdcd604edfbdf0222181e7203e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef8095cdcd604edfbdf0222181e7203e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-LiveMigrationNegativeTest-1956921451 Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: ef8095cdcd604edfbdf0222181e7203e Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1956921451 Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-LiveMigrationNegativeTest-1956921451-project-admin Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 87f382afa9194618a94663d350549f76 Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-LiveMigrationNegativeTest-1956921451-project-admin Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} Oct 16 01:03:03.331049 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'os-migrateLive' instance 93edfeaa-bb47-49b5-a772-114760eed0c9 while it is in vm_state suspended Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '93edfeaa-bb47-49b5-a772-114760eed0c9', 'body': {'os-migrateLive': {'host': 'n-h2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 16 01:03:03.331893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 93edfeaa-bb47-49b5-a772-114760eed0c9 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:03:03.333181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 93edfeaa-bb47-49b5-a772-114760eed0c9 while it is in vm_state suspended Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 93edfeaa-bb47-49b5-a772-114760eed0c9 while it is in vm_state suspended Oct 16 01:03:03.334488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:03.335760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 93edfeaa-bb47-49b5-a772-114760eed0c9 while it is in vm_state suspended {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:03.335760 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c26e759c-2d5d-443b-862a-d381039fc3c1 tempest-LiveMigrationNegativeTest-1956921451 tempest-LiveMigrationNegativeTest-1956921451-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9/action" status: 409 len: 155 microversion: 2.1 time: 0.130601 Oct 16 01:03:03.335760 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 433/799] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:03 2022] POST /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9/action => generated 155 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:03:03.341509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:03.342011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:03.348340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.348833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.349269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.349977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.350437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.350864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.378071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:03:03.459962 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d1cb7f29-2a63-478f-b2e7-7436bd67c303 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "DELETE /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 204 len: 0 microversion: 2.1 time: 0.121400 Oct 16 01:03:03.461179 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 367/800] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:03:03 2022] DELETE /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:03:03.470989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:03.472094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:03.480171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.480812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.481276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.482132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.482617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.483138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.657378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:03.669913 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-64ef0430-f9d6-4f24-833f-120a82ab4ae6 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1466 microversion: 2.1 time: 0.204257 Oct 16 01:03:03.671037 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 434/801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:03 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1466 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:03.825005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b8efac36-49d5-4983-9c2e-13546bba33f5 req-6217966a-6be7-44b1-aad1-f01d4f330989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5", "name": "network-vif-plugged", "status": "completed", "tag": "62f88490-3555-4b72-88e6-cee67ed2ea99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:03.832617 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:03.841123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b8efac36-49d5-4983-9c2e-13546bba33f5 req-6217966a-6be7-44b1-aad1-f01d4f330989 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:03.842062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b8efac36-49d5-4983-9c2e-13546bba33f5 req-6217966a-6be7-44b1-aad1-f01d4f330989 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:03.842649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b8efac36-49d5-4983-9c2e-13546bba33f5 req-6217966a-6be7-44b1-aad1-f01d4f330989 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:03.858810 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b8efac36-49d5-4983-9c2e-13546bba33f5 req-6217966a-6be7-44b1-aad1-f01d4f330989 service nova] Creating event network-vif-plugged:62f88490-3555-4b72-88e6-cee67ed2ea99 for instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 on n-h2-master-1 Oct 16 01:03:03.864966 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b8efac36-49d5-4983-9c2e-13546bba33f5 req-6217966a-6be7-44b1-aad1-f01d4f330989 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044404 Oct 16 01:03:03.866063 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 368/802] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:04.169916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:04.170655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:04.180210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.182660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.183367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.184204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.185909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.186591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.225233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:04.226801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:04.234215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.235179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.235839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.236905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.237800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.238434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.510608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:04.524495 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-72a6f8fc-6078-4cec-98ec-55a1ad928db9 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1313 microversion: 2.1 time: 0.357519 Oct 16 01:03:04.525883 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 435/803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:04 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:04.562622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:04.582125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:04.582644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:04.593240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.593364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.593805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.595466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.595946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.596914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.604622 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-65cc642a-41d8-4a7f-a739-f249127dfe50 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1378 microversion: 2.1 time: 0.383947 Oct 16 01:03:04.607733 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 369/804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:04 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1378 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:04.651771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:03:04.698743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:04.699487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:04.710543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.713109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.713649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:04.716228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:04.717541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:04.718286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.076611 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10a42cf0-6227-40af-9214-8a9553e3ec91 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 204 len: 0 microversion: 2.1 time: 0.548702 Oct 16 01:03:05.078199 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 436/805] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:03:04 2022] DELETE /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:03:05.093307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:05.102865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:05.118019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.118769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.119453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.120785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.121484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.122273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.127877 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:05.249129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:05.260416 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-60222170-d35c-47ef-bb39-539693eb5360 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1466 microversion: 2.1 time: 0.566546 Oct 16 01:03:05.267481 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 370/806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:04 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1466 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:05.272550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-91c8bb21-97d9-4159-99e3-a23439b74d1a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e53e430>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:05.324591 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-91c8bb21-97d9-4159-99e3-a23439b74d1a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/33da3cf5-7469-46c4-94b9-cf348aa0c433" status: 200 len: 662 microversion: 2.1 time: 0.054966 Oct 16 01:03:05.326813 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 371/807] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:05 2022] GET /compute/v2.1/images/33da3cf5-7469-46c4-94b9-cf348aa0c433 => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:05.332149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-807a2153-319f-4632-90d6-4cc36aa2f958 req-7af00523-52d2-45dc-8a65-bfba7a3213ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12066daa-d04c-4f73-b4ee-45b8a17cecc8", "tag": "462f1588-13d7-4346-bf9e-fb24a7f41f90"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:05.336018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:05.344750 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0b979b59-0f30-4228-9c5a-72f9ba7bb8cf tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1706 microversion: 2.1 time: 0.259240 Oct 16 01:03:05.350908 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 437/808] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:05 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1706 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:05.355856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-370a65a1-b6a9-4566-9652-f67f311f29a7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e7e6a60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:05.360855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-807a2153-319f-4632-90d6-4cc36aa2f958 req-7af00523-52d2-45dc-8a65-bfba7a3213ca service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.369659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-807a2153-319f-4632-90d6-4cc36aa2f958 req-7af00523-52d2-45dc-8a65-bfba7a3213ca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.370268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-807a2153-319f-4632-90d6-4cc36aa2f958 req-7af00523-52d2-45dc-8a65-bfba7a3213ca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.387689 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-807a2153-319f-4632-90d6-4cc36aa2f958 req-7af00523-52d2-45dc-8a65-bfba7a3213ca service nova] Creating event network-changed:462f1588-13d7-4346-bf9e-fb24a7f41f90 for instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 on n-h2-master-1 Oct 16 01:03:05.394560 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-807a2153-319f-4632-90d6-4cc36aa2f958 req-7af00523-52d2-45dc-8a65-bfba7a3213ca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066064 Oct 16 01:03:05.399114 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 372/809] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:05.420107 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-370a65a1-b6a9-4566-9652-f67f311f29a7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/33da3cf5-7469-46c4-94b9-cf348aa0c433" status: 200 len: 662 microversion: 2.1 time: 0.068001 Oct 16 01:03:05.420752 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 438/810] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:05 2022] GET /compute/v2.1/images/33da3cf5-7469-46c4-94b9-cf348aa0c433 => generated 662 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:05.554725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:05.555758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:05.562463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.563435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.563926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.565164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.565709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.566200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.634481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:05.635246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:05.645024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.645940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.646687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.647643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.648321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:05.649136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:05.860499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:05.879349 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-12358c1e-4fc0-436b-8a62-0a81ae13f587 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1313 microversion: 2.1 time: 0.335207 Oct 16 01:03:05.882393 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 373/811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:05 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:05.913281 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:05.922911 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-48bfa04c-6c08-4086-a391-75ee7d079253 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1378 microversion: 2.1 time: 0.292934 Oct 16 01:03:05.924495 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 439/812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:05 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1378 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:05.983504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-584439c3-e6d4-4731-a5d4-84ef48a961a9 req-64aaebf2-b34e-4064-a50a-a686b6d4c02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028af892-d8f0-4da9-92a9-01722179aede", "name": "network-vif-plugged", "status": "completed", "tag": "b65f4d91-18d9-4f8e-a0bb-9908531d28c6"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:05.998843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-584439c3-e6d4-4731-a5d4-84ef48a961a9 req-64aaebf2-b34e-4064-a50a-a686b6d4c02b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:05.999343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-584439c3-e6d4-4731-a5d4-84ef48a961a9 req-64aaebf2-b34e-4064-a50a-a686b6d4c02b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:06.000567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-584439c3-e6d4-4731-a5d4-84ef48a961a9 req-64aaebf2-b34e-4064-a50a-a686b6d4c02b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:06.013241 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-584439c3-e6d4-4731-a5d4-84ef48a961a9 req-64aaebf2-b34e-4064-a50a-a686b6d4c02b service nova] Creating event network-vif-plugged:b65f4d91-18d9-4f8e-a0bb-9908531d28c6 for instance 028af892-d8f0-4da9-92a9-01722179aede on n-h1-master-1 Oct 16 01:03:06.020371 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-584439c3-e6d4-4731-a5d4-84ef48a961a9 req-64aaebf2-b34e-4064-a50a-a686b6d4c02b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040409 Oct 16 01:03:06.020987 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 374/813] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:06.289241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:06.289918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:06.297786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:06.298321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:06.298696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:06.299453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:06.299905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:06.300328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:06.380195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:06.380900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:06.390705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:06.391648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:06.394385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:06.395158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:06.395788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:06.396431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:06.639916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:06.654697 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac677f48-fff7-4cf8-9249-6042dcf43f7b tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1466 microversion: 2.1 time: 0.368983 Oct 16 01:03:06.666942 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 440/814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:06 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1466 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:06.791301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:06.812209 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2b1770cb-bb65-4f94-a3f4-ab833aefb89b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1706 microversion: 2.1 time: 0.434256 Oct 16 01:03:06.812942 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 375/815] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:06 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1706 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:06.913534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:06.914258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:06.925324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:06.925829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:06.926269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:06.927000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:06.931966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:06.937842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:06.996333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-109c88f9-e8e4-46cb-8eff-3b903887f750 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Action: 'update', calling method: .version_select at 0x7fd64e9ee8b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:07.089549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109c88f9-e8e4-46cb-8eff-3b903887f750 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.091464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109c88f9-e8e4-46cb-8eff-3b903887f750 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.092115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109c88f9-e8e4-46cb-8eff-3b903887f750 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.093588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109c88f9-e8e4-46cb-8eff-3b903887f750 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.094215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109c88f9-e8e4-46cb-8eff-3b903887f750 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.094813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109c88f9-e8e4-46cb-8eff-3b903887f750 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.173662 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-109c88f9-e8e4-46cb-8eff-3b903887f750 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/0a62c676c6d34f9da4a8641118e3f753" status: 200 len: 148 microversion: 2.57 time: 0.329743 Oct 16 01:03:07.175461 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 441/816] 10.222.0.39 () {62 vars in 1303 bytes} [Sun Oct 16 01:03:06 2022] PUT /compute/v2.1/os-quota-sets/0a62c676c6d34f9da4a8641118e3f753 => generated 148 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 01:03:07.182198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:07.196286 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db417d52-4f02-4e80-81ef-9825903c7f62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1313 microversion: 2.1 time: 0.292141 Oct 16 01:03:07.196878 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 376/817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:06 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:07.201424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:07.202042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:07.212186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-900a55fa-965f-4c5e-ad58-b2fef1eb8395 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Calling method '.version_select at 0x7fd64e53e430>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:07.223622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.224125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.224891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.225561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.226026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.226827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.351317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-900a55fa-965f-4c5e-ad58-b2fef1eb8395 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.351937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-900a55fa-965f-4c5e-ad58-b2fef1eb8395 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.352494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-900a55fa-965f-4c5e-ad58-b2fef1eb8395 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.353324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-900a55fa-965f-4c5e-ad58-b2fef1eb8395 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.353914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-900a55fa-965f-4c5e-ad58-b2fef1eb8395 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.355323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-900a55fa-965f-4c5e-ad58-b2fef1eb8395 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.380862 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-900a55fa-965f-4c5e-ad58-b2fef1eb8395 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/0a62c676c6d34f9da4a8641118e3f753/detail" status: 200 len: 463 microversion: 2.57 time: 0.182899 Oct 16 01:03:07.381693 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 377/818] 10.222.0.39 () {60 vars in 1304 bytes} [Sun Oct 16 01:03:07 2022] GET /compute/v2.1/os-quota-sets/0a62c676c6d34f9da4a8641118e3f753/detail => generated 463 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:07.389328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-03cc9008-a346-4aeb-a74e-892f02e42354 req-740bf827-2f88-4a54-a6d1-28c01dd87a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93edfeaa-bb47-49b5-a772-114760eed0c9", "name": "network-vif-deleted", "tag": "104f04cd-60c8-4aaf-b277-55a6a4c14c2f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:07.416751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-03cc9008-a346-4aeb-a74e-892f02e42354 req-740bf827-2f88-4a54-a6d1-28c01dd87a63 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.417240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-03cc9008-a346-4aeb-a74e-892f02e42354 req-740bf827-2f88-4a54-a6d1-28c01dd87a63 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.417671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-03cc9008-a346-4aeb-a74e-892f02e42354 req-740bf827-2f88-4a54-a6d1-28c01dd87a63 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.433182 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-03cc9008-a346-4aeb-a74e-892f02e42354 req-740bf827-2f88-4a54-a6d1-28c01dd87a63 service nova] Creating event network-vif-deleted:104f04cd-60c8-4aaf-b277-55a6a4c14c2f for instance 93edfeaa-bb47-49b5-a772-114760eed0c9 on n-h1-master-1 Oct 16 01:03:07.441158 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-03cc9008-a346-4aeb-a74e-892f02e42354 req-740bf827-2f88-4a54-a6d1-28c01dd87a63 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057345 Oct 16 01:03:07.442338 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 378/819] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:07.518766 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4a02b48b-df25-4b23-8cbc-4ab0a0aa0904 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4ff550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:07.559770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:07.573386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d952f02-a58d-4bfc-b44a-1cdbb38c3428 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1378 microversion: 2.1 time: 0.395862 Oct 16 01:03:07.574424 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 442/820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:07 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1378 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:07.605557 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4a02b48b-df25-4b23-8cbc-4ab0a0aa0904 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/9d66bd6e-dc07-49f3-a2c5-f411f655b0e7" status: 200 len: 662 microversion: 2.1 time: 0.092573 Oct 16 01:03:07.607017 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 379/821] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:07 2022] GET /compute/v2.1/images/9d66bd6e-dc07-49f3-a2c5-f411f655b0e7 => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:07.621252 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e4ebb20-e949-459b-8eff-25a84520ae09 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e7e6040>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:07.676034 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e4ebb20-e949-459b-8eff-25a84520ae09 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/9d66bd6e-dc07-49f3-a2c5-f411f655b0e7" status: 200 len: 662 microversion: 2.1 time: 0.058438 Oct 16 01:03:07.681676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:07.682693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:07.697923 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 443/822] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:07 2022] GET /compute/v2.1/images/9d66bd6e-dc07-49f3-a2c5-f411f655b0e7 => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:07.699282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.699982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.700960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.702987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Action: 'update', calling method: .version_select at 0x7fd64e91dca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:07.703468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.704684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.707058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.784470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.785295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.786070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.787041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.787672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.788254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.822829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:07.835919 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1bc63b8-687e-44c4-8150-8d32f91bf324 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1295 microversion: 2.1 time: 0.158401 Oct 16 01:03:07.847847 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 380/823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:07 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1295 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:07.847847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:07.847847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:07.855732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.856383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.856994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.857855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.859058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.859928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.860809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.861220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.862269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:07.862947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.863095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:07.863615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:07.943524 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d8f8a52c-a3b8-42bf-95b8-8201dd469b70 tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/0a62c676c6d34f9da4a8641118e3f753?user_id=7902fd7520e144b4afa475433173058d" status: 200 len: 148 microversion: 2.57 time: 0.243741 Oct 16 01:03:07.951867 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 444/824] 10.222.0.39 () {62 vars in 1384 bytes} [Sun Oct 16 01:03:07 2022] PUT /compute/v2.1/os-quota-sets/0a62c676c6d34f9da4a8641118e3f753?user_id=7902fd7520e144b4afa475433173058d => generated 148 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:07.958501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1766461163", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:08.034525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:08.043685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:03:08.046244 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e99e53ce-e4c5-42a4-986f-924d18243664 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1706 microversion: 2.1 time: 0.204135 Oct 16 01:03:08.061939 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 381/825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:07 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1706 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:08.061939 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80f38c9e-6aa0-4d41-a3dc-29724169f63c tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] Calling method '.version_select at 0x7fd64e8d4b80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:08.166335 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80f38c9e-6aa0-4d41-a3dc-29724169f63c tempest-QuotasAdminTestV257-120288733 tempest-QuotasAdminTestV257-120288733-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/0a62c676c6d34f9da4a8641118e3f753?user_id=7902fd7520e144b4afa475433173058d" status: 200 len: 190 microversion: 2.57 time: 0.117409 Oct 16 01:03:08.167325 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 382/826] 10.222.0.39 () {60 vars in 1364 bytes} [Sun Oct 16 01:03:08 2022] GET /compute/v2.1/os-quota-sets/0a62c676c6d34f9da4a8641118e3f753?user_id=7902fd7520e144b4afa475433173058d => generated 190 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:08.223103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:08.224491 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:08.241049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.242945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.244532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.246115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.246594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.247055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.320830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:08.321458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:08.321929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:08.322335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:08.322866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:08.334392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.334895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.336420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.337180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.337640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.338065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.381369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Getting quotas for project b214da9f32b843de96003cb6169f0a5c. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:03:08.388353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Getting quotas for user 283dbcfc68244d4b86de327091147337 and project b214da9f32b843de96003cb6169f0a5c. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:03:08.395108 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=74,nova_cell0:UPDATE=7 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:08.411068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:03:08.413763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:03:08.467114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a8af19b8-7c1a-4926-9c2d-69609dc5f685 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513602 Oct 16 01:03:08.468357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 445/827] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:03:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:03:08.486588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:08.498119 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b22a1a87-8a58-4090-9e28-5cfc8cf8d994 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1462 microversion: 2.1 time: 0.281908 Oct 16 01:03:08.499314 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 383/828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:08 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1462 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:08.520566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:08.521193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:08.527872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.532644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.533879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.539394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.540505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.541940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.603698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:08.604608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:08.618081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.619484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.621058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.621789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:08.622274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:08.625268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:08.905535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:08.915173 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3055a3ef-3410-4b05-85ed-b9f666e278fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1463 microversion: 2.1 time: 0.398603 Oct 16 01:03:08.915886 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 446/829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:08 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1463 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:08.933149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1213608278", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:08.954486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:08.967247 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-660a8982-b37b-4b16-b393-50f5fac7ddde tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1378 microversion: 2.1 time: 0.367114 Oct 16 01:03:08.970155 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 384/830] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:08 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1378 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:08.987320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:08.988017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:08.999210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.003985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.004596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.007563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.008814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.037947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.086796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:03:09.137813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.138316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.138745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.139229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lazy-loading 'fault' on Instance uuid 93edfeaa-bb47-49b5-a772-114760eed0c9 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:09.266288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:09.279020 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db8c3b4e-f2f2-4d12-929c-6ff4927b4f60 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 200 len: 1309 microversion: 2.1 time: 0.304869 Oct 16 01:03:09.291643 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 385/831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:08 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:09.296188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:09.298076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:09.314654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.318462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.320752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.321664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.323624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.326087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.449160 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea698e4b461143cfafb17befe69af2a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdbebb3c197640f8b915a091c4277bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:09.462045 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-beb2ef0c-13b2-4696-ac08-b17fcbf50fe4 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 200 len: 1345 microversion: 2.1 time: 0.176041 Oct 16 01:03:09.475978 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 386/832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:09 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 1345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:09.486017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1347350258", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:09.574078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:03:09.771823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:09.772663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:09.774229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:09.774976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:09.775822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:09.789341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.790152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.791416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.793278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.794045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.795146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.822378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Getting quotas for project b214da9f32b843de96003cb6169f0a5c. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:03:09.829618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Getting quotas for user 283dbcfc68244d4b86de327091147337 and project b214da9f32b843de96003cb6169f0a5c. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:03:09.859100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:03:09.862452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:03:09.877560 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:09.916365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:09.916951 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:09.917590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:09.917999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:09.918418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:09.928903 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c398af11-2e00-4cc1-b08a-d224350f721f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011975 Oct 16 01:03:09.930547 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 447/833] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:03:09.942652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-8cb05632-fa65-43d2-941b-07cd7eea15b6 req-ac1561f3-8ecb-4181-88bd-01d1bf0a4fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde1b8e8-35b6-4ebf-8cc4-81cf210059dd", "name": "network-vif-deleted", "tag": "738e577f-1f71-4f81-923f-ac52284e87a9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:09.943957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.951732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.952432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.954651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.955422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.956103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:09.973146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8cb05632-fa65-43d2-941b-07cd7eea15b6 req-ac1561f3-8ecb-4181-88bd-01d1bf0a4fb7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:09.973753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8cb05632-fa65-43d2-941b-07cd7eea15b6 req-ac1561f3-8ecb-4181-88bd-01d1bf0a4fb7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:09.974363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8cb05632-fa65-43d2-941b-07cd7eea15b6 req-ac1561f3-8ecb-4181-88bd-01d1bf0a4fb7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.000778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Getting quotas for project 9f15cb6a79194375bd48a2af095e9374. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:03:10.007497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Getting quotas for user 57612f6a347e49be96d699e76bd9bead and project 9f15cb6a79194375bd48a2af095e9374. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:03:10.012789 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-8cb05632-fa65-43d2-941b-07cd7eea15b6 req-ac1561f3-8ecb-4181-88bd-01d1bf0a4fb7 service nova] Creating event network-vif-deleted:738e577f-1f71-4f81-923f-ac52284e87a9 for instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd on n-h1-master-1 Oct 16 01:03:10.018749 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-8cb05632-fa65-43d2-941b-07cd7eea15b6 req-ac1561f3-8ecb-4181-88bd-01d1bf0a4fb7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086871 Oct 16 01:03:10.020190 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 448/834] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:10.024267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:03:10.026205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92bb4dfa-3be6-4519-8a3f-7f13915891d5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.027001 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92bb4dfa-3be6-4519-8a3f-7f13915891d5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.027944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:03:10.153101 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e7f46ce-2bf2-4dac-9c90-35df8f7cdb11 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675564 Oct 16 01:03:10.153802 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 387/835] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:03:10.168065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.169454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.178897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.179669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.180293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.181153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.182455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.183133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.187667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-92bb4dfa-3be6-4519-8a3f-7f13915891d5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:10.201874 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92bb4dfa-3be6-4519-8a3f-7f13915891d5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1218 microversion: 2.1 time: 0.175340 Oct 16 01:03:10.202829 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 449/836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:10 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:10.207314 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:10.219652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed446fe7-3093-4634-a8bb-80e1289ea238 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.220866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ed446fe7-3093-4634-a8bb-80e1289ea238 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.519502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ed446fe7-3093-4634-a8bb-80e1289ea238 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:10.529039 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ed446fe7-3093-4634-a8bb-80e1289ea238 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1214 microversion: 2.1 time: 0.324917 Oct 16 01:03:10.529652 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 450/837] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:10 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:10.549649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.550423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 93edfeaa-bb47-49b5-a772-114760eed0c9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.580958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.581451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.581887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.588022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.590364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.594419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.601026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:10.615802 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb6e5b99-bc58-4ac0-9a46-24e64edad76b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1378 microversion: 2.1 time: 0.452349 Oct 16 01:03:10.617596 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 388/838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:10 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1378 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:10.626271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.628072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.630253 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] HTTP exception thrown: Instance 93edfeaa-bb47-49b5-a772-114760eed0c9 could not be found. Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Request method failure captured: Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 HTTP/1.1 Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1geYupzDJNvXh0tl_9ES0rnVJyHDi3xTv_UL0OODOE_xWoYx6PCoesCeQ4PGdAtqqgljjANbYX0t-UfMF6w_nXoD6rgKPmTCRztxu8UfjZJRHE299UIrsYleKC_2WqdQn6HxoNoFK7ybaX7GLyKWDJ-cfCg7ZdMe2Y0LD1JDA8QrpY Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 65ddfc9041e44055be492260cb2f1ae9 Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-LiveMigrationNegativeTest-1101730194 Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:03:10.632142 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_65ddfc9041e44055be492260cb2f1ae9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/65ddfc9041e44055be492260cb2f1ae9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65ddfc9041e44055be492260cb2f1ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65ddfc9041e44055be492260cb2f1ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-LiveMigrationNegativeTest-1101730194 Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 65ddfc9041e44055be492260cb2f1ae9 Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1101730194 Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-LiveMigrationNegativeTest-1101730194-project Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 4352b314efdf413d940755f4cb0dbbda Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-LiveMigrationNegativeTest-1101730194-project Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 93edfeaa-bb47-49b5-a772-114760eed0c9 could not be found. Oct 16 01:03:10.633586 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '93edfeaa-bb47-49b5-a772-114760eed0c9'} Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93edfeaa-bb47-49b5-a772-114760eed0c9 could not be found. Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:10.634371 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93edfeaa-bb47-49b5-a772-114760eed0c9 could not be found. Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93edfeaa-bb47-49b5-a772-114760eed0c9 could not be found. Oct 16 01:03:10.636787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.638012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Returning 404 to user: Instance 93edfeaa-bb47-49b5-a772-114760eed0c9 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:10.641717 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f02b100e-1dac-4644-a517-6558cd0f35a9 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9" status: 404 len: 111 microversion: 2.1 time: 0.104189 Oct 16 01:03:10.642381 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 451/839] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:10 2022] GET /compute/v2.1/servers/93edfeaa-bb47-49b5-a772-114760eed0c9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:10.670305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.671131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.677617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.681323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.681779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.684236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.687156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.688191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.688808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.689659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.690238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.690238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.698302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.700765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.728538 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] HTTP exception thrown: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Request method failure captured: Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd HTTP/1.1 Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e3CRWF2nqnRvebXGvQFypJGXoPChbdWmIx9gay6Pk0ObdtuLmJlAStVUL2_6reUtRjAraEkApSlymjiLVt2tB0twDsaEvab20Eqge_DpJYJizHAbD3IJ-TzBTKTMJwfnMgI41t3WpQO7jZZ1TqVpgFP2YZudfjUWjYXFdVBSOTO3A Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:03:10.731889 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdbebb3c197640f8b915a091c4277bc8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ea698e4b461143cfafb17befe69af2a5 Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: exception: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:10.733269 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'dde1b8e8-35b6-4ebf-8cc4-81cf210059dd'} Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:10.734080 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:10.735317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.738375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Returning 404 to user: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:10.739626 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba13925d-7aaa-4763-9d68-84cbdc5f05a2 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 404 len: 111 microversion: 2.1 time: 0.119652 Oct 16 01:03:10.739626 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 389/840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:10 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:10.755914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.757189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.772917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.777179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.778799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:03:10.779438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.780425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.784295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.787382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.829645 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] HTTP exception thrown: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Request method failure captured: Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c HTTP/1.1 Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e3CRWF2nqnRvebXGvQFypJGXoPChbdWmIx9gay6Pk0ObdtuLmJlAStVUL2_6reUtRjAraEkApSlymjiLVt2tB0twDsaEvab20Eqge_DpJYJizHAbD3IJ-TzBTKTMJwfnMgI41t3WpQO7jZZ1TqVpgFP2YZudfjUWjYXFdVBSOTO3A Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:03:10.835261 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdbebb3c197640f8b915a091c4277bc8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ea698e4b461143cfafb17befe69af2a5 Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.837230 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '147c7739-d5f8-4098-b0a8-837bb131c35c'} Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:10.838137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.839527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.844320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Returning 404 to user: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:10.846001 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bb40c89-bd56-4578-bbf7-79866043fc5e tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 404 len: 111 microversion: 2.1 time: 0.100657 Oct 16 01:03:10.846867 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 390/841] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:03:10 2022] DELETE /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:10.857598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.863932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:10.879234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.880090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.881605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.882955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:10.885352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:10.885519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:10.914582 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] HTTP exception thrown: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Request method failure captured: Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c HTTP/1.1 Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e3CRWF2nqnRvebXGvQFypJGXoPChbdWmIx9gay6Pk0ObdtuLmJlAStVUL2_6reUtRjAraEkApSlymjiLVt2tB0twDsaEvab20Eqge_DpJYJizHAbD3IJ-TzBTKTMJwfnMgI41t3WpQO7jZZ1TqVpgFP2YZudfjUWjYXFdVBSOTO3A Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:03:10.920522 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdbebb3c197640f8b915a091c4277bc8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ea698e4b461143cfafb17befe69af2a5 Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.922055 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '147c7739-d5f8-4098-b0a8-837bb131c35c'} Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:10.929586 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:10.932296 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:10.936529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Returning 404 to user: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:10.936529 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8751405-2dea-466a-9ef0-55b96c8e3509 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 404 len: 111 microversion: 2.1 time: 0.068328 Oct 16 01:03:10.936529 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 391/842] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:10 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:10.938222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-49f24afa-59dc-49cc-8c42-73dd5e7a5a61 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '.version_select at 0x7fd64e502160>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:10.991346 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-49f24afa-59dc-49cc-8c42-73dd5e7a5a61 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379365393" status: 202 len: 0 microversion: 2.1 time: 0.060071 Oct 16 01:03:10.995434 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-862bd4de-dd1c-4d48-90bf-5136535815ef tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "DELETE /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 204 len: 0 microversion: 2.1 time: 0.347386 Oct 16 01:03:10.999702 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 452/843] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:03:10 2022] DELETE /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:03:11.000443 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 392/844] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:03:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379365393 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:11.007124 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:11.008097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:11.018070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.020919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.021722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.023525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.024190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.024791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.238647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:11.243404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:11.256452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.256963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.257625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.258637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.259349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.259941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.405316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:11.424777 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e801b50b-8e6e-4293-8f57-8593212411c2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1214 microversion: 2.1 time: 0.196582 Oct 16 01:03:11.425994 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 393/845] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:11 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:11.434498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:11.445683 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cca657ac-bd0d-45ce-8636-a390bd479d6f tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1474 microversion: 2.1 time: 0.443702 Oct 16 01:03:11.446719 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 453/846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:11 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1474 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:11.554759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:11.555501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:11.561818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.563431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.563570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.573537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.574195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.574754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.641413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:11.641932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:11.648138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:11.655357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.656134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.657012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.657954 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-927b5378-2b5e-4d40-908e-59fb3bebe892 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1218 microversion: 2.1 time: 0.107044 Oct 16 01:03:11.658092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:11.658888 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 394/847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:11 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:11.659042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:11.663796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:11.818339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:11.826364 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd7f2bd3-463c-4766-95d2-93c7caa5a60e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1378 microversion: 2.1 time: 0.188935 Oct 16 01:03:11.827216 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 454/848] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:11 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1378 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:12.299877 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-8f509751-ce0f-419f-86c6-5d5100413147 req-61240fad-5b26-4c5a-8df4-3b7e04b7759a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12066daa-d04c-4f73-b4ee-45b8a17cecc8", "name": "network-vif-plugged", "status": "completed", "tag": "462f1588-13d7-4346-bf9e-fb24a7f41f90"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:12.320799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8f509751-ce0f-419f-86c6-5d5100413147 req-61240fad-5b26-4c5a-8df4-3b7e04b7759a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.321380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8f509751-ce0f-419f-86c6-5d5100413147 req-61240fad-5b26-4c5a-8df4-3b7e04b7759a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.321904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8f509751-ce0f-419f-86c6-5d5100413147 req-61240fad-5b26-4c5a-8df4-3b7e04b7759a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.339014 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-8f509751-ce0f-419f-86c6-5d5100413147 req-61240fad-5b26-4c5a-8df4-3b7e04b7759a service nova] Creating event network-vif-plugged:462f1588-13d7-4346-bf9e-fb24a7f41f90 for instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 on n-h2-master-1 Oct 16 01:03:12.347478 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-8f509751-ce0f-419f-86c6-5d5100413147 req-61240fad-5b26-4c5a-8df4-3b7e04b7759a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054116 Oct 16 01:03:12.348982 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 395/849] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:12.452630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:12.453301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:12.460107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.460766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.461201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.462748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.463228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.463659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.475327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:12.476451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:12.487195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.488071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.488700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.490021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.490890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.491524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.555214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:12.563531 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7da901d1-0f6a-4a92-bd8e-7c8a191ac939 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1276 microversion: 2.1 time: 0.114177 Oct 16 01:03:12.578609 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 455/850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:12 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:12.683614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:12.684324 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:12.692213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.694570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.695202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.696282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.696939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.697517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.756900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:12.766081 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d7ae012-8afd-483a-8035-c171e87f215a tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1474 microversion: 2.1 time: 0.295961 Oct 16 01:03:12.766663 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 396/851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:12 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1474 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:12.820306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:12.831952 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1fb49c9c-2d31-4e18-abce-cd7b8e2941fa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1218 microversion: 2.1 time: 0.152577 Oct 16 01:03:12.833042 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 456/852] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:12 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:12.856594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:12.857209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:12.863774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.864487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.864915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.865925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:12.866381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:12.866986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:12.893445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffb4c63b-4db8-479c-91fb-3499e103f708 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:12.946901 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ffb4c63b-4db8-479c-91fb-3499e103f708 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1996775043" status: 202 len: 0 microversion: 2.1 time: 0.058665 Oct 16 01:03:12.947858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 457/853] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:03:12 2022] DELETE /compute/v2.1/flavors/1996775043 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:03:12.964085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9fe7e785-645e-4ebc-8a78-bef925d524c2 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:12.991492 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9fe7e785-645e-4ebc-8a78-bef925d524c2 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5888 microversion: 2.1 time: 0.038920 Oct 16 01:03:12.992449 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 458/854] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:03:12 2022] GET /compute/v2.1/flavors/detail => generated 5888 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:13.011419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f3aa2b4d-1dad-43f7-82e6-799f78ce9534 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.036228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f3aa2b4d-1dad-43f7-82e6-799f78ce9534 tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/86433692" status: 202 len: 0 microversion: 2.1 time: 0.028362 Oct 16 01:03:13.037616 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 459/855] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:03:13 2022] DELETE /compute/v2.1/flavors/86433692 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:03:13.053900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b4afaef-a069-460f-9678-672f9a7db51c tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.102360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:13.103514 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5b4afaef-a069-460f-9678-672f9a7db51c tempest-ServersWithSpecificFlavorTestJSON-751471696 tempest-ServersWithSpecificFlavorTestJSON-751471696-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.061882 Oct 16 01:03:13.104877 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 460/856] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:13.112577 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d7f22ce4-e993-420f-a3de-bcef88de882f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1378 microversion: 2.1 time: 0.265824 Oct 16 01:03:13.119430 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 397/857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:12 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1378 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:13.133375 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.134234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.145025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.146058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.146735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.147546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.148107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.149981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.166013 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] HTTP exception thrown: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Request method failure captured: Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd HTTP/1.1 Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1e3CRWF2nqnRvebXGvQFypJGXoPChbdWmIx9gay6Pk0ObdtuLmJlAStVUL2_6reUtRjAraEkApSlymjiLVt2tB0twDsaEvab20Eqge_DpJYJizHAbD3IJ-TzBTKTMJwfnMgI41t3WpQO7jZZ1TqVpgFP2YZudfjUWjYXFdVBSOTO3A Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:03:13.167824 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdbebb3c197640f8b915a091c4277bc8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ea698e4b461143cfafb17befe69af2a5 Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: exception: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.169454 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'dde1b8e8-35b6-4ebf-8cc4-81cf210059dd'} Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:13.171488 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.172712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.174157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Returning 404 to user: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:13.174157 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aaa72a10-e782-4d80-8ce8-d2838b7e9661 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 404 len: 111 microversion: 2.1 time: 0.040348 Oct 16 01:03:13.174157 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 461/858] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:03:13 2022] DELETE /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:13.178343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.178982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: dde1b8e8-35b6-4ebf-8cc4-81cf210059dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.185001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.185496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.185927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.186630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.187124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.187547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.203350 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] HTTP exception thrown: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Request method failure captured: Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd HTTP/1.1 Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e3CRWF2nqnRvebXGvQFypJGXoPChbdWmIx9gay6Pk0ObdtuLmJlAStVUL2_6reUtRjAraEkApSlymjiLVt2tB0twDsaEvab20Eqge_DpJYJizHAbD3IJ-TzBTKTMJwfnMgI41t3WpQO7jZZ1TqVpgFP2YZudfjUWjYXFdVBSOTO3A Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:03:13.206599 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdbebb3c197640f8b915a091c4277bc8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ea698e4b461143cfafb17befe69af2a5 Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: exception: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.208464 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'dde1b8e8-35b6-4ebf-8cc4-81cf210059dd'} Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:13.209317 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. Oct 16 01:03:13.210641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.213709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Returning 404 to user: Instance dde1b8e8-35b6-4ebf-8cc4-81cf210059dd could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:13.214862 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3369a675-8ebe-465e-9d7a-56242b471345 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd" status: 404 len: 111 microversion: 2.1 time: 0.040457 Oct 16 01:03:13.216003 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 398/859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/servers/dde1b8e8-35b6-4ebf-8cc4-81cf210059dd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:13.224931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.226051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.233676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.234392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.235057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.236122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.236784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.237381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.254355 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] HTTP exception thrown: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Request method failure captured: Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c HTTP/1.1 Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1e3CRWF2nqnRvebXGvQFypJGXoPChbdWmIx9gay6Pk0ObdtuLmJlAStVUL2_6reUtRjAraEkApSlymjiLVt2tB0twDsaEvab20Eqge_DpJYJizHAbD3IJ-TzBTKTMJwfnMgI41t3WpQO7jZZ1TqVpgFP2YZudfjUWjYXFdVBSOTO3A Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:03:13.255958 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdbebb3c197640f8b915a091c4277bc8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ea698e4b461143cfafb17befe69af2a5 Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.257284 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '147c7739-d5f8-4098-b0a8-837bb131c35c'} Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:13.258004 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.259982 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.261615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Returning 404 to user: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:13.261615 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-130253ed-f1f8-4486-a715-df0e1f02c71b tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 404 len: 111 microversion: 2.1 time: 0.036547 Oct 16 01:03:13.261615 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 462/860] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:03:13 2022] DELETE /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:13.267087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.268597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] [instance: 147c7739-d5f8-4098-b0a8-837bb131c35c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.276198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.276974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.277443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.278308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.278778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.279230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.297463 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] HTTP exception thrown: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Request method failure captured: Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c HTTP/1.1 Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1e3CRWF2nqnRvebXGvQFypJGXoPChbdWmIx9gay6Pk0ObdtuLmJlAStVUL2_6reUtRjAraEkApSlymjiLVt2tB0twDsaEvab20Eqge_DpJYJizHAbD3IJ-TzBTKTMJwfnMgI41t3WpQO7jZZ1TqVpgFP2YZudfjUWjYXFdVBSOTO3A Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:03:13.308216 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bdbebb3c197640f8b915a091c4277bc8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bdbebb3c197640f8b915a091c4277bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: bdbebb3c197640f8b915a091c4277bc8 Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102 Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ea698e4b461143cfafb17befe69af2a5 Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1287954102-project Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.309906 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '147c7739-d5f8-4098-b0a8-837bb131c35c'} Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:13.310627 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. Oct 16 01:03:13.311814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:13.312848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] Returning 404 to user: Instance 147c7739-d5f8-4098-b0a8-837bb131c35c could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:13.312848 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2cdecb6f-0a54-4f47-b5a8-9a42f81fa8e6 tempest-ServersWithSpecificFlavorTestJSON-1287954102 tempest-ServersWithSpecificFlavorTestJSON-1287954102-project] 10.222.0.39 "GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c" status: 404 len: 111 microversion: 2.1 time: 0.048760 Oct 16 01:03:13.312848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 399/861] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/servers/147c7739-d5f8-4098-b0a8-837bb131c35c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:13.468214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d8587dd-1ca4-4743-b6b9-d78d8e579268 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.476142 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d8587dd-1ca4-4743-b6b9-d78d8e579268 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.141726 Oct 16 01:03:13.476842 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 463/862] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:13.492453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de2fc072-fce8-4770-9982-c418d94ce7c1 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.516227 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-de2fc072-fce8-4770-9982-c418d94ce7c1 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 2912 microversion: 2.1 time: 0.028310 Oct 16 01:03:13.516966 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 400/863] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors => generated 2912 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:13.535482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e6321ad-ac53-4e3f-802b-9cb8e4df4f27 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.545710 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4e6321ad-ac53-4e3f-802b-9cb8e4df4f27 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015204 Oct 16 01:03:13.546594 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 464/864] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:13.560141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dad36d5a-ba5c-49c2-b3a4-2261b33e8c05 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.569344 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dad36d5a-ba5c-49c2-b3a4-2261b33e8c05 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012964 Oct 16 01:03:13.570118 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 401/865] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:13.582651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1a01420-623e-4582-893e-8d91edc9adf5 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.592274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.593270 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.600657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.601375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.602877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.603832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.604450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.605037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.612148 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c1a01420-623e-4582-893e-8d91edc9adf5 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032884 Oct 16 01:03:13.613084 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 465/866] 10.222.0.39 () {58 vars in 1165 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:13.632221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-302f8213-dadc-4592-b904-232b41e752f0 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.639938 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-302f8213-dadc-4592-b904-232b41e752f0 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011506 Oct 16 01:03:13.640518 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 466/867] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:13.653172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f4bd918d-f8b7-4af5-88e5-ea25fbf947b8 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.680232 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f4bd918d-f8b7-4af5-88e5-ea25fbf947b8 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.030694 Oct 16 01:03:13.680924 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 467/868] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:13.699185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1b792ff-eb21-4149-a38b-4c4c772ae591 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.714314 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1b792ff-eb21-4149-a38b-4c4c772ae591 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.020421 Oct 16 01:03:13.718340 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 468/869] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:13.719026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:13.727718 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-682ac28c-226e-4b95-a2be-8c0b2a66b3be tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1276 microversion: 2.1 time: 0.142610 Oct 16 01:03:13.733451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b031f666-9678-4dc1-9d67-ba1380362915 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.739571 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 402/870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:13.744674 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b031f666-9678-4dc1-9d67-ba1380362915 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016496 Oct 16 01:03:13.753697 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 469/871] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:13.759857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1b37e1f-68db-48b7-af3b-410515690174 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.793918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.795283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.804301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.805369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.810762 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1b37e1f-68db-48b7-af3b-410515690174 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2989 microversion: 2.1 time: 0.055461 Oct 16 01:03:13.811482 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 403/872] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2989 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:13.811619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.812302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.812742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.813172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.828950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87309811-0ac3-4621-b309-109f4ccc82e5 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.839670 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-87309811-0ac3-4621-b309-109f4ccc82e5 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014986 Oct 16 01:03:13.840272 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 404/873] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:13.857854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-353be636-5d8f-4cd9-a789-0a5992474e55 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.886695 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-353be636-5d8f-4cd9-a789-0a5992474e55 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.032505 Oct 16 01:03:13.887329 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 405/874] 10.222.0.39 () {58 vars in 1144 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:13.902242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:13.903926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:13.908887 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:13.913282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.921603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.922143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:13.924105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:13.924948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:13.925111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.072695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:14.085629 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eaeb7ad8-1298-409f-b4e6-fae0ef680d87 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1266 microversion: 2.1 time: 0.187613 Oct 16 01:03:14.088135 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 406/875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:14.093681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d19910d3-6843-466e-ab0d-1e18f47b66c4 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.112870 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d19910d3-6843-466e-ab0d-1e18f47b66c4 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022747 Oct 16 01:03:14.119881 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 407/876] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:14.126392 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1452b643-64b4-4369-9fff-a47b68969622 req-4ed333bb-e5c1-43ee-97dc-239fce79e6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f108bb-6f59-4710-a3d0-5f0b49ee7f92", "name": "network-vif-deleted", "tag": "55dae9fc-e894-4862-915e-111559c59140"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:14.138354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1452b643-64b4-4369-9fff-a47b68969622 req-4ed333bb-e5c1-43ee-97dc-239fce79e6a1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.138841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1452b643-64b4-4369-9fff-a47b68969622 req-4ed333bb-e5c1-43ee-97dc-239fce79e6a1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.139315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1452b643-64b4-4369-9fff-a47b68969622 req-4ed333bb-e5c1-43ee-97dc-239fce79e6a1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.154172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1452b643-64b4-4369-9fff-a47b68969622 req-4ed333bb-e5c1-43ee-97dc-239fce79e6a1 service nova] Creating event network-vif-deleted:55dae9fc-e894-4862-915e-111559c59140 for instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 on n-h2-master-1 Oct 16 01:03:14.158532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:14.178233 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8c357dfc-0b33-4774-87d0-285e3af10297 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1474 microversion: 2.1 time: 0.388795 Oct 16 01:03:14.180594 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1452b643-64b4-4369-9fff-a47b68969622 req-4ed333bb-e5c1-43ee-97dc-239fce79e6a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058925 Oct 16 01:03:14.182596 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 470/877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:13 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1474 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:14.186411 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 408/878] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:14.197234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.197968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:14.201005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-47818b53-4195-4635-aef3-92fc69ee8d0e tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.206692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.207399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.207835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.209297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.209823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.210263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.223452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-47818b53-4195-4635-aef3-92fc69ee8d0e tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.039481 Oct 16 01:03:14.232985 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 471/879] 10.222.0.39 () {58 vars in 1148 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:14.238788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ad8c24a-a806-4bce-9635-07f5a28fba19 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.254586 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ad8c24a-a806-4bce-9635-07f5a28fba19 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020512 Oct 16 01:03:14.255468 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 472/880] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:14.269401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05b39751-c81f-4d73-be61-03ca427d4bfc tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.286578 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05b39751-c81f-4d73-be61-03ca427d4bfc tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022228 Oct 16 01:03:14.296973 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 473/881] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:14.303237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-066edb4e-8cb0-4cff-9037-781571bd759a tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.358139 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-066edb4e-8cb0-4cff-9037-781571bd759a tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1618 microversion: 2.1 time: 0.059325 Oct 16 01:03:14.363450 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 474/882] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/flavors?marker=452 => generated 1618 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:14.373556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1efd8139-0ef5-4bf3-bd3a-5b4590dda058 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.444489 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1efd8139-0ef5-4bf3-bd3a-5b4590dda058 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.074738 Oct 16 01:03:14.456152 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 475/883] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:14.467621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa43c51e-5243-4212-9fc7-3b0dbfac8dc8 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.475377 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa43c51e-5243-4212-9fc7-3b0dbfac8dc8 tempest-FlavorsV2TestJSON-1662051485 tempest-FlavorsV2TestJSON-1662051485-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011905 Oct 16 01:03:14.479100 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 476/884] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:14.556132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:14.569167 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3a7c27b8-5c2d-484f-bb06-73e4dca8cacc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1378 microversion: 2.1 time: 0.380847 Oct 16 01:03:14.570993 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 409/885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1378 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:14.757337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:14.758484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:14.770311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.772190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.774091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:14.776054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:14.776718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:14.777441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.079678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:15.098810 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-824b908f-3f4e-4788-b837-a9446f7cefd4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.343662 Oct 16 01:03:15.101188 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 477/886] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:14 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:15.119932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:15.121215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:15.142056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.144656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.146371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.147379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.148001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.148600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.204959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:15.206509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:15.217875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.218794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.220928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.222019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.222666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.224525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.231186 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:15.290842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.291130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.292131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.293627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lazy-loading 'fault' on Instance uuid 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:15.350863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:15.359497 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76cfb81f-f325-4d46-95db-98b56bc6bfb5 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1266 microversion: 2.1 time: 0.247197 Oct 16 01:03:15.376451 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 410/887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:15 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:15.594259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:15.594949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:15.602622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.603160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.603601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.604332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.604793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.605222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.715578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4352b314efdf413d940755f4cb0dbbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ddfc9041e44055be492260cb2f1ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:15.724155 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0455ed5-7652-4610-9c3b-f6eaf35e9a9e tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 200 len: 1309 microversion: 2.1 time: 0.522726 Oct 16 01:03:15.740283 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 478/888] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:15 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 1309 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:15.916655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:15.932615 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8f00c68-36ea-423d-991a-5fb6c7da59a6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1528 microversion: 2.1 time: 0.341906 Oct 16 01:03:15.933812 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 411/889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:15 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1528 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:15.955732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:15.956747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:15.963338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.964115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.964733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:15.965601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:15.966222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:15.966810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.131159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:16.132428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:16.141818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.148236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.148988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.149911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.150537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.151172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.293708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:16.316730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a553edb6-e86f-4743-856d-446ad38157ab tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1528 microversion: 2.1 time: 0.361487 Oct 16 01:03:16.318414 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 479/890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:15 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1528 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:16.340290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f75b8fb-40be-4f97-920e-b87f33885f7a tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:16.377203 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2f75b8fb-40be-4f97-920e-b87f33885f7a tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/71b7ff9b-5345-4015-976b-8e9511ad18fc" status: 202 len: 0 microversion: 2.1 time: 0.040037 Oct 16 01:03:16.384404 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 480/891] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:03:16 2022] DELETE /compute/v2.1/flavors/71b7ff9b-5345-4015-976b-8e9511ad18fc => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:03:16.392615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:16.393454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:16.402635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.403891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.404734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.405977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.406700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.407362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.457928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:16.467765 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d526eee-2e4a-4140-be77-63bae92ea9cb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.341156 Oct 16 01:03:16.468951 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 412/892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:16 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:16.488605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3806a081-5244-4616-bacb-a53f23d7f40e tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:16.517782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:16.528476 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3806a081-5244-4616-bacb-a53f23d7f40e tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057545 Oct 16 01:03:16.529822 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 413/893] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:03:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:16.538958 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71f90f50-9a62-4249-8d8b-dfe30bcc31e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1272 microversion: 2.1 time: 0.152976 Oct 16 01:03:16.539908 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 481/894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:16 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:16.553707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:16.557189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:16.565728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.566455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.568209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.569245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.569719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.570204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.604662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:16.612967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Old instance type tempest-test_resize_flavor_-1892442813, new instance type m1.heat {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:03:16.622596 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:16.623138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:16.623814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:16.624235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:16.624652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:16.729337 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fe9f0e02-c8f4-433f-92d8-7739baa64964 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8/action" status: 202 len: 0 microversion: 2.1 time: 0.183353 Oct 16 01:03:16.734248 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 414/895] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:16 2022] POST /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:16.745358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:16.748346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:16.749911 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:16.750534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] [instance: 68f108bb-6f59-4710-a3d0-5f0b49ee7f92] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:16.762462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.763337 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:16.765770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.766201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.770393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.771145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.771782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.774176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.775341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.777953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.780049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:16.780655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:16.783444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:16.806099 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] HTTP exception thrown: Instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 could not be found. Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Request method failure captured: Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 HTTP/1.1 Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1geYupzDJNvXh0tl_9ES0rnVJyHDi3xTv_UL0OODOE_xWoYx6PCoesCeQ4PGdAtqqgljjANbYX0t-UfMF6w_nXoD6rgKPmTCRztxu8UfjZJRHE299UIrsYleKC_2WqdQn6HxoNoFK7ybaX7GLyKWDJ-cfCg7ZdMe2Y0LD1JDA8QrpY Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 65ddfc9041e44055be492260cb2f1ae9 Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-LiveMigrationNegativeTest-1101730194 Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:03:16.808680 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_65ddfc9041e44055be492260cb2f1ae9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/65ddfc9041e44055be492260cb2f1ae9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65ddfc9041e44055be492260cb2f1ae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65ddfc9041e44055be492260cb2f1ae9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-LiveMigrationNegativeTest-1101730194 Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 65ddfc9041e44055be492260cb2f1ae9 Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1101730194 Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-LiveMigrationNegativeTest-1101730194-project Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 4352b314efdf413d940755f4cb0dbbda Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-LiveMigrationNegativeTest-1101730194-project Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 could not be found. Oct 16 01:03:16.810360 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '68f108bb-6f59-4710-a3d0-5f0b49ee7f92'} Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 could not be found. Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:03:16.811339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 could not be found. Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 could not be found. Oct 16 01:03:16.812814 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:03:16.814683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] Returning 404 to user: Instance 68f108bb-6f59-4710-a3d0-5f0b49ee7f92 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:03:16.814683 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-95f48a92-0b37-4c44-bd2a-6ad27936b2a3 tempest-LiveMigrationNegativeTest-1101730194 tempest-LiveMigrationNegativeTest-1101730194-project] 10.222.0.39 "GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92" status: 404 len: 111 microversion: 2.1 time: 0.064545 Oct 16 01:03:16.816009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 415/896] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:16 2022] GET /compute/v2.1/servers/68f108bb-6f59-4710-a3d0-5f0b49ee7f92 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:03:17.046219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:17.056593 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7cefed55-02e6-4090-92ef-de81bcefbe0e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1537 microversion: 2.1 time: 0.320388 Oct 16 01:03:17.068274 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 482/897] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:16 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1537 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:17.428277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0a21f4f4-1ad0-4882-9202-01d6820562b8 req-ab08f5cf-7653-4850-84bc-2b0576f51b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4495b959-d827-46f4-92c3-05b9b91c2020", "tag": "ca157844-15f0-450a-862c-cca64f9f972e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:17.440498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a21f4f4-1ad0-4882-9202-01d6820562b8 req-ab08f5cf-7653-4850-84bc-2b0576f51b5f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.445517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a21f4f4-1ad0-4882-9202-01d6820562b8 req-ab08f5cf-7653-4850-84bc-2b0576f51b5f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.446155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a21f4f4-1ad0-4882-9202-01d6820562b8 req-ab08f5cf-7653-4850-84bc-2b0576f51b5f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:17.462596 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0a21f4f4-1ad0-4882-9202-01d6820562b8 req-ab08f5cf-7653-4850-84bc-2b0576f51b5f service nova] Creating event network-changed:ca157844-15f0-450a-862c-cca64f9f972e for instance 4495b959-d827-46f4-92c3-05b9b91c2020 on n-h1-master-1 Oct 16 01:03:17.478668 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0a21f4f4-1ad0-4882-9202-01d6820562b8 req-ab08f5cf-7653-4850-84bc-2b0576f51b5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053026 Oct 16 01:03:17.485636 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 416/898] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:17.492350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:17.493049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:17.502626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.503152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.503605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:17.504297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.504755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.505180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:17.569906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:17.570974 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:17.580623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.581118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.584186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:17.584930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:17.589525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:17.590234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:17.622728 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:17.785668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:17.819664 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:17.828571 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ab2c8b45-454b-4838-a2d7-40636c1ca68a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.341176 Oct 16 01:03:17.830285 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 483/899] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:17 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:17.867278 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-34a00c92-f1cb-4822-bd38-8df7ee32bf83 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1272 microversion: 2.1 time: 0.265368 Oct 16 01:03:17.868283 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 417/900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:17 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1272 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:18.081872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:18.082493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:18.092930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.093694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.094362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.095429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.096586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.097231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.322677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:18.333379 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-963af340-69f9-4ee1-8a25-c9dc7791803a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1537 microversion: 2.1 time: 0.255430 Oct 16 01:03:18.334282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 484/901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:18 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:18.864888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:18.867562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:18.883386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.887445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.887997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.891221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.893084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:18.893735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:18.893984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.894999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.913210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.913774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.914335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:18.915109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:18.915616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:18.916045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:19.027068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:19.040919 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3c56ba84-7f95-4f1b-bdbf-ab99f3a24774 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1272 microversion: 2.1 time: 0.152333 Oct 16 01:03:19.041715 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 485/902] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:18 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:19.125696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:19.146785 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7931fded-a495-4891-880a-87e58d68213a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.292634 Oct 16 01:03:19.148240 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 418/903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:18 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:19.358067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:19.359001 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:19.371362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:19.372213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:19.378338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:19.379316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:19.379952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:19.380546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:19.546768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-280d371d-06de-4f2f-aaa1-d99413c8d09e req-acccd122-9ff5-4f2e-b015-47c55ff06d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143c3ee9-153e-42d5-80b0-df5c3fe70085", "tag": "4a711534-6fc5-44d9-b654-ed82a1e4d7ad"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:19.583109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-280d371d-06de-4f2f-aaa1-d99413c8d09e req-acccd122-9ff5-4f2e-b015-47c55ff06d67 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:19.584056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-280d371d-06de-4f2f-aaa1-d99413c8d09e req-acccd122-9ff5-4f2e-b015-47c55ff06d67 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:19.584985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-280d371d-06de-4f2f-aaa1-d99413c8d09e req-acccd122-9ff5-4f2e-b015-47c55ff06d67 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:19.599989 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-280d371d-06de-4f2f-aaa1-d99413c8d09e req-acccd122-9ff5-4f2e-b015-47c55ff06d67 service nova] Creating event network-changed:4a711534-6fc5-44d9-b654-ed82a1e4d7ad for instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 on n-h1-master-1 Oct 16 01:03:19.606120 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-280d371d-06de-4f2f-aaa1-d99413c8d09e req-acccd122-9ff5-4f2e-b015-47c55ff06d67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065843 Oct 16 01:03:19.607461 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 419/904] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:19.742076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:19.755113 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cfc3a851-d937-4e95-96db-9298ad081e5a tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1537 microversion: 2.1 time: 0.401239 Oct 16 01:03:19.755694 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 486/905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:19 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1537 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:20.063568 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:20.065017 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=28 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:20.070225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:20.071365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:20.089315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:20.091764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:20.092220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:20.093010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:20.093399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:20.093837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:20.169853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:20.171418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:20.175210 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=11 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:20.184660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:20.190768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:20.192893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:20.193995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:20.195286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:20.195963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:20.523676 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=11 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:20.574779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:20.577733 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:20.583911 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-100cfaf1-ae81-4457-858a-ffd015d1b6f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.418162 Oct 16 01:03:20.584538 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 487/906] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:20 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:20.609782 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-27ea464e-e08e-4847-b66c-7a60f710d37a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 0.547350 Oct 16 01:03:20.610893 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 420/907] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:20 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:20.780959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:20.781855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:20.800929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:20.801771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:20.802374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:20.803329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:20.803793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:20.804223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:21.190333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:21.206824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-64480d53-0c7f-4ba1-a122-b148a9dc6873 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1537 microversion: 2.1 time: 0.431832 Oct 16 01:03:21.209279 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 488/908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:20 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1537 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:21.616597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:21.617993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:21.627726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:21.638443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:21.639431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:21.640729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:21.644130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:21.646526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:21.647330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:21.648980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:21.679806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:21.682043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:21.682460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:21.685679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:21.688471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:21.689633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:22.184133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:22.191392 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:22.192965 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c7a3db6-2583-44bb-989f-a9d92c8b3f68 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.584466 Oct 16 01:03:22.201412 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77dc9235-4cae-4bc7-ae72-2b73e2d7810e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 0.571423 Oct 16 01:03:22.212116 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 489/909] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:21 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:22.215371 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 421/910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:21 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:22.238844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:22.239584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:22.245956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:22.246501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:22.247051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:22.247945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:22.248654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:22.249143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:22.558127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:22.569700 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f6310cf8-0e2f-49a3-b65a-dd83e293aa48 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1537 microversion: 2.1 time: 0.336049 Oct 16 01:03:22.592118 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 490/911] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:22 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1537 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:23.223363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:23.224120 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:23.229399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:23.230764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:23.242772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.245841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.246699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.247431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.248399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.249080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.249964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.250647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.256591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.257693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.258416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.259137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.795738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:23.811860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f37b7df-d3ae-4410-b426-0d9c474f2d4f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.592794 Oct 16 01:03:23.828289 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 422/912] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:23 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:23.836636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:23.839268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:23.839880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:23.855344 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68d42121-0140-49e0-acb3-fb2c446f6708 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 0.618877 Oct 16 01:03:23.856291 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 491/913] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:23 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:23.870811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a967d093-4c8a-4250-8632-7c1c98b2d372 req-b4b8ba91-d146-463d-a320-7fc09d23cbdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2706c06f-8948-4e1a-8504-945a205583f0", "tag": "7d6cc6a6-e2eb-432f-9efe-53517f5441f2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:23.878587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.879129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.879574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.880696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.881166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.881688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.900098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a967d093-4c8a-4250-8632-7c1c98b2d372 req-b4b8ba91-d146-463d-a320-7fc09d23cbdc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:23.900730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a967d093-4c8a-4250-8632-7c1c98b2d372 req-b4b8ba91-d146-463d-a320-7fc09d23cbdc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:23.901240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a967d093-4c8a-4250-8632-7c1c98b2d372 req-b4b8ba91-d146-463d-a320-7fc09d23cbdc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:23.922549 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a967d093-4c8a-4250-8632-7c1c98b2d372 req-b4b8ba91-d146-463d-a320-7fc09d23cbdc service nova] Creating event network-changed:7d6cc6a6-e2eb-432f-9efe-53517f5441f2 for instance 2706c06f-8948-4e1a-8504-945a205583f0 on n-h2-master-1 Oct 16 01:03:23.941675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a967d093-4c8a-4250-8632-7c1c98b2d372 req-b4b8ba91-d146-463d-a320-7fc09d23cbdc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081592 Oct 16 01:03:23.943855 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 492/914] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:24.656387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:24.691744 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74d6cca3-c5c3-4bb6-8c6c-1cb55a6fb1d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.854151 Oct 16 01:03:24.694443 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 423/915] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:23 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:24.846313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:24.848433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:24.868019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:24.869943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:24.870729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:24.871666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:24.875898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:24.877640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:24.887614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:24.888833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:24.897306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:24.901451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:24.903308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:24.909091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:24.913610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:24.914310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:25.841431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:25.854224 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3143d0e0-732d-468b-b60d-5f1a419717aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 0.972383 Oct 16 01:03:25.856747 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 424/916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:24 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:25.873291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:25.874167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:25.886799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:25.887331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:25.887995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:25.891167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:25.891863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:25.892743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:25.924885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:25.936927 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9518eaea-b0d2-47f2-a541-bd6ee81e8b24 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 1.096228 Oct 16 01:03:25.951402 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 493/917] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:24 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:26.538851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:26.565120 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cfe4417e-2034-483d-98d9-74bbf548be1f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.698827 Oct 16 01:03:26.590626 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 425/918] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:25 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:26.885640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:26.886497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:26.910970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.913414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.915143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:26.918739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.919165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.924971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:26.965820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:26.966425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:26.978510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.979030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.984667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:26.985731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:26.988216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:26.988667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:28.003317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:28.021006 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-38a0a25a-f02d-443c-8ed1-0e74020ad898 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 1.139588 Oct 16 01:03:28.021602 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 494/919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:26 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:28.040249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-23830509-c8de-4a44-b8cb-2aa5474a92c0 req-c8818d41-5eff-486d-93ea-5f12f31fea7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4495b959-d827-46f4-92c3-05b9b91c2020", "name": "network-vif-plugged", "status": "completed", "tag": "ca157844-15f0-450a-862c-cca64f9f972e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:28.070094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:28.086582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-23830509-c8de-4a44-b8cb-2aa5474a92c0 req-c8818d41-5eff-486d-93ea-5f12f31fea7e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:28.087109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-23830509-c8de-4a44-b8cb-2aa5474a92c0 req-c8818d41-5eff-486d-93ea-5f12f31fea7e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:28.089443 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a009dce7-66a8-4296-8a44-a1506fdb95a5 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 1.127044 Oct 16 01:03:28.090078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-23830509-c8de-4a44-b8cb-2aa5474a92c0 req-c8818d41-5eff-486d-93ea-5f12f31fea7e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:28.091128 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 426/920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:26 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:28.101073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:28.102572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:28.117056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:28.117746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:28.118346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:28.119844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:28.120730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:28.121320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:28.135166 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-23830509-c8de-4a44-b8cb-2aa5474a92c0 req-c8818d41-5eff-486d-93ea-5f12f31fea7e service nova] Creating event network-vif-plugged:ca157844-15f0-450a-862c-cca64f9f972e for instance 4495b959-d827-46f4-92c3-05b9b91c2020 on n-h1-master-1 Oct 16 01:03:28.142358 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-23830509-c8de-4a44-b8cb-2aa5474a92c0 req-c8818d41-5eff-486d-93ea-5f12f31fea7e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119476 Oct 16 01:03:28.143599 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 495/921] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:28.480692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:28.494519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4633d0ff-3ec7-4549-8f09-b205263f6070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.401196 Oct 16 01:03:28.495445 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 427/922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:28 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:29.048863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:29.050227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:29.059564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:29.063082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:29.063721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.067795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:29.068404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:29.069480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.114958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:29.115718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:29.126013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:29.131084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:29.131891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.134139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:29.135983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:29.136679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.629037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:29.637176 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:29.647852 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-09b07c8a-ad15-4366-9d8b-aa4d1d5042e1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 0.603270 Oct 16 01:03:29.648507 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 496/923] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:29 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:29.654353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:29.659788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:29.672649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:29.672882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:29.675444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:29.677289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.678243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:29.679551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:29.682052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:29.685097 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8f1af9b-c733-45b4-a878-3e51b431c6c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.575247 Oct 16 01:03:29.686520 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 428/924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:29 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:30.340448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:30.353641 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f952e745-14fb-4af6-ab45-26a0a829cece tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.701974 Oct 16 01:03:30.363790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 497/925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:29 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:30.672762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:30.673426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:30.685729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.686225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.686657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:30.703311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.703821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.710095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:30.710714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:30.723080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:30.728976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.729486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.729925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:30.737350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:30.737884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:30.738332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:31.703951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:31.709018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:31.719322 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-10d35296-d9d2-4b77-a07b-d4078449b6ce tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 1.050671 Oct 16 01:03:31.719538 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-62c6bc48-5e2e-418d-a010-7262cd763bf1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 1.013131 Oct 16 01:03:31.723544 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 429/926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:30 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:31.737595 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 498/927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:30 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:31.745952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:31.746803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:31.755334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:31.756170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:31.757088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:31.758822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:31.759753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:31.760408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.072030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-49614446", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "ba2039d4-7a1a-4c70-b987-1dd870ff50d7"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:32.171386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] validate_networks() for [('ba2039d4-7a1a-4c70-b987-1dd870ff50d7', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:03:32.281282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:32.296227 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2425a370-c13b-447a-b005-fd1279bf4336 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.554546 Oct 16 01:03:32.298840 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 499/928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:31 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:32.304532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e655b426-2993-4668-901f-e6b62b4eeda5 req-3e94cb42-6c5e-4a6b-ba02-8542b2544cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143c3ee9-153e-42d5-80b0-df5c3fe70085", "name": "network-vif-plugged", "status": "completed", "tag": "4a711534-6fc5-44d9-b654-ed82a1e4d7ad"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:32.335077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e655b426-2993-4668-901f-e6b62b4eeda5 req-3e94cb42-6c5e-4a6b-ba02-8542b2544cae service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.335565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e655b426-2993-4668-901f-e6b62b4eeda5 req-3e94cb42-6c5e-4a6b-ba02-8542b2544cae service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.336196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e655b426-2993-4668-901f-e6b62b4eeda5 req-3e94cb42-6c5e-4a6b-ba02-8542b2544cae service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.354226 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e655b426-2993-4668-901f-e6b62b4eeda5 req-3e94cb42-6c5e-4a6b-ba02-8542b2544cae service nova] Creating event network-vif-plugged:4a711534-6fc5-44d9-b654-ed82a1e4d7ad for instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 on n-h1-master-1 Oct 16 01:03:32.360413 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e655b426-2993-4668-901f-e6b62b4eeda5 req-3e94cb42-6c5e-4a6b-ba02-8542b2544cae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059176 Oct 16 01:03:32.361277 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 500/929] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:32.748198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:32.749638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:32.779050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.779339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.779777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:32.780490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:32.780955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:32.781370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.174763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:33.176452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:33.177616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:33.179100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:33.180071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:33.206806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:33.213738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.216341 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49d42c9e-8cf7-49be-8097-fd6dae7ffdfa tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1318 microversion: 2.1 time: 0.474983 Oct 16 01:03:33.216649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.221306 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 501/930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:32 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:33.228512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.230768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.231830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.232889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.233636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:33.234404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:33.257746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.258253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.258690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.259431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.260067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.260645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.273686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:03:33.286366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for user 875dca9ed4914e379601ddbdba035cb2 and project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:03:33.320431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:03:33.323924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:03:33.419973 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8765730a-88e6-4d25-8a27-029a19918e99 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.688048 Oct 16 01:03:33.420939 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 430/931] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:03:33.434123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:33.435565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:33.443634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.444297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.444878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.445761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:33.446375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:33.447183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:33.840323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:33.853525 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-51a696e4-eb15-4654-9b9d-4c51ff444290 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 0.630989 Oct 16 01:03:33.854105 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 502/932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:33 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:33.890418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a2244b6d-d215-4d02-8113-3670c3c01202 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:33.891492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a2244b6d-d215-4d02-8113-3670c3c01202 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:33.897915 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:33.906703 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c74a6ba-b7eb-4daa-8e2f-2568a2e869d5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.483981 Oct 16 01:03:33.915846 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 431/933] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:33 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:33.983449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a2244b6d-d215-4d02-8113-3670c3c01202 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:33.990695 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a2244b6d-d215-4d02-8113-3670c3c01202 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1206 microversion: 2.1 time: 0.130591 Oct 16 01:03:33.991559 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 503/934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:33 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1206 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:34.241548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:34.243187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:34.254202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:34.254977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:34.255581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:34.257131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:34.259562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:34.261107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:34.464934 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:34.480475 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5fbec818-d49f-4d88-86fd-a46da20b37d7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1468 microversion: 2.1 time: 0.241364 Oct 16 01:03:34.481949 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 432/935] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:34 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1468 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:34.488540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-458cb67a-8ff3-44de-a669-9085d386a21b req-493e3168-bb90-477b-a447-33a7d9d7594a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2706c06f-8948-4e1a-8504-945a205583f0", "name": "network-vif-plugged", "status": "completed", "tag": "7d6cc6a6-e2eb-432f-9efe-53517f5441f2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:34.512856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-458cb67a-8ff3-44de-a669-9085d386a21b req-493e3168-bb90-477b-a447-33a7d9d7594a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:34.513342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-458cb67a-8ff3-44de-a669-9085d386a21b req-493e3168-bb90-477b-a447-33a7d9d7594a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:34.513764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-458cb67a-8ff3-44de-a669-9085d386a21b req-493e3168-bb90-477b-a447-33a7d9d7594a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:34.557319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-458cb67a-8ff3-44de-a669-9085d386a21b req-493e3168-bb90-477b-a447-33a7d9d7594a service nova] Creating event network-vif-plugged:7d6cc6a6-e2eb-432f-9efe-53517f5441f2 for instance 2706c06f-8948-4e1a-8504-945a205583f0 on n-h2-master-1 Oct 16 01:03:34.570250 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-458cb67a-8ff3-44de-a669-9085d386a21b req-493e3168-bb90-477b-a447-33a7d9d7594a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086248 Oct 16 01:03:34.573952 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 433/936] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:34.582459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:34.584737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:34.592611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:34.593485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:34.594108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:34.595025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:34.596255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:34.596866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:34.873026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-807013073", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "8b1499e7-a562-4896-ac36-445314ab5b9f"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:34.924323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:34.941849 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d173a9e-7fbd-4b85-9fc4-736ae9d1a791 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 1468 microversion: 2.1 time: 0.357593 Oct 16 01:03:34.946041 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 434/937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:34 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 1468 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:34.965103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:34.965714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:34.983031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] validate_networks() for [('8b1499e7-a562-4896-ac36-445314ab5b9f', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:03:34.987609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:34.988488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.004365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.005357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.005855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.006294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.311076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:35.321983 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d732e95d-4f28-4493-b15e-86ec1e3969af tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 0.374115 Oct 16 01:03:35.323367 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 435/938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:34 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:35.331993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:35.333496 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:35.344226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.345077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.345742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.347674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.349715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.350688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.380665 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:35.691879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:35.700860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-348e0d0c-7da9-47da-aedd-7579973ce12b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.376061 Oct 16 01:03:35.716737 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 436/939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:35 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:35.727561 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1542885062"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:35.731834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:35.739886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.740618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.741186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.741903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.742380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.743012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.768648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:35.769555 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:35.770050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:35.770459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:35.771096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:35.785754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.786550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.787266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.788185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.788812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.789411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.809916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Getting quotas for project 7776307d685b47fe8beca919b5f90966. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:03:35.816902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Getting quotas for user 8cd01d53807440fd827b41778a54627a and project 7776307d685b47fe8beca919b5f90966. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:03:35.830741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:03:35.833445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:03:35.906345 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1323c51e-7ed9-4dc6-922d-931f718d7ff5 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566592 Oct 16 01:03:35.907584 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 504/940] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:03:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:03:35.918714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:35.919616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:35.931990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.933019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.933631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:35.934496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:35.935651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:35.936249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.040695 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:36.056394 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c69b2ea7-2240-49d6-b7f0-83ed105cf7ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1258 microversion: 2.1 time: 0.146755 Oct 16 01:03:36.057750 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 505/941] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:35 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:36.106041 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c87a91de-2aa5-467e-a872-54bea906b8c7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "POST /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020/action" status: 202 len: 0 microversion: 2.1 time: 0.385544 Oct 16 01:03:36.118436 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 437/942] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:35 2022] POST /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:03:36.132681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.133964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:36.141602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.142512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.143232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.144150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.144808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.145453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.259036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba0d73f7-67ef-41d8-a2f9-96386fd34a74 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Calling method '.version_select at 0x7fd64eab7310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.263713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba0d73f7-67ef-41d8-a2f9-96386fd34a74 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.264207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba0d73f7-67ef-41d8-a2f9-96386fd34a74 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.264649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba0d73f7-67ef-41d8-a2f9-96386fd34a74 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.265382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba0d73f7-67ef-41d8-a2f9-96386fd34a74 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.265998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba0d73f7-67ef-41d8-a2f9-96386fd34a74 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.266434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba0d73f7-67ef-41d8-a2f9-96386fd34a74 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.296338 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba0d73f7-67ef-41d8-a2f9-96386fd34a74 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.237020 Oct 16 01:03:36.305848 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 506/943] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:36.315295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d5cadfb1-1262-4bad-8bfb-ec2bb7aa6f5c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.316892 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d5cadfb1-1262-4bad-8bfb-ec2bb7aa6f5c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:36.344682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid 981200a2-5a9d-469f-9f65-ad75dbe1b422 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:03:36.376003 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-152e3ed6-d970-4f55-aba4-616804f85349 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 2342 microversion: 2.25 time: 0.254948 Oct 16 01:03:36.378642 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 438/944] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 2342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:03:36.383475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7429f134-e4e5-45aa-a2bd-51268c92076c tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e426ee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.432944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d5cadfb1-1262-4bad-8bfb-ec2bb7aa6f5c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:36.444639 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d5cadfb1-1262-4bad-8bfb-ec2bb7aa6f5c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1223 microversion: 2.1 time: 0.137199 Oct 16 01:03:36.445484 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 507/945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:36.451787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-998b7c9e-3ad8-449b-b6cd-6e3dc13e1940 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Calling method '.version_select at 0x7fd64e8b59d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.451951 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7429f134-e4e5-45aa-a2bd-51268c92076c tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.072020 Oct 16 01:03:36.452430 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 439/946] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:36.463210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-998b7c9e-3ad8-449b-b6cd-6e3dc13e1940 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.464073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-998b7c9e-3ad8-449b-b6cd-6e3dc13e1940 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.464194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.464651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-998b7c9e-3ad8-449b-b6cd-6e3dc13e1940 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.464845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:36.465703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-998b7c9e-3ad8-449b-b6cd-6e3dc13e1940 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.466259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-998b7c9e-3ad8-449b-b6cd-6e3dc13e1940 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.475691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-998b7c9e-3ad8-449b-b6cd-6e3dc13e1940 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.489689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.492297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.493059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.494043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.494723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.495537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.571236 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-998b7c9e-3ad8-449b-b6cd-6e3dc13e1940 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.124130 Oct 16 01:03:36.571878 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 508/947] 10.222.0.39 () {58 vars in 1139 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:36.587696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7d6bda9-fa8d-44c2-a16d-297071e9f500 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.593468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7d6bda9-fa8d-44c2-a16d-297071e9f500 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.594280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7d6bda9-fa8d-44c2-a16d-297071e9f500 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.595013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7d6bda9-fa8d-44c2-a16d-297071e9f500 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.596483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7d6bda9-fa8d-44c2-a16d-297071e9f500 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.597148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7d6bda9-fa8d-44c2-a16d-297071e9f500 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.597744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7d6bda9-fa8d-44c2-a16d-297071e9f500 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.650885 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b7d6bda9-fa8d-44c2-a16d-297071e9f500 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.068244 Oct 16 01:03:36.652353 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 509/948] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:36.658731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e93d40bc-dab3-4d9d-a091-473378ed0567 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Calling method '.version_select at 0x7fd64e9ee8b0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.665245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e93d40bc-dab3-4d9d-a091-473378ed0567 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.666279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e93d40bc-dab3-4d9d-a091-473378ed0567 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.666904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e93d40bc-dab3-4d9d-a091-473378ed0567 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.667830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e93d40bc-dab3-4d9d-a091-473378ed0567 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.668634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e93d40bc-dab3-4d9d-a091-473378ed0567 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.669224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e93d40bc-dab3-4d9d-a091-473378ed0567 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.707206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e93d40bc-dab3-4d9d-a091-473378ed0567 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.053142 Oct 16 01:03:36.716916 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 510/949] 10.222.0.39 () {58 vars in 1145 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:03:36.722680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c4726c7-e8a8-4762-9191-9040410e5d56 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Calling method '.version_select at 0x7fd64eb79670>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.731524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c4726c7-e8a8-4762-9191-9040410e5d56 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.732023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c4726c7-e8a8-4762-9191-9040410e5d56 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.732657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c4726c7-e8a8-4762-9191-9040410e5d56 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.734965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c4726c7-e8a8-4762-9191-9040410e5d56 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.735286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c4726c7-e8a8-4762-9191-9040410e5d56 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.735711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c4726c7-e8a8-4762-9191-9040410e5d56 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.772589 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5c4726c7-e8a8-4762-9191-9040410e5d56 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.053375 Oct 16 01:03:36.773757 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 511/950] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:36.780218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.781067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:36.790390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.793333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.801055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:36.803919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.805195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.805960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.823386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.828006 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3fb84059-f8f9-4dc4-814e-322910c4e0ec tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1314 microversion: 2.1 time: 0.363549 Oct 16 01:03:36.831167 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 440/951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:36.856014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85b3605d-0639-4738-9937-563d36716221 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Calling method '.version_select at 0x7fd64e45b280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:36.873065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b3605d-0639-4738-9937-563d36716221 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.875641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b3605d-0639-4738-9937-563d36716221 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.876298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b3605d-0639-4738-9937-563d36716221 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:36.877398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b3605d-0639-4738-9937-563d36716221 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:36.879660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b3605d-0639-4738-9937-563d36716221 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:36.891967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b3605d-0639-4738-9937-563d36716221 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.010082 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85b3605d-0639-4738-9937-563d36716221 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.166705 Oct 16 01:03:37.018612 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 441/952] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:37.027587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f656a885-8a76-4800-a8f7-11b056fa1881 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Calling method '.version_select at 0x7fd64ec51430>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:37.031185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f656a885-8a76-4800-a8f7-11b056fa1881 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.031711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f656a885-8a76-4800-a8f7-11b056fa1881 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.032166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f656a885-8a76-4800-a8f7-11b056fa1881 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.045192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f656a885-8a76-4800-a8f7-11b056fa1881 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.045689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f656a885-8a76-4800-a8f7-11b056fa1881 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.046132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f656a885-8a76-4800-a8f7-11b056fa1881 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.119310 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f656a885-8a76-4800-a8f7-11b056fa1881 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.099456 Oct 16 01:03:37.120554 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 442/953] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:03:37 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:37.144667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:37.145382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:37.146051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:37.166453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.167201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.168028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.168517 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e39bbed-7e23-4034-8881-534b093fd6b8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.388006 Oct 16 01:03:37.169446 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 512/954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:36 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:37.169701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.170477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.170886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.176220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b5cd931-ae9a-4cc2-b503-e7c42b2d4cb8 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Calling method '.version_select at 0x7fd64e7e6c10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:37.194551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b5cd931-ae9a-4cc2-b503-e7c42b2d4cb8 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.195095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b5cd931-ae9a-4cc2-b503-e7c42b2d4cb8 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.195536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b5cd931-ae9a-4cc2-b503-e7c42b2d4cb8 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.244683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b5cd931-ae9a-4cc2-b503-e7c42b2d4cb8 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.245182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b5cd931-ae9a-4cc2-b503-e7c42b2d4cb8 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.247370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b5cd931-ae9a-4cc2-b503-e7c42b2d4cb8 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.265059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:37.276237 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-04b68ca1-93df-401a-9b57-9bc404a2eba1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1264 microversion: 2.1 time: 0.154059 Oct 16 01:03:37.277170 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 443/955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:37 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:37.309811 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5b5cd931-ae9a-4cc2-b503-e7c42b2d4cb8 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 860 microversion: 2.1 time: 0.138967 Oct 16 01:03:37.310790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 513/956] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Oct 16 01:03:37 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 860 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:37.322210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f06abc63-0390-4ec2-858d-a066646569a2 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Calling method '.version_select at 0x7fd64e426ca0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:37.329400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06abc63-0390-4ec2-858d-a066646569a2 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.330647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06abc63-0390-4ec2-858d-a066646569a2 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.331265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06abc63-0390-4ec2-858d-a066646569a2 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.345627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06abc63-0390-4ec2-858d-a066646569a2 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.346440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06abc63-0390-4ec2-858d-a066646569a2 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.346858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06abc63-0390-4ec2-858d-a066646569a2 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.395616 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f06abc63-0390-4ec2-858d-a066646569a2 tempest-HostsAdminTestJSON-150603382 tempest-HostsAdminTestJSON-150603382-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 991 microversion: 2.1 time: 0.077113 Oct 16 01:03:37.396854 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 444/957] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Oct 16 01:03:37 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:37.472374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:37.472524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec80ef10-af79-4682-93d8-ec8340c71989 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e8701f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:37.473179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:37.476714 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:37.487465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.488249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.489242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.491873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.493397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.494448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.601259 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec80ef10-af79-4682-93d8-ec8340c71989 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.116175 Oct 16 01:03:37.612627 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 514/958] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:37 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:37.651164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:37.662333 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51eac210-4202-431d-9a41-c2d998796093 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1275 microversion: 2.1 time: 0.193142 Oct 16 01:03:37.667205 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 445/959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:37 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1275 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:37.857122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:37.857730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:37.873876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.874902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.875378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:37.879311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:37.879835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:37.882522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.121220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:38.136803 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-75f2fbf0-1702-446a-bdc1-4a3448cf5a64 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1464 microversion: 2.1 time: 0.283681 Oct 16 01:03:38.137714 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 515/960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:37 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1464 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:38.197814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:38.198485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:38.211939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.212737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.215177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.216281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.218320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.219087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.603755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:38.620887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Searching by: {'deleted': False, 'project_id': 'de18aeb229f843b4ab5928afbdc34afd'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:03:38.636201 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:38.639203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.641324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.643809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.644700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.645626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.649469 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-277d94ec-2594-406f-b249-d2b7bdc86889 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.455735 Oct 16 01:03:38.651570 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 516/961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:38 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:38.659639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.667626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:38.668806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:38.682669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.683199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.683642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.687742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:38.688495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:38.691703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:38.897226 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df9046c7-c86d-4961-a612-3a22889cbd54 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.732945 Oct 16 01:03:38.898335 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 446/962] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:03:38 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:03:38.903011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-adc2e831-4838-4232-820f-b48d515d86ba tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4e69d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:38.963150 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-adc2e831-4838-4232-820f-b48d515d86ba tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.063419 Oct 16 01:03:38.963993 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 447/963] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:38 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:38.987312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:38.988220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:38.999054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.000540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.002067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.003675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.004371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.005009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.141262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:39.156144 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1cf18b0-7e19-4f0d-a631-db8230170b37 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.499364 Oct 16 01:03:39.156935 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 517/964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:38 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:39.163177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:39.190909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Searching by: {'deleted': False} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:03:39.196593 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:39.198472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.202627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.203331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.204965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.209020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.209659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.253041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:39.272172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7415ff00-81e2-4b20-adf9-cf2caa770768 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1281 microversion: 2.1 time: 0.290884 Oct 16 01:03:39.275414 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 448/965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:38 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1281 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:39.504519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:03:39.675545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:39.676279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:39.689356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.690102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.690699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.692465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.693260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.695014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:39.765396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:39.770970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:39.771553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:40.087330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:40.096897 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-00ce4ba8-6c7d-4a19-8820-ddc855cf332b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.426721 Oct 16 01:03:40.098308 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 449/966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:39 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:40.106069 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4c3b12f-a119-4c59-9c48-b1814c80a6ed tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4a9700>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:40.194636 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4c3b12f-a119-4c59-9c48-b1814c80a6ed tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.094534 Oct 16 01:03:40.207149 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 450/967] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:40 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:40.230071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:40.240048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:40.257820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:40.261329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:40.261966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:40.262868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:40.267624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:40.268815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:40.906876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:40.929478 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9590d01c-601f-4e66-ba55-ae6611d38676 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.718131 Oct 16 01:03:40.953776 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 451/968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:40 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:40.965357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:40.965981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:40.991714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:40.992233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:40.992682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:40.993407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:40.993868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:40.994468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:41.345923 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f95b93a-f3c7-4146-a3ff-dfd3b6d7f322 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22770 microversion: 2.1 time: 2.184432 Oct 16 01:03:41.365363 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 518/969] 10.222.0.39 () {58 vars in 1171 bytes} [Sun Oct 16 01:03:39 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22770 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:41.382753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:41.412504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2484f446-ece7-4e7f-89f9-a9bff0a47d39", "device": "/dev/xvdb"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:41.420174 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:41.426568 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a1d95b7-5d2e-4ee1-a6b2-0b9658eca680 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.471519 Oct 16 01:03:41.427227 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 452/970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:40 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:41.452189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:41.452964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:41.456443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:41.457103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:41.457633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:41.458055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:41.466497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:41.467544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:41.493695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:41.496202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:41.499735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:41.500680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:41.501236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:41.505252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:41.883785 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:41.911570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:41.927112 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-332f2edc-5456-4fa9-983e-299bd747c2cc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.498088 Oct 16 01:03:41.953522 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 453/971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:41 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:41.959944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d03b9cb7-670a-49df-b0fb-40cfda16c012 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e491ca0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:42.012359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d03b9cb7-670a-49df-b0fb-40cfda16c012 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.057659 Oct 16 01:03:42.013217 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 454/972] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:41 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:42.026497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:42.033345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Searching by: {'deleted': False, 'project_id': 'de18aeb229f843b4ab5928afbdc34afd'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:03:42.054057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.057393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.058842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.060226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.061536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.063097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.130309 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ec84d0f-c3de-44af-b51c-a7cd9f3dd135 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?tenant_id=9f15cb6a79194375bd48a2af095e9374" status: 200 len: 15 microversion: 2.1 time: 0.115843 Oct 16 01:03:42.135399 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 455/973] 10.222.0.39 () {58 vars in 1231 bytes} [Sun Oct 16 01:03:42 2022] GET /compute/v2.1/servers/detail?tenant_id=9f15cb6a79194375bd48a2af095e9374 => generated 15 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:03:42.147791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-4d30f9a6-2e79-431f-b1ef-d8c2410b06dd req-65939c8d-d2c5-4a98-834a-6ed631da18f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9930a3af-2106-418e-87a8-a959ce89905e", "tag": "1bf8e6b8-2014-4792-9b67-18c9f48d806a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:42.172473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4d30f9a6-2e79-431f-b1ef-d8c2410b06dd req-65939c8d-d2c5-4a98-834a-6ed631da18f7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.172473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4d30f9a6-2e79-431f-b1ef-d8c2410b06dd req-65939c8d-d2c5-4a98-834a-6ed631da18f7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.172473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4d30f9a6-2e79-431f-b1ef-d8c2410b06dd req-65939c8d-d2c5-4a98-834a-6ed631da18f7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.207600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-4d30f9a6-2e79-431f-b1ef-d8c2410b06dd req-65939c8d-d2c5-4a98-834a-6ed631da18f7 service nova] Creating event network-changed:1bf8e6b8-2014-4792-9b67-18c9f48d806a for instance 9930a3af-2106-418e-87a8-a959ce89905e on n-h2-master-1 Oct 16 01:03:42.213609 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-4d30f9a6-2e79-431f-b1ef-d8c2410b06dd req-65939c8d-d2c5-4a98-834a-6ed631da18f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076590 Oct 16 01:03:42.214729 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 456/974] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:42.221058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:42.222232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:42.229885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.230550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.231216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.232094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.232561 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9a5c3c6a-cd57-4d99-95bf-6fe7755154f2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "POST /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.854272 Oct 16 01:03:42.233016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.234027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.234405 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 519/975] 10.222.0.39 () {62 vars in 1364 bytes} [Sun Oct 16 01:03:41 2022] POST /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:03:42.252803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:42.277903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Searching by: {'tenant_id': '9f15cb6a79194375bd48a2af095e9374', 'deleted': False} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:03:42.291870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.293208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.295912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.299782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.300580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.302157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.451737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:03:42.547007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:42.565655 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df20ff40-d852-465f-8c42-940c4cfa0278 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.349166 Oct 16 01:03:42.567632 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 457/976] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:42 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:42.576066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.576066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.576066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.584284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31e62b53-de58-45ca-8436-c06a8f9380aa"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:42.586847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:42.593856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.595736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.596668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.597973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.598593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.599193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.627290 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:42.836201 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1510c77e-49bc-487b-812d-b2e586983c04 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9f15cb6a79194375bd48a2af095e9374" status: 200 len: 4825 microversion: 2.1 time: 0.597199 Oct 16 01:03:42.840449 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 520/977] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:03:42 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9f15cb6a79194375bd48a2af095e9374 => generated 4825 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:42.844430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:42.845912 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:42.852522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.853454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.854266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:42.856132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:42.856754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:42.857340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.047590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:43.056870 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-64939f5a-a907-41ca-90f0-6fecbd81be44 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.218655 Oct 16 01:03:43.062972 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 521/978] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:42 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:43.081248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a350a8de-033e-4e7e-b72f-0cdc0f615c7c req-feaa5032-baa3-449c-9343-a1682fd1af1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4495b959-d827-46f4-92c3-05b9b91c2020", "name": "network-vif-plugged", "status": "completed", "tag": "ca157844-15f0-450a-862c-cca64f9f972e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:43.119533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a350a8de-033e-4e7e-b72f-0cdc0f615c7c req-feaa5032-baa3-449c-9343-a1682fd1af1b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.121054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a350a8de-033e-4e7e-b72f-0cdc0f615c7c req-feaa5032-baa3-449c-9343-a1682fd1af1b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.122433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a350a8de-033e-4e7e-b72f-0cdc0f615c7c req-feaa5032-baa3-449c-9343-a1682fd1af1b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.160809 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a350a8de-033e-4e7e-b72f-0cdc0f615c7c req-feaa5032-baa3-449c-9343-a1682fd1af1b service nova] Creating event network-vif-plugged:ca157844-15f0-450a-862c-cca64f9f972e for instance 4495b959-d827-46f4-92c3-05b9b91c2020 on n-h1-master-1 Oct 16 01:03:43.215880 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a350a8de-033e-4e7e-b72f-0cdc0f615c7c req-feaa5032-baa3-449c-9343-a1682fd1af1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148824 Oct 16 01:03:43.231132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 522/979] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:43.256461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:43.264390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Searching by: {'tenant_id': 'de18aeb229f843b4ab5928afbdc34afd', 'deleted': False} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:03:43.272219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.273596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.275312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.276394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.277093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.278080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.305809 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:43.337069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8c4f8dfa-6a9e-4baf-a7d3-077da9fada01 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=de18aeb229f843b4ab5928afbdc34afd" status: 200 len: 15 microversion: 2.1 time: 0.089068 Oct 16 01:03:43.341469 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 523/980] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:03:43 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=de18aeb229f843b4ab5928afbdc34afd => generated 15 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:03:43.353574 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:43.355977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:43.382549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.383550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.385377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.387212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.388686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.391169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.406390 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-421088ff-3868-42e1-884f-2247b6b0c3dc tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "POST /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.837301 Oct 16 01:03:43.415618 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 458/981] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:03:42 2022] POST /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:43.429411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9bef534-179f-49b2-8497-6cab131b7708 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e2f5280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:43.519525 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f9bef534-179f-49b2-8497-6cab131b7708 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.102298 Oct 16 01:03:43.520112 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 459/982] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:43 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:43.534788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54625712-bee0-4328-9dc9-e00c14a3a644 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:43.565330 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-54625712-bee0-4328-9dc9-e00c14a3a644 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.035348 Oct 16 01:03:43.577228 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 460/983] 10.222.0.39 () {58 vars in 1189 bytes} [Sun Oct 16 01:03:43 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:03:43.609729 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:43.612510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:43.650828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.651560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.652729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.653633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.654297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.655006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.658986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:43.667063 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ebcaaff9-d713-4cc3-82f2-7c8283dbd3df tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.323364 Oct 16 01:03:43.667651 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 524/984] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:43 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:43.681819 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:43.685072 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:43.704044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.707318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.711568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.712648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.713326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.714165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.939621 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ecc891f-4575-42ce-bfe2-c2e7fe460e94 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action" status: 202 len: 0 microversion: 2.1 time: 0.270739 Oct 16 01:03:43.940386 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 525/985] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:43 2022] POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:43.948750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:43.955290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:43.957629 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '9f15cb6a79194375bd48a2af095e9374'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:03:43.971449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.973222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.975291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:43.977306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:43.978013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:43.979413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.106286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:03:44.120501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:44.139048 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa71352a-227e-4d99-ab0d-59da51abb522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.543737 Oct 16 01:03:44.142741 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 461/986] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:43 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:44.150396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:44.157962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:44.173095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.174655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.175472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.178441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.179671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.180699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.265213 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d1833c7-b302-46e1-a683-70a1614296f4 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.320524 Oct 16 01:03:44.266175 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 526/987] 10.222.0.39 () {58 vars in 1150 bytes} [Sun Oct 16 01:03:43 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:03:44.290905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:44.304743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:44.315943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.316656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.317228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.318040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.318622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.319177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.418770 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba4043d3-e76a-4c26-ad28-8100ad61d521 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action" status: 202 len: 0 microversion: 2.1 time: 0.142339 Oct 16 01:03:44.423127 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 527/988] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:44 2022] POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:44.431021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:44.432013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:44.443311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.444089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.444711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.445974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.446871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.447482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.511939 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:44.538751 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2a188d5b-259f-472a-ae03-ac2aa1b456dd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.382948 Oct 16 01:03:44.557971 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 462/989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:44 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:44.573359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-66ffbe29-f6be-4230-85ea-7e3e17fe1d95 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e352af0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:44.653599 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-66ffbe29-f6be-4230-85ea-7e3e17fe1d95 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.094214 Oct 16 01:03:44.663574 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 463/990] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:44 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:44.697442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:44.698064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:44.708056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.708571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.709019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.709741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:44.715506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:44.715970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:44.967889 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05776ab4-0842-47d6-a68e-0d7731a57efa tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1614 microversion: 2.1 time: 0.542302 Oct 16 01:03:44.983429 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 528/991] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:44 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1614 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:44.997949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-87e68fac-4efe-4c0e-b3b4-ab9afb518e42 req-9846a9bc-ce73-4efa-b78f-18804c09f177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80668ef9-fa93-48b1-b507-d7b4a7de0afb", "tag": "3944e49d-d846-4923-940e-18c1f16c178f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:45.085267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-87e68fac-4efe-4c0e-b3b4-ab9afb518e42 req-9846a9bc-ce73-4efa-b78f-18804c09f177 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.085798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-87e68fac-4efe-4c0e-b3b4-ab9afb518e42 req-9846a9bc-ce73-4efa-b78f-18804c09f177 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.090010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-87e68fac-4efe-4c0e-b3b4-ab9afb518e42 req-9846a9bc-ce73-4efa-b78f-18804c09f177 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.112730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-87e68fac-4efe-4c0e-b3b4-ab9afb518e42 req-9846a9bc-ce73-4efa-b78f-18804c09f177 service nova] Creating event network-changed:3944e49d-d846-4923-940e-18c1f16c178f for instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb on n-h1-master-1 Oct 16 01:03:45.118179 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-87e68fac-4efe-4c0e-b3b4-ab9afb518e42 req-9846a9bc-ce73-4efa-b78f-18804c09f177 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145548 Oct 16 01:03:45.122789 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 529/992] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:45.132244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:45.133425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:45.133794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:45.146169 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c564367-f63a-4403-ab4c-6d3c06a9db89 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.455044 Oct 16 01:03:45.149249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.150551 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 464/993] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:44 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:45.150860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.151865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.152742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.153360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.154011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.169570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:45.170836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:45.183831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.188112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.189110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.190044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.190621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.191647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.550159 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b5abc70-77a6-4902-b2fc-802b20a48e10 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1614 microversion: 2.1 time: 0.426091 Oct 16 01:03:45.550745 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 530/994] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:45 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1614 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:45.572440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:45.576531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:45.581961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:45.584623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ca0df2ca-3da9-4393-a6f7-bf40011edd2c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.419618 Oct 16 01:03:45.607534 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 465/995] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:45 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:45.607760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.608172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.608599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.609292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.609744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.610160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.617384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:45.640398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Searching by: {'host': 'n-h2-master-1', 'deleted': False} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:03:45.648481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.652730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.653745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.655564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:45.663851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:45.665437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:45.898870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:03:45.937715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:45.953233 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4cf0241d-a46b-4413-b988-bd66ae24df81 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.390274 Oct 16 01:03:45.954102 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 531/996] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:45 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:45.976756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-afeba783-2646-4e17-b6d7-9fb106c5590f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e464e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:46.037348 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-afeba783-2646-4e17-b6d7-9fb106c5590f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.069069 Oct 16 01:03:46.037933 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 532/997] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:45 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:46.067695 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9483631e-ecbf-4dc5-a07d-167b3e77f6b0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1" status: 200 len: 2295 microversion: 2.1 time: 0.458147 Oct 16 01:03:46.068601 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 466/998] 10.222.0.39 () {58 vars in 1190 bytes} [Sun Oct 16 01:03:45 2022] GET /compute/v2.1/servers?host=n-h2-master-1&all_tenants=1 => generated 2295 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:46.085334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:46.092079 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:03:46.098453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.099216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.099841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.100746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.101441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.102035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.173935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:46.175563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:46.187844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.188725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.189870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.195549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.196241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.196866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.227049 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fea06dc7-1adc-42ef-8f31-c1bbfac96718 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.148521 Oct 16 01:03:46.237261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 533/999] 10.222.0.39 () {58 vars in 1196 bytes} [Sun Oct 16 01:03:46 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:03:46.250398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:46.257610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:46.289054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.289838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.290497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.291990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.300122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.300766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.386698 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:46.498850 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e6287c8-8fa0-4d84-bcc0-2b18bb0c4ef0 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action" status: 202 len: 0 microversion: 2.1 time: 0.258884 Oct 16 01:03:46.505435 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 534/1000] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:46 2022] POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:03:46.508971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:46.519014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:46.522510 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ff97186b-7530-4a8e-86ec-2378c335bd91 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.352783 Oct 16 01:03:46.524792 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 467/1001] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:46 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:46.537527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:46.544036 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.555369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.556085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.557014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.557634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.558231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.611897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:46.615523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:46.627695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.628403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.629018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.629902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.630515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.631137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.711156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:03:46.717950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:03:46.718647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:03:46.719197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:03:46.719721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:03:46.915793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:46.941438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.944363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:46.944908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.945367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.946115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:46.946581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:46.953306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:46.957627 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-965435f2-1314-43dd-b175-beb47561bcfd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.349934 Oct 16 01:03:46.960968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 468/1002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:46 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:46.985563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:46.988036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:46.997718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:47.000754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:47.001736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:47.004712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:47.006014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:47.008997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:47.030139 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3a1bcbb1-ef84-4729-b6fb-1892e87e4fab tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action" status: 202 len: 1067 microversion: 2.1 time: 0.514960 Oct 16 01:03:47.045551 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 535/1003] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:46 2022] POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action => generated 1067 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 16 01:03:47.061477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:47.067816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:47.092624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:47.093110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:47.093532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:47.094229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:47.094684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:47.095744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:47.547146 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:47.570784 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-438306f1-ffda-4937-8697-102d2aff152b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.589684 Oct 16 01:03:47.571672 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 469/1004] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:46 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:47.577278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:47.610736 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c14944c4-b3a5-4ae6-bfde-60e3aa87d06a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 0.563874 Oct 16 01:03:47.615445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d79795e2-7d29-4c80-933c-ebd7d60c2118 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e491700>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:47.618499 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 536/1005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:47 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:47.649946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:47.652048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:47.664924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:47.668504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:47.680190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:47.682798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:47.684752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:47.685838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:47.741192 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d79795e2-7d29-4c80-933c-ebd7d60c2118 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.167692 Oct 16 01:03:47.742297 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 470/1006] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:47 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:47.990875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:47.992019 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:48.010894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:48.011889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:48.012693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:48.013742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:48.014506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:48.015255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:48.418961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:48.429236 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2255f787-b321-4c5a-aecd-cbadf5155ac6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.809456 Oct 16 01:03:48.433693 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 537/1007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:47 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:48.440191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:48.456513 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7b46a21-c87c-4644-854d-72fa96139443 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.471266 Oct 16 01:03:48.457655 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 471/1008] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:47 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:48.598520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:48.599176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:48.609775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:48.615796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:48.616514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:48.618033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:48.618768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:48.619430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:48.641827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:48.643533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:48.658855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:48.659711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:48.663080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:48.666674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:48.670708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:48.674163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:49.092357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:49.106982 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-32369eba-afac-4815-906d-c0609c41294d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.516851 Oct 16 01:03:49.118212 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 538/1009] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:48 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:49.142748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17c700ec-5913-4861-a18d-79b48b1b09f4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e3bed30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:49.151360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:49.161116 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9054fff-de5f-449d-9d96-d9ca83e861a7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 0.523382 Oct 16 01:03:49.184149 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 472/1010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:48 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:49.250712 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-17c700ec-5913-4861-a18d-79b48b1b09f4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.112489 Oct 16 01:03:49.251419 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 539/1011] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:49 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:49.459605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:49.460359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:49.474051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:49.476346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:49.478288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:49.478288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:49.478288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:49.481311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:49.485420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:49.487704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:49.511337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:49.512104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:49.512615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:49.513444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:49.514123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:49.514658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:49.981036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:49.990575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bb11fe1c-43e2-4ce3-83e8-294ee5542cad tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.536858 Oct 16 01:03:49.991188 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 473/1012] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:49 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:50.081626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:50.099329 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ceaee6da-dc6f-4d36-b8f8-3532c34a0565 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.618090 Oct 16 01:03:50.115830 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 540/1013] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:49 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:50.142202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:50.143073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:50.154698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:50.156429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:50.160262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:50.164081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:50.164784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:50.166508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:50.200382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:50.201375 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:50.219683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:50.220311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:50.220840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:50.224060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:50.224533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:50.224961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:50.743291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:50.760542 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c4413d39-c8fa-4ba4-bf7c-a971aff497d3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.621933 Oct 16 01:03:50.764256 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 474/1014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:50 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:50.768754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:50.776564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc3fab35-2671-42ae-bc34-4b340617c11a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e3e8e50>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:50.783343 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b9e6f20-6566-40ec-9641-c606f606137c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 0.585736 Oct 16 01:03:50.784985 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 541/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:50 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:50.869314 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bc3fab35-2671-42ae-bc34-4b340617c11a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.099804 Oct 16 01:03:50.872640 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 475/1016] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:50 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:51.022880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:51.028853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:51.053536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.057566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.062652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:51.064335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.065972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.067812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:51.122889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:51.123528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:51.133211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.133710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.134147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:51.134857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.135343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.135771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:51.385562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:51.398909 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f98d4091-cc6f-4744-be17-35e416030407 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.281092 Oct 16 01:03:51.399853 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 476/1017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:51 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:51.470034 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:51.483303 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1a78e04-e086-4f2e-b814-86fbee732de9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1542 microversion: 2.1 time: 0.465513 Oct 16 01:03:51.499465 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 542/1018] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:51 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1542 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:51.625577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-edb898a7-1672-4443-a665-40bed6466d39 req-b1ea246c-0a79-423b-a84f-d546ed892a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9930a3af-2106-418e-87a8-a959ce89905e", "name": "network-vif-plugged", "status": "completed", "tag": "1bf8e6b8-2014-4792-9b67-18c9f48d806a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:51.659636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edb898a7-1672-4443-a665-40bed6466d39 req-b1ea246c-0a79-423b-a84f-d546ed892a77 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.660102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edb898a7-1672-4443-a665-40bed6466d39 req-b1ea246c-0a79-423b-a84f-d546ed892a77 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.660523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edb898a7-1672-4443-a665-40bed6466d39 req-b1ea246c-0a79-423b-a84f-d546ed892a77 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:51.683259 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-edb898a7-1672-4443-a665-40bed6466d39 req-b1ea246c-0a79-423b-a84f-d546ed892a77 service nova] Creating event network-vif-plugged:1bf8e6b8-2014-4792-9b67-18c9f48d806a for instance 9930a3af-2106-418e-87a8-a959ce89905e on n-h2-master-1 Oct 16 01:03:51.689841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-edb898a7-1672-4443-a665-40bed6466d39 req-b1ea246c-0a79-423b-a84f-d546ed892a77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071104 Oct 16 01:03:51.690652 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 477/1019] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:51.795035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:51.816429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:51.817296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:51.818298 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:51.836540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.838225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.839584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:51.840505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.841124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.841716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:51.848302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.855570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.858141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:51.859166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:51.862841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:51.863576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.394526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:52.405175 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db5f8c9b-29d8-412e-a231-3624e75d1145 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 0.592933 Oct 16 01:03:52.423942 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 478/1020] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:51 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:52.429059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:52.445624 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-554e907e-34ed-47d3-9a09-b807b72ccf3d tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.655791 Oct 16 01:03:52.446510 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 543/1021] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:51 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:52.456472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a670d015-243d-4a05-a49b-d467888132c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e1c28b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:52.466955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:52.468611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:52.481967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.482573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.483105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.483946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.484313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.484887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.588786 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a670d015-243d-4a05-a49b-d467888132c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.143229 Oct 16 01:03:52.590732 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 479/1022] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:52 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:52.592062 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=14 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:52.602013 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:52.603836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:52.614112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.614888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.615771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.616659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:52.618126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:52.618731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:52.656053 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:52.919088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:52.933398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:52.936187 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d58b431a-98ec-48fb-b255-def5266b43f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1306 microversion: 2.1 time: 0.485342 Oct 16 01:03:52.939588 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 544/1023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:52 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1306 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:52.944745 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed0c632d-059d-47a4-b54d-3a40cac77c39 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1541 microversion: 2.1 time: 0.351744 Oct 16 01:03:52.945347 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 480/1024] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:52 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1541 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:53.433478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:53.434077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:53.442030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:53.446095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:53.446652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:53.448562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:53.455650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:53.456206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:53.473141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:53.473752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:53.491782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:53.492586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:53.493216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:53.494152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:53.494768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:53.495384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:53.907635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:53.925049 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7826e84c-acfd-4eba-8f29-b291c8ba501c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.455269 Oct 16 01:03:53.925739 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 481/1025] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:53 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:53.930815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-faeedbe2-5e58-4dff-be58-3c987fc8efc0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e210e50>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:54.025449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:54.032184 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-faeedbe2-5e58-4dff-be58-3c987fc8efc0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.105179 Oct 16 01:03:54.033917 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 482/1026] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:53 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:54.041837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-bce8ac47-50c1-48e2-b1f0-2951fcd1ec0d req-09a71b76-998a-4d91-8ae0-a9e5794579fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80668ef9-fa93-48b1-b507-d7b4a7de0afb", "name": "network-vif-plugged", "status": "completed", "tag": "3944e49d-d846-4923-940e-18c1f16c178f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:54.046356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-410ef62c-91fe-4706-b5a4-bc268541dd1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 0.616748 Oct 16 01:03:54.050778 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 545/1027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:53 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:54.070485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:54.072109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bce8ac47-50c1-48e2-b1f0-2951fcd1ec0d req-09a71b76-998a-4d91-8ae0-a9e5794579fc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.072632 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:54.072755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bce8ac47-50c1-48e2-b1f0-2951fcd1ec0d req-09a71b76-998a-4d91-8ae0-a9e5794579fc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.082941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.084034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.086162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.087341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.087507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bce8ac47-50c1-48e2-b1f0-2951fcd1ec0d req-09a71b76-998a-4d91-8ae0-a9e5794579fc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.090101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.090715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.109580 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-bce8ac47-50c1-48e2-b1f0-2951fcd1ec0d req-09a71b76-998a-4d91-8ae0-a9e5794579fc service nova] Creating event network-vif-plugged:3944e49d-d846-4923-940e-18c1f16c178f for instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb on n-h1-master-1 Oct 16 01:03:54.116123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-bce8ac47-50c1-48e2-b1f0-2951fcd1ec0d req-09a71b76-998a-4d91-8ae0-a9e5794579fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078684 Oct 16 01:03:54.116738 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 483/1028] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:54.128819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:54.129785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:54.138212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.138997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.139732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.140607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.141542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.142195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.497244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:54.536149 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f931159-0f85-481a-b952-7cf685047c06 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1486 microversion: 2.1 time: 0.468716 Oct 16 01:03:54.538606 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 546/1029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:54 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1486 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:54.566556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:54.567449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:54.575306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:54.594808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.598771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.601136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.605055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.629468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.630295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.631035 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5778feb-2c0f-4b9a-8cfe-cb5f3490939d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1541 microversion: 2.1 time: 0.510742 Oct 16 01:03:54.636052 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 484/1030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:54 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1541 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:54.787704 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-007179b5-aaaa-4586-90c9-d97c53996f5d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e/action" status: 202 len: 0 microversion: 2.1 time: 0.229335 Oct 16 01:03:54.790047 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 547/1031] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:03:54 2022] POST /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:03:54.805416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:54.807430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:54.821720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.822423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.823177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.824288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.825108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.826083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.949915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:54.950786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:54.968098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.977579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.978705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:54.980496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:54.981547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:54.983041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:55.062626 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:55.263240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:55.272628 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59996677-b4a9-44fa-8cad-62f733e45544 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1491 microversion: 2.1 time: 0.478527 Oct 16 01:03:55.279665 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 485/1032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:54 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1491 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:55.285209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22332590-20f2-4b5b-a51d-927d3190b430 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e309f70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:55.385095 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22332590-20f2-4b5b-a51d-927d3190b430 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.103163 Oct 16 01:03:55.385691 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 486/1033] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:55 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:55.415997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:55.416660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:55.446523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:55.447063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:55.447508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:55.448296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:55.448764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:55.449193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:55.538014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:55.547236 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-237cb9fd-c30e-4f71-89e9-8320ff396a31 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1323 microversion: 2.1 time: 0.601566 Oct 16 01:03:55.578121 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 548/1034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:54 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1323 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:55.660381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:55.661013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:55.674407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:55.695265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:55.695763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:55.696781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:55.697550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:55.697994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:55.838488 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=12 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:55.882350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:55.899006 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3cd74cca-1fb0-435c-8011-e68fb2619fa8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 0.507558 Oct 16 01:03:55.918390 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 487/1035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:55 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:55.988867 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:56.009115 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa6d8b07-a45b-4813-a1cd-abda00c9a8a2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1473 microversion: 2.1 time: 0.353653 Oct 16 01:03:56.012714 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 549/1036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:55 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:56.309516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:56.310161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:56.325757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.459847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.459847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.459847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.459847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.475840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.477544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-31bfb14e-ba7f-43b2-83b6-395f3ee5c1c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4db160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:56.477544 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=22 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:56.511961 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-31bfb14e-ba7f-43b2-83b6-395f3ee5c1c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.114534 Oct 16 01:03:56.538046 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 550/1037] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:56 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:03:56.590185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:56.590790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:56.606418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.610908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.611599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.612525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.613013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.613446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.755788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:56.788269 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b92fe00-ade7-493c-be44-05c1e91806a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1491 microversion: 2.1 time: 0.482260 Oct 16 01:03:56.804052 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 488/1038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:56 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1491 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:56.901068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:56.910869 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-698cdd9a-480a-4866-b2c9-ab3633a9638b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1519 microversion: 2.1 time: 0.324929 Oct 16 01:03:56.928750 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 551/1039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:56 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1519 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:56.931360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:56.933782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:56.940331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3d3d4b8-1505-4559-9f39-ece95f40bea8 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'create', calling method: .version_select at 0x7fd64e4db670>, body: {"pool": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:56.961724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.964350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.965804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:56.966770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:56.973241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:56.973986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:58.276016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:58.296743 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1f487bf9-a4f1-4583-ab96-89533bbf7f24 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 1.372065 Oct 16 01:03:58.300460 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 489/1040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:56 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:58.309809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:58.310794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:58.341132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:58.341862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:58.343097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:58.350267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:58.353540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:58.354839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.250555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:03:59.262267 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0f897ad5-9d65-4be9-abfc-58f0944638a4 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1470 microversion: 2.1 time: 0.958137 Oct 16 01:03:59.262845 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 490/1041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:58 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1470 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:59.280658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9533b3be-a9d0-446c-a7b7-c9512343e987 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e2f5ee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:59.369362 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9533b3be-a9d0-446c-a7b7-c9512343e987 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.100554 Oct 16 01:03:59.370441 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 491/1042] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:59 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:03:59.383028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0a2a46d5-38d3-4680-a340-34e906591c0d req-e7f87080-873c-4f0d-a704-50e774e8e81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12066daa-d04c-4f73-b4ee-45b8a17cecc8", "name": "network-vif-unplugged", "status": "completed", "tag": "462f1588-13d7-4346-bf9e-fb24a7f41f90"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:03:59.419037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a2a46d5-38d3-4680-a340-34e906591c0d req-e7f87080-873c-4f0d-a704-50e774e8e81f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.426507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a2a46d5-38d3-4680-a340-34e906591c0d req-e7f87080-873c-4f0d-a704-50e774e8e81f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.429511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a2a46d5-38d3-4680-a340-34e906591c0d req-e7f87080-873c-4f0d-a704-50e774e8e81f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.469166 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0a2a46d5-38d3-4680-a340-34e906591c0d req-e7f87080-873c-4f0d-a704-50e774e8e81f service nova] Creating event network-vif-unplugged:462f1588-13d7-4346-bf9e-fb24a7f41f90 for instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 on n-h2-master-1 Oct 16 01:03:59.488456 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-0a2a46d5-38d3-4680-a340-34e906591c0d req-e7f87080-873c-4f0d-a704-50e774e8e81f service nova] Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:03:59.518078 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0a2a46d5-38d3-4680-a340-34e906591c0d req-e7f87080-873c-4f0d-a704-50e774e8e81f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137806 Oct 16 01:03:59.519848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 492/1043] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:03:59.533338 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:03:59.535648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:03:59.554326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.555833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.556630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:03:59.557585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:03:59.558198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:03:59.561234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.061926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:00.086426 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ce99e1d-4288-4def-b6c3-1579120cc919 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 200 len: 1471 microversion: 2.1 time: 0.564397 Oct 16 01:04:00.131331 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 493/1044] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:03:59 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 1471 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:00.152127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:00.155463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:00.185870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.192807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.199746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.201903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.202397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.202833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.281853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.283332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.283958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.285532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.286182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.287428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.352222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:04:00.366339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for user f3b14e05c41648159d8ed97719c68862 and project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:04:00.614689 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-66f5befa-f7df-4507-9863-9900535219d0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8/action" status: 202 len: 0 microversion: 2.1 time: 0.481369 Oct 16 01:04:00.621530 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 494/1045] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:00 2022] POST /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:00.626488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:00.627358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:00.639886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.640546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.640993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:00.646121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:00.646607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:00.647090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:01.099991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:01.108630 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e5811e42-de13-4129-9fe7-8a5e53fab89c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 0.486804 Oct 16 01:04:01.109232 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 495/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:00 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:01.127815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-66064742"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:01.130074 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:01.167262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:01.167757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:01.168197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:01.168911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:01.169368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:01.169790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:01.550542 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a3d3d4b8-1505-4559-9f39-ece95f40bea8 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.611566 Oct 16 01:04:01.550542 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 552/1047] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:03:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:01.554263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52fbac95-95d7-4451-8e68-515a6167c8f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e3d7ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:01.691663 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:01.698701 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52fbac95-95d7-4451-8e68-515a6167c8f8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.148324 Oct 16 01:04:01.699149 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 553/1048] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:01 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:01.726263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:01.742335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:01.756778 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a3616929-b29b-4236-88f3-e985645e3367 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e/action" status: 202 len: 0 microversion: 2.1 time: 0.645511 Oct 16 01:04:01.758020 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 496/1049] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:01 2022] POST /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:04:01.763997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-34be69d4-d2dc-4d33-9b17-756370882e35 req-6c0e235b-5667-48f7-bfb0-cd7ebd9032bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12066daa-d04c-4f73-b4ee-45b8a17cecc8", "name": "network-vif-plugged", "status": "completed", "tag": "462f1588-13d7-4346-bf9e-fb24a7f41f90"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:01.777889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-34be69d4-d2dc-4d33-9b17-756370882e35 req-6c0e235b-5667-48f7-bfb0-cd7ebd9032bf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:01.779015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-34be69d4-d2dc-4d33-9b17-756370882e35 req-6c0e235b-5667-48f7-bfb0-cd7ebd9032bf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:01.779854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-34be69d4-d2dc-4d33-9b17-756370882e35 req-6c0e235b-5667-48f7-bfb0-cd7ebd9032bf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:01.802263 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-34be69d4-d2dc-4d33-9b17-756370882e35 req-6c0e235b-5667-48f7-bfb0-cd7ebd9032bf service nova] Creating event network-vif-plugged:462f1588-13d7-4346-bf9e-fb24a7f41f90 for instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 on n-h2-master-1 Oct 16 01:04:01.808297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:01.808892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:01.809340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:01.812933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-34be69d4-d2dc-4d33-9b17-756370882e35 req-6c0e235b-5667-48f7-bfb0-cd7ebd9032bf service nova] Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:04:01.819239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:01.819775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:01.821169 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-34be69d4-d2dc-4d33-9b17-756370882e35 req-6c0e235b-5667-48f7-bfb0-cd7ebd9032bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061293 Oct 16 01:04:01.822274 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 497/1050] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:01.825518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:01.829474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cfb46996-6c46-4cbb-964a-4a9a55eab33c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e210dc0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:01.884111 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cfb46996-6c46-4cbb-964a-4a9a55eab33c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.059592 Oct 16 01:04:01.885726 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 498/1051] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:01 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:02.011865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1770335289", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "8b1499e7-a562-4896-ac36-445314ab5b9f"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:02.108080 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:02.150443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:02.161909 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1bf93ac5-7670-41d4-ab7a-b14e0faa1f09 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1469 microversion: 2.1 time: 0.447958 Oct 16 01:04:02.162487 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 554/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:01 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1469 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:02.170660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:02.171288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:02.217597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] validate_networks() for [('8b1499e7-a562-4896-ac36-445314ab5b9f', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:04:02.219242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:02.219742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:02.220828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:02.222214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:02.224076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:02.224076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:03.185021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:03.195498 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c977172a-fc61-4b9f-a457-3873e9ac1724 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 1.030948 Oct 16 01:04:03.196640 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 555/1053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:02 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:03.206015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d93822df-a777-41c8-bfa6-ce848784ccb3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4dbaf0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:03.290182 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d93822df-a777-41c8-bfa6-ce848784ccb3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.090498 Oct 16 01:04:03.291247 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 556/1054] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:03 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:03.297814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8fc42971-6964-4b05-9748-dfa6c05606ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e542820>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:03.495624 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8fc42971-6964-4b05-9748-dfa6c05606ea tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.202369 Oct 16 01:04:03.496335 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 557/1055] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:03 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:03.509757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:03.518311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:03.540955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:03.541465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:03.552629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:03.553814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:03.554310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:03.567933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:03.786688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:04:03.787287 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:04:03.787696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:04:03.788103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:04:03.789211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:04:03.805893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:03.806380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:03.806814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:03.808577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:03.809420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:03.810490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:03.845287 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Getting quotas for project 7776307d685b47fe8beca919b5f90966. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:04:03.850848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Getting quotas for user 8cd01d53807440fd827b41778a54627a and project 7776307d685b47fe8beca919b5f90966. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:04:03.865969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:04:03.868794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:04:03.950134 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-435e98ce-b9b0-40e6-bd5c-c317c5871267 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944935 Oct 16 01:04:03.953261 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 499/1056] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:04:03.963626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ec9b2ce5-0f31-45bb-8551-f82325affff6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:03.965844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ec9b2ce5-0f31-45bb-8551-f82325affff6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:04.274108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ec9b2ce5-0f31-45bb-8551-f82325affff6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:04.286648 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ec9b2ce5-0f31-45bb-8551-f82325affff6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1224 microversion: 2.1 time: 0.325906 Oct 16 01:04:04.288474 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 500/1057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:03 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1224 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:04:04.304999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:04.305870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:04.329853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:04.330491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:04.330960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:04.331699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:04.334993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:04.335516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:04.398299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:04.417634 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec8150ec-17d5-4528-8267-2feb6e0c569d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1469 microversion: 2.1 time: 0.918079 Oct 16 01:04:04.418909 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 558/1058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:03 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1469 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:04.432144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2001e88d-03fb-4205-ae0e-38f460b26446 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e419c10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:04.563304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2001e88d-03fb-4205-ae0e-38f460b26446 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.140868 Oct 16 01:04:04.564608 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 559/1059] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:04 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:04.576569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0154d66c-57e5-4030-b187-25913fa5b834 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e62ac10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:04.726954 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0154d66c-57e5-4030-b187-25913fa5b834 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.160247 Oct 16 01:04:04.731645 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 560/1060] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:04 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:04.827938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:04.862506 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b0323cf-2806-41ba-8d81-0468b6cb42c1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1471 microversion: 2.1 time: 0.565808 Oct 16 01:04:04.872441 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 501/1061] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:04 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:05.318121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:05.319278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:05.326742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:05.327478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:05.328100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:05.329051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:05.329710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:05.330483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:05.450153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:05.451528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:05.474460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:05.477418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:05.479267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:05.492125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:05.493000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:05.494555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:05.718561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:05.743019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-efc6e2ac-f600-42bc-8f46-eea76b00c966 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1276 microversion: 2.1 time: 0.429908 Oct 16 01:04:05.761096 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 561/1062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:05 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1276 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:05.775936 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f3fc3ab8-a11f-4d1e-944a-7e2297785ac7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e3a84c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:05.874638 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f3fc3ab8-a11f-4d1e-944a-7e2297785ac7 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.112360 Oct 16 01:04:05.875627 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 562/1063] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:05 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:05.900486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a57172f4-12f4-4f86-a381-9547b4afcc8d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e4db160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:05.995019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a57172f4-12f4-4f86-a381-9547b4afcc8d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.118037 Oct 16 01:04:05.996273 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 563/1064] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:05 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:06.001368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:06.002515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:06.010231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:06.011032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:06.011650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:06.012698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:06.013331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:06.014501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:06.076286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:06.088334 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0b185194-4823-480b-9cd1-419aded87fb3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1469 microversion: 2.1 time: 0.649468 Oct 16 01:04:06.094525 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 502/1065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:05 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1469 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:06.578348 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:06.598713 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-df6ac75e-6b2a-449b-a2cf-ee2a900e433d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1489 microversion: 2.1 time: 0.600864 Oct 16 01:04:06.600011 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 564/1066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:05 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1489 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:06.766483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:06.767876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:06.785774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:06.790112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:06.791562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:06.796325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:06.800472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:06.800973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:06.891024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-402ddaf3-af9d-41d5-a197-a0f1f0b17492 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e3dbaf0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:06.953201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:06.955215 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-402ddaf3-af9d-41d5-a197-a0f1f0b17492 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1455 microversion: 2.1 time: 0.068019 Oct 16 01:04:06.969479 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 565/1067] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:06 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:04:06.976177 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-12c6051d-4ea7-48da-8960-a79904698d64 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1282 microversion: 2.1 time: 0.213984 Oct 16 01:04:06.988850 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 503/1068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:06 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:07.012887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a836b084-2d9b-4c51-af6c-3adee5922d43 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e3beb80>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:07.109047 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a836b084-2d9b-4c51-af6c-3adee5922d43 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.100233 Oct 16 01:04:07.109939 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 566/1069] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:07 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:07.126092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:07.129310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:07.141505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:07.145204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:07.146000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:07.147873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:07.148393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:07.148997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:07.475358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1810746157", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "a5e706d8-a668-4337-ad37-edd049e6eb97"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:07.521318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:07.530907 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2838dcd3-dc82-4511-bcc1-5654955dc832 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1469 microversion: 2.1 time: 0.410377 Oct 16 01:04:07.533589 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 504/1070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:07 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:07.567299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b46acaad-1c18-4b8c-8214-4f4214ee3fef req-99e72c51-0e96-4002-91ee-a2631bc5dea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9930a3af-2106-418e-87a8-a959ce89905e", "name": "network-vif-plugged", "status": "completed", "tag": "1bf8e6b8-2014-4792-9b67-18c9f48d806a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:07.590072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b46acaad-1c18-4b8c-8214-4f4214ee3fef req-99e72c51-0e96-4002-91ee-a2631bc5dea2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:07.590901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b46acaad-1c18-4b8c-8214-4f4214ee3fef req-99e72c51-0e96-4002-91ee-a2631bc5dea2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:07.591599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b46acaad-1c18-4b8c-8214-4f4214ee3fef req-99e72c51-0e96-4002-91ee-a2631bc5dea2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:07.594598 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] validate_networks() for [('a5e706d8-a668-4337-ad37-edd049e6eb97', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:04:07.615561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b46acaad-1c18-4b8c-8214-4f4214ee3fef req-99e72c51-0e96-4002-91ee-a2631bc5dea2 service nova] Creating event network-vif-plugged:1bf8e6b8-2014-4792-9b67-18c9f48d806a for instance 9930a3af-2106-418e-87a8-a959ce89905e on n-h2-master-1 Oct 16 01:04:07.623477 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b46acaad-1c18-4b8c-8214-4f4214ee3fef req-99e72c51-0e96-4002-91ee-a2631bc5dea2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088131 Oct 16 01:04:07.624533 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 505/1071] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:07.631766 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:07.632896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:07.641215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:07.644036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:07.644891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:07.646430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:07.647349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:07.649028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.363653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:08.375922 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c804e2dd-41b3-4991-a159-16d78a742c16 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1477 microversion: 2.1 time: 0.749774 Oct 16 01:04:08.378052 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 506/1072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:07 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1477 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:08.396261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a58f30d4-82b2-4731-af05-39fcaeaca9c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e18ef70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:08.461909 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a58f30d4-82b2-4731-af05-39fcaeaca9c3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1464 microversion: 2.1 time: 0.081605 Oct 16 01:04:08.463206 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 507/1073] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:08 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:08.469869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:08.471270 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:08.479051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.479917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.480566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.481580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.482243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.482875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.700740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:08.711331 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a1de0703-648b-42ec-800b-f75d8e941afd tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1324 microversion: 2.1 time: 0.246279 Oct 16 01:04:08.711916 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 508/1074] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:08 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:08.729854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-69994672-f593-47a9-8257-9a8e6bd25a31 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e168820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:08.796632 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-69994672-f593-47a9-8257-9a8e6bd25a31 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.071776 Oct 16 01:04:08.807497 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 509/1075] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:08 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:08.814512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:08.815674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:08.826289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.829100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.830679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.832179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.833801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.834702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.866551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:04:08.867662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:04:08.868340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:04:08.874309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:04:08.877970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:04:08.898579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.899621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.900306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.901371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:08.902107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:08.904957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:08.930118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for project 05a68224ef104af2963c881faa8383de. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:04:08.935539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for user 3c33afd9ae144eb185203c30baa70351 and project 05a68224ef104af2963c881faa8383de. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:04:08.949926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:04:08.952517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:04:08.999112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid 981200a2-5a9d-469f-9f65-ad75dbe1b422 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:09.011900 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9438651e-6464-4f59-9365-b1eb8b6eada3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770918 Oct 16 01:04:09.012969 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 567/1076] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:04:09.015565 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-15a2a9f3-2569-44fe-b620-b90f44cbf23c tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 2420 microversion: 2.25 time: 0.206502 Oct 16 01:04:09.016587 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 510/1077] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:08 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 2420 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:09.022345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4cbd110b-dff9-4982-a0ee-dcbcc51c8557 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e1a6dc0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:09.095945 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4cbd110b-dff9-4982-a0ee-dcbcc51c8557 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 200 len: 1464 microversion: 2.1 time: 0.074528 Oct 16 01:04:09.096452 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 511/1078] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:09 2022] GET /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 1464 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:09.104800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:09.107831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:09.125730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.130176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.131089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.132037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.132815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.133761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.262603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3e58f1f3-6598-436e-ac31-9ab10b95fe6f"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:09.265257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:09.280255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.280741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.281168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.283982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.284545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.285332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.358292 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:09.370016 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-953891f0-a6d4-4e4e-a5bf-4e495ce13539 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1469 microversion: 2.1 time: 0.271724 Oct 16 01:04:09.389803 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 512/1079] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:09 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:09.396368 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0467fe9e-29cf-403b-bcae-02d752dd52f8 req-ff523306-1fee-4f36-8825-4b0b9f6a434e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd8bea2-cfe6-4678-b296-002942b54485", "tag": "b7ce8315-f4dd-4628-b68f-68b9f4a5761f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:09.410253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0467fe9e-29cf-403b-bcae-02d752dd52f8 req-ff523306-1fee-4f36-8825-4b0b9f6a434e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.410607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0467fe9e-29cf-403b-bcae-02d752dd52f8 req-ff523306-1fee-4f36-8825-4b0b9f6a434e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.411064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0467fe9e-29cf-403b-bcae-02d752dd52f8 req-ff523306-1fee-4f36-8825-4b0b9f6a434e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.441545 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0467fe9e-29cf-403b-bcae-02d752dd52f8 req-ff523306-1fee-4f36-8825-4b0b9f6a434e service nova] Creating event network-changed:b7ce8315-f4dd-4628-b68f-68b9f4a5761f for instance ccd8bea2-cfe6-4678-b296-002942b54485 on n-h1-master-1 Oct 16 01:04:09.466100 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0467fe9e-29cf-403b-bcae-02d752dd52f8 req-ff523306-1fee-4f36-8825-4b0b9f6a434e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074797 Oct 16 01:04:09.467840 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 513/1080] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:09.494464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e09fae03-3b10-4a44-a7e7-03ff6ad23b71 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:09.495611 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e09fae03-3b10-4a44-a7e7-03ff6ad23b71 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:09.576792 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e09fae03-3b10-4a44-a7e7-03ff6ad23b71 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:09.592183 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e09fae03-3b10-4a44-a7e7-03ff6ad23b71 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1211 microversion: 2.1 time: 0.122920 Oct 16 01:04:09.593531 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 514/1081] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:09 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1211 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:09.599068 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:09.603794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:09.613996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.614890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.615821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.618770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.619742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.620548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.655708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'flavor' on Instance uuid 981200a2-5a9d-469f-9f65-ad75dbe1b422 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:09.660401 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] HTTP exception thrown: Volume 3e58f1f3-6598-436e-ac31-9ab10b95fe6f could not be found. Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Request method failure captured: Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments/31e62b53-de58-45ca-8436-c06a8f9380aa HTTP/1.1 Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 74 Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1gimhNJ1shjNh_HNY6zfsXHQ-rrZ4jmvrVABa4Q77FiDKB9ZJ89bd4exC5m9vFd8n3oWNM6HL2kxwUJg77F1fVfG8VhEQ-x34rePFZe9llIGxAJVxe6IzCtoF63i3naqAIf8ghaabn9gtx4DJKpwS6wqxVnsqwh9fsE3HjgUt1oMMc Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 9a8b7d6b98284f61849a7ef4350a2abe Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesAdminNegativeTest-86393841 Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:04:09.665744 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9a8b7d6b98284f61849a7ef4350a2abe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9a8b7d6b98284f61849a7ef4350a2abe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9a8b7d6b98284f61849a7ef4350a2abe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9a8b7d6b98284f61849a7ef4350a2abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesAdminNegativeTest-86393841 Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 9a8b7d6b98284f61849a7ef4350a2abe Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-86393841 Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesAdminNegativeTest-86393841-project-admin Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 3b1244bc039d4645b2c813b77b1593cd Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesAdminNegativeTest-86393841-project-admin Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: {"volumeAttachment": {"volumeId": "3e58f1f3-6598-436e-ac31-9ab10b95fe6f"}} Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:04:09.667177 n-d-master-1 devstack@n-api.service[120545]: exception: Volume 3e58f1f3-6598-436e-ac31-9ab10b95fe6f could not be found. Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': '032f3033-6ed6-434b-a124-9edf48c5554e', 'id': '31e62b53-de58-45ca-8436-c06a8f9380aa', 'body': {'volumeAttachment': {'volumeId': '3e58f1f3-6598-436e-ac31-9ab10b95fe6f'}}} Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:09.668365 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e58f1f3-6598-436e-ac31-9ab10b95fe6f could not be found. (HTTP 404) (Request-ID: req-7d6d217b-c188-474b-881c-37abd65eaa1d) Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:09.669454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e58f1f3-6598-436e-ac31-9ab10b95fe6f could not be found. Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:09.671639 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 3e58f1f3-6598-436e-ac31-9ab10b95fe6f could not be found. Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e58f1f3-6598-436e-ac31-9ab10b95fe6f could not be found. Oct 16 01:04:09.673588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:09.675247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Returning 400 to user: Volume 3e58f1f3-6598-436e-ac31-9ab10b95fe6f could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:09.675247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-59881511-7f74-464a-86a7-dab554e770a7 tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] 10.222.0.39 "PUT /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments/31e62b53-de58-45ca-8436-c06a8f9380aa" status: 400 len: 107 microversion: 2.1 time: 0.653218 Oct 16 01:04:09.675247 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 568/1082] 10.222.0.39 () {60 vars in 1433 bytes} [Sun Oct 16 01:04:09 2022] PUT /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments/31e62b53-de58-45ca-8436-c06a8f9380aa => generated 107 bytes in 654 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:04:09.682193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Going to try to live migrate instance to n-h1-master-1 {{(pid=120546) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:04:09.695134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:09.695948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:09.697915 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:09.727213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.728195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.731241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.732049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.732658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.733160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.904752 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:09.914375 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83423958-955e-4c1b-a696-4203ad016a99 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 1468 microversion: 2.1 time: 0.245573 Oct 16 01:04:09.915281 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 569/1083] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:09 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 1468 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:09.920924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:09.927821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:09.934956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.935817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.936260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:09.936965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:09.937420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:09.938037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:10.081161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:10.089161 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4271bc49-509a-45d2-8da6-9084378f00bd tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1477 microversion: 2.1 time: 0.172522 Oct 16 01:04:10.089758 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 570/1084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:09 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:10.094333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-12f5cbb1-20e6-4939-89e3-bf2922a3cc24 req-061d6fd5-a6e4-420d-9464-a8f2e89d5b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5", "name": "network-vif-unplugged", "status": "completed", "tag": "62f88490-3555-4b72-88e6-cee67ed2ea99"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:10.106699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-12f5cbb1-20e6-4939-89e3-bf2922a3cc24 req-061d6fd5-a6e4-420d-9464-a8f2e89d5b35 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:10.107614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-12f5cbb1-20e6-4939-89e3-bf2922a3cc24 req-061d6fd5-a6e4-420d-9464-a8f2e89d5b35 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:10.108267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-12f5cbb1-20e6-4939-89e3-bf2922a3cc24 req-061d6fd5-a6e4-420d-9464-a8f2e89d5b35 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:10.127704 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-12f5cbb1-20e6-4939-89e3-bf2922a3cc24 req-061d6fd5-a6e4-420d-9464-a8f2e89d5b35 service nova] Creating event network-vif-unplugged:62f88490-3555-4b72-88e6-cee67ed2ea99 for instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 on n-h2-master-1 Oct 16 01:04:10.143472 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-12f5cbb1-20e6-4939-89e3-bf2922a3cc24 req-061d6fd5-a6e4-420d-9464-a8f2e89d5b35 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050767 Oct 16 01:04:10.148506 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 571/1085] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:10.154556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:10.160368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:10.183958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:10.184457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:10.184895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:10.185605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:10.186064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:10.186562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:10.367263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:10.379149 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-62daeb58-79ca-4c7f-a2cd-2bd656bb7a1c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1324 microversion: 2.1 time: 0.228972 Oct 16 01:04:10.380320 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 572/1086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:10 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:10.386260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:10.386947 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:10.393880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:10.394602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:10.395415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:10.395935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:10.396575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:10.397004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:10.579775 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lazy-loading 'services' on Instance uuid 032f3033-6ed6-434b-a124-9edf48c5554e {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:10.715417 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d0dc667-4426-4b6c-907a-a36a4ed6f66f tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments/31e62b53-de58-45ca-8436-c06a8f9380aa" status: 202 len: 0 microversion: 2.1 time: 0.332994 Oct 16 01:04:10.716568 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 573/1087] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:04:10 2022] DELETE /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments/31e62b53-de58-45ca-8436-c06a8f9380aa => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:10.724352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3fe2bebb-72b8-4966-8312-0e58497accbd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e3db310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:10.801219 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3fe2bebb-72b8-4966-8312-0e58497accbd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.082998 Oct 16 01:04:10.803419 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 574/1088] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:10 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:10.818684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-425777428"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:10.822532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:10.835010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:10.835816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:10.836250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:10.836946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:10.837553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:10.856073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:11.276327 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2973ea1b-1ab8-48c1-a0b5-d2014fe261ac tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "POST /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085/action" status: 202 len: 0 microversion: 2.1 time: 0.471275 Oct 16 01:04:11.285530 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 575/1089] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:10 2022] POST /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:04:11.291071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:11.296076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:11.313134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:11.315878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:11.318029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:11.319246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:11.321206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:11.321680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:11.650729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:11.659868 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:11.668456 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c632263d-6e45-42dd-b4ae-3092debfaec6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1469 microversion: 2.1 time: 0.380661 Oct 16 01:04:11.670957 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 576/1090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:11 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:11.693847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:11.698258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:11.716683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:11.718441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:11.719501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:11.721296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:11.722193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:11.723045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:11.860888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:11.874252 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1dbb9d9a-c333-4aab-93a8-e7397418994c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1263 microversion: 2.1 time: 0.201189 Oct 16 01:04:11.875815 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 577/1091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:11 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1263 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:11.883273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:11.886267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:11.910800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:11.911843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:11.912530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:11.914277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:11.915049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:11.915662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:11.981632 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71a72627-d230-48f9-b23d-c43d7909a22e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104202 Oct 16 01:04:11.982423 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 578/1092] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:11 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:11.995054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:11.996096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:12.012795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.014691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.016147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:12.018529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.021385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.022781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:12.340446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:12.350851 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3dbbef52-21ac-4790-a596-def418b9c006 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1477 microversion: 2.1 time: 0.360891 Oct 16 01:04:12.363930 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 579/1093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:11 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1477 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:12.374744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91dcb9d2-3af0-4502-8ad1-364c5f9df89f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e387310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:12.456686 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91dcb9d2-3af0-4502-8ad1-364c5f9df89f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837" status: 200 len: 1454 microversion: 2.1 time: 0.091461 Oct 16 01:04:12.458539 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 580/1094] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:12 2022] GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:12.464614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:12.465226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:12.473464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.474064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.474691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:12.475702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.476334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.476927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:12.633992 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-15c3e195-d456-491a-ba0a-6d5a01b8f450 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/action" status: 202 len: 0 microversion: 2.25 time: 3.039046 Oct 16 01:04:12.635889 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 515/1095] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:04:09 2022] POST /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/action => generated 0 bytes in 3041 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:04:12.658778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d07f6ccc-6742-4099-bc87-6dbce47e47f5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e1a6f70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:12.727577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:12.748204 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d4b83e2c-0d71-4226-b1fa-758e230413b2 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1324 microversion: 2.1 time: 0.287745 Oct 16 01:04:12.773844 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 581/1096] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:12 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:12.794069 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d07f6ccc-6742-4099-bc87-6dbce47e47f5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.156316 Oct 16 01:04:12.794733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a8e0f481-413f-4f92-a0be-5a4e8c42143f req-ac94d667-06ca-4a4f-b09b-311e0bfee33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4495b959-d827-46f4-92c3-05b9b91c2020", "name": "network-vif-unplugged", "status": "completed", "tag": "ca157844-15f0-450a-862c-cca64f9f972e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:12.795358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 516/1097] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:12 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:12.806901 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:12.812315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:12.822120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a8e0f481-413f-4f92-a0be-5a4e8c42143f req-ac94d667-06ca-4a4f-b09b-311e0bfee33e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.823120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a8e0f481-413f-4f92-a0be-5a4e8c42143f req-ac94d667-06ca-4a4f-b09b-311e0bfee33e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.824280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a8e0f481-413f-4f92-a0be-5a4e8c42143f req-ac94d667-06ca-4a4f-b09b-311e0bfee33e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:12.832425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.833321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.834861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:12.836834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.851564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.852829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:12.870407 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a8e0f481-413f-4f92-a0be-5a4e8c42143f req-ac94d667-06ca-4a4f-b09b-311e0bfee33e service nova] Creating event network-vif-unplugged:ca157844-15f0-450a-862c-cca64f9f972e for instance 4495b959-d827-46f4-92c3-05b9b91c2020 on n-h1-master-1 Oct 16 01:04:12.876708 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a8e0f481-413f-4f92-a0be-5a4e8c42143f req-ac94d667-06ca-4a4f-b09b-311e0bfee33e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098369 Oct 16 01:04:12.877635 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 582/1098] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:12.883480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:12.884310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:12.910891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.915718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.916527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:12.918229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:12.918960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:12.919825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.216513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:13.232580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:13.234039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:13.235264 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ec0b5d5c-d8aa-4b1a-beb0-9867b6425b99 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.437499 Oct 16 01:04:13.235900 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 517/1099] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:12 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:13.253686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:13.262199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:13.263740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:13.279027 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-878507bb-18e5-4cd9-ae2c-b30b971877e6 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1535 microversion: 2.1 time: 0.395061 Oct 16 01:04:13.279960 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 583/1100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:12 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1535 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:13.283362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:13.284213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:13.284824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.287094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:13.288817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:13.290968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.291127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:13.293176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:13.308860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:13.309481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:13.310048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.311029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:13.311660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:13.312160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.422935 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-54c4dfec-2a92-4b68-b716-3c70a05aed65 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141897 Oct 16 01:04:13.427039 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 584/1101] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:13 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:13.439718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:13.439976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:13.465441 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:13.477958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:13.479798 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-caf3bd52-231d-40fa-b5ab-19815c0b8c23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1271 microversion: 2.1 time: 0.242836 Oct 16 01:04:13.480493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:13.481340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.482776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:13.483452 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 518/1102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:13 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:13.487527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:13.489526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.496787 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f57ec45e-748f-466d-a9a5-4ec69d73d10b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e149940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:13.615405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f57ec45e-748f-466d-a9a5-4ec69d73d10b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837" status: 200 len: 1454 microversion: 2.1 time: 0.130672 Oct 16 01:04:13.617367 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 519/1103] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:13 2022] GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837 => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:13.777431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:13.778063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:13.793445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:13.794226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:13.795387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.797686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:13.799570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:13.802729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:13.842196 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=5 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:13.847008 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:13.864453 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-23d24b14-32e6-430a-8b36-1d670b256873 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1477 microversion: 2.1 time: 0.434685 Oct 16 01:04:13.865198 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 585/1104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:13 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1477 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:13.880510 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1a21bb8c-d905-4539-a00d-dda865d94e95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e387790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:13.972467 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1a21bb8c-d905-4539-a00d-dda865d94e95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.104786 Oct 16 01:04:13.973158 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 586/1105] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:13 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:14.090427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:14.100592 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-447f6d39-1d05-4fb9-ab44-60a8450432f0 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1324 microversion: 2.1 time: 0.327672 Oct 16 01:04:14.101559 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 520/1106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:13 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:14.270610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:14.271077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:14.288711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.289213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.289650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.290612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.291102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.291532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.309720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:14.310331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:14.325159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.325726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.326291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.342975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.347468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.354453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.365049 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:14.599381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:14.602399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:14.624975 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfb1efe2-4d68-40c4-88aa-7957ab4f931e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1535 microversion: 2.1 time: 0.321130 Oct 16 01:04:14.625928 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:14.628937 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 521/1107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:14 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1535 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:14.632376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:14.636230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:14.637891 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b62fe28c-56e4-48f1-9f5a-5d18242477fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.372020 Oct 16 01:04:14.639205 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 587/1108] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:14 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:14.645126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:14.647843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:14.650529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:14.657411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.662424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.663235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.663868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.665599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.666266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.666976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.667621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.668247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.671649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.672356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.673176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.750857 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d486833-66a9-4d5f-938f-5087cc70434d tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120534 Oct 16 01:04:14.752463 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 522/1109] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:14 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:14.757299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9f3ee2df-a54c-453e-9df9-11ca3e49cd08 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e18e1f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:14.808090 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9f3ee2df-a54c-453e-9df9-11ca3e49cd08 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837" status: 200 len: 1454 microversion: 2.1 time: 0.054317 Oct 16 01:04:14.808745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:14.809607 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 523/1110] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:14 2022] GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:14.837680 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4b802af0-e82f-4109-9d61-6efcc1ed64cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1269 microversion: 2.1 time: 0.197193 Oct 16 01:04:14.838280 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 588/1111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:14 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1269 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:14.893243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:14.894205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:14.906282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.907130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.908424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.910564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.911294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.912442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:14.951977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-427d39d9-487e-4513-b36c-9ef3ac84675d req-9a0d6975-57dd-46f9-8654-c3d945cf97a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12066daa-d04c-4f73-b4ee-45b8a17cecc8", "name": "network-vif-unplugged", "status": "completed", "tag": "462f1588-13d7-4346-bf9e-fb24a7f41f90"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:14.976535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-427d39d9-487e-4513-b36c-9ef3ac84675d req-9a0d6975-57dd-46f9-8654-c3d945cf97a3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:14.979736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-427d39d9-487e-4513-b36c-9ef3ac84675d req-9a0d6975-57dd-46f9-8654-c3d945cf97a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:14.983069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-427d39d9-487e-4513-b36c-9ef3ac84675d req-9a0d6975-57dd-46f9-8654-c3d945cf97a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:15.049318 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-427d39d9-487e-4513-b36c-9ef3ac84675d req-9a0d6975-57dd-46f9-8654-c3d945cf97a3 service nova] Creating event network-vif-unplugged:462f1588-13d7-4346-bf9e-fb24a7f41f90 for instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 on n-h2-master-1 Oct 16 01:04:15.073098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-427d39d9-487e-4513-b36c-9ef3ac84675d req-9a0d6975-57dd-46f9-8654-c3d945cf97a3 service nova] Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:04:15.087483 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-427d39d9-487e-4513-b36c-9ef3ac84675d req-9a0d6975-57dd-46f9-8654-c3d945cf97a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139151 Oct 16 01:04:15.090423 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 589/1112] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:15.099665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb3b87f2-cc06-415e-85fd-70ff331d3936 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e3dbe50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:15.173726 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb3b87f2-cc06-415e-85fd-70ff331d3936 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.080492 Oct 16 01:04:15.175683 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 590/1113] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:15 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:15.180731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:15.181716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:15.194349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:15.195253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:15.195946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:15.196882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:15.197566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:15.198212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:15.231417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:15.250888 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be3801da-2ca3-4d4b-bf68-2ee5b0036f35 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1477 microversion: 2.1 time: 0.362904 Oct 16 01:04:15.267605 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 524/1114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:14 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:15.431297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:15.439992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-099c1b8e-b992-4e9d-ada9-3f3289e85177 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1324 microversion: 2.1 time: 0.263025 Oct 16 01:04:15.445587 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 591/1115] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:15 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:15.652747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:15.653369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:15.668662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:15.669158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:15.669593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:15.678158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:15.679123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:15.679528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:15.679653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:15.680049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:15.690463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:15.692568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:15.693236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:15.694487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:15.701441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:15.702288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.061943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:16.081284 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-896490c5-a23f-4e4d-9fcc-289c19c941ac tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1535 microversion: 2.1 time: 0.432804 Oct 16 01:04:16.082694 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 525/1116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:15 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1535 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:16.099953 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.113428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:16.120315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:16.131736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:16.132478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:16.133138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.134040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:16.134790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:16.137350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:16.138059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.144182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:16.146894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0b57a217-c0ce-4060-8618-bf003cc91d7b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.473643 Oct 16 01:04:16.163648 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 592/1117] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:15 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:16.178677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89e6d7cd-d26d-4b85-8b3c-1346e65cf9a1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e3dbe50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.202716 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6cc2e6cd-9f8d-486c-8540-bea156d511ec tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112054 Oct 16 01:04:16.203721 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 526/1118] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:16.208696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.209570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:16.224951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:16.225699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:16.226289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.227204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:16.227813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:16.228394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.318672 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89e6d7cd-d26d-4b85-8b3c-1346e65cf9a1 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837" status: 200 len: 1454 microversion: 2.1 time: 0.145921 Oct 16 01:04:16.320332 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 593/1119] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:16.340432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-274026b9-e421-484a-a452-68756c363d9a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e3a84c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.430496 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-274026b9-e421-484a-a452-68756c363d9a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1412 microversion: 2.1 time: 0.099143 Oct 16 01:04:16.440806 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 594/1120] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:16.446159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.447017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:16.453817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:16.455426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:16.456019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.456910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:16.457521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:16.458098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.510464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:16.519998 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9370e0db-40e9-4ab0-b34f-caf5b52a5145 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1311 microversion: 2.1 time: 0.315008 Oct 16 01:04:16.524294 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 527/1121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:16.533530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:16.535620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:16.566586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:16.567347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:16.568038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.568935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:16.569594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:16.570198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:16.760367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:16.779604 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ce6072db-2b7e-44c9-82b8-02391db48c62 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1477 microversion: 2.1 time: 0.336986 Oct 16 01:04:16.785011 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 595/1122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:16.865232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:16.875109 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8fb04098-5ae0-416a-9b91-ebd831edbd15 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1324 microversion: 2.1 time: 0.349401 Oct 16 01:04:16.885542 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 528/1123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:16 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:17.106265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:17.107352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:17.122506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:17.123037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:17.136193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:17.137029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:17.137529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:17.137973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:17.180673 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:17.181337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:17.213674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:17.214245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:17.217777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:17.218590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:17.223790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:17.224252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:17.773432 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:17.792823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:17.799826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:17.801264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:17.802333 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-337faaf8-b12b-49d6-b9c1-2c4e03ab4d4f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.626177 Oct 16 01:04:17.803546 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 529/1124] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:17 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:17.811237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:17.812190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6fdf3886-6ebd-48e7-a74a-509f3e4e0b86 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1535 microversion: 2.1 time: 0.709723 Oct 16 01:04:17.815665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:17.817539 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 596/1125] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:17 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1535 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:17.824340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:17.825179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:17.825828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:17.826875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:17.827693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:17.828274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:17.832761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f0a39503-c134-4989-b30e-af6f1a977a26 req-21d89d65-6c26-499a-af80-327f1e8f8ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd8bea2-cfe6-4678-b296-002942b54485", "name": "network-vif-plugged", "status": "completed", "tag": "b7ce8315-f4dd-4628-b68f-68b9f4a5761f"}, {"server_uuid": "ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5", "name": "network-vif-plugged", "status": "completed", "tag": "62f88490-3555-4b72-88e6-cee67ed2ea99"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:17.871931 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd81bd6c-8c4a-4841-9cfc-5b094728b9c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067125 Oct 16 01:04:17.873398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f0a39503-c134-4989-b30e-af6f1a977a26 req-21d89d65-6c26-499a-af80-327f1e8f8ea8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:17.873890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f0a39503-c134-4989-b30e-af6f1a977a26 req-21d89d65-6c26-499a-af80-327f1e8f8ea8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:17.875546 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 530/1126] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:17 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:17.882555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a62d2fe-df4b-470a-93f3-9d6eec150878 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e309f70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:17.882775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f0a39503-c134-4989-b30e-af6f1a977a26 req-21d89d65-6c26-499a-af80-327f1e8f8ea8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:17.930710 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f0a39503-c134-4989-b30e-af6f1a977a26 req-21d89d65-6c26-499a-af80-327f1e8f8ea8 service nova] Creating event network-vif-plugged:b7ce8315-f4dd-4628-b68f-68b9f4a5761f for instance ccd8bea2-cfe6-4678-b296-002942b54485 on n-h1-master-1 Oct 16 01:04:17.935004 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f0a39503-c134-4989-b30e-af6f1a977a26 req-21d89d65-6c26-499a-af80-327f1e8f8ea8 service nova] Creating event network-vif-plugged:62f88490-3555-4b72-88e6-cee67ed2ea99 for instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 on n-h2-master-1 Oct 16 01:04:17.975692 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f0a39503-c134-4989-b30e-af6f1a977a26 req-21d89d65-6c26-499a-af80-327f1e8f8ea8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.156796 Oct 16 01:04:17.976383 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 597/1127] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:17.998180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fbdeb455-f112-4543-a694-e042347761e3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e27a310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:18.917908 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:18.944911 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:19.620522 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=10 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:27.824324 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:27.870399 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=53 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:27.870673 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=45 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:27.929124 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=86 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:28.460498 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a62d2fe-df4b-470a-93f3-9d6eec150878 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837" status: 200 len: 1454 microversion: 2.1 time: 10.583422 Oct 16 01:04:28.468813 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 531/1128] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:17 2022] GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837 => generated 1454 bytes in 10585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:28.471878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fbdeb455-f112-4543-a694-e042347761e3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1421 microversion: 2.1 time: 10.490694 Oct 16 01:04:28.472576 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 598/1129] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:17 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1421 bytes in 10495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:28.474774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:28.479760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:28.480386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:28.484686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:28.493388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:28.494517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:28.495158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:28.496258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:28.496523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:28.497351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:28.497785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:28.498092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:28.507459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:28.508356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:28.508933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:28.509466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:28.719186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:28.733029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e95102a8-d6a1-456e-ace3-afff28c117aa tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1463 microversion: 2.1 time: 0.259151 Oct 16 01:04:28.735781 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 599/1130] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:28 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1463 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:28.741202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:28.742048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:28.745137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:28.750222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:28.750878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:28.752203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:28.753102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:28.753714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:28.754298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:28.754698 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7353c059-02ea-4b7c-b57a-0b03c2e6061c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1311 microversion: 2.1 time: 0.290200 Oct 16 01:04:28.756834 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 532/1131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:28 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1311 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:28.761492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:28.762316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:28.770202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:28.770756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:28.771302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:28.772055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:28.772727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:28.773342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.000668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:29.002876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:29.012408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:29.013933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:29.015283 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d0fb031-0434-4af6-a10d-4c73440dcb03 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 200 len: 1521 microversion: 2.1 time: 0.277623 Oct 16 01:04:29.015443 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ceff1d96-1d70-43dc-9d87-08d2c0636f05 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.257509 Oct 16 01:04:29.017671 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 600/1132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:28 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:29.029756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:29.031252 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 533/1133] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:28 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:29.036206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:29.040614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:29.042837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:29.047107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.047810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.049708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.050630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.051070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.051562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.051879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.051993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.052605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.052735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.053108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.053532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.123604 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a60f399a-cff3-4e8b-9b82-9c903f01a561 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091154 Oct 16 01:04:29.124327 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 534/1134] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:04:29 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:04:29.134626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9cc75875-4040-4b31-8671-2c1bc8afb1f9 req-7815065b-ec4b-4dcb-b951-669ed1a597da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae19d1c-0d21-4eb0-8323-93679f2c60c8", "tag": "a63778d8-206e-4f12-97a1-d377df5ddbe8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:29.145803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9cc75875-4040-4b31-8671-2c1bc8afb1f9 req-7815065b-ec4b-4dcb-b951-669ed1a597da service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.146637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9cc75875-4040-4b31-8671-2c1bc8afb1f9 req-7815065b-ec4b-4dcb-b951-669ed1a597da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.147354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9cc75875-4040-4b31-8671-2c1bc8afb1f9 req-7815065b-ec4b-4dcb-b951-669ed1a597da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.176515 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9cc75875-4040-4b31-8671-2c1bc8afb1f9 req-7815065b-ec4b-4dcb-b951-669ed1a597da service nova] Creating event network-changed:a63778d8-206e-4f12-97a1-d377df5ddbe8 for instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 on n-h1-master-1 Oct 16 01:04:29.183461 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9cc75875-4040-4b31-8671-2c1bc8afb1f9 req-7815065b-ec4b-4dcb-b951-669ed1a597da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057593 Oct 16 01:04:29.184505 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 535/1135] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:29.190025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1dc1c822-6d2d-4527-b769-2b4397a4ada0 req-7774595c-02af-4cd8-9fb7-b70d24c5b217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143c3ee9-153e-42d5-80b0-df5c3fe70085", "name": "network-vif-plugged", "status": "completed", "tag": "4a711534-6fc5-44d9-b654-ed82a1e4d7ad"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:29.218812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1dc1c822-6d2d-4527-b769-2b4397a4ada0 req-7774595c-02af-4cd8-9fb7-b70d24c5b217 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.219344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1dc1c822-6d2d-4527-b769-2b4397a4ada0 req-7774595c-02af-4cd8-9fb7-b70d24c5b217 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.219867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1dc1c822-6d2d-4527-b769-2b4397a4ada0 req-7774595c-02af-4cd8-9fb7-b70d24c5b217 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.243249 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1dc1c822-6d2d-4527-b769-2b4397a4ada0 req-7774595c-02af-4cd8-9fb7-b70d24c5b217 service nova] Creating event network-vif-plugged:4a711534-6fc5-44d9-b654-ed82a1e4d7ad for instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 on n-h1-master-1 Oct 16 01:04:29.248903 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1dc1c822-6d2d-4527-b769-2b4397a4ada0 req-7774595c-02af-4cd8-9fb7-b70d24c5b217 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062859 Oct 16 01:04:29.249785 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 536/1136] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:29.257131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7fb3f480-9517-4bee-aaed-42473557dbf0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e125f70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:29.291906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:29.301002 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e2ed4758-a741-4d90-aa67-836bbf64b2d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1528 microversion: 2.1 time: 0.279701 Oct 16 01:04:29.326149 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 601/1137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:29 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1528 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:29.334389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:29.335035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:29.350139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.350803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.351429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.352302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.352930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.354898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.355540 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7fb3f480-9517-4bee-aaed-42473557dbf0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 200 len: 1421 microversion: 2.1 time: 0.104323 Oct 16 01:04:29.356627 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 537/1138] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:29 2022] GET /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:29.363552 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.228"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:29.366412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:29.388223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.388723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.391426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.394255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.394749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.395726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.444274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:04:29.447808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquired lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:04:29.619834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:29.638070 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2fd2eb1-fca8-43b5-92a6-a2fdba54e62f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1463 microversion: 2.1 time: 0.310305 Oct 16 01:04:29.639053 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 602/1139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:29 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1463 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:29.645507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:29.646535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:29.659580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.660455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.671980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:29.674563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:29.675204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:29.675751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:30.015447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:30.028273 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-167037fd-6f84-4037-b1a5-31dc46c8f931 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1528 microversion: 2.1 time: 0.387907 Oct 16 01:04:30.029252 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 603/1140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:29 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1528 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:30.034077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f319067-7064-460e-b617-1eb41f1951a0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e3db3a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:30.691146 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f319067-7064-460e-b617-1eb41f1951a0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 204 len: 0 microversion: 2.1 time: 0.660553 Oct 16 01:04:30.691923 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 604/1141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:30 2022] DELETE /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:04:30.697493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-373797496", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "86231cee-28c1-455e-8b68-73fb209e04d9"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:30.756613 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] validate_networks() for [('86231cee-28c1-455e-8b68-73fb209e04d9', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:04:30.943281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:04:31.416425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:04:31.417483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:04:31.418119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:04:31.418635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:04:31.419289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:04:31.433692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.434457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.435107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.435996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.436645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.437358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.458045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Getting quotas for project 5eec6e034df149f8863b1b9ebacfaa81. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:04:31.464906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Getting quotas for user aceec71835c14681a2ff7d7285d87776 and project 5eec6e034df149f8863b1b9ebacfaa81. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:04:31.477780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:04:31.480169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:04:31.528167 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1dcbea3d-f8f9-4894-b6b9-03ec2e031be0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834942 Oct 16 01:04:31.531080 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 605/1142] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:04:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:04:31.540399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c5c02896-c7ec-4df2-9f93-b6e8e0f687d8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e3a8e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:31.636872 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c5c02896-c7ec-4df2-9f93-b6e8e0f687d8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837" status: 200 len: 1463 microversion: 2.1 time: 0.104686 Oct 16 01:04:31.637965 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 606/1143] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:31 2022] GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837 => generated 1463 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:31.646459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:31.650583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:31.659208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.660504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.661044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.662422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.663020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.663679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.716849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Updating instance_info_cache with network_info: [{"id": "3944e49d-d846-4923-940e-18c1f16c178f", "address": "fa:16:3e:73:05:57", "network": {"id": "8b1499e7-a562-4896-ac36-445314ab5b9f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1434734463-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7776307d685b47fe8beca919b5f90966", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3944e49d-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:04:31.733747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Releasing lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:04:31.734716 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-871889ac-eddf-4cbf-b097-387ddc4d2995 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action" status: 202 len: 0 microversion: 2.1 time: 2.376904 Oct 16 01:04:31.738500 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 538/1144] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:29 2022] POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action => generated 0 bytes in 2378 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:04:31.742703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:31.743321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:31.751695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.752235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.752724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.754009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.755148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.755983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.776702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:04:31.777361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:04:31.777918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:04:31.778515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:04:31.779030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:04:31.863349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:31.869811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.870309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.870745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.871495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.871953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.872386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.902342 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83e5fe60-514d-411e-b89c-59ccb258df06 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action" status: 202 len: 1067 microversion: 2.1 time: 0.261478 Oct 16 01:04:31.903378 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 607/1145] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:31 2022] POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action => generated 1067 bytes in 264 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 16 01:04:31.909647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:31.910293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:31.917199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.917535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.918345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.918655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:31.919136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:31.919720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:31.959742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:31.982032 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a8012cd-d465-4229-8b4e-b7deaed3db75 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1311 microversion: 2.1 time: 0.244959 Oct 16 01:04:31.986397 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 539/1146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:31 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1311 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:31.995687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54adeef2-5650-4e92-90cc-17f70043fd0f tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:32.019154 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-54adeef2-5650-4e92-90cc-17f70043fd0f tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] HTTP exception thrown: Flavor 71b7ff9b-5345-4015-976b-8e9511ad18fc could not be found. Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54adeef2-5650-4e92-90cc-17f70043fd0f tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Request method failure captured: Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/flavors/71b7ff9b-5345-4015-976b-8e9511ad18fc HTTP/1.1 Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ew8As6FwvUFmKfoaxnQOhq7vFECEnBmYa_Pl4O7A3ZABizyLe8To7WZ67kUKflGFehZPT1HETYz3WVUvZNmlM0DCuHnAqFJ-L2PD0id3ijJsyYUvMVqO5i1eErnAjRGYrdSy_qyAavEW00t5vwhGXPS6s89jKnjDyzRw5q16TVCYU Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f1dc88035f18493d8c713b47a35517ea Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-MigrationsAdminTest-327525074 Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:04:32.024234 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1dc88035f18493d8c713b47a35517ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1dc88035f18493d8c713b47a35517ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1dc88035f18493d8c713b47a35517ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1dc88035f18493d8c713b47a35517ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-MigrationsAdminTest-327525074 Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f1dc88035f18493d8c713b47a35517ea Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-MigrationsAdminTest-327525074 Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-MigrationsAdminTest-327525074-project-admin Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 6f6ea3b7518449b89a369107e12ee9cf Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-MigrationsAdminTest-327525074-project-admin Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: exception: Flavor 71b7ff9b-5345-4015-976b-8e9511ad18fc could not be found. Oct 16 01:04:32.026015 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '71b7ff9b-5345-4015-976b-8e9511ad18fc'} Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 71b7ff9b-5345-4015-976b-8e9511ad18fc could not be found. Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:32.026984 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 71b7ff9b-5345-4015-976b-8e9511ad18fc could not be found. Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 71b7ff9b-5345-4015-976b-8e9511ad18fc could not be found. Oct 16 01:04:32.028573 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:32.029946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54adeef2-5650-4e92-90cc-17f70043fd0f tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Returning 404 to user: Flavor 71b7ff9b-5345-4015-976b-8e9511ad18fc could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:32.029946 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-54adeef2-5650-4e92-90cc-17f70043fd0f tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/71b7ff9b-5345-4015-976b-8e9511ad18fc" status: 404 len: 109 microversion: 2.1 time: 0.040416 Oct 16 01:04:32.034047 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 540/1147] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:31 2022] DELETE /compute/v2.1/flavors/71b7ff9b-5345-4015-976b-8e9511ad18fc => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:32.059111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:32.059687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:32.069313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.069893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.070397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.071328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.071866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.072359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.108445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:04:32.177778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:32.187077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:32.188882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:32.207258 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-717f00ff-bc47-405c-8fdf-3aec83775bfe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.286845 Oct 16 01:04:32.208615 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 608/1148] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:31 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:32.213550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-482c0f8e-e934-47dc-a4c1-0f9495bbaeb5 req-f45c7a68-fce2-4b8c-a148-008c33283ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80668ef9-fa93-48b1-b507-d7b4a7de0afb", "tag": "3944e49d-d846-4923-940e-18c1f16c178f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:32.237184 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-065d45d9-bfd6-48ba-9919-4952edf1ba29 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 204 len: 0 microversion: 2.1 time: 0.192127 Oct 16 01:04:32.238040 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 541/1149] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:32 2022] DELETE /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:04:32.243888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c37a3236-57e4-43d4-bc15-86ab6f23cefc req-65c26ae6-a9b2-450d-8b02-97865dd9e58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12066daa-d04c-4f73-b4ee-45b8a17cecc8", "name": "network-vif-plugged", "status": "completed", "tag": "462f1588-13d7-4346-bf9e-fb24a7f41f90"}, {"server_uuid": "4ae19d1c-0d21-4eb0-8323-93679f2c60c8", "name": "network-vif-plugged", "status": "completed", "tag": "a63778d8-206e-4f12-97a1-d377df5ddbe8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:32.251487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-482c0f8e-e934-47dc-a4c1-0f9495bbaeb5 req-f45c7a68-fce2-4b8c-a148-008c33283ab8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.251487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-482c0f8e-e934-47dc-a4c1-0f9495bbaeb5 req-f45c7a68-fce2-4b8c-a148-008c33283ab8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.259829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-482c0f8e-e934-47dc-a4c1-0f9495bbaeb5 req-f45c7a68-fce2-4b8c-a148-008c33283ab8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.266093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c37a3236-57e4-43d4-bc15-86ab6f23cefc req-65c26ae6-a9b2-450d-8b02-97865dd9e58d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.267346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c37a3236-57e4-43d4-bc15-86ab6f23cefc req-65c26ae6-a9b2-450d-8b02-97865dd9e58d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.267952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c37a3236-57e4-43d4-bc15-86ab6f23cefc req-65c26ae6-a9b2-450d-8b02-97865dd9e58d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.276812 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-482c0f8e-e934-47dc-a4c1-0f9495bbaeb5 req-f45c7a68-fce2-4b8c-a148-008c33283ab8 service nova] Creating event network-changed:3944e49d-d846-4923-940e-18c1f16c178f for instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb on n-h1-master-1 Oct 16 01:04:32.284470 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-482c0f8e-e934-47dc-a4c1-0f9495bbaeb5 req-f45c7a68-fce2-4b8c-a148-008c33283ab8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074255 Oct 16 01:04:32.285766 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 609/1150] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:32.289746 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c37a3236-57e4-43d4-bc15-86ab6f23cefc req-65c26ae6-a9b2-450d-8b02-97865dd9e58d service nova] Creating event network-vif-plugged:462f1588-13d7-4346-bf9e-fb24a7f41f90 for instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 on n-h2-master-1 Oct 16 01:04:32.291121 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c37a3236-57e4-43d4-bc15-86ab6f23cefc req-65c26ae6-a9b2-450d-8b02-97865dd9e58d service nova] Creating event network-vif-plugged:a63778d8-206e-4f12-97a1-d377df5ddbe8 for instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 on n-h1-master-1 Oct 16 01:04:32.291377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:32.292077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:32.301004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.301775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.302377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.303549 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c37a3236-57e4-43d4-bc15-86ab6f23cefc req-65c26ae6-a9b2-450d-8b02-97865dd9e58d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063424 Oct 16 01:04:32.303825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.304237 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 542/1151] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:32.304753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.305995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.314965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8482aab-f016-456b-ac10-26fdc0589781 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e155ee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:32.376772 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8482aab-f016-456b-ac10-26fdc0589781 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837" status: 200 len: 1463 microversion: 2.1 time: 0.069649 Oct 16 01:04:32.377386 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 543/1152] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:32 2022] GET /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837 => generated 1463 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:32.382793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.228"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:32.385303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:32.395284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.396036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.396724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.397680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.398373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.398784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:32.399304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.408792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b69893f3-c56b-4876-b1b4-5f9aba94f100 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1221 microversion: 2.1 time: 0.121830 Oct 16 01:04:32.409372 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 610/1153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:32 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:32.414125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:32.415247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:32.422059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.422648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.423059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.424124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:32.424589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:32.425014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:32.435597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "refresh_cache-ccd8bea2-cfe6-4678-b296-002942b54485" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:04:32.436139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquired lock "refresh_cache-ccd8bea2-cfe6-4678-b296-002942b54485" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:04:32.648214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:32.657249 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3ca4ad3c-9b86-4ab0-8d96-70513a577e59 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.246649 Oct 16 01:04:32.658363 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 611/1154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:32 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:32.663407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1521009771", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:32.721012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:04:33.372436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:04:33.372772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:04:33.373407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:04:33.373979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:04:33.374554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:04:33.387093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:33.387590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:33.388014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:33.388729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:33.389182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:33.389781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:33.409835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:04:33.414557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Getting quotas for user f3b14e05c41648159d8ed97719c68862 and project f6556287cca54d74b4971ef3e666cc1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:04:33.427123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:04:33.429523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:04:33.482217 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cde7d910-0588-437c-8f3d-04dd5b96b660 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822321 Oct 16 01:04:33.483058 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 612/1155] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:04:33.489478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1654887924", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "ba2039d4-7a1a-4c70-b987-1dd870ff50d7"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:33.560744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] validate_networks() for [('ba2039d4-7a1a-4c70-b987-1dd870ff50d7', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:04:34.283213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:04:34.283591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:04:34.284077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:04:34.284691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:04:34.285102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:04:34.304217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:34.304705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:34.305137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:34.305861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:34.306317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:34.306740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:34.347398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:04:34.352225 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for user 875dca9ed4914e379601ddbdba035cb2 and project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:04:34.366377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:04:34.369306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:04:34.425226 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa92b878-e776-4e36-9ada-65f2accc93c9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940848 Oct 16 01:04:34.441000 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 613/1156] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:04:34.448126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:34.451045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:34.467196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:34.468006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:34.468674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:34.469813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:34.471129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:34.471823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:34.817166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:34.828800 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2670451b-099e-4b64-bfca-11cd0949d983 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1468 microversion: 2.1 time: 0.384337 Oct 16 01:04:34.831747 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 614/1157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:34 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:34.842022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:34.843689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:34.858805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:34.859344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:34.862229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:34.863138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:34.863958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:34.870106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:36.053060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:36.065223 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff14a4d5-a6ab-452f-b8f4-f38370503e82 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1311 microversion: 2.1 time: 1.227385 Oct 16 01:04:36.078944 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 615/1158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:34 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1311 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:36.078944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:36.078944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:36.105958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:36.106468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:36.106976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:36.108634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:36.109267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:36.112572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:36.649112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:36.656750 n-d-master-1 devstack@n-api.service[120546]: INFO nova.network.neutron [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] re-assign floating IP 172.35.4.228 from instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb Oct 16 01:04:36.671512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:36.673637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:36.675168 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0cd6b392-4f45-462f-b288-4a8ca2e5f759 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.607956 Oct 16 01:04:36.676091 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 616/1159] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:36 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:36.681498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:36.682298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:36.689301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:36.690122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:36.690719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:36.691769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:36.692634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:36.693225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:36.770460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:04:36.800316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:36.811651 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f4e187f0-66c4-4a69-8feb-8ade3e2425b3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1275 microversion: 2.1 time: 0.134107 Oct 16 01:04:36.813160 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 617/1160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:36 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1275 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:36.819197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:36.820025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:36.828396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:36.831509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:36.832620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:36.835537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:36.836198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:36.836807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:36.874056 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:36.975655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:37.002508 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ee7ad6fe-eac2-4daf-a98f-c6301fcffcdd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1273 microversion: 2.1 time: 0.184142 Oct 16 01:04:37.003483 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 618/1161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:36 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:37.016445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:37.017775 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:37.030745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:37.031268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:37.031783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:37.032754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:37.033968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:37.034719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:37.365083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:37.388347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bcd2846d-7e0a-430a-8a1e-ef1a74f30d18 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.382871 Oct 16 01:04:37.389046 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 619/1162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:37 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:37.393998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-fc38482b-b915-4d03-a885-82095050c0b6 req-2756bbc0-1379-4671-a21d-bd15e0f9229b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9930a3af-2106-418e-87a8-a959ce89905e", "name": "network-vif-unplugged", "status": "completed", "tag": "1bf8e6b8-2014-4792-9b67-18c9f48d806a"}, {"server_uuid": "143c3ee9-153e-42d5-80b0-df5c3fe70085", "name": "network-vif-unplugged", "status": "completed", "tag": "4a711534-6fc5-44d9-b654-ed82a1e4d7ad"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:37.405580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fc38482b-b915-4d03-a885-82095050c0b6 req-2756bbc0-1379-4671-a21d-bd15e0f9229b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:37.406340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fc38482b-b915-4d03-a885-82095050c0b6 req-2756bbc0-1379-4671-a21d-bd15e0f9229b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:37.407021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fc38482b-b915-4d03-a885-82095050c0b6 req-2756bbc0-1379-4671-a21d-bd15e0f9229b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:37.420963 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-fc38482b-b915-4d03-a885-82095050c0b6 req-2756bbc0-1379-4671-a21d-bd15e0f9229b service nova] Creating event network-vif-unplugged:1bf8e6b8-2014-4792-9b67-18c9f48d806a for instance 9930a3af-2106-418e-87a8-a959ce89905e on n-h2-master-1 Oct 16 01:04:37.421839 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-fc38482b-b915-4d03-a885-82095050c0b6 req-2756bbc0-1379-4671-a21d-bd15e0f9229b service nova] Creating event network-vif-unplugged:4a711534-6fc5-44d9-b654-ed82a1e4d7ad for instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 on n-h1-master-1 Oct 16 01:04:37.431482 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-fc38482b-b915-4d03-a885-82095050c0b6 req-2756bbc0-1379-4671-a21d-bd15e0f9229b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.041034 Oct 16 01:04:37.432401 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 620/1163] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:37.437818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:37.439266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:37.445732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:37.446348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:37.447092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:37.447988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:37.448908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:37.449401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:37.520258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:37.544035 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89cc8f58-14f2-47cb-85df-c016f4c50555 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1260 microversion: 2.1 time: 0.105417 Oct 16 01:04:37.553381 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 621/1164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:37 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1260 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:37.553381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-503405218"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:37.555166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:37.568531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:37.569031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:37.569464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:37.570589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:37.571313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:37.571624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:37.597067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Updating instance_info_cache with network_info: [{"id": "3944e49d-d846-4923-940e-18c1f16c178f", "address": "fa:16:3e:73:05:57", "network": {"id": "8b1499e7-a562-4896-ac36-445314ab5b9f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1434734463-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7776307d685b47fe8beca919b5f90966", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3944e49d-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:04:37.604723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:04:37.890121 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8739efbf-2bb6-4cd4-b8b6-917ddccec439 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "POST /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020/action" status: 202 len: 0 microversion: 2.1 time: 0.343438 Oct 16 01:04:37.899027 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 622/1165] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:37 2022] POST /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:04:37.905975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-27abed98-8659-4488-86f5-b6d8a280d9c4 req-ff51f082-5888-4ace-b0da-5253fe3c4206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981200a2-5a9d-469f-9f65-ad75dbe1b422", "name": "network-vif-unplugged", "status": "completed", "tag": "f0442b98-20e1-4888-8035-39c00f3965ce"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:37.924769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-27abed98-8659-4488-86f5-b6d8a280d9c4 req-ff51f082-5888-4ace-b0da-5253fe3c4206 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:37.925403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-27abed98-8659-4488-86f5-b6d8a280d9c4 req-ff51f082-5888-4ace-b0da-5253fe3c4206 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:37.925985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-27abed98-8659-4488-86f5-b6d8a280d9c4 req-ff51f082-5888-4ace-b0da-5253fe3c4206 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:37.957962 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-27abed98-8659-4488-86f5-b6d8a280d9c4 req-ff51f082-5888-4ace-b0da-5253fe3c4206 service nova] Creating event network-vif-unplugged:f0442b98-20e1-4888-8035-39c00f3965ce for instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 on n-h2-master-1 Oct 16 01:04:37.977918 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-27abed98-8659-4488-86f5-b6d8a280d9c4 req-ff51f082-5888-4ace-b0da-5253fe3c4206 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076734 Oct 16 01:04:37.981664 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 623/1166] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:37.999690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-70a615d3-8a98-47e8-9b68-4252bbce9dbe req-aa093478-335f-4e90-8714-43c73529c049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9930a3af-2106-418e-87a8-a959ce89905e", "name": "network-vif-deleted", "tag": "1bf8e6b8-2014-4792-9b67-18c9f48d806a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:38.036311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-70a615d3-8a98-47e8-9b68-4252bbce9dbe req-aa093478-335f-4e90-8714-43c73529c049 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.036892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-70a615d3-8a98-47e8-9b68-4252bbce9dbe req-aa093478-335f-4e90-8714-43c73529c049 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.037409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-70a615d3-8a98-47e8-9b68-4252bbce9dbe req-aa093478-335f-4e90-8714-43c73529c049 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.059981 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-70a615d3-8a98-47e8-9b68-4252bbce9dbe req-aa093478-335f-4e90-8714-43c73529c049 service nova] Creating event network-vif-deleted:1bf8e6b8-2014-4792-9b67-18c9f48d806a for instance 9930a3af-2106-418e-87a8-a959ce89905e on n-h2-master-1 Oct 16 01:04:38.068991 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-70a615d3-8a98-47e8-9b68-4252bbce9dbe req-aa093478-335f-4e90-8714-43c73529c049 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084006 Oct 16 01:04:38.069758 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 624/1167] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:38.077697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:38.078747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:38.089515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.090230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.090846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.091770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.092437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.093094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.443981 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:38.457414 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f9b9d1f-a249-43e5-a49d-295cbafd1d50 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1495 microversion: 2.1 time: 0.385221 Oct 16 01:04:38.459593 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 625/1168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:38 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1495 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:38.466555 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:38.467153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:38.496727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.497231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.498158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.500230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Updating instance_info_cache with network_info: [{"id": "b7ce8315-f4dd-4628-b68f-68b9f4a5761f", "address": "fa:16:3e:bc:b4:87", "network": {"id": "8b1499e7-a562-4896-ac36-445314ab5b9f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1434734463-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7776307d685b47fe8beca919b5f90966", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb7ce8315-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:04:38.501725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.505806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.506688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.516393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Releasing lock "refresh_cache-ccd8bea2-cfe6-4678-b296-002942b54485" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:04:38.517675 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56a223f1-6a0c-403f-a8c0-671d928e6046 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485/action" status: 202 len: 0 microversion: 2.1 time: 6.139191 Oct 16 01:04:38.519129 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 544/1169] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:32 2022] POST /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485/action => generated 0 bytes in 6141 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:04:38.524781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:38.525693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:38.532977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.533931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.534535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.535558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.536238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.536810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.820727 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:38.836021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:38.837592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:38.838814 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-02868a34-fd6c-465b-8307-4fea3805e37f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.377520 Oct 16 01:04:38.841551 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 626/1170] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:38 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:38.847434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b45dfb5-49e4-45a7-b82e-50d829402f02 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e2e1e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:38.871056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:38.904501 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b45dfb5-49e4-45a7-b82e-50d829402f02 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.061842 Oct 16 01:04:38.913576 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 627/1171] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:38 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:38.918680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:38.919520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:38.924242 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:38.928193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.928911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.929503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.929795 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8065fe67-5f68-4420-80c6-a07256519c86 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1317 microversion: 2.1 time: 0.409270 Oct 16 01:04:38.930421 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 545/1172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:38 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:38.930814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.931533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.932117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.957903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:38.958613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:38.973008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.973765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.974722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:38.975626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:38.976235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:38.976807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.192840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:39.201810 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-47bb50ec-3b6b-4e51-89a7-b06eef29c7c9 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1313 microversion: 2.1 time: 0.286644 Oct 16 01:04:39.202523 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 628/1173] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:38 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:39.309827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:39.310607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:39.318093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.318093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.318749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.319872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.320468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.321023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.321386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:39.332767 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c52f4e49-26eb-4c11-9ace-598e5dffca82 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.385817 Oct 16 01:04:39.339089 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 546/1174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:38 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:39.346487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.228"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:39.545245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:39.553116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.553689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.554459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.555278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.555805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.556467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.566016 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d11fd13a-1107-451e-b106-d636dde57c93 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1646 microversion: 2.1 time: 0.339849 Oct 16 01:04:39.567501 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 629/1175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:39 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1646 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:39.582468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:39.583738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:39.596715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.597782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.598659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.599969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.600881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.601737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.680627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:39.689973 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34974212-8dff-4749-a4e7-154c64ceac47 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1266 microversion: 2.1 time: 0.120143 Oct 16 01:04:39.699893 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 630/1176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:39 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:39.699893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:39.699893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:39.702393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.703180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.703936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.707111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.707800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.708409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.909069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c21cbcbc-37c7-4211-979d-df9144811a54 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1646 microversion: 2.1 time: 0.216769 Oct 16 01:04:39.914253 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 631/1177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:39 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1646 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:39.927803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:39.929124 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:39.937557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.938249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.939176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:39.940179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:39.940718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:39.941221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.093250 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] HTTP exception thrown: Floating IP 172.35.4.228 is not associated with instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb. Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Request method failure captured: Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action HTTP/1.1 Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 49 Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hmSopeweabfuzMkWsa_kaYBqYua5RcQnjytRJ6Tar9mhyOsRgaL_czSEbMO6jJoOokzUlYx0NCD8du_ucAHdjFnpzjd3uZ0GHF1ICwnevBVRcOeZt1B1jmwODQOW6zoC0lKIhw93n19ocEP400gr6NrIOdozd5v7llhBQn8JfYQ9k Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 7776307d685b47fe8beca919b5f90966 Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:04:40.096039 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7776307d685b47fe8beca919b5f90966", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7776307d685b47fe8beca919b5f90966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7776307d685b47fe8beca919b5f90966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7776307d685b47fe8beca919b5f90966"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 7776307d685b47fe8beca919b5f90966 Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FloatingIPsAssociationTestJSON-1066714197-project Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 8cd01d53807440fd827b41778a54627a Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1066714197-project Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: {"removeFloatingIp": {"address": "172.35.4.228"}} Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:04:40.097678 n-d-master-1 devstack@n-api.service[120546]: exception: Floating IP 172.35.4.228 is not associated with instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb. Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '80668ef9-fa93-48b1-b507-d7b4a7de0afb', 'body': {'removeFloatingIp': {'address': '172.35.4.228'}}} Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.228 is not associated with instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb. Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:40.098648 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:40.100110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:40.100110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:40.100110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:40.100110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:40.100110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.228 is not associated with instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb. Oct 16 01:04:40.100110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:40.100590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Returning 409 to user: Floating IP 172.35.4.228 is not associated with instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:40.101598 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-72d3099f-dedb-4ee4-9806-4210fbbf4a9c tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action" status: 409 len: 146 microversion: 2.1 time: 0.766725 Oct 16 01:04:40.102314 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 547/1178] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:39 2022] POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action => generated 146 bytes in 768 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:04:40.108956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0eacba6d-3503-4700-9710-e08d48ae1473 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e125160>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:40.129554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:40.139519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:40.141023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:40.143416 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be93cf85-cab0-48e5-a180-b63ec4e3db96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.226451 Oct 16 01:04:40.157646 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 632/1179] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:39 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:40.159398 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0eacba6d-3503-4700-9710-e08d48ae1473 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.055201 Oct 16 01:04:40.159792 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 548/1180] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:40 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:40.164608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6efc5550-f1ed-4c61-a3d2-a011aa2fa1d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:40.169570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:40.169955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efc5550-f1ed-4c61-a3d2-a011aa2fa1d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.170330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:40.170439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efc5550-f1ed-4c61-a3d2-a011aa2fa1d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.170910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efc5550-f1ed-4c61-a3d2-a011aa2fa1d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.171923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efc5550-f1ed-4c61-a3d2-a011aa2fa1d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.172450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efc5550-f1ed-4c61-a3d2-a011aa2fa1d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.172802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efc5550-f1ed-4c61-a3d2-a011aa2fa1d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.177517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.178081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.178607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.179724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.180324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.180754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.200792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6efc5550-f1ed-4c61-a3d2-a011aa2fa1d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041798 Oct 16 01:04:40.201580 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 633/1181] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:04:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:40.207285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b1f18da8-d204-43ec-9f47-75c5d15ed479 req-87c759cd-b838-4ca2-ab30-5fb95f16532d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80668ef9-fa93-48b1-b507-d7b4a7de0afb", "tag": "3944e49d-d846-4923-940e-18c1f16c178f"}, {"name": "network-changed", "server_uuid": "ccd8bea2-cfe6-4678-b296-002942b54485", "tag": "b7ce8315-f4dd-4628-b68f-68b9f4a5761f"}, {"name": "network-changed", "server_uuid": "981200a2-5a9d-469f-9f65-ad75dbe1b422", "tag": "f0442b98-20e1-4888-8035-39c00f3965ce"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:40.219049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b1f18da8-d204-43ec-9f47-75c5d15ed479 req-87c759cd-b838-4ca2-ab30-5fb95f16532d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.219541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b1f18da8-d204-43ec-9f47-75c5d15ed479 req-87c759cd-b838-4ca2-ab30-5fb95f16532d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.220008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b1f18da8-d204-43ec-9f47-75c5d15ed479 req-87c759cd-b838-4ca2-ab30-5fb95f16532d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.235407 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b1f18da8-d204-43ec-9f47-75c5d15ed479 req-87c759cd-b838-4ca2-ab30-5fb95f16532d service nova] Creating event network-changed:3944e49d-d846-4923-940e-18c1f16c178f for instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb on n-h1-master-1 Oct 16 01:04:40.236345 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b1f18da8-d204-43ec-9f47-75c5d15ed479 req-87c759cd-b838-4ca2-ab30-5fb95f16532d service nova] Creating event network-changed:b7ce8315-f4dd-4628-b68f-68b9f4a5761f for instance ccd8bea2-cfe6-4678-b296-002942b54485 on n-h1-master-1 Oct 16 01:04:40.236544 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b1f18da8-d204-43ec-9f47-75c5d15ed479 req-87c759cd-b838-4ca2-ab30-5fb95f16532d service nova] Creating event network-changed:f0442b98-20e1-4888-8035-39c00f3965ce for instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 on n-h2-master-1 Oct 16 01:04:40.246525 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b1f18da8-d204-43ec-9f47-75c5d15ed479 req-87c759cd-b838-4ca2-ab30-5fb95f16532d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.043861 Oct 16 01:04:40.248117 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 634/1182] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:40.254017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'action', calling method: .version_select at 0x7fd650bf0940>, body: {"removeFloatingIp": {"address": "172.35.4.228"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:40.450305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:40.459336 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-475708e5-2e53-4687-a173-7bf5d522e638 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1317 microversion: 2.1 time: 0.298351 Oct 16 01:04:40.470981 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 549/1183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:40 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:40.470981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a239040c-25ff-4d8a-b3f5-c44eb51e7ac5 req-82bdb9ee-e684-4696-a8bc-3614370a5de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8", "tag": "8741ee6c-5609-43e8-b6a9-bcce49ec1b84"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:40.481277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a239040c-25ff-4d8a-b3f5-c44eb51e7ac5 req-82bdb9ee-e684-4696-a8bc-3614370a5de9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.481759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a239040c-25ff-4d8a-b3f5-c44eb51e7ac5 req-82bdb9ee-e684-4696-a8bc-3614370a5de9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.482519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a239040c-25ff-4d8a-b3f5-c44eb51e7ac5 req-82bdb9ee-e684-4696-a8bc-3614370a5de9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.492973 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:40.495135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a239040c-25ff-4d8a-b3f5-c44eb51e7ac5 req-82bdb9ee-e684-4696-a8bc-3614370a5de9 service nova] Creating event network-changed:8741ee6c-5609-43e8-b6a9-bcce49ec1b84 for instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 on n-h2-master-1 Oct 16 01:04:40.500542 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a239040c-25ff-4d8a-b3f5-c44eb51e7ac5 req-82bdb9ee-e684-4696-a8bc-3614370a5de9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038402 Oct 16 01:04:40.501650 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 550/1184] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:40.504565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:40.507024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:40.509475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:40.516363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.517407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.517981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.518646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.519035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.519470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.522867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.527222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.528126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.529322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:40.530113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:40.530751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:40.568931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lazy-loading 'flavor' on Instance uuid 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:40.584973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Going to try to live migrate instance to n-h2-master-1 {{(pid=120546) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:04:41.038257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "refresh_cache-ccd8bea2-cfe6-4678-b296-002942b54485" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:04:41.039521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquired lock "refresh_cache-ccd8bea2-cfe6-4678-b296-002942b54485" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:04:42.538575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Building network info cache for instance {{(pid=120545) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:04:43.393944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Updating instance_info_cache with network_info: [{"id": "b7ce8315-f4dd-4628-b68f-68b9f4a5761f", "address": "fa:16:3e:bc:b4:87", "network": {"id": "8b1499e7-a562-4896-ac36-445314ab5b9f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1434734463-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7776307d685b47fe8beca919b5f90966", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb7ce8315-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120545) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:04:43.404601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Releasing lock "refresh_cache-ccd8bea2-cfe6-4678-b296-002942b54485" {{(pid=120545) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:04:43.405458 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1dd7eca1-9b97-436e-8b0d-00423a85afa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485/action" status: 202 len: 0 microversion: 2.1 time: 3.156249 Oct 16 01:04:43.406131 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 635/1185] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:40 2022] POST /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485/action => generated 0 bytes in 3157 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:04:43.411543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:43.412158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:43.418165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:43.418901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:43.419360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:43.420073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:43.420580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:43.420962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:43.633155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:43.655151 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2d3b217-0f7a-4285-a271-289d24ef2ac2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1313 microversion: 2.1 time: 0.245711 Oct 16 01:04:43.657910 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 636/1186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:43 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:43.664862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:43.666507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:43.688521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:43.690334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:43.693647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:43.694407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:43.694878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:43.695331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:43.707402 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:43.935405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:43.947260 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71a0a221-24c9-4072-8c0f-0150a8936a49 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.287971 Oct 16 01:04:43.959680 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 637/1187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:43 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:43.971626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:43.972550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:43.979905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:43.980645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:43.981337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:43.982230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:43.982839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:43.983580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.161256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:44.172065 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6cf74c1-6f43-4b43-9a80-e0bf66b09335 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1308 microversion: 2.1 time: 0.210627 Oct 16 01:04:44.173903 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 638/1188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:43 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:44.180367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:44.181285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:44.189853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.199741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.205410 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-21e6dfcd-8ae6-4f81-ba43-74083879be3b tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8/action" status: 202 len: 0 microversion: 2.1 time: 3.702300 Oct 16 01:04:44.206510 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 551/1189] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:40 2022] POST /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8/action => generated 0 bytes in 3704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:44.206911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.209785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.211356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.211995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.230572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f361e7fb-4bf0-41ff-9af9-082c789ed15b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e1bc5e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:44.333491 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f361e7fb-4bf0-41ff-9af9-082c789ed15b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.121964 Oct 16 01:04:44.334309 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 552/1190] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:44 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:44.341152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:44.348416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:44.356673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.357410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.358017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.358890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.359534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.360123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.360866 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=18 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:44.441084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:44.450445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:44.457659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:44.460614 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ecad1356-05f3-4849-be3f-b3bc039b3b6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.284032 Oct 16 01:04:44.463166 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 639/1191] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:44 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:44.467958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-24ebaa01-2f83-4279-bf15-780c5de9b934 req-97af225a-3a8b-4bcb-90e8-895af02be831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd8bea2-cfe6-4678-b296-002942b54485", "tag": "b7ce8315-f4dd-4628-b68f-68b9f4a5761f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:44.495545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-24ebaa01-2f83-4279-bf15-780c5de9b934 req-97af225a-3a8b-4bcb-90e8-895af02be831 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.496257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-24ebaa01-2f83-4279-bf15-780c5de9b934 req-97af225a-3a8b-4bcb-90e8-895af02be831 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.496909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-24ebaa01-2f83-4279-bf15-780c5de9b934 req-97af225a-3a8b-4bcb-90e8-895af02be831 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.511858 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-24ebaa01-2f83-4279-bf15-780c5de9b934 req-97af225a-3a8b-4bcb-90e8-895af02be831 service nova] Creating event network-changed:b7ce8315-f4dd-4628-b68f-68b9f4a5761f for instance ccd8bea2-cfe6-4678-b296-002942b54485 on n-h1-master-1 Oct 16 01:04:44.518527 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-24ebaa01-2f83-4279-bf15-780c5de9b934 req-97af225a-3a8b-4bcb-90e8-895af02be831 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053949 Oct 16 01:04:44.519870 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 640/1192] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:44.527730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1a30749d-6a6c-4d91-af1a-129b94f23a77 req-c7f6f0b8-3324-4cc9-a58f-b1d93819ef40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:44.542390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1a30749d-6a6c-4d91-af1a-129b94f23a77 req-c7f6f0b8-3324-4cc9-a58f-b1d93819ef40 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.543286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1a30749d-6a6c-4d91-af1a-129b94f23a77 req-c7f6f0b8-3324-4cc9-a58f-b1d93819ef40 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.551479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1a30749d-6a6c-4d91-af1a-129b94f23a77 req-c7f6f0b8-3324-4cc9-a58f-b1d93819ef40 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.570987 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1a30749d-6a6c-4d91-af1a-129b94f23a77 req-c7f6f0b8-3324-4cc9-a58f-b1d93819ef40 service nova] Creating event network-changed:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h2-master-1 Oct 16 01:04:44.577248 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1a30749d-6a6c-4d91-af1a-129b94f23a77 req-c7f6f0b8-3324-4cc9-a58f-b1d93819ef40 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055842 Oct 16 01:04:44.581256 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 641/1193] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:44.591518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:44.603328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:44.609965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.610739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.612678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.613577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.614194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.615741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.669177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:04:44.710495 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:44.730647 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-835a6285-7080-491a-835c-eb71d5a23a56 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1317 microversion: 2.1 time: 0.389295 Oct 16 01:04:44.732203 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 553/1194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:44 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:44.752899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:44.753512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:44.788764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.794433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.797707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.799291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.804463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.806526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.837450 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da57cbd0-d2d3-4875-a557-21e29de62823 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 204 len: 0 microversion: 2.1 time: 0.254350 Oct 16 01:04:44.843324 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 642/1195] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:44 2022] DELETE /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:04:44.853804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:44.854512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:44.869130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.869626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.870061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:44.870755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:44.874969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:44.876112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:45.216356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:45.236878 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e2144ec8-6924-4455-bfd6-62bfbfa647e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1505 microversion: 2.1 time: 0.483013 Oct 16 01:04:45.240175 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 554/1196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:44 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:45.250342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6e01e9cc-8c31-47ca-b5a7-7c2ec4ba7f85 req-8b410e7a-3e59-42a6-9180-307dbebf3b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4495b959-d827-46f4-92c3-05b9b91c2020", "name": "network-vif-plugged", "status": "completed", "tag": "ca157844-15f0-450a-862c-cca64f9f972e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:45.281455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6e01e9cc-8c31-47ca-b5a7-7c2ec4ba7f85 req-8b410e7a-3e59-42a6-9180-307dbebf3b6f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:45.282722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6e01e9cc-8c31-47ca-b5a7-7c2ec4ba7f85 req-8b410e7a-3e59-42a6-9180-307dbebf3b6f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:45.284398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6e01e9cc-8c31-47ca-b5a7-7c2ec4ba7f85 req-8b410e7a-3e59-42a6-9180-307dbebf3b6f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:45.346052 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6e01e9cc-8c31-47ca-b5a7-7c2ec4ba7f85 req-8b410e7a-3e59-42a6-9180-307dbebf3b6f service nova] Creating event network-vif-plugged:ca157844-15f0-450a-862c-cca64f9f972e for instance 4495b959-d827-46f4-92c3-05b9b91c2020 on n-h1-master-1 Oct 16 01:04:45.352804 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6e01e9cc-8c31-47ca-b5a7-7c2ec4ba7f85 req-8b410e7a-3e59-42a6-9180-307dbebf3b6f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110610 Oct 16 01:04:45.354818 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 555/1197] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:45.364777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.228"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:45.369190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:45.385218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:45.385710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:45.386145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:45.386853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:45.393478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:45.397138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:45.403875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:45.413347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bffb622c-328f-492b-9d80-8ebc051d3946 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1313 microversion: 2.1 time: 0.568254 Oct 16 01:04:45.437964 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 643/1198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:44 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:45.447523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:04:45.448311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquired lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:04:45.453321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:45.453946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:45.463734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:45.464798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:45.465738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:45.466732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:45.467443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:45.468185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:45.986245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:45.997365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-279961dd-4993-4d6c-98a5-ba9e3a6cb8b6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.554762 Oct 16 01:04:46.000144 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 644/1199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:45 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:46.008178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:46.013808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:46.030277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:46.041844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:46.042578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:46.043512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:46.044134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:46.044720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:47.058586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:47.070846 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c49b8178-0790-481c-ac62-f5b06a30a0cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1308 microversion: 2.1 time: 1.068191 Oct 16 01:04:47.093623 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 645/1200] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:46 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1308 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:47.099688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f47a329e-f74c-48de-aa21-23b45bb7b322 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e1fb5e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:47.169929 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f47a329e-f74c-48de-aa21-23b45bb7b322 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.074974 Oct 16 01:04:47.171235 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 646/1201] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:47 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:47.179833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:47.181181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:47.190251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:47.191182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:47.191892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:47.192963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:47.193704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:47.194447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:47.702546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:47.711288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:47.712723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:47.713897 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13b09de8-5b32-4b2b-ab02-8f6bed9e3e6a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.541113 Oct 16 01:04:47.724878 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 647/1202] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:47 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:47.727946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:47.728557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:47.753207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:47.753707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:47.754141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:47.754855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:47.755351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:47.755776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.097808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:48.107212 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c35a4c00-7bec-4fcc-aaff-d71c0c8e2389 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1317 microversion: 2.1 time: 0.382794 Oct 16 01:04:48.112208 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 648/1203] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:47 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:48.116980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:48.128044 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:48.134370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.135246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.140132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.142567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.143445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.144133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.419024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:48.428440 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b677da99-62c9-4000-a5cc-1b4ad6ddb7b2 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1505 microversion: 2.1 time: 0.314973 Oct 16 01:04:48.447323 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 649/1204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:48 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:48.456162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:48.460165 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:48.478475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.479348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.479972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.480862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.481507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.481934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.822367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:48.831062 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d5d2965d-2a4f-44d6-b6ec-95abdf022627 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1313 microversion: 2.1 time: 0.382285 Oct 16 01:04:48.836290 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 650/1205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:48 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:48.841105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-31b7577d-7e64-4aa9-8b76-b087e1eed04a req-23dbd7ad-92f9-46c6-b199-479a5505b904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90", "tag": "04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:48.844112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:04:48.863476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31b7577d-7e64-4aa9-8b76-b087e1eed04a req-23dbd7ad-92f9-46c6-b199-479a5505b904 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.875746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31b7577d-7e64-4aa9-8b76-b087e1eed04a req-23dbd7ad-92f9-46c6-b199-479a5505b904 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.876536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31b7577d-7e64-4aa9-8b76-b087e1eed04a req-23dbd7ad-92f9-46c6-b199-479a5505b904 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.899104 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-31b7577d-7e64-4aa9-8b76-b087e1eed04a req-23dbd7ad-92f9-46c6-b199-479a5505b904 service nova] Creating event network-changed:04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3 for instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 on n-h2-master-1 Oct 16 01:04:48.909260 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-31b7577d-7e64-4aa9-8b76-b087e1eed04a req-23dbd7ad-92f9-46c6-b199-479a5505b904 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071519 Oct 16 01:04:48.916034 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 651/1206] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:48.922724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:48.927831 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:48.939031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.951776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.952229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:48.952988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:48.953456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:48.955677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:49.427430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:49.436710 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f59d89d-210f-4e13-8c0d-d8bf1f429cde tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.519146 Oct 16 01:04:49.443846 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 652/1207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:48 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:49.448777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-607e8872-11e9-4641-918b-3297c89105ed req-5c237fb3-65e4-423e-a809-001a097eaffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8", "name": "network-vif-plugged", "status": "completed", "tag": "8741ee6c-5609-43e8-b6a9-bcce49ec1b84"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:49.486385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-607e8872-11e9-4641-918b-3297c89105ed req-5c237fb3-65e4-423e-a809-001a097eaffd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:49.486944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-607e8872-11e9-4641-918b-3297c89105ed req-5c237fb3-65e4-423e-a809-001a097eaffd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:49.487379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-607e8872-11e9-4641-918b-3297c89105ed req-5c237fb3-65e4-423e-a809-001a097eaffd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:49.519369 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-607e8872-11e9-4641-918b-3297c89105ed req-5c237fb3-65e4-423e-a809-001a097eaffd service nova] Creating event network-vif-plugged:8741ee6c-5609-43e8-b6a9-bcce49ec1b84 for instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 on n-h2-master-1 Oct 16 01:04:49.530614 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-607e8872-11e9-4641-918b-3297c89105ed req-5c237fb3-65e4-423e-a809-001a097eaffd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085244 Oct 16 01:04:49.534820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 653/1208] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:49.552777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:49.553771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:49.589228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:49.593668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:49.594304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:49.595929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:49.615141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:49.619597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:50.183871 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:50.680064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:50.692121 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ecf0314-96d3-4242-8657-1cf25739d8ce tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1308 microversion: 2.1 time: 1.155717 Oct 16 01:04:50.706984 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 654/1209] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:49 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1308 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:50.706984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c17da431-1d19-4777-85b0-cf356d375af4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e3db5e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:50.791118 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c17da431-1d19-4777-85b0-cf356d375af4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.096338 Oct 16 01:04:50.793845 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 655/1210] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:50 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:50.812174 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:50.814401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:50.830164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:50.831125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:50.831810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:50.832748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:50.833431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:50.834068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.200165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Updating instance_info_cache with network_info: [{"id": "3944e49d-d846-4923-940e-18c1f16c178f", "address": "fa:16:3e:73:05:57", "network": {"id": "8b1499e7-a562-4896-ac36-445314ab5b9f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1434734463-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7776307d685b47fe8beca919b5f90966", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3944e49d-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:04:51.219303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Releasing lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:04:51.222027 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3c359849-e74a-4236-82ec-3170e2a7f7fe tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action" status: 202 len: 0 microversion: 2.1 time: 5.865456 Oct 16 01:04:51.222835 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 556/1211] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:45 2022] POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action => generated 0 bytes in 5867 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:04:51.234547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-edc48275-cc7c-471f-8209-944f0c9ea437 req-d221152e-982e-44cb-acc4-4a7fa1ef498d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80668ef9-fa93-48b1-b507-d7b4a7de0afb", "tag": "3944e49d-d846-4923-940e-18c1f16c178f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:51.246852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edc48275-cc7c-471f-8209-944f0c9ea437 req-d221152e-982e-44cb-acc4-4a7fa1ef498d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.247651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edc48275-cc7c-471f-8209-944f0c9ea437 req-d221152e-982e-44cb-acc4-4a7fa1ef498d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.248425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edc48275-cc7c-471f-8209-944f0c9ea437 req-d221152e-982e-44cb-acc4-4a7fa1ef498d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.255109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:51.258173 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:51.264105 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-edc48275-cc7c-471f-8209-944f0c9ea437 req-d221152e-982e-44cb-acc4-4a7fa1ef498d service nova] Creating event network-changed:3944e49d-d846-4923-940e-18c1f16c178f for instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb on n-h1-master-1 Oct 16 01:04:51.264337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:51.265610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:51.270096 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-edc48275-cc7c-471f-8209-944f0c9ea437 req-d221152e-982e-44cb-acc4-4a7fa1ef498d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045811 Oct 16 01:04:51.271292 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 557/1212] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:51.276546 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7bc884b3-dbae-4b96-915a-10b691012edf tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1812 microversion: 2.25 time: 0.469537 Oct 16 01:04:51.277168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:51.277296 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 656/1213] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:50 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1812 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:51.282704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:51.293917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:51.297019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:51.303480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.305497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.306311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.307902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.308607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.309349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.312323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.312779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.313301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.314515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.315008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.315440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.845832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:51.857973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:51.875296 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-19bcd99f-f54b-4c36-8474-990726e2e683 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1505 microversion: 2.1 time: 0.596841 Oct 16 01:04:51.876646 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 657/1214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:51 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1505 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:51.900794 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f667a24f-b114-46ad-be52-e066cda252c4 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1317 microversion: 2.1 time: 0.627001 Oct 16 01:04:51.901095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:51.901773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:51.902354 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 558/1215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:51 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:51.909810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:51.910684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:51.917498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.917734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.918663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.919200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.919944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.920743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.921394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.922177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.922618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:51.925225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:51.925941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:51.926844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.237528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:52.240354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:52.249197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2bb87fb-2a0a-4518-8c8b-235b691e86da tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1313 microversion: 2.1 time: 0.367687 Oct 16 01:04:52.249783 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 658/1216] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:51 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:52.253080 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-394d3733-eabf-4f6a-83e8-128074719725 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.349341 Oct 16 01:04:52.254482 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 559/1217] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:51 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:52.259179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-45d805ae-fc57-41cc-bda9-f4020ed91cbb tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '.version_select at 0x7fd64e309790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:52.261690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-050ce802-1b09-46a9-b683-d0ffb7f29c67 req-c3b54955-28dd-49e7-87ec-0b3c28729102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd8bea2-cfe6-4678-b296-002942b54485", "name": "network-vif-deleted", "tag": "b7ce8315-f4dd-4628-b68f-68b9f4a5761f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:52.278409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-050ce802-1b09-46a9-b683-d0ffb7f29c67 req-c3b54955-28dd-49e7-87ec-0b3c28729102 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.279066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-050ce802-1b09-46a9-b683-d0ffb7f29c67 req-c3b54955-28dd-49e7-87ec-0b3c28729102 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.280405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-050ce802-1b09-46a9-b683-d0ffb7f29c67 req-c3b54955-28dd-49e7-87ec-0b3c28729102 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.293506 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-050ce802-1b09-46a9-b683-d0ffb7f29c67 req-c3b54955-28dd-49e7-87ec-0b3c28729102 service nova] Creating event network-vif-deleted:b7ce8315-f4dd-4628-b68f-68b9f4a5761f for instance ccd8bea2-cfe6-4678-b296-002942b54485 on n-h1-master-1 Oct 16 01:04:52.300481 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-050ce802-1b09-46a9-b683-d0ffb7f29c67 req-c3b54955-28dd-49e7-87ec-0b3c28729102 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045882 Oct 16 01:04:52.303353 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 659/1218] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:52.309842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-45c00e7d-418a-4f88-a6a1-5ceca407b0f9 req-a06bf499-caf1-45e8-93c8-d76519fc9631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "name": "network-vif-plugged", "status": "completed", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:52.322986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45c00e7d-418a-4f88-a6a1-5ceca407b0f9 req-a06bf499-caf1-45e8-93c8-d76519fc9631 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.323546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45c00e7d-418a-4f88-a6a1-5ceca407b0f9 req-a06bf499-caf1-45e8-93c8-d76519fc9631 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.329186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45c00e7d-418a-4f88-a6a1-5ceca407b0f9 req-a06bf499-caf1-45e8-93c8-d76519fc9631 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.341228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-45c00e7d-418a-4f88-a6a1-5ceca407b0f9 req-a06bf499-caf1-45e8-93c8-d76519fc9631 service nova] Creating event network-vif-plugged:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h2-master-1 Oct 16 01:04:52.347333 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-45c00e7d-418a-4f88-a6a1-5ceca407b0f9 req-a06bf499-caf1-45e8-93c8-d76519fc9631 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042273 Oct 16 01:04:52.348691 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 660/1219] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:52.354813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:52.355725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:52.364472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.365187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.365787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.366649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.367291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.367704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.629357 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-45d805ae-fc57-41cc-bda9-f4020ed91cbb tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/f2619789-f79c-4aa6-a689-9344c33e22f1" status: 200 len: 184 microversion: 2.1 time: 0.373608 Oct 16 01:04:52.630014 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 560/1220] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:04:52 2022] GET /compute/v2.1/os-floating-ips/f2619789-f79c-4aa6-a689-9344c33e22f1 => generated 184 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:52.635493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-94bcd1c8-3242-4636-b680-6a1196b55f64 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e2feb80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:52.694239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:52.706484 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d45489b5-af0f-434f-9873-aa90206e90d1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1308 microversion: 2.1 time: 0.356143 Oct 16 01:04:52.707384 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 661/1221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:52 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:52.715138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:52.715963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:52.723591 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-94bcd1c8-3242-4636-b680-6a1196b55f64 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.092491 Oct 16 01:04:52.723939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.724181 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 561/1222] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:52 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:52.733722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.734192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.734981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:52.735622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:52.736312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:52.746886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.228"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:53.010833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:53.019230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:53.020573 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:53.026293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.026782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.027430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.029537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.030459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:53.030695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.031271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.035489 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0390f1b-aa67-4b98-a14e-dee705b1d41e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1802 microversion: 2.25 time: 0.325498 Oct 16 01:04:53.036344 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 662/1223] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:52 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1802 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:53.067002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:53.068409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:53.076715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.077569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.078234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.080117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.080938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.081619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.375339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:53.393568 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f8aa6bbc-d570-4c5f-aaf7-e1753a329516 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1505 microversion: 2.1 time: 0.339990 Oct 16 01:04:53.413541 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 663/1224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:53 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:53.413541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:53.413541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:53.418067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.426543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.427693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.428448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.429167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.429749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.449191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:04:53.449666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquired lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:04:53.687533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:53.697700 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d537c60-e38f-49cf-8898-9d6425ab18e2 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1506 microversion: 2.1 time: 0.302418 Oct 16 01:04:53.698191 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 664/1225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:53 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:53.702643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4df076b7-7ae3-46da-8d34-769fb8f3c767 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '.version_select at 0x7fd64e1fbd30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:53.708756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df076b7-7ae3-46da-8d34-769fb8f3c767 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.709239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df076b7-7ae3-46da-8d34-769fb8f3c767 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.709671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4df076b7-7ae3-46da-8d34-769fb8f3c767 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.725392 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4df076b7-7ae3-46da-8d34-769fb8f3c767 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3449 microversion: 2.25 time: 0.026126 Oct 16 01:04:53.726323 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 665/1226] 10.222.0.39 () {60 vars in 1184 bytes} [Sun Oct 16 01:04:53 2022] GET /compute/v2.1/os-migrations => generated 3449 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:53.730832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:53.731484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:53.739206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.739706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.740141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:53.740871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:53.741330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:53.741766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.084458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:54.096595 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10f7768f-1c38-495a-bc6b-edf9151040dc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1313 microversion: 2.1 time: 0.369174 Oct 16 01:04:54.116589 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 666/1227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:53 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:54.135285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:54.137926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:54.151424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.154606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.159168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.160981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.161719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.162415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.482782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:54.503797 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69843db3-be82-4101-9793-6543557bfb1d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.384904 Oct 16 01:04:54.515493 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 667/1228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:54 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:54.521092 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f297f69c-5caf-4fe9-838e-e7eede51185d req-1d821cf4-25a5-4fdf-94d9-814b748e57e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae19d1c-0d21-4eb0-8323-93679f2c60c8", "name": "network-vif-unplugged", "status": "completed", "tag": "a63778d8-206e-4f12-97a1-d377df5ddbe8"}, {"name": "network-changed", "server_uuid": "4ae19d1c-0d21-4eb0-8323-93679f2c60c8", "tag": "a63778d8-206e-4f12-97a1-d377df5ddbe8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:54.535735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f297f69c-5caf-4fe9-838e-e7eede51185d req-1d821cf4-25a5-4fdf-94d9-814b748e57e8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.536613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f297f69c-5caf-4fe9-838e-e7eede51185d req-1d821cf4-25a5-4fdf-94d9-814b748e57e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.537213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f297f69c-5caf-4fe9-838e-e7eede51185d req-1d821cf4-25a5-4fdf-94d9-814b748e57e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.583044 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f297f69c-5caf-4fe9-838e-e7eede51185d req-1d821cf4-25a5-4fdf-94d9-814b748e57e8 service nova] Creating event network-vif-unplugged:a63778d8-206e-4f12-97a1-d377df5ddbe8 for instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 on n-h1-master-1 Oct 16 01:04:54.583645 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f297f69c-5caf-4fe9-838e-e7eede51185d req-1d821cf4-25a5-4fdf-94d9-814b748e57e8 service nova] Creating event network-changed:a63778d8-206e-4f12-97a1-d377df5ddbe8 for instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 on n-h1-master-1 Oct 16 01:04:54.589165 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f297f69c-5caf-4fe9-838e-e7eede51185d req-1d821cf4-25a5-4fdf-94d9-814b748e57e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.072190 Oct 16 01:04:54.590176 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 668/1229] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:54.618391 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:54.619285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:54.636838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.639876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.640479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:54.641368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:54.641968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:54.642474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.101985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:04:55.164483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:55.179679 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0f9d0fa-abab-48ce-a497-60d5fee6b823 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1308 microversion: 2.1 time: 0.588216 Oct 16 01:04:55.180569 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 669/1230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:54 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:55.196346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9265c43f-763c-4c0e-a009-c93db41c492b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e20ca60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:55.302600 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9265c43f-763c-4c0e-a009-c93db41c492b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.120790 Oct 16 01:04:55.303222 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 670/1231] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:55 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:55.312502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:55.314655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:55.337008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.338605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.340764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.343543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.344236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.347473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.706736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid 981200a2-5a9d-469f-9f65-ad75dbe1b422 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:55.742957 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-123531b0-20cc-4d26-a58e-cfb13d6f99cf tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 2420 microversion: 2.25 time: 0.437226 Oct 16 01:04:55.745797 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 671/1232] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:55 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 2420 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:55.752670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a7eae8eb-17ed-4bbb-9cf8-55653f8ca7a5 req-e21825b3-f12c-4565-a183-c6b4c09d0073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90", "name": "network-vif-plugged", "status": "completed", "tag": "04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:55.779745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a7eae8eb-17ed-4bbb-9cf8-55653f8ca7a5 req-e21825b3-f12c-4565-a183-c6b4c09d0073 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.780286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a7eae8eb-17ed-4bbb-9cf8-55653f8ca7a5 req-e21825b3-f12c-4565-a183-c6b4c09d0073 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.780729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a7eae8eb-17ed-4bbb-9cf8-55653f8ca7a5 req-e21825b3-f12c-4565-a183-c6b4c09d0073 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.803920 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a7eae8eb-17ed-4bbb-9cf8-55653f8ca7a5 req-e21825b3-f12c-4565-a183-c6b4c09d0073 service nova] Creating event network-vif-plugged:04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3 for instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 on n-h2-master-1 Oct 16 01:04:55.836618 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a7eae8eb-17ed-4bbb-9cf8-55653f8ca7a5 req-e21825b3-f12c-4565-a183-c6b4c09d0073 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086674 Oct 16 01:04:55.838496 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 672/1233] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:55.844046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:55.844871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:55.852920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.853394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.853828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:55.854612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:55.855106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:55.855540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.402802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Updating instance_info_cache with network_info: [{"id": "3944e49d-d846-4923-940e-18c1f16c178f", "address": "fa:16:3e:73:05:57", "network": {"id": "8b1499e7-a562-4896-ac36-445314ab5b9f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1434734463-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7776307d685b47fe8beca919b5f90966", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3944e49d-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:04:56.413578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:56.421537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Releasing lock "refresh_cache-80668ef9-fa93-48b1-b507-d7b4a7de0afb" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:04:56.423557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e22933f-9092-45f6-8da4-7b0dfbd90c9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1505 microversion: 2.1 time: 0.582989 Oct 16 01:04:56.423923 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64acbf1c-cacc-46b7-bc89-24c376a6e31a tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action" status: 202 len: 0 microversion: 2.1 time: 3.698798 Oct 16 01:04:56.424949 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 673/1234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:55 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:56.429814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:56.430720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:56.437712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.439301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.439716 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 562/1235] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:52 2022] POST /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb/action => generated 0 bytes in 3715 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:04:56.440296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.441227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.443629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.444331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.450408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:56.451088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:56.458825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.459614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.460224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.462448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.463118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.463706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.672289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:56.689382 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-07a6faf5-e255-4cce-aa7a-c210a3d9896f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1462 microversion: 2.1 time: 0.261461 Oct 16 01:04:56.689995 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 674/1236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:56 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1462 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:56.694600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:56.695338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:56.708789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:56.720083 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c2705eb9-5159-488a-bb5b-631bb4b7f19e tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1472 microversion: 2.1 time: 0.279112 Oct 16 01:04:56.721711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 563/1237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:56 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:56.726948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:56.728078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:56.732189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.736116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.736735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.737574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.738295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.739600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.744255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.744751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.745189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:56.745893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:56.746350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:56.746777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.028922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:57.037800 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d2b8cfb9-02b1-4c2a-a7b3-54f332c7e348 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1308 microversion: 2.1 time: 0.314606 Oct 16 01:04:57.042904 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 564/1238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:56 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:57.049968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "74e54c63-941b-4271-8aa4-fe080a842d48"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:57.064298 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.068228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid 981200a2-5a9d-469f-9f65-ad75dbe1b422 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:57.081297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.081895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.082434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.083258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.084269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.084770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.099286 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3c25924d-8eef-4136-acaa-50944a93b6e5 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 2420 microversion: 2.25 time: 0.400329 Oct 16 01:04:57.100564 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 675/1239] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:04:56 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 2420 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:04:57.106045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e7c0b6e-e9d0-4faa-b3db-3aa5f4d5da5f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e1fbca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.182866 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e7c0b6e-e9d0-4faa-b3db-3aa5f4d5da5f tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.080856 Oct 16 01:04:57.183728 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 676/1240] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:57 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:57.185332 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] HTTP exception thrown: Volume c9b922ae-9946-4c3b-95df-718731719cc4 could not be found. Oct 16 01:04:57.191733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.192561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Request method failure captured: Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8/os-volume_attachments/c9b922ae-9946-4c3b-95df-718731719cc4 HTTP/1.1 Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 74 Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1gimhNJ1shjNh_HNY6zfsXHQ-rrZ4jmvrVABa4Q77FiDKB9ZJ89bd4exC5m9vFd8n3oWNM6HL2kxwUJg77F1fVfG8VhEQ-x34rePFZe9llIGxAJVxe6IzCtoF63i3naqAIf8ghaabn9gtx4DJKpwS6wqxVnsqwh9fsE3HjgUt1oMMc Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 9a8b7d6b98284f61849a7ef4350a2abe Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-VolumesAdminNegativeTest-86393841 Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:04:57.193684 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9a8b7d6b98284f61849a7ef4350a2abe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9a8b7d6b98284f61849a7ef4350a2abe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9a8b7d6b98284f61849a7ef4350a2abe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9a8b7d6b98284f61849a7ef4350a2abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-VolumesAdminNegativeTest-86393841 Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 9a8b7d6b98284f61849a7ef4350a2abe Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-86393841 Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-VolumesAdminNegativeTest-86393841-project-admin Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 3b1244bc039d4645b2c813b77b1593cd Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-VolumesAdminNegativeTest-86393841-project-admin Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: {"volumeAttachment": {"volumeId": "74e54c63-941b-4271-8aa4-fe080a842d48"}} Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:04:57.195508 n-d-master-1 devstack@n-api.service[120546]: exception: Volume c9b922ae-9946-4c3b-95df-718731719cc4 could not be found. Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': 'ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8', 'id': 'c9b922ae-9946-4c3b-95df-718731719cc4', 'body': {'volumeAttachment': {'volumeId': '74e54c63-941b-4271-8aa4-fe080a842d48'}}} Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:57.196562 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9b922ae-9946-4c3b-95df-718731719cc4 could not be found. (HTTP 404) (Request-ID: req-8eb0b66c-b939-4170-abf2-677a0246c92f) Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:04:57.197733 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9b922ae-9946-4c3b-95df-718731719cc4 could not be found. Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:57.199175 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9b922ae-9946-4c3b-95df-718731719cc4 could not be found. Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9b922ae-9946-4c3b-95df-718731719cc4 could not be found. Oct 16 01:04:57.200361 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.201598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] Returning 404 to user: Volume c9b922ae-9946-4c3b-95df-718731719cc4 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:57.201598 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b44534da-653f-40a0-b837-ebc607985eee tempest-VolumesAdminNegativeTest-86393841 tempest-VolumesAdminNegativeTest-86393841-project-admin] 10.222.0.39 "PUT /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8/os-volume_attachments/c9b922ae-9946-4c3b-95df-718731719cc4" status: 404 len: 109 microversion: 2.1 time: 0.152022 Oct 16 01:04:57.201598 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 565/1241] 10.222.0.39 () {60 vars in 1433 bytes} [Sun Oct 16 01:04:57 2022] PUT /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8/os-volume_attachments/c9b922ae-9946-4c3b-95df-718731719cc4 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:57.210646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.211369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.218383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.218838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.219375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.220142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.220410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.220922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.221122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.221705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.222102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.222253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.223396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.223984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.241542 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] HTTP exception thrown: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Request method failure captured: Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 HTTP/1.1 Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hmSopeweabfuzMkWsa_kaYBqYua5RcQnjytRJ6Tar9mhyOsRgaL_czSEbMO6jJoOokzUlYx0NCD8du_ucAHdjFnpzjd3uZ0GHF1ICwnevBVRcOeZt1B1jmwODQOW6zoC0lKIhw93n19ocEP400gr6NrIOdozd5v7llhBQn8JfYQ9k Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 7776307d685b47fe8beca919b5f90966 Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:04:57.243968 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7776307d685b47fe8beca919b5f90966", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7776307d685b47fe8beca919b5f90966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7776307d685b47fe8beca919b5f90966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7776307d685b47fe8beca919b5f90966"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 7776307d685b47fe8beca919b5f90966 Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FloatingIPsAssociationTestJSON-1066714197-project Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 8cd01d53807440fd827b41778a54627a Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1066714197-project Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: exception: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.245614 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ccd8bea2-cfe6-4678-b296-002942b54485'} Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:57.246532 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.248107 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.251183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Returning 404 to user: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:57.252213 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5874561f-62d2-4853-9bbf-2b088badc867 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 404 len: 111 microversion: 2.1 time: 0.066928 Oct 16 01:04:57.253827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 677/1242] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:04:57 2022] DELETE /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:57.259447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0d2756ff-349d-455e-bfbe-f826b1cd4381 req-a59e8c95-8068-4f0c-9e04-511d61f2d848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80668ef9-fa93-48b1-b507-d7b4a7de0afb", "tag": "3944e49d-d846-4923-940e-18c1f16c178f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:57.272629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0d2756ff-349d-455e-bfbe-f826b1cd4381 req-a59e8c95-8068-4f0c-9e04-511d61f2d848 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.274214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0d2756ff-349d-455e-bfbe-f826b1cd4381 req-a59e8c95-8068-4f0c-9e04-511d61f2d848 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.275105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0d2756ff-349d-455e-bfbe-f826b1cd4381 req-a59e8c95-8068-4f0c-9e04-511d61f2d848 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.308426 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0d2756ff-349d-455e-bfbe-f826b1cd4381 req-a59e8c95-8068-4f0c-9e04-511d61f2d848 service nova] Creating event network-changed:3944e49d-d846-4923-940e-18c1f16c178f for instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb on n-h1-master-1 Oct 16 01:04:57.315600 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0d2756ff-349d-455e-bfbe-f826b1cd4381 req-a59e8c95-8068-4f0c-9e04-511d61f2d848 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060030 Oct 16 01:04:57.316815 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 678/1243] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:04:57.324050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.325319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.333665 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:57.335976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.336822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.337550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.338484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.339130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.339663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.367309 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:57.486962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lazy-loading 'services' on Instance uuid 981200a2-5a9d-469f-9f65-ad75dbe1b422 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:04:57.513113 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd2b3972-2a27-4ba6-a8c3-b23d547d95a0 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1613 microversion: 2.1 time: 0.311383 Oct 16 01:04:57.514235 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 566/1244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:57 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1613 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:57.531256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.532827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: ccd8bea2-cfe6-4678-b296-002942b54485] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.540780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.559516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.560396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.561939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.562418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.562846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.589123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] HTTP exception thrown: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Request method failure captured: Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 HTTP/1.1 Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hmSopeweabfuzMkWsa_kaYBqYua5RcQnjytRJ6Tar9mhyOsRgaL_czSEbMO6jJoOokzUlYx0NCD8du_ucAHdjFnpzjd3uZ0GHF1ICwnevBVRcOeZt1B1jmwODQOW6zoC0lKIhw93n19ocEP400gr6NrIOdozd5v7llhBQn8JfYQ9k Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 7776307d685b47fe8beca919b5f90966 Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:04:57.591159 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7776307d685b47fe8beca919b5f90966", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7776307d685b47fe8beca919b5f90966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7776307d685b47fe8beca919b5f90966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7776307d685b47fe8beca919b5f90966"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 7776307d685b47fe8beca919b5f90966 Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FloatingIPsAssociationTestJSON-1066714197-project Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 8cd01d53807440fd827b41778a54627a Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1066714197-project Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.592689 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ccd8bea2-cfe6-4678-b296-002942b54485'} Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:04:57.593601 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. Oct 16 01:04:57.595653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:04:57.598669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Returning 404 to user: Instance ccd8bea2-cfe6-4678-b296-002942b54485 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:04:57.599750 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db63ba86-16e7-4c90-b275-253540672df6 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485" status: 404 len: 111 microversion: 2.1 time: 0.084383 Oct 16 01:04:57.600808 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 567/1245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:57 2022] GET /compute/v2.1/servers/ccd8bea2-cfe6-4678-b296-002942b54485 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:57.605826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:57.606656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.614594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.615376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.616007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.616871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.618575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.619231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.695375 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca3c084c-dcc1-4a65-8136-f6715367652b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "DELETE /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments/2484f446-ece7-4e7f-89f9-a9bff0a47d39" status: 202 len: 0 microversion: 2.25 time: 0.375426 Oct 16 01:04:57.697135 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 679/1246] 10.222.0.39 () {60 vars in 1457 bytes} [Sun Oct 16 01:04:57 2022] DELETE /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments/2484f446-ece7-4e7f-89f9-a9bff0a47d39 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:04:57.705985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:04:57.712296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:57.724180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.730551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.731530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.732476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:57.733099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:57.733719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:57.906296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6f6ea3b7518449b89a369107e12ee9cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc88035f18493d8c713b47a35517ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:57.913194 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] flavor_id is None. Assuming migration. {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 16 01:04:57.913938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:04:58.090658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:58.104296 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-44d90b4b-9a1c-4610-bbd5-a6a010d87cbb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1505 microversion: 2.1 time: 0.502253 Oct 16 01:04:58.107225 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 568/1247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:57 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:58.121727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fc29067f-492a-4e9b-ae22-ab501bdbd0bc tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '.version_select at 0x7fd64e309d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:58.300133 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82e0188a-82e5-44ec-afde-1611a6147efd tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6/action" status: 202 len: 0 microversion: 2.1 time: 0.596649 Oct 16 01:04:58.304220 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 680/1248] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:04:57 2022] POST /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:04:58.314877 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:58.327517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:58.335725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.341399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.342096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.343083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.343707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.344317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.416461 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10eecf58-c7f5-4f50-93be-3120ed3f21df tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110906 Oct 16 01:04:58.417368 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 681/1249] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:04:58 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:04:58.422062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:58.422716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:58.437293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.443028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.443938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:58.444869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:58.445499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:58.446268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.071250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:59.097909 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1204334b-a507-46a4-8c71-342666b29f4b tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1478 microversion: 2.1 time: 0.679385 Oct 16 01:04:59.102960 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 682/1250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:58 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1478 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:59.109920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.116155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:59.136208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.136708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.137161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.138005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.138469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.138892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.464010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:59.480019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-01f8cac8-3456-4a6a-892b-1529a62e1c96 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1308 microversion: 2.1 time: 0.375610 Oct 16 01:04:59.480694 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 683/1251] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:59 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:59.489669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7731351d-a415-48d6-9809-f9797de793c6 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e27a790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.578708 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7731351d-a415-48d6-9809-f9797de793c6 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.096714 Oct 16 01:04:59.580459 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 684/1252] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:59 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:59.595991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.598142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:59.610781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.614079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.614765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.615868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.618804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.619476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.871985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:04:59.881777 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-788795bd-8de2-49d3-8e2f-67c1b5ce93fa tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1471 microversion: 2.1 time: 0.299156 Oct 16 01:04:59.885904 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 685/1253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:59 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:04:59.893950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:04:59.894805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:04:59.901265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.901982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.902582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:04:59.903477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:04:59.904090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:04:59.905182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:00.488133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:00.496803 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bf43a022-5d04-4a51-8acf-b9c2375b6f17 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1505 microversion: 2.1 time: 0.609574 Oct 16 01:05:00.515679 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 686/1254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:04:59 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1505 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:00.527511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:00.534474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:00.539062 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fc29067f-492a-4e9b-ae22-ab501bdbd0bc tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/f2619789-f79c-4aa6-a689-9344c33e22f1" status: 202 len: 0 microversion: 2.1 time: 2.430510 Oct 16 01:05:00.540661 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 569/1255] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:04:58 2022] DELETE /compute/v2.1/os-floating-ips/f2619789-f79c-4aa6-a689-9344c33e22f1 => generated 0 bytes in 2433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:00.549923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:00.552255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:00.555874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:00.562193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:00.564598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:00.565982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:00.570707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:00.572213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:00.575404 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:00.583217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:00.591629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:00.592456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:00.593697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:00.594354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:00.595523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:00.679049 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:00.966848 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fda1e165-8c93-4550-b8b0-e676d14196c1 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.449844 Oct 16 01:05:00.967895 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 687/1256] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:05:00 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments => generated 197 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:05:00.979081 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:00.979958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:00.990671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:00.991351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:00.991964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:00.992781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:00.993341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:00.993864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.202364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:01.228321 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0fc1c8c4-7365-4b38-a0b5-3fc9fe47491c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1478 microversion: 2.1 time: 0.686301 Oct 16 01:05:01.232232 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 570/1257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:00 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1478 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:01.243852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:01.244368 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:01.263132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.263396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.267723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.270288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.272564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.273634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.363686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:01.369884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:01.385084 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7a4c45b-aa97-492b-9317-48d075163de7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1488 microversion: 2.1 time: 0.415974 Oct 16 01:05:01.386211 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 688/1258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:00 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1488 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:01.397279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1899796e-3228-4513-8478-e2dbe58777d2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e1545e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:01.500647 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1899796e-3228-4513-8478-e2dbe58777d2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.113204 Oct 16 01:05:01.502288 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 689/1259] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:01 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:01.508271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:01.534794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:01.558825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.560577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.562892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.564002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.565606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.568289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.666468 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c4077cc8-ac1e-4b6c-ae6d-c401814aa8d9 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "DELETE /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 204 len: 0 microversion: 2.1 time: 0.425705 Oct 16 01:05:01.667590 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 571/1260] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:01 2022] DELETE /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:01.695119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-8ebadf19-1c3d-4c3e-8342-b71312b0995b req-376b1990-6c3c-4d96-9879-4bf5e6368e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5", "name": "network-vif-unplugged", "status": "completed", "tag": "62f88490-3555-4b72-88e6-cee67ed2ea99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:01.724997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8ebadf19-1c3d-4c3e-8342-b71312b0995b req-376b1990-6c3c-4d96-9879-4bf5e6368e11 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.724997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8ebadf19-1c3d-4c3e-8342-b71312b0995b req-376b1990-6c3c-4d96-9879-4bf5e6368e11 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.725854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8ebadf19-1c3d-4c3e-8342-b71312b0995b req-376b1990-6c3c-4d96-9879-4bf5e6368e11 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.738810 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-8ebadf19-1c3d-4c3e-8342-b71312b0995b req-376b1990-6c3c-4d96-9879-4bf5e6368e11 service nova] Creating event network-vif-unplugged:62f88490-3555-4b72-88e6-cee67ed2ea99 for instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 on n-h2-master-1 Oct 16 01:05:01.746897 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-8ebadf19-1c3d-4c3e-8342-b71312b0995b req-376b1990-6c3c-4d96-9879-4bf5e6368e11 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077742 Oct 16 01:05:01.751839 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 572/1261] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:01.757380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7199e1f0-139d-4f84-b117-77dca0c421be tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:01.774248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7199e1f0-139d-4f84-b117-77dca0c421be tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:01.782615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7199e1f0-139d-4f84-b117-77dca0c421be tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:01.783209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7199e1f0-139d-4f84-b117-77dca0c421be tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:01.900490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7199e1f0-139d-4f84-b117-77dca0c421be tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Going to try to stop instance {{(pid=120546) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:05:01.988294 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7199e1f0-139d-4f84-b117-77dca0c421be tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90/action" status: 202 len: 0 microversion: 2.1 time: 0.234755 Oct 16 01:05:01.997008 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 573/1262] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:05:01 2022] POST /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:02.010675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.012610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.028359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.028862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.031649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.032858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.035710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.036206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.058191 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:02.069572 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d148a7a-0509-4466-9eea-ad9d2aa4a47b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1471 microversion: 2.1 time: 0.564766 Oct 16 01:05:02.070538 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 690/1263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:01 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1471 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:02.076447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.077288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.086363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.087187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.087865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.088748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.089348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.090021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.344512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:02.357811 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b05ef090-69b0-45c9-8236-1dd319192e43 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1505 microversion: 2.1 time: 0.359413 Oct 16 01:05:02.358751 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 574/1264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:01 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:02.369516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.376649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.422557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.423604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.425011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.426361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.427170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.427879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.497415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:02.506047 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c2756285-ead3-4cd3-98f8-6d743333baa7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1525 microversion: 2.1 time: 0.434199 Oct 16 01:05:02.513086 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 691/1265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:02 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1525 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:02.518681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.524287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.531675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:02.542515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.543386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.544038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.544987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.545656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.546303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.617801 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-256e259d-976a-4d13-8d4b-dec6c787c406 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106243 Oct 16 01:05:02.618996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 692/1266] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:05:02 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:05:02.624020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.624866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.631992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.632877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.633472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.634442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.635100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.635696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.825813 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88e3c9e1-2fa0-481f-b194-89bd56a36b7e tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 204 len: 0 microversion: 2.1 time: 0.460231 Oct 16 01:05:02.835162 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 575/1267] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:02 2022] DELETE /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:02.862142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:02.862860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:02.896642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.897983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.901277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:02.902539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:02.906793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:02.908818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.002178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:03.013037 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f6e0ab56-6d1a-4358-9fef-28dc9c4f08d9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.390325 Oct 16 01:05:03.014143 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 693/1268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:02 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:03.022285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-24df43e9-357b-42e0-8f59-ae2c4164f3f0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e27ad30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:03.110550 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-24df43e9-357b-42e0-8f59-ae2c4164f3f0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1454 microversion: 2.1 time: 0.095117 Oct 16 01:05:03.111842 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 694/1269] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:03 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:03.120351 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:03.121213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:03.130783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.131542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.132177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.133862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.134897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.135599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.286031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:03.295995 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-87cfac67-0677-4f82-a5a9-835a02fa4a12 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1478 microversion: 2.1 time: 0.457854 Oct 16 01:05:03.307000 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 576/1270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:02 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1478 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:03.316042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:03.316653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:03.330660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.331205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.332008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.332846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.333323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.333752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.549836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:03.577744 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-70c9eb95-5f49-4ac5-8c89-ab6054b78a32 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1512 microversion: 2.1 time: 0.457301 Oct 16 01:05:03.578546 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 695/1271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:03 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:03.583705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:03.586645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:03.593271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.593978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.595133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.596881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.597869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.598396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.861649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:03.869472 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d7551c37-d95d-488a-b6ea-95864586ef76 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1471 microversion: 2.1 time: 0.566655 Oct 16 01:05:03.882947 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 577/1272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:03 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1471 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:03.882947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:03.882947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:03.882947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.883723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.883992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.884705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:03.885164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:03.885649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:03.978035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:03.988215 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:03.996632 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-51108118-5eff-46cb-bd6f-0a4603e5ec1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1495 microversion: 2.1 time: 0.416738 Oct 16 01:05:03.999260 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 696/1273] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:03 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1495 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:04.028791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:04.033818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:04.067953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.072108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.074345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:04.075800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.077343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.078077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:04.148180 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-823d656d-22a1-4061-bf91-945fb419ff3d tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135261 Oct 16 01:05:04.148773 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 697/1274] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:05:03 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:05:04.162255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9192cc2b-f358-4db8-bbe3-f37de164cd19 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '.version_select at 0x7fd64eadda60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:04.168985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9192cc2b-f358-4db8-bbe3-f37de164cd19 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.169597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9192cc2b-f358-4db8-bbe3-f37de164cd19 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.170326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9192cc2b-f358-4db8-bbe3-f37de164cd19 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:04.185775 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9192cc2b-f358-4db8-bbe3-f37de164cd19 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3121 microversion: 2.1 time: 0.029915 Oct 16 01:05:04.187031 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 698/1275] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:05:04 2022] GET /compute/v2.1/os-migrations => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:04.192420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:04.193251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:04.200624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.201114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.201547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:04.202355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.202808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.203327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:04.523202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:04.531950 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bc674ff0-62b3-4736-a658-31b09013b34b tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1525 microversion: 2.1 time: 0.660904 Oct 16 01:05:04.541586 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 578/1276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:03 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1525 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:04.541586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59d77040-1214-4ee7-a25b-549e4abdd47c tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4d8dc0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:04.604588 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59d77040-1214-4ee7-a25b-549e4abdd47c tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1463 microversion: 2.1 time: 0.070335 Oct 16 01:05:04.614884 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 579/1277] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:04 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1463 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:04.614884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:04.614884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:04.623622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.624381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.626515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:04.629461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.630119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.631211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:04.757991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:04.791494 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4322fff8-8013-4d6b-9133-9e1dff6cadd5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.601600 Oct 16 01:05:04.813168 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 699/1278] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:04 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:04.822910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:04.823559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:04.832557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.833104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.833536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:04.834765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:04.835256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:04.835677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.014418 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d3ce3230-6963-4b3d-8fd0-666236af64d9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1646 microversion: 2.1 time: 0.407362 Oct 16 01:05:05.017764 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 580/1279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:04 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1646 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:05.029161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:05.030218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:05.053047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.054124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.054124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.059393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.060078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.060542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.134709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:05.145184 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1a229108-8d2d-48e6-a1db-80cc5a348b3c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1478 microversion: 2.1 time: 0.327457 Oct 16 01:05:05.146731 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 700/1280] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:04 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1478 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:05.153174 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5112d051-5af7-4870-a758-802c8c9dfb89 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e154280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:05.214411 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5112d051-5af7-4870-a758-802c8c9dfb89 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 200 len: 1463 microversion: 2.1 time: 0.066201 Oct 16 01:05:05.215445 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 701/1281] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:05 2022] GET /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 1463 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:05.231056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:05.232128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:05.238283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.244370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.244917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.245749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.246318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.246843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.449122 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:05.458274 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0e7b9047-66f5-45ce-bded-03fc3f4ec4f3 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1512 microversion: 2.1 time: 0.437848 Oct 16 01:05:05.458874 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 581/1282] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:05 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1512 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:05.467199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-96853c2f-12f3-4a2b-b941-94a6f83d5e88 req-6de0ea8d-59c2-427d-80cf-07cdcc461b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5", "name": "network-vif-plugged", "status": "completed", "tag": "62f88490-3555-4b72-88e6-cee67ed2ea99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:05.500220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-96853c2f-12f3-4a2b-b941-94a6f83d5e88 req-6de0ea8d-59c2-427d-80cf-07cdcc461b42 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.500716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-96853c2f-12f3-4a2b-b941-94a6f83d5e88 req-6de0ea8d-59c2-427d-80cf-07cdcc461b42 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.509294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-96853c2f-12f3-4a2b-b941-94a6f83d5e88 req-6de0ea8d-59c2-427d-80cf-07cdcc461b42 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.537525 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-96853c2f-12f3-4a2b-b941-94a6f83d5e88 req-6de0ea8d-59c2-427d-80cf-07cdcc461b42 service nova] Creating event network-vif-plugged:62f88490-3555-4b72-88e6-cee67ed2ea99 for instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 on n-h2-master-1 Oct 16 01:05:05.544336 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-96853c2f-12f3-4a2b-b941-94a6f83d5e88 req-6de0ea8d-59c2-427d-80cf-07cdcc461b42 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080421 Oct 16 01:05:05.545748 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 582/1283] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:05.568767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2c39d347-3739-432e-8b14-daa492cbf78f req-87fa1b65-6b4e-48a5-a04b-e64285415a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80668ef9-fa93-48b1-b507-d7b4a7de0afb", "name": "network-vif-deleted", "tag": "3944e49d-d846-4923-940e-18c1f16c178f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:05.574857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:05.582019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2c39d347-3739-432e-8b14-daa492cbf78f req-87fa1b65-6b4e-48a5-a04b-e64285415a09 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.582867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2c39d347-3739-432e-8b14-daa492cbf78f req-87fa1b65-6b4e-48a5-a04b-e64285415a09 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.583748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2c39d347-3739-432e-8b14-daa492cbf78f req-87fa1b65-6b4e-48a5-a04b-e64285415a09 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.587369 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0292e2c3-e03c-40a3-95eb-acaffbb21140 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.370657 Oct 16 01:05:05.617192 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 702/1284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:05 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:05.629011 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2c39d347-3739-432e-8b14-daa492cbf78f req-87fa1b65-6b4e-48a5-a04b-e64285415a09 service nova] Creating event network-vif-deleted:3944e49d-d846-4923-940e-18c1f16c178f for instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb on n-h1-master-1 Oct 16 01:05:05.632152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1344302928", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "a5e706d8-a668-4337-ad37-edd049e6eb97"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:05.639179 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2c39d347-3739-432e-8b14-daa492cbf78f req-87fa1b65-6b4e-48a5-a04b-e64285415a09 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089221 Oct 16 01:05:05.640241 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 583/1285] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:05.650670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:05.653361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:05.661420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.662693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.663343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.664482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.665116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.665711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.733915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] validate_networks() for [('a5e706d8-a668-4337-ad37-edd049e6eb97', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:05:05.736930 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c2327f71-0df1-44b1-b40a-d6224e188e72 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090721 Oct 16 01:05:05.748850 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 584/1286] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:05:05 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:05:05.755271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:05.755888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:05.762075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.762576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.763092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.764291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:05.764820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:05.765258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:05.803011 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:06.041977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:06.051274 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac5f2fb0-bba8-472b-84c7-f120097637a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 1468 microversion: 2.1 time: 0.300808 Oct 16 01:05:06.051873 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 585/1287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:05 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 1468 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:06.069015 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-49388a55-6ab9-46ff-966c-fdee38499237 req-f3938b7a-68d5-4e9e-a3c4-37b5885fca21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8", "name": "network-vif-deleted", "tag": "8741ee6c-5609-43e8-b6a9-bcce49ec1b84"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:06.080832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-49388a55-6ab9-46ff-966c-fdee38499237 req-f3938b7a-68d5-4e9e-a3c4-37b5885fca21 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.081302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-49388a55-6ab9-46ff-966c-fdee38499237 req-f3938b7a-68d5-4e9e-a3c4-37b5885fca21 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.081734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-49388a55-6ab9-46ff-966c-fdee38499237 req-f3938b7a-68d5-4e9e-a3c4-37b5885fca21 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.093523 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-49388a55-6ab9-46ff-966c-fdee38499237 req-f3938b7a-68d5-4e9e-a3c4-37b5885fca21 service nova] Creating event network-vif-deleted:8741ee6c-5609-43e8-b6a9-bcce49ec1b84 for instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 on n-h2-master-1 Oct 16 01:05:06.099783 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-49388a55-6ab9-46ff-966c-fdee38499237 req-f3938b7a-68d5-4e9e-a3c4-37b5885fca21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034750 Oct 16 01:05:06.100384 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 586/1288] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:06.105704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.106388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.113325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.113808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.114243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.114952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.115403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.115821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.151649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.152132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.152560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.153020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lazy-loading 'fault' on Instance uuid 80668ef9-fa93-48b1-b507-d7b4a7de0afb {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:06.209260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:06.218408 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03a4d202-12bd-4df3-acd0-2dccb42e155e tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1313 microversion: 2.1 time: 0.116673 Oct 16 01:05:06.219129 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 587/1289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1313 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:06.224770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.225409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.231269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.231943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.232378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.233073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.233525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.233950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.420948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:05:06.421492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:05:06.422091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:05:06.422540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:05:06.423019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:05:06.431955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.432443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.432875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.433795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.434259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.434687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.444508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:06.452252 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3bd8e882-a356-4e8a-820f-558a0d8ecd49 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.231310 Oct 16 01:05:06.452837 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 588/1290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:06.457408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8d4e453-b1c3-4e3c-8d62-94d6ac10dabf tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e441d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.462901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for project 05a68224ef104af2963c881faa8383de. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:05:06.480698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for user 3c33afd9ae144eb185203c30baa70351 and project 05a68224ef104af2963c881faa8383de. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:05:06.505759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:05:06.508797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:05:06.570561 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca0d2261-b444-474b-9908-35dada35899b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951906 Oct 16 01:05:06.572106 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 703/1291] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:05:06.577040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.577980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.582357 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8d4e453-b1c3-4e3c-8d62-94d6ac10dabf tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images?changes-since=2022-10-16T01%3A03%3A05Z" status: 200 len: 2375 microversion: 2.1 time: 0.128415 Oct 16 01:05:06.593670 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 589/1292] 10.222.0.39 () {58 vars in 1199 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/images?changes-since=2022-10-16T01%3A03%3A05Z => generated 2375 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:06.593670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.593670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.596721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.597237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.597691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.598409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.598876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.599408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.599723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.600432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.601073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.601973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.602737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.603426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.640495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.641019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.642446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.642957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lazy-loading 'fault' on Instance uuid ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:06.739224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:06.753814 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11ebefd6-851f-432a-a1aa-1d25f613c059 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 200 len: 1307 microversion: 2.1 time: 0.169349 Oct 16 01:05:06.755088 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 590/1293] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:06.777963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f50d2d14-8b69-41cf-8e40-c691827c40ae tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.778579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f50d2d14-8b69-41cf-8e40-c691827c40ae tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.882711 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f50d2d14-8b69-41cf-8e40-c691827c40ae tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:06.896992 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f50d2d14-8b69-41cf-8e40-c691827c40ae tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1211 microversion: 2.1 time: 0.123702 Oct 16 01:05:06.898278 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 591/1294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:06.919271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:06.921745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3c2fed33-7f1a-43da-bdb2-07d12becb93d tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e125160>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.928994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d07eea3e-03df-4f6a-a2b3-f2a50bbc39e6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1478 microversion: 2.1 time: 0.355617 Oct 16 01:05:06.929568 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 704/1295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1478 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:06.937584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:06.937753 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:06.959046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.959742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.960341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:06.961214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:06.966791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:06.967479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.015473 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3c2fed33-7f1a-43da-bdb2-07d12becb93d tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1858822666" status: 200 len: 485 microversion: 2.1 time: 0.102183 Oct 16 01:05:07.023616 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 592/1296] 10.222.0.39 () {58 vars in 1231 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1858822666 => generated 485 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:07.031480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.034108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:07.040673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.041517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.041985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.042770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.043290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.043908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.077420 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-607bb097-cb6c-4457-969b-07532da5b2e7 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.052425 Oct 16 01:05:07.083055 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 593/1297] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:07.088626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfa56cdf-2e16-4140-8254-9970df230fb3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e138040>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.138455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:07.163577 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb870674-af28-4031-8a58-65bf10313008 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.230793 Oct 16 01:05:07.164833 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 705/1298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:06 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:07.197256 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfa56cdf-2e16-4140-8254-9970df230fb3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images?server=4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 957 microversion: 2.1 time: 0.112896 Oct 16 01:05:07.197852 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 594/1299] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/images?server=4495b959-d827-46f4-92c3-05b9b91c2020 => generated 957 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:07.211111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-29104711-5d9f-4ff5-a7d7-138340ec75a4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e684c10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.265149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.265781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:07.278407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.278629 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-29104711-5d9f-4ff5-a7d7-138340ec75a4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 484 microversion: 2.1 time: 0.070818 Oct 16 01:05:07.278903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.279558 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 706/1300] 10.222.0.39 () {58 vars in 1317 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 484 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:05:07.294992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.296047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.296605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.297821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.314621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a90add56-f8f3-49b2-8139-9dd029110ac4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e0e5e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.390365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.390586 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a90add56-f8f3-49b2-8139-9dd029110ac4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 484 microversion: 2.1 time: 0.093890 Oct 16 01:05:07.392461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.392916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.393380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lazy-loading 'fault' on Instance uuid 80668ef9-fa93-48b1-b507-d7b4a7de0afb {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:07.396201 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 707/1301] 10.222.0.39 () {58 vars in 1303 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 484 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:07.409430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49c8ed7b-b2bd-4828-b23f-a658ddd44373 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e0e5280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.509205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd01d53807440fd827b41778a54627a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7776307d685b47fe8beca919b5f90966', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:07.522465 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64ebed89-a10b-4805-834b-ba03a95cb5e7 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 200 len: 1313 microversion: 2.1 time: 0.280850 Oct 16 01:05:07.523134 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 595/1302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:07.531665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.533094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:07.540129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.540918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.541551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.542464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.543155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.544191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.661079 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49c8ed7b-b2bd-4828-b23f-a658ddd44373 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.255924 Oct 16 01:05:07.666687 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 708/1303] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:07.679262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c04c0ccb-3a48-4804-9721-db8ed35a03d4 req-7ce2f63a-fd21-4bc8-b4b5-6b91b8ce6de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4495b959-d827-46f4-92c3-05b9b91c2020", "name": "network-vif-unplugged", "status": "completed", "tag": "ca157844-15f0-450a-862c-cca64f9f972e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:07.696056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c04c0ccb-3a48-4804-9721-db8ed35a03d4 req-7ce2f63a-fd21-4bc8-b4b5-6b91b8ce6de8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.697068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c04c0ccb-3a48-4804-9721-db8ed35a03d4 req-7ce2f63a-fd21-4bc8-b4b5-6b91b8ce6de8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.697682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c04c0ccb-3a48-4804-9721-db8ed35a03d4 req-7ce2f63a-fd21-4bc8-b4b5-6b91b8ce6de8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.717666 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c04c0ccb-3a48-4804-9721-db8ed35a03d4 req-7ce2f63a-fd21-4bc8-b4b5-6b91b8ce6de8 service nova] Creating event network-vif-unplugged:ca157844-15f0-450a-862c-cca64f9f972e for instance 4495b959-d827-46f4-92c3-05b9b91c2020 on n-h1-master-1 Oct 16 01:05:07.728331 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c04c0ccb-3a48-4804-9721-db8ed35a03d4 req-7ce2f63a-fd21-4bc8-b4b5-6b91b8ce6de8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054610 Oct 16 01:05:07.729211 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 709/1304] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:07.745939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-36ec83c2-1b23-4b02-9b82-e264da96dc8b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e206e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.881090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:07.890365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-36ec83c2-1b23-4b02-9b82-e264da96dc8b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.155889 Oct 16 01:05:07.891248 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 710/1305] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:07.896776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.898019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:07.906054 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c19fe9b1-6d00-4b00-8785-ef3cd2f1c908 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.379256 Oct 16 01:05:07.907687 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 596/1306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:07.912627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dcb9e959-d86a-4317-b28f-a16c72c75bd8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e491ee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:07.928503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.929483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.931819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.935728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:07.939560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:07.940372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:07.993196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] HTTP exception thrown: Instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 could not be found. Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Request method failure captured: Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 HTTP/1.1 Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1gVTT-hMPbSFKHiJBDs8d67_ivCbxHFqQpxBSnlSOM9yKuPjTDinCx3GqJf_H25c2BOvyESWHLrqSPOlhVjBRjBvT84Rmv_3YXjQCV-ZyoQ3xBSWuq1ZhMhew894NQf6hvq0L-t4ICum-6ExqHDOy2TyfHiabilYlwhtv9qYSwqqB0 Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 5eec6e034df149f8863b1b9ebacfaa81 Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesAdminNegativeTest-1620951426 Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:05:07.996031 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5eec6e034df149f8863b1b9ebacfaa81", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5eec6e034df149f8863b1b9ebacfaa81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5eec6e034df149f8863b1b9ebacfaa81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5eec6e034df149f8863b1b9ebacfaa81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesAdminNegativeTest-1620951426 Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 5eec6e034df149f8863b1b9ebacfaa81 Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1620951426 Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesAdminNegativeTest-1620951426-project Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: aceec71835c14681a2ff7d7285d87776 Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesAdminNegativeTest-1620951426-project Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: exception: Instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 could not be found. Oct 16 01:05:07.998664 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8'} Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 could not be found. Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:08.002123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 could not be found. Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 could not be found. Oct 16 01:05:08.005989 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.010656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Returning 404 to user: Instance ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:08.011359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dcb9e959-d86a-4317-b28f-a16c72c75bd8 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.088668 Oct 16 01:05:08.011599 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cc291aa-1f21-4c41-8f3c-d64e009589a6 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8" status: 404 len: 111 microversion: 2.1 time: 0.105703 Oct 16 01:05:08.011817 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 597/1307] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:08.012025 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 711/1308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/servers/ddc1243c-2a2f-4dbb-9c0e-5cd19fe4c2a8 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:08.012025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.012025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.016160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.017101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.017608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.018044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.018663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.020366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.020841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.021713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.036506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.038341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.039452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.042003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.044506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.045647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.205679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:08.218051 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e24dc050-a6b5-483f-b90c-102045b18723 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1263 microversion: 2.1 time: 0.218135 Oct 16 01:05:08.219204 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 598/1309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1263 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:08.224768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c8ffc08-d16a-44e8-a712-23a7e0aefe88 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64eebc310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.282761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:08.291232 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6cb561b5-6f13-4e07-a306-538d2dd150e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1463 microversion: 2.1 time: 0.290978 Oct 16 01:05:08.291970 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 712/1310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:07 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1463 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:08.299559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.300586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.308308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.317490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.317490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.317490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.317862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.318158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.335084 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c8ffc08-d16a-44e8-a712-23a7e0aefe88 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/detail?changes-since=2022-10-16T01%3A03%3A01Z" status: 200 len: 6334 microversion: 2.1 time: 0.113829 Oct 16 01:05:08.335833 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 599/1311] 10.222.0.39 () {58 vars in 1220 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-16T01%3A03%3A01Z => generated 6334 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:08.340657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:08.343190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.351684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.352507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.352941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.353966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.354473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.354903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.449815 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd26ab0b-981b-4adc-8f51-71f11d2f976d tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action" status: 202 len: 0 microversion: 2.1 time: 0.112648 Oct 16 01:05:08.451079 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 600/1312] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:05:08 2022] POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:08.460805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4b4011cb-9c42-40ef-bcf8-f0f4ac933f85 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4d8790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.502422 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:08.513218 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7199a934-8831-4906-b226-9f7b42876acf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.219174 Oct 16 01:05:08.513794 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 713/1313] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:08.519604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.520331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.527918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.528408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.528837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.529540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.529997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.530594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.583008 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4b4011cb-9c42-40ef-bcf8-f0f4ac933f85 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1858822666" status: 200 len: 665 microversion: 2.1 time: 0.130630 Oct 16 01:05:08.595362 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 601/1314] 10.222.0.39 () {58 vars in 1252 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1858822666 => generated 665 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:08.600716 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.601428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] [instance: 80668ef9-fa93-48b1-b507-d7b4a7de0afb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.612086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.612840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.613352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.614865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.615424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.616071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.616388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.617050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.617767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.618294 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lazy-loading 'fault' on Instance uuid ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:08.631514 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] HTTP exception thrown: Instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb could not be found. Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Request method failure captured: Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb HTTP/1.1 Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hmSopeweabfuzMkWsa_kaYBqYua5RcQnjytRJ6Tar9mhyOsRgaL_czSEbMO6jJoOokzUlYx0NCD8du_ucAHdjFnpzjd3uZ0GHF1ICwnevBVRcOeZt1B1jmwODQOW6zoC0lKIhw93n19ocEP400gr6NrIOdozd5v7llhBQn8JfYQ9k Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 7776307d685b47fe8beca919b5f90966 Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:05:08.633259 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7776307d685b47fe8beca919b5f90966", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7776307d685b47fe8beca919b5f90966"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7776307d685b47fe8beca919b5f90966"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7776307d685b47fe8beca919b5f90966"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 7776307d685b47fe8beca919b5f90966 Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1066714197 Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FloatingIPsAssociationTestJSON-1066714197-project Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 8cd01d53807440fd827b41778a54627a Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1066714197-project Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb could not be found. Oct 16 01:05:08.634642 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '80668ef9-fa93-48b1-b507-d7b4a7de0afb'} Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb could not be found. Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:08.635590 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb could not be found. Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb could not be found. Oct 16 01:05:08.641446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:08.642806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] Returning 404 to user: Instance 80668ef9-fa93-48b1-b507-d7b4a7de0afb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:08.642806 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be71b73d-6c34-4d67-939c-7d77b804fcb3 tempest-FloatingIPsAssociationTestJSON-1066714197 tempest-FloatingIPsAssociationTestJSON-1066714197-project] 10.222.0.39 "GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb" status: 404 len: 111 microversion: 2.1 time: 0.038044 Oct 16 01:05:08.642806 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 602/1315] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/servers/80668ef9-fa93-48b1-b507-d7b4a7de0afb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:08.643323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53928ca5-8a27-400c-a23a-9bd911c78b5c tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4d84c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.730997 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53928ca5-8a27-400c-a23a-9bd911c78b5c tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1466 microversion: 2.1 time: 0.092927 Oct 16 01:05:08.732032 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 603/1316] 10.222.0.39 () {58 vars in 1338 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1466 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:08.747350 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e555a1c-7c96-4560-8f7f-97d9d6efbf29 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1597 microversion: 2.1 time: 0.232037 Oct 16 01:05:08.747913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7856100e-2ec1-4920-b3d7-5bae910357a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e1ba280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:08.767080 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 714/1317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1597 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:08.781458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:08.787939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:08.805174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.805790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.806300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.808854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:08.811317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:08.811831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:08.851775 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7856100e-2ec1-4920-b3d7-5bae910357a0 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1466 microversion: 2.1 time: 0.107641 Oct 16 01:05:08.867896 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 604/1318] 10.222.0.39 () {58 vars in 1324 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1466 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:08.882737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b0c57dc-445a-4df5-8d86-ab53fcf900d4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e4d8940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.024515 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a49fc5b5-6056-4efc-99b2-45b7f0391c3c tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action" status: 202 len: 0 microversion: 2.1 time: 0.252386 Oct 16 01:05:09.025569 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 715/1319] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:05:08 2022] POST /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:09.034351 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.035409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:09.053908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.054666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.055319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.056420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.057080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.057770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.096345 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b0c57dc-445a-4df5-8d86-ab53fcf900d4 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.221596 Oct 16 01:05:09.097608 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 605/1320] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Oct 16 01:05:08 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:09.123836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.124758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:09.136708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.140874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.147310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.149984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.150633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.151185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.439095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:09.456333 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dcc49c64-947e-45f3-8972-ce914156278c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.429428 Oct 16 01:05:09.457175 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 716/1321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:09 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:09.472680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-439d3f73-91c0-4245-9630-a64272712854 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e0e5280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.518088 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ad867593-5da4-4007-850e-05c8b43bc425 tempest-ServersAdminTestJSON-2126071256 tempest-ServersAdminTestJSON-2126071256-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1614 microversion: 2.1 time: 0.405467 Oct 16 01:05:09.521997 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 606/1322] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:09 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1614 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:09.531580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.533508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:09.549422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.549916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.550354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.558415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.559106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.559771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.579606 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-439d3f73-91c0-4245-9630-a64272712854 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.118423 Oct 16 01:05:09.580479 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 717/1323] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Oct 16 01:05:09 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:09.612978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.613607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:09.620714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.621218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.621657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.622373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.622833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.633900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.648434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:09.662168 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5c105b1b-53c7-4aeb-b2c3-8bd7d6605c18 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1269 microversion: 2.1 time: 0.138335 Oct 16 01:05:09.662821 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 607/1324] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:09 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1269 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:09.676855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.677362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:09.690870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.691403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.691853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.692559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:09.693020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:09.693450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:09.759572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:09.882432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:09.894457 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad985daf-e7f2-454f-a5b5-cb8b21c76904 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.294012 Oct 16 01:05:09.911430 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 718/1325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:09 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:09.918521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57e8f360-a03f-4ee0-8bce-6a53e9d04ab3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e0e55e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.971355 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-57e8f360-a03f-4ee0-8bce-6a53e9d04ab3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/a103d6a4-5636-40e5-8e77-0179ae547423" status: 200 len: 784 microversion: 2.1 time: 0.058601 Oct 16 01:05:09.982984 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 719/1326] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:09 2022] GET /compute/v2.1/images/a103d6a4-5636-40e5-8e77-0179ae547423 => generated 784 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:09.987655 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b3f1ae6-d59b-4c25-928b-6d73cbfaa188 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 204 len: 0 microversion: 2.1 time: 0.315309 Oct 16 01:05:09.989062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf4a44ea-271a-42fb-906f-4d455d6c5aa3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e21e0d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:09.991840 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 608/1327] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:09 2022] DELETE /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:10.012117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:10.016497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:10.028385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:10.029958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:10.032928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:10.034602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:10.038738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:10.039972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:10.073290 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf4a44ea-271a-42fb-906f-4d455d6c5aa3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.088900 Oct 16 01:05:10.074122 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 720/1328] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:05:09 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:10.091142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-161fb142-ed31-4983-8e69-561d041a6e95 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e0e5940>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:10.106995 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:10.172393 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:05:10.172812 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 01:05:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 (ip 10.222.0.39) !!! Oct 16 01:05:10.356833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:10.381765 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-06061912-64f2-4c5e-a257-b1693579f262 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1470 microversion: 2.1 time: 0.384248 Oct 16 01:05:10.407111 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 609/1329] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:09 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1470 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:10.487350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:10.488450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:10.507140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:10.513814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:10.514524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:10.517332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:10.518271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:10.518874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:10.924551 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-161fb142-ed31-4983-8e69-561d041a6e95 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "DELETE /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7" status: 204 len: 0 microversion: 2.1 time: 0.837356 Oct 16 01:05:10.925239 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 721/1330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:10 2022] DELETE /compute/v2.1/images/3ff59b4f-f8e2-431b-8f29-520e0ec6c2c7 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:10.930652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:10.931339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:10.947351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:10.948938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:10.952744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:10.953753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:10.954722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:10.956586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:11.141063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:11.154314 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f015423-f50a-4da0-ba6e-41444bc1e68b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.676101 Oct 16 01:05:11.156241 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 610/1331] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:10 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:05:11.162269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:11.162957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:11.169654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:11.170377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:11.171194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:11.173241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:11.174599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:11.175253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:11.389163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:11.398029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8321cab6-43f2-4eca-aa62-19c95a8c0336 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.471643 Oct 16 01:05:11.398628 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 722/1332] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:10 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:11.411310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0fb782e-519b-409c-9718-4263103ed40a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e0e5ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:11.773043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:11.792013 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d0e4f564-dd8c-4a69-b474-c99778bb1062 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.631648 Oct 16 01:05:11.792928 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 611/1333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:11 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:11.819479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:11.821373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:11.851487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:11.853626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:11.854664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:11.856768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:11.858491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:11.862088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:12.281090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:12.298103 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c02120c8-7ac9-4f70-9870-f0e2e4a6a111 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1470 microversion: 2.1 time: 0.500869 Oct 16 01:05:12.298716 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 612/1334] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:11 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:12.310393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:12.321113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:12.373109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:12.383655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:12.387076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:12.389837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:12.395918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:12.400157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:12.462202 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0fb782e-519b-409c-9718-4263103ed40a tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "DELETE /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837" status: 204 len: 0 microversion: 2.1 time: 1.062431 Oct 16 01:05:12.463513 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 723/1335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:11 2022] DELETE /compute/v2.1/images/5207d3d7-66ac-4dd8-9294-169ff75cc837 => generated 0 bytes in 1064 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:12.471719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:12.472547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:12.489626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:12.490427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:12.492529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:12.496304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:12.499965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:12.500790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:12.559405 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:13.017467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:13.025923 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8be75ee-14f7-443d-b05b-c07d6bc785f7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.719965 Oct 16 01:05:13.033945 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 613/1336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:12 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:13.087281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-06fa6f27-3611-40f7-a6e5-fe64ff845738 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64eb03c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:13.101862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:13.111808 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe238373-de05-44ad-a51d-c23d4c741990 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.646506 Oct 16 01:05:13.113097 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 724/1337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:12 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:13.119770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:13.120570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:13.127615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:13.128361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:13.129029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:13.130312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:13.130957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:13.131866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:13.988223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:14.010609 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aecf5732-1e01-457a-8c26-d8faa808b7fc tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.895970 Oct 16 01:05:14.014062 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 725/1338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:13 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:14.031838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:14.033111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:14.064810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.064810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.064810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.065873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.067903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.068031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.115867 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-06fa6f27-3611-40f7-a6e5-fe64ff845738 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "DELETE /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27" status: 204 len: 0 microversion: 2.1 time: 1.044574 Oct 16 01:05:14.117326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 614/1339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:13 2022] DELETE /compute/v2.1/images/ec24d237-bb87-4e0f-8373-1d3f26b72a27 => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:14.124219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a7766d6b-fd95-43c4-9db3-9408040c9620 req-d7a1acce-0a92-4763-8145-965d204a659f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410ba63a-9ba1-4c3b-89fb-51e8f05ebec5", "tag": "47665bb6-8bdf-48f8-941d-f051a5c2dfc5"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:14.161244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.161747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.162206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.162651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lazy-loading 'fault' on Instance uuid 2706c06f-8948-4e1a-8504-945a205583f0 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:14.163293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a7766d6b-fd95-43c4-9db3-9408040c9620 req-d7a1acce-0a92-4763-8145-965d204a659f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.168386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a7766d6b-fd95-43c4-9db3-9408040c9620 req-d7a1acce-0a92-4763-8145-965d204a659f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.174374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a7766d6b-fd95-43c4-9db3-9408040c9620 req-d7a1acce-0a92-4763-8145-965d204a659f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.207480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a7766d6b-fd95-43c4-9db3-9408040c9620 req-d7a1acce-0a92-4763-8145-965d204a659f service nova] Creating event network-changed:47665bb6-8bdf-48f8-941d-f051a5c2dfc5 for instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 on n-h1-master-1 Oct 16 01:05:14.216893 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a7766d6b-fd95-43c4-9db3-9408040c9620 req-d7a1acce-0a92-4763-8145-965d204a659f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097512 Oct 16 01:05:14.220707 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 615/1340] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:14.237288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-33224937-ac39-4b11-8e71-5b7331e7ec07 req-3c1fbc82-600f-40c7-ab46-eaee95a93e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2706c06f-8948-4e1a-8504-945a205583f0", "name": "network-vif-deleted", "tag": "7d6cc6a6-e2eb-432f-9efe-53517f5441f2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:14.265834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-33224937-ac39-4b11-8e71-5b7331e7ec07 req-3c1fbc82-600f-40c7-ab46-eaee95a93e57 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.267378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-33224937-ac39-4b11-8e71-5b7331e7ec07 req-3c1fbc82-600f-40c7-ab46-eaee95a93e57 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.268006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-33224937-ac39-4b11-8e71-5b7331e7ec07 req-3c1fbc82-600f-40c7-ab46-eaee95a93e57 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.292519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-33224937-ac39-4b11-8e71-5b7331e7ec07 req-3c1fbc82-600f-40c7-ab46-eaee95a93e57 service nova] Creating event network-vif-deleted:7d6cc6a6-e2eb-432f-9efe-53517f5441f2 for instance 2706c06f-8948-4e1a-8504-945a205583f0 on n-h2-master-1 Oct 16 01:05:14.306756 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-33224937-ac39-4b11-8e71-5b7331e7ec07 req-3c1fbc82-600f-40c7-ab46-eaee95a93e57 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082771 Oct 16 01:05:14.308006 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 616/1341] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:14.313782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:14.314630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:14.323525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.324406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.325047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.326118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.326771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.327537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.356547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:14.365802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:14.370675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e345646e-f45c-491b-a31e-5c09f1649f10 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1304 microversion: 2.1 time: 0.354977 Oct 16 01:05:14.382941 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 726/1342] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:14 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1304 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:14.382941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:14.382941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:14.397582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.398107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.398670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.399721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.400244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.400688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.512348 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:14.569612 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8bc8d0b-c18b-4044-a766-3d28e71fb264 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 204 len: 0 microversion: 2.1 time: 0.259896 Oct 16 01:05:14.570216 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 617/1343] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:14 2022] DELETE /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:14.599636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:14.601198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:14.609349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.610463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.611832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.612843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.614457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.615846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.691522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:14.866668 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53f84bef-41ad-45b1-99d8-fa7ed24ae8cd tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "DELETE /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 204 len: 0 microversion: 2.1 time: 0.284995 Oct 16 01:05:14.867392 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 618/1344] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:14 2022] DELETE /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:14.883270 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:14.884986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:14.892039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.896943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.897566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.898464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:14.899108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:14.900250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:14.992833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:15.007059 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a472126f-7629-48bd-9a98-70e18e010c54 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.634200 Oct 16 01:05:15.009820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 727/1345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:14 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:15.022329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:15.023527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:15.040676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.041452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.045904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.049487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.050185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.052532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.315802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:15.331092 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be97d435-0f47-4c96-ad5b-d6a593d350e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.462044 Oct 16 01:05:15.347631 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 619/1346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:14 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:15.353014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:15.353877 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:15.361193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.362088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.362702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.363636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.364275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.364889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.378154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:15.387188 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e1f0c7e-6db7-47dd-9c71-2df78978f1b0 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1682 microversion: 2.1 time: 0.374727 Oct 16 01:05:15.401459 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 728/1347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:15 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1682 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:15.413503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:15.414465 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:15.446419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.449480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.451986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.453056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.455341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.456488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.715201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:15.725446 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-06ca7269-1365-4630-809a-063dad2d6d6e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1474 microversion: 2.1 time: 0.376608 Oct 16 01:05:15.726684 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 620/1348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:15 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1474 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:15.740784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:15.741699 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:15.747977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.748692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.749123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.749814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.750426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.750886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.788447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:15.794384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:15.795390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:15.796087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:15.796779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lazy-loading 'fault' on Instance uuid 2706c06f-8948-4e1a-8504-945a205583f0 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:15.801292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-61f1bef0-781d-423b-a124-b2dcf4fddde0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.398317 Oct 16 01:05:15.802114 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 729/1349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:15 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:15.871050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:15.881361 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a12af579-aa8b-4780-b804-ea2d5eb6581a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1304 microversion: 2.1 time: 0.153181 Oct 16 01:05:15.893773 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 621/1350] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:15 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:16.035223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:16.035811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:16.041918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.042402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.043440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.044413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.045082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.045847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.223518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:16.232197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3bef74ab-57c9-4011-8810-955063181f69 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.201373 Oct 16 01:05:16.232764 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 730/1351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:16 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:16.359174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:16.361352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:16.367838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.368717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.369425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.370786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.371334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.371962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.417542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:16.418357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:16.428804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.430241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.431603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.433867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.435127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.435566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.460706 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:16.503865 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:16.675566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:16.684570 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fcb3e353-a828-423c-a682-f8e7fdf4ca23 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.329509 Oct 16 01:05:16.689882 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 622/1352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:16 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:16.751308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:16.751945 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:16.767340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.768951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.769572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.770536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.771486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.772150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.784134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:16.798180 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a9f559ac-1ffc-4a00-a629-ce407a07fe5c tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1682 microversion: 2.1 time: 0.385505 Oct 16 01:05:16.814944 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 731/1353] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:16 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1682 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:16.831424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:16.832136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:16.840028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.840723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.841526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.842431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:16.843122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:16.843742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:16.890574 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:17.056985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:17.068703 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6bf78952-3346-4bb2-b5ed-cb4c76e73133 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1474 microversion: 2.1 time: 0.322680 Oct 16 01:05:17.069299 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 623/1354] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:16 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:05:17.083022 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:17.083644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:17.098099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.098638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.099117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:17.099837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.100296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.100732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:17.174259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:17.183589 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a7f4745-a12e-44b6-bffc-959b9d99df05 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.360916 Oct 16 01:05:17.184267 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 732/1355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:16 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:17.189801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.190595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.191383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:17.192129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lazy-loading 'fault' on Instance uuid 2706c06f-8948-4e1a-8504-945a205583f0 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:17.194468 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:17.260440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:17.262593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:17.276762 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:17.283323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.288031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.288708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:17.292210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.293104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.293740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:17.361834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:17.375511 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d1eeaadf-5d23-4d11-854c-f54136981529 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 200 len: 1304 microversion: 2.1 time: 0.296012 Oct 16 01:05:17.380717 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 624/1356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:17 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:17.584348 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:17.604587 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e39548a1-fbb1-4e13-8fff-ae4dfe4ef4ab tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.343654 Oct 16 01:05:17.605672 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 733/1357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:17 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:17.711891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:17.712424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:17.727591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.728163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.729841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:17.730724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.734392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.734842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:17.827387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:17.828002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:17.838032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.839707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.840162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:17.841727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:17.843052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:17.843494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:18.031307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:18.042693 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-31600db7-b510-4b07-8b36-c17d26ae6871 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1614 microversion: 2.1 time: 0.218230 Oct 16 01:05:18.044132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 734/1358] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:17 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1614 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:05:18.094237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:18.095651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:18.114089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:18.114607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:18.119185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:18.120027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:18.120513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:18.120953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:18.170564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:18.182401 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53698cb5-2b17-4840-84b1-7cffc970e27e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.474737 Oct 16 01:05:18.189140 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 625/1359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:17 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:18.210455 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:18.211120 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:18.225627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:18.226113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:18.226545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:18.234028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:18.234988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:18.235832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.005174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:19.009876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:19.018890 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77f8cfc9-8950-4a4b-975c-dc6d19510977 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1474 microversion: 2.1 time: 0.929088 Oct 16 01:05:19.022553 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8979cc05-629b-442e-b597-4f38c3beb070 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.809818 Oct 16 01:05:19.022721 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 735/1360] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:18 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1474 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:19.038206 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 626/1361] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:18 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:19.040866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:19.041936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 2706c06f-8948-4e1a-8504-945a205583f0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:19.044878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-73d4753f-18bb-4de8-a0ee-570f21cc9565 req-58b5667f-21ea-469b-ad54-c55713acf169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032f3033-6ed6-434b-a124-9edf48c5554e", "name": "network-vif-deleted", "tag": "6e78da3e-5f4c-4325-b58e-57cc18086ccb"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:19.055386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.056574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.066716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-73d4753f-18bb-4de8-a0ee-570f21cc9565 req-58b5667f-21ea-469b-ad54-c55713acf169 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.071375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.072260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-73d4753f-18bb-4de8-a0ee-570f21cc9565 req-58b5667f-21ea-469b-ad54-c55713acf169 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.072397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.072798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.073155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-73d4753f-18bb-4de8-a0ee-570f21cc9565 req-58b5667f-21ea-469b-ad54-c55713acf169 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.074719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.098509 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-73d4753f-18bb-4de8-a0ee-570f21cc9565 req-58b5667f-21ea-469b-ad54-c55713acf169 service nova] Creating event network-vif-deleted:6e78da3e-5f4c-4325-b58e-57cc18086ccb for instance 032f3033-6ed6-434b-a124-9edf48c5554e on n-h2-master-1 Oct 16 01:05:19.116247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-73d4753f-18bb-4de8-a0ee-570f21cc9565 req-58b5667f-21ea-469b-ad54-c55713acf169 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092307 Oct 16 01:05:19.117412 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 736/1362] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:19.122740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:19.123743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:19.135741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.138111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.140409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.142004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.144539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.146836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.150280 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] HTTP exception thrown: Instance 2706c06f-8948-4e1a-8504-945a205583f0 could not be found. Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Request method failure captured: Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 HTTP/1.1 Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1g0M0ov_S3M0Ujn08LCjeathFMsVOaN8cJPP5qZRacbgx9ZJemta2xOBt_cuikHWvYXA9YxW_F89RO5eBgLYYMPGGaPZ4cXbc0hMPNNe2WDA_nrEqoCQkWz4xTeck0uru7Tzj2ulVwzklAzSnXwz6J5sffgtcAnB8wOtmDnUFCNY2Y Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 9f15cb6a79194375bd48a2af095e9374 Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:05:19.153320 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f15cb6a79194375bd48a2af095e9374", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 9f15cb6a79194375bd48a2af095e9374 Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersAdminTestJSON-32393966-project Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 57612f6a347e49be96d699e76bd9bead Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersAdminTestJSON-32393966-project Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 2706c06f-8948-4e1a-8504-945a205583f0 could not be found. Oct 16 01:05:19.154816 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '2706c06f-8948-4e1a-8504-945a205583f0'} Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2706c06f-8948-4e1a-8504-945a205583f0 could not be found. Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:19.155702 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2706c06f-8948-4e1a-8504-945a205583f0 could not be found. Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2706c06f-8948-4e1a-8504-945a205583f0 could not be found. Oct 16 01:05:19.157125 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:19.158310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Returning 404 to user: Instance 2706c06f-8948-4e1a-8504-945a205583f0 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:19.158310 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cc34911b-d91e-4af0-965d-c9eeabbeb4b1 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0" status: 404 len: 111 microversion: 2.1 time: 0.133437 Oct 16 01:05:19.158903 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 627/1363] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:19 2022] GET /compute/v2.1/servers/2706c06f-8948-4e1a-8504-945a205583f0 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:19.175062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:19.175966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:19.197521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.200050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.201830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.203656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.205869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.207170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.330643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.331211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.338748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.342431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lazy-loading 'fault' on Instance uuid 032f3033-6ed6-434b-a124-9edf48c5554e {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:19.494939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:19.505425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aceec71835c14681a2ff7d7285d87776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eec6e034df149f8863b1b9ebacfaa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:19.516278 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3a7083bd-d050-4819-be9f-bc862e2576a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.397462 Oct 16 01:05:19.522346 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 737/1364] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:19 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:19.524612 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a01abba3-3dcd-48b0-87e9-41a672b74c67 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 200 len: 1331 microversion: 2.1 time: 0.362045 Oct 16 01:05:19.525830 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 628/1365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:19 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 1331 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:19.529587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:19.530091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:19.541692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:19.544131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.544649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:19.546000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.546667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.548447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.549135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.549805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.569895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.570395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.570852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.571722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.572245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.572820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.607934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:19.801245 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-505aa861-9c39-4717-88fc-c90d2fa83cd6 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "DELETE /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 204 len: 0 microversion: 2.1 time: 0.276502 Oct 16 01:05:19.805917 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 738/1366] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:19 2022] DELETE /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:19.813727 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6908ad1f-5797-48f0-9cb2-0a9e59b49674 req-b62d52fa-70c1-4a16-8c02-27b494d3af72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143c3ee9-153e-42d5-80b0-df5c3fe70085", "name": "network-vif-deleted", "tag": "4a711534-6fc5-44d9-b654-ed82a1e4d7ad"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:19.826251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6908ad1f-5797-48f0-9cb2-0a9e59b49674 req-b62d52fa-70c1-4a16-8c02-27b494d3af72 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.827126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6908ad1f-5797-48f0-9cb2-0a9e59b49674 req-b62d52fa-70c1-4a16-8c02-27b494d3af72 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.828126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6908ad1f-5797-48f0-9cb2-0a9e59b49674 req-b62d52fa-70c1-4a16-8c02-27b494d3af72 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.848718 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6908ad1f-5797-48f0-9cb2-0a9e59b49674 req-b62d52fa-70c1-4a16-8c02-27b494d3af72 service nova] Creating event network-vif-deleted:4a711534-6fc5-44d9-b654-ed82a1e4d7ad for instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 on n-h1-master-1 Oct 16 01:05:19.855514 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6908ad1f-5797-48f0-9cb2-0a9e59b49674 req-b62d52fa-70c1-4a16-8c02-27b494d3af72 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046461 Oct 16 01:05:19.856922 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 739/1367] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:19.867829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:19.869018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:19.878220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.879453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.880055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.880965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:19.881965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:19.882778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:19.908715 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:19.925563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:19.937111 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-594cedc3-392e-4f5a-a01a-34b8b3a9ee8f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.410043 Oct 16 01:05:19.937802 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 629/1368] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:19 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:20.051366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:20.052066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:20.070075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.070580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.071059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.075192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.075721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.076165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.434694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:20.449026 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82ba8073-56bd-4107-8d42-e802a1b72541 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.401990 Oct 16 01:05:20.454644 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 630/1369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:20 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:20.463695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:20.465151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:20.479914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.480426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.480866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.481584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.482050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.482591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.520129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.522197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.524936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.525907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lazy-loading 'fault' on Instance uuid 143c3ee9-153e-42d5-80b0-df5c3fe70085 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:20.620309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:20.623016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:20.631849 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2bd7f400-cf10-4902-9370-477541778736 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1308 microversion: 2.1 time: 0.175920 Oct 16 01:05:20.633730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc3694b4-3f1f-492e-9d81-fec49564d683 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1468 microversion: 2.1 time: 0.775322 Oct 16 01:05:20.634533 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 740/1370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:19 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1468 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:20.649051 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 631/1371] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:20 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:20.654245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:20.654796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:20.661571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:20.662429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] [instance: 032f3033-6ed6-434b-a124-9edf48c5554e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:20.663625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.664256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.664692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.665629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.666257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.666855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.671813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.672829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.673866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.674776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.675435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.676036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.697541 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] HTTP exception thrown: Instance 032f3033-6ed6-434b-a124-9edf48c5554e could not be found. Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Request method failure captured: Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e HTTP/1.1 Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1gVTT-hMPbSFKHiJBDs8d67_ivCbxHFqQpxBSnlSOM9yKuPjTDinCx3GqJf_H25c2BOvyESWHLrqSPOlhVjBRjBvT84Rmv_3YXjQCV-ZyoQ3xBSWuq1ZhMhew894NQf6hvq0L-t4ICum-6ExqHDOy2TyfHiabilYlwhtv9qYSwqqB0 Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 5eec6e034df149f8863b1b9ebacfaa81 Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-VolumesAdminNegativeTest-1620951426 Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:05:20.699358 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5eec6e034df149f8863b1b9ebacfaa81", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5eec6e034df149f8863b1b9ebacfaa81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5eec6e034df149f8863b1b9ebacfaa81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5eec6e034df149f8863b1b9ebacfaa81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-VolumesAdminNegativeTest-1620951426 Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 5eec6e034df149f8863b1b9ebacfaa81 Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1620951426 Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-VolumesAdminNegativeTest-1620951426-project Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: aceec71835c14681a2ff7d7285d87776 Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-VolumesAdminNegativeTest-1620951426-project Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 032f3033-6ed6-434b-a124-9edf48c5554e could not be found. Oct 16 01:05:20.700985 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '032f3033-6ed6-434b-a124-9edf48c5554e'} Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 032f3033-6ed6-434b-a124-9edf48c5554e could not be found. Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:20.701917 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 032f3033-6ed6-434b-a124-9edf48c5554e could not be found. Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 032f3033-6ed6-434b-a124-9edf48c5554e could not be found. Oct 16 01:05:20.703454 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:20.706335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Returning 404 to user: Instance 032f3033-6ed6-434b-a124-9edf48c5554e could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:20.707413 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c196cfcb-ff89-4e51-9062-5ce49f4cff19 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e" status: 404 len: 111 microversion: 2.1 time: 0.057262 Oct 16 01:05:20.708151 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 632/1372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:20 2022] GET /compute/v2.1/servers/032f3033-6ed6-434b-a124-9edf48c5554e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:20.716466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-538e6832-10d8-4e05-a520-4fdc61d8cd61 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] Calling method '.version_select at 0x7fd64e18e430>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:20.740552 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-538e6832-10d8-4e05-a520-4fdc61d8cd61 tempest-VolumesAdminNegativeTest-1620951426 tempest-VolumesAdminNegativeTest-1620951426-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205828961" status: 202 len: 0 microversion: 2.1 time: 0.027756 Oct 16 01:05:20.745276 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 633/1373] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:05:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205828961 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:05:20.964465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:20.964465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:20.965386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:20.974257 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a00d1274-9c75-457e-a948-92108804be4b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.323905 Oct 16 01:05:20.974848 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 741/1374] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:20 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:20.984260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.990407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.991075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:20.991982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:20.993758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:20.994378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:21.485882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:21.485882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:21.495932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:21.496429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:21.496862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:21.508605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:21.509374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:21.510345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:21.687697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:21.698112 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-939b42dd-d2a2-4e7a-808f-5673a1737cd1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.740685 Oct 16 01:05:21.707314 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 634/1375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:20 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:21.712396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:21.713199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:21.724431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:21.724934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:21.725373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:21.726086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:21.726540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:21.729285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:21.799619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:21.800730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:21.801420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:21.802213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lazy-loading 'fault' on Instance uuid 143c3ee9-153e-42d5-80b0-df5c3fe70085 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:21.941314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:21.954578 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e0ffecc-7a2d-4951-8eb4-4790b4e6cb31 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 200 len: 1308 microversion: 2.1 time: 0.245851 Oct 16 01:05:21.979910 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 635/1376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:21 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:21.987903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:21.988829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:21.998603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:21.999657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:22.000268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:22.001601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:22.002240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:22.003096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:22.359142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:22.371699 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-333b84fd-1a53-446f-a818-d3dc9d3065e1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1476 microversion: 2.1 time: 0.897153 Oct 16 01:05:22.377975 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 742/1377] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:21 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1476 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:22.394663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:22.404565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:22.412776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:22.415975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:22.416459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:22.417425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:22.417889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:22.427483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:22.497083 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:22.508231 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e8f1b04-0c98-41f1-9109-25450e7d4b4c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1468 microversion: 2.1 time: 0.526433 Oct 16 01:05:22.523304 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 636/1378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:21 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1468 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:22.656440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-03d0dd94-08ed-4c6e-be11-c98e14120461 req-bc8e7dd2-e051-439d-bc2e-65422bc99c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410ba63a-9ba1-4c3b-89fb-51e8f05ebec5", "name": "network-vif-plugged", "status": "completed", "tag": "47665bb6-8bdf-48f8-941d-f051a5c2dfc5"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:22.681469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-03d0dd94-08ed-4c6e-be11-c98e14120461 req-bc8e7dd2-e051-439d-bc2e-65422bc99c87 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:22.682322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-03d0dd94-08ed-4c6e-be11-c98e14120461 req-bc8e7dd2-e051-439d-bc2e-65422bc99c87 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:22.682980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-03d0dd94-08ed-4c6e-be11-c98e14120461 req-bc8e7dd2-e051-439d-bc2e-65422bc99c87 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:22.710641 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-03d0dd94-08ed-4c6e-be11-c98e14120461 req-bc8e7dd2-e051-439d-bc2e-65422bc99c87 service nova] Creating event network-vif-plugged:47665bb6-8bdf-48f8-941d-f051a5c2dfc5 for instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 on n-h1-master-1 Oct 16 01:05:22.722451 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-03d0dd94-08ed-4c6e-be11-c98e14120461 req-bc8e7dd2-e051-439d-bc2e-65422bc99c87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070278 Oct 16 01:05:22.723109 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 637/1379] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:05:22.745212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:22.745932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:22.753277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:22.753772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:22.754213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:22.754945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:22.755421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:22.755853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:23.201576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:23.221073 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7d3eed7-ad78-4cf9-a604-2b6f0562a728 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.841350 Oct 16 01:05:23.222428 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 743/1380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:22 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:23.231546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:23.232416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 143c3ee9-153e-42d5-80b0-df5c3fe70085] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:23.241461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:23.242309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:23.242994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:23.243960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:23.244645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:23.245307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:23.262897 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] HTTP exception thrown: Instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 could not be found. Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Request method failure captured: Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 HTTP/1.1 Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hEFgJu_-6qqmux9aoCeXXzSx9v5_DM_7WzZ_DmA65lPgA4_9d_kRX4a4bDsb1slEp31nDXYvbb0tQsNBgT-oV9bfZwO4XKrkWQADoFfPY3NrlsfroAf3HzxiV2xnp61pmjxKzO6k9vTZ6GEyAwevb0-hEmhto2GzN9fVvzMRyLdqA Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b214da9f32b843de96003cb6169f0a5c Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ListImageFiltersTestJSON-1146613874 Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:05:23.264994 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b214da9f32b843de96003cb6169f0a5c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b214da9f32b843de96003cb6169f0a5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b214da9f32b843de96003cb6169f0a5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b214da9f32b843de96003cb6169f0a5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ListImageFiltersTestJSON-1146613874 Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b214da9f32b843de96003cb6169f0a5c Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1146613874 Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ListImageFiltersTestJSON-1146613874-project Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 283dbcfc68244d4b86de327091147337 Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ListImageFiltersTestJSON-1146613874-project Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 could not be found. Oct 16 01:05:23.266942 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '143c3ee9-153e-42d5-80b0-df5c3fe70085'} Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 could not be found. Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:23.267838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 could not be found. Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 could not be found. Oct 16 01:05:23.269098 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:23.271922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Returning 404 to user: Instance 143c3ee9-153e-42d5-80b0-df5c3fe70085 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:23.273018 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-11564840-25a0-42c5-90ed-b3ebe88d4db9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085" status: 404 len: 111 microversion: 2.1 time: 0.048792 Oct 16 01:05:23.274050 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 744/1381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:23 2022] GET /compute/v2.1/servers/143c3ee9-153e-42d5-80b0-df5c3fe70085 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:23.281485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:23.283830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:23.291458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:23.292275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:23.292923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:23.293908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:23.295218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:23.295891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:23.359490 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:23.444837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:23.461415 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6d24fd98-cb83-4e5f-89b9-98cede5af31b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.737072 Oct 16 01:05:23.462291 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 638/1382] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:22 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:23.494309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:23.495189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:23.508002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:23.509117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:23.511153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:23.512363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:23.513034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:23.513805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:23.586290 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-141e8bbb-4c85-4643-9b20-daf2b88fea77 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 204 len: 0 microversion: 2.1 time: 0.301097 Oct 16 01:05:23.590268 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 745/1383] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:23 2022] DELETE /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:05:23.605352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:23.606623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:23.626752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:23.627548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:23.628186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:23.629251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:23.629871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:23.630469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:24.289941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:24.302621 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2811269d-feaf-4041-a5dc-d25553bcf5fe tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1426 microversion: 2.1 time: 0.712499 Oct 16 01:05:24.304766 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 746/1384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:23 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1426 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:24.311085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:24.311865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:24.320940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:24.321600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:24.322137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:24.323836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:24.324414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:24.324990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:24.603513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:24.618787 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a27975e2-4e54-4e97-b21e-2f2d0f4bca20 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1475 microversion: 2.1 time: 1.131427 Oct 16 01:05:24.639899 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 639/1385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:23 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1475 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:24.647472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:24.656226 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6fc8366-1e8d-4595-9242-cd788457bbc3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 1474 microversion: 2.1 time: 0.350103 Oct 16 01:05:24.657668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0cf33a5b-62d9-4e6d-93c5-6728e65187fd req-4d1a0958-fe5c-42fa-a847-e2a8a8b2c05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "name": "network-vif-unplugged", "status": "completed", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:24.660112 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 747/1386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:24 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 1474 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:24.666219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:24.675858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:24.689123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0cf33a5b-62d9-4e6d-93c5-6728e65187fd req-4d1a0958-fe5c-42fa-a847-e2a8a8b2c05a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:24.690606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0cf33a5b-62d9-4e6d-93c5-6728e65187fd req-4d1a0958-fe5c-42fa-a847-e2a8a8b2c05a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:24.692052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0cf33a5b-62d9-4e6d-93c5-6728e65187fd req-4d1a0958-fe5c-42fa-a847-e2a8a8b2c05a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:24.695240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:24.698446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:24.700525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:24.701461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:24.708000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:24.708756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:24.729138 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0cf33a5b-62d9-4e6d-93c5-6728e65187fd req-4d1a0958-fe5c-42fa-a847-e2a8a8b2c05a service nova] Creating event network-vif-unplugged:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h1-master-1 Oct 16 01:05:24.739427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-0cf33a5b-62d9-4e6d-93c5-6728e65187fd req-4d1a0958-fe5c-42fa-a847-e2a8a8b2c05a service nova] Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:05:24.770040 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0cf33a5b-62d9-4e6d-93c5-6728e65187fd req-4d1a0958-fe5c-42fa-a847-e2a8a8b2c05a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128507 Oct 16 01:05:24.770658 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 640/1387] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:24.889708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5fe71bea-d0fe-4c6b-92bb-864d5e84441a req-decde67d-3dcd-41bd-96f9-d454cc2bdb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028af892-d8f0-4da9-92a9-01722179aede", "name": "network-vif-deleted", "tag": "b65f4d91-18d9-4f8e-a0bb-9908531d28c6"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:24.913932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5fe71bea-d0fe-4c6b-92bb-864d5e84441a req-decde67d-3dcd-41bd-96f9-d454cc2bdb06 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:24.916510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5fe71bea-d0fe-4c6b-92bb-864d5e84441a req-decde67d-3dcd-41bd-96f9-d454cc2bdb06 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:24.916953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5fe71bea-d0fe-4c6b-92bb-864d5e84441a req-decde67d-3dcd-41bd-96f9-d454cc2bdb06 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:24.947147 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5fe71bea-d0fe-4c6b-92bb-864d5e84441a req-decde67d-3dcd-41bd-96f9-d454cc2bdb06 service nova] Creating event network-vif-deleted:b65f4d91-18d9-4f8e-a0bb-9908531d28c6 for instance 028af892-d8f0-4da9-92a9-01722179aede on n-h1-master-1 Oct 16 01:05:24.956034 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:24.957958 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5fe71bea-d0fe-4c6b-92bb-864d5e84441a req-decde67d-3dcd-41bd-96f9-d454cc2bdb06 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181581 Oct 16 01:05:24.960767 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 641/1388] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:24.965431 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e5b796b0-da3e-4052-b7d4-13d77e9fe78f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.304009 Oct 16 01:05:24.979712 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 748/1389] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:24 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:24.979845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:24.979845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:24.980619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:24.981593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:24.982228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:24.983181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:24.983856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:24.985148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:25.268238 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:25.278617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4e89ba0-9fa9-4645-b7a4-9da3466ffb34 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1311 microversion: 2.1 time: 0.313527 Oct 16 01:05:25.291831 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 642/1390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:24 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:25.334320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:25.335377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:25.343148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:25.343942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:25.345446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:25.347179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:25.347836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:25.348508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:25.445246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:25.457922 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22a5a154-595b-4cfc-9d1d-bea00fe5ea9d tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1426 microversion: 2.1 time: 0.131977 Oct 16 01:05:25.460500 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 749/1391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:25 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1426 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:25.647713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:25.648396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:25.662810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:25.663405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:25.663858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:25.664556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:25.665281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:25.665704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:25.681122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:25.682416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:25.692655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:25.700261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:25.701006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:25.701929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:25.702557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:25.703171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:26.396466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:26.399947 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:26.409254 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d779c831-0d8f-4608-abf3-c5869053aac9 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 1474 microversion: 2.1 time: 0.731957 Oct 16 01:05:26.413460 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 750/1392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:25 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 1474 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:26.424971 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d599f3be-47c8-4635-8a32-447c282d708d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1475 microversion: 2.1 time: 0.780977 Oct 16 01:05:26.442152 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 643/1393] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:25 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1475 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:26.442602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:26.442602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:26.457864 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:26.458483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:26.485131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:26.486628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:26.486840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:26.487608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:26.488070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:26.488539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:26.503050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:26.503550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:26.503992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:26.504706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:26.505169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:26.505591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:26.510192 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:26.967769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:26.993490 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5af50687-7811-4132-82fa-2cd925de0edf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.577166 Oct 16 01:05:27.020976 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 751/1394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:26 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:27.036787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:27.042698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:27.059094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:27.059807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:27.060784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:27.062360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:27.113223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:27.114265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.051s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:27.295114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:27.300928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:27.301441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:27.301905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lazy-loading 'fault' on Instance uuid 028af892-d8f0-4da9-92a9-01722179aede {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:27.503003 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:27.515979 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13b5aef8-7a2d-44d8-92f7-2e4319324a02 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 200 len: 1303 microversion: 2.1 time: 0.489973 Oct 16 01:05:27.536644 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 752/1395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:27 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 1303 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:27.545087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-7e1693be-d26a-48fa-92c4-23767ac5fd90 req-6bdfcc3a-a9b3-4d4c-8857-e10912a07a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:27.577391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7e1693be-d26a-48fa-92c4-23767ac5fd90 req-6bdfcc3a-a9b3-4d4c-8857-e10912a07a6f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:27.582240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7e1693be-d26a-48fa-92c4-23767ac5fd90 req-6bdfcc3a-a9b3-4d4c-8857-e10912a07a6f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:27.584627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7e1693be-d26a-48fa-92c4-23767ac5fd90 req-6bdfcc3a-a9b3-4d4c-8857-e10912a07a6f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:27.647202 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-7e1693be-d26a-48fa-92c4-23767ac5fd90 req-6bdfcc3a-a9b3-4d4c-8857-e10912a07a6f service nova] Creating event network-changed:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h1-master-1 Oct 16 01:05:27.649198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:27.671317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-7e1693be-d26a-48fa-92c4-23767ac5fd90 req-6bdfcc3a-a9b3-4d4c-8857-e10912a07a6f service nova] Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:05:27.675752 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d5191f8-afab-4f8d-bdd1-571b6e4d0fdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1494 microversion: 2.1 time: 1.248258 Oct 16 01:05:27.685471 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 644/1396] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:26 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1494 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:27.711636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:27.713032 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:27.720461 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-7e1693be-d26a-48fa-92c4-23767ac5fd90 req-6bdfcc3a-a9b3-4d4c-8857-e10912a07a6f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190917 Oct 16 01:05:27.722376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 753/1397] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:27.729830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:27.731443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:27.732402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:27.732904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:27.733347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:27.734059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:27.734519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:27.734961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:27.741225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:27.742106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:27.742872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:27.744313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:27.745559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:27.746877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:28.423190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:28.434265 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2fd8defd-b2ea-481b-8abb-c209b1635db3 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 1474 microversion: 2.1 time: 0.746082 Oct 16 01:05:28.434948 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 645/1398] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:27 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 1474 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:28.457527 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:28.458298 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:28.468041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:28.468961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:28.469101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:28.470962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:28.484248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:28.486123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:28.553767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:28.561931 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b7739c26-354b-4565-a309-16997d3d13bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1475 microversion: 2.1 time: 0.837156 Oct 16 01:05:28.592132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 754/1399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:27 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1475 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:28.599068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:28.599837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:28.607227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:28.607879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:28.608551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:28.613301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:28.616731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:28.617306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:28.995278 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dc14b521-b831-4c56-9101-8a6cc7cec930 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1645 microversion: 2.1 time: 0.559370 Oct 16 01:05:29.014817 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 646/1400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:28 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1645 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:29.037706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:29.039406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: 028af892-d8f0-4da9-92a9-01722179aede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:29.047844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.048623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.049304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.050217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.050903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.051511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.062823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:29.071714 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] HTTP exception thrown: Instance 028af892-d8f0-4da9-92a9-01722179aede could not be found. Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Request method failure captured: Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede HTTP/1.1 Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1g0M0ov_S3M0Ujn08LCjeathFMsVOaN8cJPP5qZRacbgx9ZJemta2xOBt_cuikHWvYXA9YxW_F89RO5eBgLYYMPGGaPZ4cXbc0hMPNNe2WDA_nrEqoCQkWz4xTeck0uru7Tzj2ulVwzklAzSnXwz6J5sffgtcAnB8wOtmDnUFCNY2Y Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 9f15cb6a79194375bd48a2af095e9374 Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:05:29.073882 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f15cb6a79194375bd48a2af095e9374", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 9f15cb6a79194375bd48a2af095e9374 Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersAdminTestJSON-32393966-project Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 57612f6a347e49be96d699e76bd9bead Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersAdminTestJSON-32393966-project Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 028af892-d8f0-4da9-92a9-01722179aede could not be found. Oct 16 01:05:29.075696 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '028af892-d8f0-4da9-92a9-01722179aede'} Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028af892-d8f0-4da9-92a9-01722179aede could not be found. Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:29.076554 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028af892-d8f0-4da9-92a9-01722179aede could not be found. Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028af892-d8f0-4da9-92a9-01722179aede could not be found. Oct 16 01:05:29.077973 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:29.081842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Returning 404 to user: Instance 028af892-d8f0-4da9-92a9-01722179aede could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:29.082946 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef257203-bdb3-48d0-89af-a9d860c9810c tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede" status: 404 len: 111 microversion: 2.1 time: 0.066991 Oct 16 01:05:29.084309 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 647/1401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:29 2022] GET /compute/v2.1/servers/028af892-d8f0-4da9-92a9-01722179aede => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:29.089964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b14fb1a4-25b5-4da8-9657-1fb0ba77ce7a req-6d813023-7812-4036-aec6-12047b577749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4495b959-d827-46f4-92c3-05b9b91c2020", "name": "network-vif-deleted", "tag": "ca157844-15f0-450a-862c-cca64f9f972e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:29.090347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe662e76-97b1-4df8-9c84-1b707ed41bdf tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.482426 Oct 16 01:05:29.093442 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 755/1402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:28 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:29.104969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b14fb1a4-25b5-4da8-9657-1fb0ba77ce7a req-6d813023-7812-4036-aec6-12047b577749 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.105798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b14fb1a4-25b5-4da8-9657-1fb0ba77ce7a req-6d813023-7812-4036-aec6-12047b577749 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.106104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:29.106624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b14fb1a4-25b5-4da8-9657-1fb0ba77ce7a req-6d813023-7812-4036-aec6-12047b577749 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.112645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:29.123578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.123959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.125246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.129229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.129832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.130284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.134080 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:29.156419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b14fb1a4-25b5-4da8-9657-1fb0ba77ce7a req-6d813023-7812-4036-aec6-12047b577749 service nova] Creating event network-vif-deleted:ca157844-15f0-450a-862c-cca64f9f972e for instance 4495b959-d827-46f4-92c3-05b9b91c2020 on n-h1-master-1 Oct 16 01:05:29.186740 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b14fb1a4-25b5-4da8-9657-1fb0ba77ce7a req-6d813023-7812-4036-aec6-12047b577749 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096358 Oct 16 01:05:29.187678 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 648/1403] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:29.200274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:29.211658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:29.233421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.234488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.236353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.237332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.238050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.239381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.320274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:29.452312 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6313c4a9-b168-41f4-a772-8b2ed52f1643 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1645 microversion: 2.1 time: 0.356591 Oct 16 01:05:29.454466 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 756/1404] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:29 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1645 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:29.478049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:29.478881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:29.506561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.507686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.530766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.536248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.538691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.541147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.544716 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-849929e0-3920-4d80-b8b5-1a457ae0ea3f tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 204 len: 0 microversion: 2.1 time: 0.348734 Oct 16 01:05:29.551750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 649/1405] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:29 2022] DELETE /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:29.564678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a9f96f69-0901-46e6-9dab-4623cbd5c3e9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:29.593552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9f96f69-0901-46e6-9dab-4623cbd5c3e9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.595207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9f96f69-0901-46e6-9dab-4623cbd5c3e9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.595948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9f96f69-0901-46e6-9dab-4623cbd5c3e9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.597374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9f96f69-0901-46e6-9dab-4623cbd5c3e9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.598240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9f96f69-0901-46e6-9dab-4623cbd5c3e9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.599004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9f96f69-0901-46e6-9dab-4623cbd5c3e9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.631549 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a9f96f69-0901-46e6-9dab-4623cbd5c3e9 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.077584 Oct 16 01:05:29.633407 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 650/1406] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:05:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:29.639771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:29.642393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:29.654929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.658939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.659863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.662215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.663288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.664361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.765380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:29.787503 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2fdd1c83-72e1-4e45-ac92-00e3f8725b6b tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 1432 microversion: 2.1 time: 0.328157 Oct 16 01:05:29.803317 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 757/1407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:29 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 1432 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:29.814619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:29.815367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:29.835082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.835637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.836160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.836923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.837413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.837835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.907889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:29.925310 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4cb05d87-156b-49b7-a787-e7f2738d79e7 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1469 microversion: 2.1 time: 0.289040 Oct 16 01:05:29.928144 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 651/1408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:29 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:29.937793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:29.944536 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:29.966493 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:29.974691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.976540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.979722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:29.980835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:29.984610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:29.985701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.066704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:30.076895 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec3169c6-1775-4bd5-9250-2245c18c6e33 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1473 microversion: 2.1 time: 0.268001 Oct 16 01:05:30.078039 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 758/1409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:29 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:30.120474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:30.121611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:30.136771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.137528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.138540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.139702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.140679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.141816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.177344 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eb214183-092c-4374-bfa2-957f5056b383 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5/action" status: 202 len: 0 microversion: 2.1 time: 0.246750 Oct 16 01:05:30.181009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 652/1410] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:05:29 2022] POST /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:30.198575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:30.199725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:30.220564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.221560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.222392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.225887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.227205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.229476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.641817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:30.660930 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2421923d-dfa6-4639-b5c2-7541a926400d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 0.545208 Oct 16 01:05:30.671641 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 759/1411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:30 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:30.818388 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e6587bcf-a7db-4d9b-afa1-af8f552f403f tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1650 microversion: 2.1 time: 0.629977 Oct 16 01:05:30.819464 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 653/1412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:30 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1650 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:30.849045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:30.849840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:30.865846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.866524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.867494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.868781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.869412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.869960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.909675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.910691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.911557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.912315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lazy-loading 'fault' on Instance uuid 4495b959-d827-46f4-92c3-05b9b91c2020 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:30.954761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:30.955397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:30.966058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.966553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.967099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:30.967698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:30.968152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:30.968572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:31.003499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283dbcfc68244d4b86de327091147337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b214da9f32b843de96003cb6169f0a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:31.034646 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-650da6ec-8309-4d84-a17e-6de9caf7c947 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 200 len: 1308 microversion: 2.1 time: 0.211798 Oct 16 01:05:31.037163 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 760/1413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:30 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:31.108060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:31.108916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:31.123623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:31.126829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:31.127393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:31.130003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:31.131000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:31.131729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:31.849023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57612f6a347e49be96d699e76bd9bead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f15cb6a79194375bd48a2af095e9374', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:31.863639 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d292a249-83f5-471d-8239-506cc5ab13e8 tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 200 len: 1469 microversion: 2.1 time: 0.913405 Oct 16 01:05:31.867886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:31.879968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 654/1414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:30 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 1469 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:31.882374 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-432ca05e-56a6-4d09-b10d-182b80ae675b tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1470 microversion: 2.1 time: 0.780798 Oct 16 01:05:31.885875 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 761/1415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:31 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1470 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:05:31.889121 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:31.894302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:31.899208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:31.900180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:31.904893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:31.908581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:31.909244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:31.911799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:31.912443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:31.913026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:31.915150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:31.915475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:31.916340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:31.917793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:31.920081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:31.925155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:32.754353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcb24f4e-be07-45d9-907a-6b27473ddcf5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1630 microversion: 2.1 time: 0.867092 Oct 16 01:05:32.755952 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 762/1416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:31 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1630 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:32.888897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:32.901202 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2ad0e91b-7451-4423-896b-2b5ddc596050 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1498 microversion: 2.1 time: 1.020043 Oct 16 01:05:32.905345 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 655/1417] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:31 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1498 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:32.913995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:32.915495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:32.928864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:32.929368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:32.929804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:32.930705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:32.931496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:32.931931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:32.990216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-252319f1-4d77-4d10-973e-f1645f95e396 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Action: 'create', calling method: .version_select at 0x7fd64e45b5e0>, body: {"pool": null} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:33.152099 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ef42184-54ea-4044-8210-1d2d5c64d338 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "POST /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6/action" status: 202 len: 0 microversion: 2.1 time: 0.394372 Oct 16 01:05:33.153028 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 763/1418] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:05:32 2022] POST /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:33.209241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:33.225870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] [instance: 4495b959-d827-46f4-92c3-05b9b91c2020] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:33.240939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:33.243669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:33.245665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:33.253695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:33.254372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:33.255348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:33.292940 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] HTTP exception thrown: Instance 4495b959-d827-46f4-92c3-05b9b91c2020 could not be found. Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Request method failure captured: Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 HTTP/1.1 Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hEFgJu_-6qqmux9aoCeXXzSx9v5_DM_7WzZ_DmA65lPgA4_9d_kRX4a4bDsb1slEp31nDXYvbb0tQsNBgT-oV9bfZwO4XKrkWQADoFfPY3NrlsfroAf3HzxiV2xnp61pmjxKzO6k9vTZ6GEyAwevb0-hEmhto2GzN9fVvzMRyLdqA Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b214da9f32b843de96003cb6169f0a5c Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ListImageFiltersTestJSON-1146613874 Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:05:33.297820 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b214da9f32b843de96003cb6169f0a5c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b214da9f32b843de96003cb6169f0a5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b214da9f32b843de96003cb6169f0a5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b214da9f32b843de96003cb6169f0a5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ListImageFiltersTestJSON-1146613874 Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b214da9f32b843de96003cb6169f0a5c Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1146613874 Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ListImageFiltersTestJSON-1146613874-project Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 283dbcfc68244d4b86de327091147337 Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ListImageFiltersTestJSON-1146613874-project Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 4495b959-d827-46f4-92c3-05b9b91c2020 could not be found. Oct 16 01:05:33.300110 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '4495b959-d827-46f4-92c3-05b9b91c2020'} Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4495b959-d827-46f4-92c3-05b9b91c2020 could not be found. Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:33.301132 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4495b959-d827-46f4-92c3-05b9b91c2020 could not be found. Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4495b959-d827-46f4-92c3-05b9b91c2020 could not be found. Oct 16 01:05:33.302589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:33.307025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Returning 404 to user: Instance 4495b959-d827-46f4-92c3-05b9b91c2020 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:33.308104 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-538bb8a3-5d06-4870-a091-7c1de6621bcb tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020" status: 404 len: 111 microversion: 2.1 time: 0.126726 Oct 16 01:05:33.309752 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 764/1419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:33 2022] GET /compute/v2.1/servers/4495b959-d827-46f4-92c3-05b9b91c2020 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:33.328004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:33.334097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:33.352952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:33.358614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:33.362227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:33.363218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:33.363852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:33.364464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:33.459656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lazy-loading 'flavor' on Instance uuid 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:33.496258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Going to try to live migrate instance to n-h2-master-1 {{(pid=120545) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:05:35.157741 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-252319f1-4d77-4d10-973e-f1645f95e396 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.250754 Oct 16 01:05:35.158243 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 656/1420] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:05:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:35.169337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:35.170236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] [instance: ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:35.178143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:35.178894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:35.179589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:35.180482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:35.181109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:35.181701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:35.197158 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] HTTP exception thrown: Instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 could not be found. Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Request method failure captured: Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 HTTP/1.1 Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1g0M0ov_S3M0Ujn08LCjeathFMsVOaN8cJPP5qZRacbgx9ZJemta2xOBt_cuikHWvYXA9YxW_F89RO5eBgLYYMPGGaPZ4cXbc0hMPNNe2WDA_nrEqoCQkWz4xTeck0uru7Tzj2ulVwzklAzSnXwz6J5sffgtcAnB8wOtmDnUFCNY2Y Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 9f15cb6a79194375bd48a2af095e9374 Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:05:35.199104 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f15cb6a79194375bd48a2af095e9374", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f15cb6a79194375bd48a2af095e9374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 9f15cb6a79194375bd48a2af095e9374 Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersAdminTestJSON-32393966 Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersAdminTestJSON-32393966-project Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 57612f6a347e49be96d699e76bd9bead Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersAdminTestJSON-32393966-project Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 could not be found. Oct 16 01:05:35.200770 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5'} Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 could not be found. Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:35.201716 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 could not be found. Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 could not be found. Oct 16 01:05:35.203294 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:05:35.205536 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] Returning 404 to user: Instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:35.206593 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-83af6f8a-6662-4c4a-b0e4-552df967057a tempest-ServersAdminTestJSON-32393966 tempest-ServersAdminTestJSON-32393966-project] 10.222.0.39 "GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5" status: 404 len: 111 microversion: 2.1 time: 0.047715 Oct 16 01:05:35.207694 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 657/1421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:35 2022] GET /compute/v2.1/servers/ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:35.213816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:35.214753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:35.221511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:35.222275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:35.222894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:35.223813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:35.224438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:35.225032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:35.465548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:35.477857 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f648a424-6ebe-432c-8003-42b0d5775051 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1469 microversion: 2.1 time: 0.266666 Oct 16 01:05:35.478956 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 658/1422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:35 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:35.493142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa9cbf23-017c-4831-ae7e-4cc1439bbe8e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e53eee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:36.197135 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1cbc06ac-fba4-4033-9163-c0f11378c390 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5/action" status: 202 len: 0 microversion: 2.1 time: 2.882649 Oct 16 01:05:36.199055 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 765/1423] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:05:33 2022] POST /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5/action => generated 0 bytes in 2888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:36.205556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-8540ac69-6b7e-4f8c-8ce3-aeab918c0bd6 req-8cfb067e-f94d-4384-a685-ed9a9f8d258f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5", "name": "network-vif-deleted", "tag": "62f88490-3555-4b72-88e6-cee67ed2ea99"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:36.257571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8540ac69-6b7e-4f8c-8ce3-aeab918c0bd6 req-8cfb067e-f94d-4384-a685-ed9a9f8d258f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:36.259514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8540ac69-6b7e-4f8c-8ce3-aeab918c0bd6 req-8cfb067e-f94d-4384-a685-ed9a9f8d258f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:36.271576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8540ac69-6b7e-4f8c-8ce3-aeab918c0bd6 req-8cfb067e-f94d-4384-a685-ed9a9f8d258f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:36.293169 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-8540ac69-6b7e-4f8c-8ce3-aeab918c0bd6 req-8cfb067e-f94d-4384-a685-ed9a9f8d258f service nova] Creating event network-vif-deleted:62f88490-3555-4b72-88e6-cee67ed2ea99 for instance ac12ac9b-29fa-42c0-9ec2-75d43ac43dc5 on n-h2-master-1 Oct 16 01:05:36.303653 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-8540ac69-6b7e-4f8c-8ce3-aeab918c0bd6 req-8cfb067e-f94d-4384-a685-ed9a9f8d258f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102576 Oct 16 01:05:36.311035 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 766/1424] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:36.324162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6c06ed83-bfba-4ede-9dec-42d628da3b77 req-1f8a5ee0-31b3-470e-b128-43e2c86b856d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "name": "network-vif-plugged", "status": "completed", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:36.355709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c06ed83-bfba-4ede-9dec-42d628da3b77 req-1f8a5ee0-31b3-470e-b128-43e2c86b856d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:36.358091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c06ed83-bfba-4ede-9dec-42d628da3b77 req-1f8a5ee0-31b3-470e-b128-43e2c86b856d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:36.359553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c06ed83-bfba-4ede-9dec-42d628da3b77 req-1f8a5ee0-31b3-470e-b128-43e2c86b856d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:36.381793 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6c06ed83-bfba-4ede-9dec-42d628da3b77 req-1f8a5ee0-31b3-470e-b128-43e2c86b856d service nova] Creating event network-vif-plugged:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h1-master-1 Oct 16 01:05:36.397919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-6c06ed83-bfba-4ede-9dec-42d628da3b77 req-1f8a5ee0-31b3-470e-b128-43e2c86b856d service nova] Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:05:36.439354 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6c06ed83-bfba-4ede-9dec-42d628da3b77 req-1f8a5ee0-31b3-470e-b128-43e2c86b856d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124906 Oct 16 01:05:36.442728 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 767/1425] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:36.464370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:36.468704 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa9cbf23-017c-4831-ae7e-4cc1439bbe8e tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "DELETE /compute/v2.1/images/9d66bd6e-dc07-49f3-a2c5-f411f655b0e7" status: 204 len: 0 microversion: 2.1 time: 0.988108 Oct 16 01:05:36.478360 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 659/1426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:35 2022] DELETE /compute/v2.1/images/9d66bd6e-dc07-49f3-a2c5-f411f655b0e7 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:36.483274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a4ecd2b-2ace-45de-8ac0-c4cb2f6b0c98 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Calling method '.version_select at 0x7fd64e125f70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:36.516100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:36.542820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:36.550644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:36.551192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:36.553960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:36.554456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:36.554899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:37.183942 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a4ecd2b-2ace-45de-8ac0-c4cb2f6b0c98 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/82c3ae75-8179-4bef-bf6d-28494299e8f8" status: 200 len: 142 microversion: 2.1 time: 0.705646 Oct 16 01:05:37.185025 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 660/1427] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:05:36 2022] GET /compute/v2.1/os-floating-ips/82c3ae75-8179-4bef-bf6d-28494299e8f8 => generated 142 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:37.195034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:37.196116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:37.213340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:37.219304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:37.220251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:37.221416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:37.221899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:37.222335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:37.362910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:37.372617 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-444f9f1b-2cf2-4471-bab9-becb6608dc0d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 200 len: 1475 microversion: 2.1 time: 0.926432 Oct 16 01:05:37.375277 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 768/1428] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:36 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 1475 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:37.399708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e58045d1-c8b7-4796-9c9d-934f639b07d2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e240700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:37.833760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:37.851439 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c4034fa8-0ca7-4c80-a1e2-42ac08b33163 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1504 microversion: 2.1 time: 0.662801 Oct 16 01:05:37.863800 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 661/1429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:37 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1504 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:37.874932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:37.876690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:37.884437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:37.885330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:37.886135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:37.887701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:37.888473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:37.889119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:38.146032 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e58045d1-c8b7-4796-9c9d-934f639b07d2 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "DELETE /compute/v2.1/images/33da3cf5-7469-46c4-94b9-cf348aa0c433" status: 204 len: 0 microversion: 2.1 time: 0.765819 Oct 16 01:05:38.148032 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 769/1430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:37 2022] DELETE /compute/v2.1/images/33da3cf5-7469-46c4-94b9-cf348aa0c433 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:38.156798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e7f532a0-08e3-4cfd-a550-265bc4674a76 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Calling method '.version_select at 0x7fd64e6879d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:38.619305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:38.635660 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2aab57a9-5099-41ca-9bbb-e64d77d6d735 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1469 microversion: 2.1 time: 0.770605 Oct 16 01:05:38.651358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 662/1431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:37 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1469 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:38.657684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-805599697"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:38.662169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:38.673845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:38.674351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:38.674791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:38.683943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:38.684592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:38.685133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:38.734843 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:38.773679 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e7f532a0-08e3-4cfd-a550-265bc4674a76 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.622079 Oct 16 01:05:38.774254 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 770/1432] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:05:38 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:38.779282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b363a0ea-decd-4809-a6a2-573639420672 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] Calling method '.version_select at 0x7fd64e687e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:39.038653 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8795c9a-22a2-4d3a-be97-0a225c33c27a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90/action" status: 202 len: 0 microversion: 2.1 time: 0.385824 Oct 16 01:05:39.039649 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 663/1433] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:05:38 2022] POST /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:05:39.064166 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25549097-4006-4979-8896-2eb544ddf5a4 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Calling method '.version_select at 0x7fd64eb031f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:39.171796 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b363a0ea-decd-4809-a6a2-573639420672 tempest-ListImageFiltersTestJSON-1146613874 tempest-ListImageFiltersTestJSON-1146613874-project] 10.222.0.39 "DELETE /compute/v2.1/images/cd366a96-798c-400c-97db-ef15e599bade" status: 204 len: 0 microversion: 2.1 time: 0.395961 Oct 16 01:05:39.173433 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 771/1434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:38 2022] DELETE /compute/v2.1/images/cd366a96-798c-400c-97db-ef15e599bade => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:39.179759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:39.180548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:39.190073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:39.190832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:39.191696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:39.192569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:39.193750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:39.195413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:39.611597 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:40.136558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:40.146806 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-29240eed-290c-410e-8afe-366e40ed8440 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1504 microversion: 2.1 time: 0.972103 Oct 16 01:05:40.148265 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 772/1435] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:39 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1504 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:40.159273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2eca4abb-eef1-417f-9e55-f1dad076c55f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e687af0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:40.211757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2eca4abb-eef1-417f-9e55-f1dad076c55f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.062167 Oct 16 01:05:40.220959 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 773/1436] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:40 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:40.220959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-cec19376-e365-48e5-89f9-78fa371e0fb6 req-d8784c89-9ce2-42f0-a2da-d5f467a0e7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "name": "network-vif-unplugged", "status": "completed", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:40.230729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cec19376-e365-48e5-89f9-78fa371e0fb6 req-d8784c89-9ce2-42f0-a2da-d5f467a0e7d4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:40.231081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cec19376-e365-48e5-89f9-78fa371e0fb6 req-d8784c89-9ce2-42f0-a2da-d5f467a0e7d4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:40.231739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cec19376-e365-48e5-89f9-78fa371e0fb6 req-d8784c89-9ce2-42f0-a2da-d5f467a0e7d4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:40.236809 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:40.248953 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-cec19376-e365-48e5-89f9-78fa371e0fb6 req-d8784c89-9ce2-42f0-a2da-d5f467a0e7d4 service nova] Creating event network-vif-unplugged:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h2-master-1 Oct 16 01:05:40.255800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-cec19376-e365-48e5-89f9-78fa371e0fb6 req-d8784c89-9ce2-42f0-a2da-d5f467a0e7d4 service nova] Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:05:40.268341 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-cec19376-e365-48e5-89f9-78fa371e0fb6 req-d8784c89-9ce2-42f0-a2da-d5f467a0e7d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052185 Oct 16 01:05:40.269305 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 774/1437] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:40.274945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2101507346", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d8ca3633-753d-4a02-9054-6faae6f93606"}], "block_device_mapping_v2": [{"uuid": "d155c4e4-2d1a-4036-8677-2cf965245907", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:40.343642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] validate_networks() for [('d8ca3633-753d-4a02-9054-6faae6f93606', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:05:41.628577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:05:41.629920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:05:41.630862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:05:41.632148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:05:41.632823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:05:41.637019 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:41.646671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:41.647443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:41.647730 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-25549097-4006-4979-8896-2eb544ddf5a4 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/82c3ae75-8179-4bef-bf6d-28494299e8f8" status: 202 len: 0 microversion: 2.1 time: 2.592447 Oct 16 01:05:41.648920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:41.649877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:41.655109 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 664/1438] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:05:39 2022] DELETE /compute/v2.1/os-floating-ips/82c3ae75-8179-4bef-bf6d-28494299e8f8 => generated 0 bytes in 2610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:41.656376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:41.656892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:41.657746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:41.670701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:41.685344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for project e9173928e9c94d31b8d2eca240e28d50. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:05:41.696796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Getting quotas for user 5f46ddd0268d44bfacff0400e3f38e7e and project e9173928e9c94d31b8d2eca240e28d50. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:05:41.698174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:41.699065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:41.699698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:41.700635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:41.701297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:41.702421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:41.816514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:05:41.820797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d155c4e4-2d1a-4036-8677-2cf965245907',volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:05:41.924628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:41.934342 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dab240fa-d257-4f35-b75c-d1145a9cab61 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1469 microversion: 2.1 time: 0.282728 Oct 16 01:05:41.935267 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 665/1439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:41 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:41.963727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5ac8e16b-5e81-49b4-b437-4a9419123602 req-35047416-9ee9-4817-9cd1-ed866881bc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410ba63a-9ba1-4c3b-89fb-51e8f05ebec5", "name": "network-vif-unplugged", "status": "completed", "tag": "47665bb6-8bdf-48f8-941d-f051a5c2dfc5"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:41.974975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5ac8e16b-5e81-49b4-b437-4a9419123602 req-35047416-9ee9-4817-9cd1-ed866881bc67 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:41.975861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5ac8e16b-5e81-49b4-b437-4a9419123602 req-35047416-9ee9-4817-9cd1-ed866881bc67 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:41.976494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5ac8e16b-5e81-49b4-b437-4a9419123602 req-35047416-9ee9-4817-9cd1-ed866881bc67 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:41.994665 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5ac8e16b-5e81-49b4-b437-4a9419123602 req-35047416-9ee9-4817-9cd1-ed866881bc67 service nova] Creating event network-vif-unplugged:47665bb6-8bdf-48f8-941d-f051a5c2dfc5 for instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 on n-h1-master-1 Oct 16 01:05:42.004555 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5ac8e16b-5e81-49b4-b437-4a9419123602 req-35047416-9ee9-4817-9cd1-ed866881bc67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067852 Oct 16 01:05:42.006005 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 666/1440] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:42.020007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:42.021207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:42.034444 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-274896a7-0193-44ce-a9f9-1a951cf0a397 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.763766 Oct 16 01:05:42.038896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 775/1441] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:05:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:05:42.044673 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22cd1557-e234-46ae-a5ec-4dcdf4a04039 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e66c5e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:42.045443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.047212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.052289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.053077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.053727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.054469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.105027 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22cd1557-e234-46ae-a5ec-4dcdf4a04039 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.064702 Oct 16 01:05:42.105618 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 776/1442] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:42 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:42.246047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:42.254037 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e393c86c-1600-49b7-9c31-909d12630279 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1504 microversion: 2.1 time: 0.246129 Oct 16 01:05:42.254619 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 667/1443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:42 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:42.259969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-28f95439-24cd-43cc-ad9d-8be81b69b4db tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Action: 'create', calling method: .version_select at 0x7fd64e77b160>, body: {"pool": null} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:42.473654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1607940322", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:42.548883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:05:42.873188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:05:42.873864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:05:42.874210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:05:42.874852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:05:42.875386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:05:42.884797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.885549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.885975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.886869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:42.887342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:42.887957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:42.908730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Getting quotas for project c4d93522c54c4449926b8ddfeda3d96e. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:05:42.913749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Getting quotas for user 5c224f40dc3447d2b3bec25f1ca968fa and project c4d93522c54c4449926b8ddfeda3d96e. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:05:42.926883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:05:42.929703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:05:42.989941 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2cc5a9b-aaac-4361-9b72-f5099fcf69ec tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883090 Oct 16 01:05:42.996865 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 777/1444] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:05:43.372464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a0dcbf03-ac55-4efe-94d4-46c0a096a0f0 tempest-AZV2TestJSON-1760293654 tempest-AZV2TestJSON-1760293654-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:43.374225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dcbf03-ac55-4efe-94d4-46c0a096a0f0 tempest-AZV2TestJSON-1760293654 tempest-AZV2TestJSON-1760293654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:43.375148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dcbf03-ac55-4efe-94d4-46c0a096a0f0 tempest-AZV2TestJSON-1760293654 tempest-AZV2TestJSON-1760293654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:43.376427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dcbf03-ac55-4efe-94d4-46c0a096a0f0 tempest-AZV2TestJSON-1760293654 tempest-AZV2TestJSON-1760293654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:43.377355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dcbf03-ac55-4efe-94d4-46c0a096a0f0 tempest-AZV2TestJSON-1760293654 tempest-AZV2TestJSON-1760293654-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:43.378360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dcbf03-ac55-4efe-94d4-46c0a096a0f0 tempest-AZV2TestJSON-1760293654 tempest-AZV2TestJSON-1760293654-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:43.379092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dcbf03-ac55-4efe-94d4-46c0a096a0f0 tempest-AZV2TestJSON-1760293654 tempest-AZV2TestJSON-1760293654-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:43.417766 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a0dcbf03-ac55-4efe-94d4-46c0a096a0f0 tempest-AZV2TestJSON-1760293654 tempest-AZV2TestJSON-1760293654-project] 10.222.0.39 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.422147 Oct 16 01:05:43.428331 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 778/1445] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Oct 16 01:05:42 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:05:43.434954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:43.436875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:43.448846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:43.449404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:43.449805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:43.450507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:43.450992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:43.451420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:43.572895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:43.587599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:43.594272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:43.598253 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa950a2e-48a0-4ba9-be1e-7f705b48884a tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1185 microversion: 2.25 time: 0.172668 Oct 16 01:05:43.608407 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 779/1446] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:43 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:05:43.613719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b8820c2e-2c4d-46ae-ad41-ec63fc96ed6b req-8a449853-ae68-43a5-87d9-e73634ae4032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:43.638271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b8820c2e-2c4d-46ae-ad41-ec63fc96ed6b req-8a449853-ae68-43a5-87d9-e73634ae4032 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:43.639385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b8820c2e-2c4d-46ae-ad41-ec63fc96ed6b req-8a449853-ae68-43a5-87d9-e73634ae4032 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:43.639990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b8820c2e-2c4d-46ae-ad41-ec63fc96ed6b req-8a449853-ae68-43a5-87d9-e73634ae4032 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:43.668613 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b8820c2e-2c4d-46ae-ad41-ec63fc96ed6b req-8a449853-ae68-43a5-87d9-e73634ae4032 service nova] Creating event network-changed:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h2-master-1 Oct 16 01:05:43.697951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-b8820c2e-2c4d-46ae-ad41-ec63fc96ed6b req-8a449853-ae68-43a5-87d9-e73634ae4032 service nova] Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:05:43.737548 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b8820c2e-2c4d-46ae-ad41-ec63fc96ed6b req-8a449853-ae68-43a5-87d9-e73634ae4032 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135343 Oct 16 01:05:43.742309 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 780/1447] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:43.750479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:43.751446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:43.759639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:43.760920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:43.761564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:43.762457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:43.763115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:43.763722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:44.212559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:44.225554 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-067f4af2-2d7a-4303-8cec-1516b9ed4d5e tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1469 microversion: 2.1 time: 0.481154 Oct 16 01:05:44.230206 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 781/1448] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:43 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1469 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:44.243995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:44.244835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:44.249295 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-28f95439-24cd-43cc-ad9d-8be81b69b4db tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.993010 Oct 16 01:05:44.250168 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 668/1449] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:05:42 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:44.255307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-540c9ad8-2e26-4c4a-b961-0b604e0dd0f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e53e670>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:44.269710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:44.270212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:44.270652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:44.271394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:44.271854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:44.285940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:44.380640 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-540c9ad8-2e26-4c4a-b961-0b604e0dd0f4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.129263 Oct 16 01:05:44.381230 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 669/1450] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:44 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:44.388283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:44.398517 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:44.414579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:44.418561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:44.419921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:44.421599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:44.422358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:44.423791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:44.702644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:44.726292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f089cece-c411-4da8-89b6-e158bc8aa641 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1218 microversion: 2.1 time: 0.491528 Oct 16 01:05:44.757571 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 782/1451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:44 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1218 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:44.784390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ba7c08a7-dce4-4efc-98a3-5d25f2ffc520 req-1c020e96-b81a-4ce7-8348-75ae71a8bb58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410ba63a-9ba1-4c3b-89fb-51e8f05ebec5", "tag": "47665bb6-8bdf-48f8-941d-f051a5c2dfc5"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:44.804917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ba7c08a7-dce4-4efc-98a3-5d25f2ffc520 req-1c020e96-b81a-4ce7-8348-75ae71a8bb58 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:44.805402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ba7c08a7-dce4-4efc-98a3-5d25f2ffc520 req-1c020e96-b81a-4ce7-8348-75ae71a8bb58 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:44.805833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ba7c08a7-dce4-4efc-98a3-5d25f2ffc520 req-1c020e96-b81a-4ce7-8348-75ae71a8bb58 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:44.823052 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ba7c08a7-dce4-4efc-98a3-5d25f2ffc520 req-1c020e96-b81a-4ce7-8348-75ae71a8bb58 service nova] Creating event network-changed:47665bb6-8bdf-48f8-941d-f051a5c2dfc5 for instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 on n-h1-master-1 Oct 16 01:05:44.833023 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ba7c08a7-dce4-4efc-98a3-5d25f2ffc520 req-1c020e96-b81a-4ce7-8348-75ae71a8bb58 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071920 Oct 16 01:05:44.834562 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 783/1452] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:44.840889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e855952-cf34-49e6-bcd9-c85d3440cc6b tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Calling method '.version_select at 0x7fd64e3be790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:44.887901 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:44.899931 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-663a0753-bde3-46dd-a997-a87c954d3fe6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1504 microversion: 2.1 time: 0.517265 Oct 16 01:05:44.901147 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 670/1453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:44 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1504 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:45.614586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:45.617293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:45.643990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:45.645549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:45.648589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:45.649549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:45.651779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:45.653930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:46.108425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:46.123829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:46.126527 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:46.133651 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-18e3b508-e742-42d5-b106-25c67e84b712 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1251 microversion: 2.25 time: 1.230297 Oct 16 01:05:46.137406 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 671/1454] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:44 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1251 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:05:46.144827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:46.145893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:46.173774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:46.175694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:46.181005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:46.182474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:46.184279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:46.185438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:47.387129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:47.395644 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-de45a583-83db-4476-8b8a-4a8d18d97d67 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1462 microversion: 2.1 time: 1.256897 Oct 16 01:05:47.415630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 672/1455] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:46 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1462 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:47.432196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23997580-e866-4bfa-b3ae-9a01d123a750 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e1388b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:47.535856 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23997580-e866-4bfa-b3ae-9a01d123a750 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.116699 Oct 16 01:05:47.536479 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 673/1456] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:47 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:47.549678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:47.562414 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:47.578167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:47.578744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:47.579496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:47.580240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:47.592070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:47.600265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:47.850741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:47.870422 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ca3b6bb-7758-45b0-be9e-2081bd7c4192 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1272 microversion: 2.1 time: 0.323048 Oct 16 01:05:47.871177 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 674/1457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:47 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1272 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:47.895736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:47.901076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:47.915592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:47.916489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:47.917155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:47.920609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:47.921380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:47.923276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:48.497621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:48.509453 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d33b88b6-c1e4-4e25-8787-7253372e4bdc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1504 microversion: 2.1 time: 0.630904 Oct 16 01:05:48.512883 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 675/1458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:47 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1504 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:48.795276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a55d1729-b9b4-432c-bf01-61df8b406eb9 req-222fb180-b4d9-40d0-ab0e-eec812a222fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90", "name": "network-vif-plugged", "status": "completed", "tag": "04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:48.831015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a55d1729-b9b4-432c-bf01-61df8b406eb9 req-222fb180-b4d9-40d0-ab0e-eec812a222fc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:48.831638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a55d1729-b9b4-432c-bf01-61df8b406eb9 req-222fb180-b4d9-40d0-ab0e-eec812a222fc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:48.832181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a55d1729-b9b4-432c-bf01-61df8b406eb9 req-222fb180-b4d9-40d0-ab0e-eec812a222fc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:48.858571 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a55d1729-b9b4-432c-bf01-61df8b406eb9 req-222fb180-b4d9-40d0-ab0e-eec812a222fc service nova] Creating event network-vif-plugged:04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3 for instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 on n-h2-master-1 Oct 16 01:05:48.867767 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a55d1729-b9b4-432c-bf01-61df8b406eb9 req-222fb180-b4d9-40d0-ab0e-eec812a222fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.352840 Oct 16 01:05:48.869208 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 676/1459] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:48.881483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:48.882669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:48.892912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:48.894104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:48.894774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:48.895775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:48.896575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:48.897293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:48.988443 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e855952-cf34-49e6-bcd9-c85d3440cc6b tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/5ffccf48-89b0-4f84-b083-c60a3ff27ff0" status: 202 len: 0 microversion: 2.1 time: 4.152344 Oct 16 01:05:48.989029 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 784/1460] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:05:44 2022] DELETE /compute/v2.1/os-floating-ips/5ffccf48-89b0-4f84-b083-c60a3ff27ff0 => generated 0 bytes in 4154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:05:48.995195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:48.996435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:49.013737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.019004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.019851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.020758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.024998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.025674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.060789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:49.085376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:49.102851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:49.113109 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-216c90c3-47a6-4c7f-aa32-1998925a2306 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1251 microversion: 2.25 time: 0.237985 Oct 16 01:05:49.116815 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 677/1461] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:48 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1251 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:05:49.128818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5cd01f46-4421-468a-a3c1-66323037d5d4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e99b5e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:49.249269 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5cd01f46-4421-468a-a3c1-66323037d5d4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.129100 Oct 16 01:05:49.250162 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 678/1462] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:49 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:49.263060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:49.263686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:49.277565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.277565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.277973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.286115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.286747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.287242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.734142 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ed4271c-1a95-4dfa-95cf-59e1f9902554 tempest-MigrationsAdminTest-327525074 tempest-MigrationsAdminTest-327525074-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1613 microversion: 2.1 time: 0.743759 Oct 16 01:05:49.740420 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 785/1463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:48 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1613 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:49.744543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:49.755257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6aadd804-311a-4e4f-81a7-826cb6593dec tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Calling method '.version_select at 0x7fd64e529ee0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:49.767445 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-022756c1-9079-43de-bb9f-04c05d5f864e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 0.511014 Oct 16 01:05:49.768627 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 679/1464] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:49 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:49.780738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:49.781537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:49.800063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.800523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.809568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.810814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.811357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.811804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:49.926343 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-6aadd804-311a-4e4f-81a7-826cb6593dec tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 could not be found", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:05:49.928253 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-6aadd804-311a-4e4f-81a7-826cb6593dec tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] HTTP exception thrown: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6aadd804-311a-4e4f-81a7-826cb6593dec tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Request method failure captured: Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-floating-ips/5ffccf48-89b0-4f84-b083-c60a3ff27ff0 HTTP/1.1 Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1jbUap_6CS7pW8djSXgsTNXTv7I19VLFZdKfihHlPikkakUmqp__fmhDLH96ALpQN9sYs8EzP-eUUUYDgF5aF_paiqh_VgnVzqLOGSySU3wKv7gfP88u2bOR6F3Vw-tBPfePBAt79dOcCWoA7kZgz512SFEIOSEL4oCtFoycJ6W018 Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8a91e848d7ef4946ad7499af40ad187e Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FloatingIPsTestJSON-2066838015 Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:05:49.930579 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8a91e848d7ef4946ad7499af40ad187e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8a91e848d7ef4946ad7499af40ad187e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a91e848d7ef4946ad7499af40ad187e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a91e848d7ef4946ad7499af40ad187e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FloatingIPsTestJSON-2066838015 Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8a91e848d7ef4946ad7499af40ad187e Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2066838015 Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FloatingIPsTestJSON-2066838015-project Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 075812ec2ad746dcbb55fceead90d0eb Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FloatingIPsTestJSON-2066838015-project Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: exception: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5ffccf48-89b0-4f84-b083-c60a3ff27ff0'} Oct 16 01:05:49.932251 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:05:49.933252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 could not be found Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4e39b29-2bc5-4401-ae2f-0e57c8e33768'] Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0. Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:49.936415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:49.937686 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:49.941509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 Oct 16 01:05:49.941509 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:49.941509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6aadd804-311a-4e4f-81a7-826cb6593dec tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Returning 404 to user: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:49.941509 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6aadd804-311a-4e4f-81a7-826cb6593dec tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/5ffccf48-89b0-4f84-b083-c60a3ff27ff0" status: 404 len: 111 microversion: 2.1 time: 0.188255 Oct 16 01:05:49.941509 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 786/1465] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:05:49 2022] GET /compute/v2.1/os-floating-ips/5ffccf48-89b0-4f84-b083-c60a3ff27ff0 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:49.950684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:49.951411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:49.984664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:49.987083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:49.987567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:50.004660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:50.005344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:50.008005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:50.087058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:50.313610 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0a89b1b7-d3ca-45d3-a165-5d412da70150 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 204 len: 0 microversion: 2.1 time: 0.379106 Oct 16 01:05:50.314420 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 787/1466] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:49 2022] DELETE /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:05:50.324243 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb5bb35b-fac5-49b2-b12b-de0ad4a06855 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Calling method '.version_select at 0x7fd64e3d74c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:50.446590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:50.463494 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d09dfd5-2fe8-4bd0-8668-0209b6efc402 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1504 microversion: 2.1 time: 0.693550 Oct 16 01:05:50.464104 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 680/1467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:49 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1504 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:50.469152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:50.479892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:50.498469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:50.499385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:50.500106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:50.501616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:50.505655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:50.506471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:50.668790 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-eb5bb35b-fac5-49b2-b12b-de0ad4a06855 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 could not be found", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:05:50.669633 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-eb5bb35b-fac5-49b2-b12b-de0ad4a06855 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] HTTP exception thrown: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb5bb35b-fac5-49b2-b12b-de0ad4a06855 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Request method failure captured: Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-floating-ips/5ffccf48-89b0-4f84-b083-c60a3ff27ff0 HTTP/1.1 Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1jbUap_6CS7pW8djSXgsTNXTv7I19VLFZdKfihHlPikkakUmqp__fmhDLH96ALpQN9sYs8EzP-eUUUYDgF5aF_paiqh_VgnVzqLOGSySU3wKv7gfP88u2bOR6F3Vw-tBPfePBAt79dOcCWoA7kZgz512SFEIOSEL4oCtFoycJ6W018 Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8a91e848d7ef4946ad7499af40ad187e Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FloatingIPsTestJSON-2066838015 Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:05:50.671906 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8a91e848d7ef4946ad7499af40ad187e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8a91e848d7ef4946ad7499af40ad187e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a91e848d7ef4946ad7499af40ad187e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8a91e848d7ef4946ad7499af40ad187e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FloatingIPsTestJSON-2066838015 Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8a91e848d7ef4946ad7499af40ad187e Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2066838015 Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FloatingIPsTestJSON-2066838015-project Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 075812ec2ad746dcbb55fceead90d0eb Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FloatingIPsTestJSON-2066838015-project Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: exception: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5ffccf48-89b0-4f84-b083-c60a3ff27ff0'} Oct 16 01:05:50.673626 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:05:50.674490 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 could not be found Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7de9729-67f0-4647-8924-d3e66600730f'] Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0. Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:50.675696 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:50.676955 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:50.678390 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 Oct 16 01:05:50.678390 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:50.691282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb5bb35b-fac5-49b2-b12b-de0ad4a06855 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] Returning 404 to user: Floating IP not found for ID 5ffccf48-89b0-4f84-b083-c60a3ff27ff0 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:50.691282 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eb5bb35b-fac5-49b2-b12b-de0ad4a06855 tempest-FloatingIPsTestJSON-2066838015 tempest-FloatingIPsTestJSON-2066838015-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/5ffccf48-89b0-4f84-b083-c60a3ff27ff0" status: 404 len: 111 microversion: 2.1 time: 0.373863 Oct 16 01:05:50.691282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 788/1468] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:05:50 2022] DELETE /compute/v2.1/os-floating-ips/5ffccf48-89b0-4f84-b083-c60a3ff27ff0 => generated 111 bytes in 375 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:50.708917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe8e83a2-d36d-41a9-a0dd-6adfa99b057a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e387670>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:50.791658 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe8e83a2-d36d-41a9-a0dd-6adfa99b057a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.099193 Oct 16 01:05:50.797021 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 789/1469] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:50 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:50.819847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:50.821096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:50.830724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:50.831614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:50.834444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:50.835471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:50.836209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:50.836871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:51.582043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:51.596589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:51.600865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:51.613805 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-38adced7-48de-430b-adb6-23d15269ff68 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1293 microversion: 2.25 time: 1.138219 Oct 16 01:05:51.614807 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 681/1470] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:50 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1293 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:05:51.619940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:51.620760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:51.632685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:51.633953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:51.634569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:51.635490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:51.639646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:51.640338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:52.008616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:52.018632 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a69f5c93-94e0-4408-bab7-d963e484e07f tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1468 microversion: 2.1 time: 1.219503 Oct 16 01:05:52.031625 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 790/1471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:50 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1468 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:52.051444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-20b38994-3f84-4bd4-a9c0-929e887aaa7c req-3a67ade2-914f-4085-9d20-1952992596b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "name": "network-vif-plugged", "status": "completed", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:52.105257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-20b38994-3f84-4bd4-a9c0-929e887aaa7c req-3a67ade2-914f-4085-9d20-1952992596b3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:52.114551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-20b38994-3f84-4bd4-a9c0-929e887aaa7c req-3a67ade2-914f-4085-9d20-1952992596b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:52.118530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-20b38994-3f84-4bd4-a9c0-929e887aaa7c req-3a67ade2-914f-4085-9d20-1952992596b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:52.180367 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-20b38994-3f84-4bd4-a9c0-929e887aaa7c req-3a67ade2-914f-4085-9d20-1952992596b3 service nova] Creating event network-vif-plugged:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h2-master-1 Oct 16 01:05:52.189229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:52.217392 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b79475a0-30bb-436b-86ab-f00c724ad79d tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 0.590875 Oct 16 01:05:52.218965 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 682/1472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:51 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:52.224816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:52.225048 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-20b38994-3f84-4bd4-a9c0-929e887aaa7c req-3a67ade2-914f-4085-9d20-1952992596b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188961 Oct 16 01:05:52.228922 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 791/1473] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:52.229840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:52.245167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4c91a0a-8330-44a3-9733-9a902db38cc6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e139ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:52.245692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:52.246375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:52.247107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:52.248166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:52.251823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:52.252503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:52.390761 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4c91a0a-8330-44a3-9733-9a902db38cc6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.160230 Oct 16 01:05:52.400457 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 792/1474] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:52 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:52.646277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:52.647219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:52.656351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:52.660702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:52.666312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:52.667275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:52.667972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:52.668518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:52.921758 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:53.390466 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:54.334728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:54.349794 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4264628-87f8-4d3b-859b-489432504d59 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1479 microversion: 2.1 time: 2.128935 Oct 16 01:05:54.355266 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 683/1475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:52 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1479 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:54.365687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:54.368594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:54.383768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:54.385025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:54.387701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:54.389063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:54.392382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:54.393154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:54.441339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:54.464752 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:54.472550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:54.475821 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e597d5ae-728a-4dd9-b759-c89c9bb7ab6c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1293 microversion: 2.25 time: 1.835031 Oct 16 01:05:54.492851 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 793/1476] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:52 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1293 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:05:54.500349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:54.507995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:54.529104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:54.530061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:54.530740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:54.532625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:54.533528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:54.534191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:55.463604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:55.485092 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f066910b-0c8f-4770-94bb-87c7f7c0a88a tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 0.990529 Oct 16 01:05:55.487237 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 794/1477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:54 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:55.499178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34585384-94db-49cd-82ed-c257143733c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e62a550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:55.512642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:55.529581 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fac564cc-9946-4d15-aae9-4d8457d6b698 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1468 microversion: 2.1 time: 1.172718 Oct 16 01:05:55.530090 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 684/1478] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:54 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1468 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:55.544405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5d1dadb8-f077-465e-804a-cbe57345bed5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '.version_select at 0x7fd64e502ee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:55.567694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d1dadb8-f077-465e-804a-cbe57345bed5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:55.568815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d1dadb8-f077-465e-804a-cbe57345bed5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:55.569279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d1dadb8-f077-465e-804a-cbe57345bed5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:55.599125 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34585384-94db-49cd-82ed-c257143733c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.110647 Oct 16 01:05:55.599757 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 795/1479] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:55 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:55.607885 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5d1dadb8-f077-465e-804a-cbe57345bed5 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3506 microversion: 2.1 time: 0.076563 Oct 16 01:05:55.609221 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 685/1480] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:05:55 2022] GET /compute/v2.1/os-migrations => generated 3506 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:55.611028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:55.614168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:55.639088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:55.640088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:55.640775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:55.641933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:55.642862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:55.643529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:55.643709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:55.644171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:55.654685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:55.655946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:55.656560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:55.659849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:55.661061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:55.661671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:55.678508 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:56.841172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-184dd803-7353-40a6-bf70-a8ca0ade7799 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1630 microversion: 2.1 time: 1.201764 Oct 16 01:05:56.843323 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 686/1481] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:55 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1630 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:57.014481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-02a854ac-cd05-4901-accb-95d75837d055 req-5f84fe36-0d5a-4914-b3f8-8e87be778b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da62c98-9b5a-46d0-ab70-a84597fd90a6", "name": "network-vif-deleted", "tag": "bc38be1b-fb74-40d3-b766-696e383b2c3f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:57.038649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-02a854ac-cd05-4901-accb-95d75837d055 req-5f84fe36-0d5a-4914-b3f8-8e87be778b46 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.039265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-02a854ac-cd05-4901-accb-95d75837d055 req-5f84fe36-0d5a-4914-b3f8-8e87be778b46 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.039774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-02a854ac-cd05-4901-accb-95d75837d055 req-5f84fe36-0d5a-4914-b3f8-8e87be778b46 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.085200 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-02a854ac-cd05-4901-accb-95d75837d055 req-5f84fe36-0d5a-4914-b3f8-8e87be778b46 service nova] Creating event network-vif-deleted:bc38be1b-fb74-40d3-b766-696e383b2c3f for instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 on n-h2-master-1 Oct 16 01:05:57.104715 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-02a854ac-cd05-4901-accb-95d75837d055 req-5f84fe36-0d5a-4914-b3f8-8e87be778b46 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257495 Oct 16 01:05:57.108148 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 687/1482] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:57.135244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:57.141686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:57.152592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.157484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.158128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.161733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.162444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.164208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.428363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:57.455374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:57.457406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:57.458776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1864e319-0cc6-4690-b518-1fbe8cda1231 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1293 microversion: 2.25 time: 1.858094 Oct 16 01:05:57.465942 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 796/1483] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:55 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1293 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:05:57.476794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:57.480924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:57.495965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.496793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.497597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.499355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.504122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.504789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.597448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:57.599558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:57.600223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:57.604416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lazy-loading 'fault' on Instance uuid 8da62c98-9b5a-46d0-ab70-a84597fd90a6 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:05:57.850167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:57.863031 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b238fcfc-30f8-48e9-8fcd-5712db715a2d tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 200 len: 1303 microversion: 2.1 time: 0.395597 Oct 16 01:05:57.882628 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 797/1484] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:57 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 1303 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:57.892646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-786e326b-b7d3-40e2-be04-c48ea1e67509 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e1391f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:57.973199 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-786e326b-b7d3-40e2-be04-c48ea1e67509 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.088752 Oct 16 01:05:57.977358 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 798/1485] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:57 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:57.994290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd131c3f-61ed-4ccd-a431-50a2fe051f79 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Action: 'create', calling method: .version_select at 0x7fd64e4190d0>, body: {"keypair": {"name": "tempest-keypair-1021869812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6F7f9CW/vxAWh1dGyjULbBz9F9oWmRQslwAJVcngAbqK3IDPwHLUkJi3508m2oHjHv0W/nwGWUof2yH+DeYpWMy1iMoohxImulxKrRLzivaiPxdwEEqiTjK3jKSwmYKg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:58.038655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-bd131c3f-61ed-4ccd-a431-50a2fe051f79 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for project 05a68224ef104af2963c881faa8383de. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:05:58.052289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-bd131c3f-61ed-4ccd-a431-50a2fe051f79 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for user 3c33afd9ae144eb185203c30baa70351 and project 05a68224ef104af2963c881faa8383de. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:05:58.116686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:58.127808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35689758-3580-4854-8089-a138acad7829 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 1.018376 Oct 16 01:05:58.130134 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd131c3f-61ed-4ccd-a431-50a2fe051f79 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149359 Oct 16 01:05:58.131377 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 688/1486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:57 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:58.140468 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 799/1487] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:05:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:58.492378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:58.492986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:58.506436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.506943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.515645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:58.516931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.520003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.520675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:58.683268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d09b87ed-d14a-49bd-a9aa-0db0f996eb99 req-e53963fa-b7fe-43ba-b1ca-ab8ae56e3c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e", "tag": "b8782224-70e0-4ab1-8247-575f68f8e9c0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:58.710186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d09b87ed-d14a-49bd-a9aa-0db0f996eb99 req-e53963fa-b7fe-43ba-b1ca-ab8ae56e3c8b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.710674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d09b87ed-d14a-49bd-a9aa-0db0f996eb99 req-e53963fa-b7fe-43ba-b1ca-ab8ae56e3c8b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.711141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d09b87ed-d14a-49bd-a9aa-0db0f996eb99 req-e53963fa-b7fe-43ba-b1ca-ab8ae56e3c8b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:58.754095 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d09b87ed-d14a-49bd-a9aa-0db0f996eb99 req-e53963fa-b7fe-43ba-b1ca-ab8ae56e3c8b service nova] Creating event network-changed:b8782224-70e0-4ab1-8247-575f68f8e9c0 for instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e on n-h2-master-1 Oct 16 01:05:58.772849 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d09b87ed-d14a-49bd-a9aa-0db0f996eb99 req-e53963fa-b7fe-43ba-b1ca-ab8ae56e3c8b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093190 Oct 16 01:05:58.773485 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 800/1488] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:58.895815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:58.896520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 8da62c98-9b5a-46d0-ab70-a84597fd90a6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:58.914719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.915515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.916155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:58.917036 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.917672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.918263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:58.952786 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] HTTP exception thrown: Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 could not be found. Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Request method failure captured: Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 HTTP/1.1 Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1euohWsARRfOQvyspOvA00WOP0ZME8bB7eZz2-xdg7Tztp521xWqi2r2io54wyVhGtlz5qa06SC9Pb2en4wcHvP5YySL7p8GcZ-mfrJe4A7Q7mTxZBuUdO3LaXqTUWd9TVvdCNZUodOIJPGRmqfy_qjS822WLruvgNZnpRvArK4AmI Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f6556287cca54d74b4971ef3e666cc1e Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-MigrationsAdminTest-908404407 Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:05:58.955019 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6556287cca54d74b4971ef3e666cc1e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-MigrationsAdminTest-908404407 Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f6556287cca54d74b4971ef3e666cc1e Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-MigrationsAdminTest-908404407 Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-MigrationsAdminTest-908404407-project Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: f3b14e05c41648159d8ed97719c68862 Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-MigrationsAdminTest-908404407-project Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 could not be found. Oct 16 01:05:58.956515 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8da62c98-9b5a-46d0-ab70-a84597fd90a6'} Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 could not be found. Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:05:58.957357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 could not be found. Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 could not be found. Oct 16 01:05:58.958706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:05:58.961415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Returning 404 to user: Instance 8da62c98-9b5a-46d0-ab70-a84597fd90a6 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:05:58.962526 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a1fab1c5-702d-4af8-a101-f0b60d844535 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6" status: 404 len: 111 microversion: 2.1 time: 0.072584 Oct 16 01:05:58.963656 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 801/1489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:58 2022] GET /compute/v2.1/servers/8da62c98-9b5a-46d0-ab70-a84597fd90a6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:05:58.972369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:58.973215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:58.992060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.993010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.993659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:58.994974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:58.995630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:58.996261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.056171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:05:59.090187 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:59.229676 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fd0edcce-6641-4714-8501-56898f0ea359 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 204 len: 0 microversion: 2.1 time: 0.261537 Oct 16 01:05:59.234236 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 802/1490] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:05:58 2022] DELETE /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:05:59.241345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d499c07-bd95-4cf1-abb2-183e42712516 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e5294c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:59.346089 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d499c07-bd95-4cf1-abb2-183e42712516 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.110424 Oct 16 01:05:59.347014 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 803/1491] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:59 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:05:59.362823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:59.363601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:59.378484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.379027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:59.379459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.380320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.380833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:59.381071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.874318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:59.886275 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:59.892612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:05:59.896513 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e9a29c36-2c02-4e3a-802d-345afada6a14 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1293 microversion: 2.25 time: 1.408733 Oct 16 01:05:59.900096 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 689/1492] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:05:58 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1293 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:05:59.910872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d0b94105-85c8-4320-9eea-291dd8498337 req-a3b5fcd5-1796-4e8c-80b8-c178bf76d7fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07f7f1bd-fedf-492a-9a95-88280c25a805", "tag": "67777f8b-edc4-4944-a928-8eb9a896e837"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:05:59.932265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d0b94105-85c8-4320-9eea-291dd8498337 req-a3b5fcd5-1796-4e8c-80b8-c178bf76d7fc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.935461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d0b94105-85c8-4320-9eea-291dd8498337 req-a3b5fcd5-1796-4e8c-80b8-c178bf76d7fc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:59.936015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d0b94105-85c8-4320-9eea-291dd8498337 req-a3b5fcd5-1796-4e8c-80b8-c178bf76d7fc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.959754 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d0b94105-85c8-4320-9eea-291dd8498337 req-a3b5fcd5-1796-4e8c-80b8-c178bf76d7fc service nova] Creating event network-changed:67777f8b-edc4-4944-a928-8eb9a896e837 for instance 07f7f1bd-fedf-492a-9a95-88280c25a805 on n-h2-master-1 Oct 16 01:05:59.967681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d0b94105-85c8-4320-9eea-291dd8498337 req-a3b5fcd5-1796-4e8c-80b8-c178bf76d7fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065546 Oct 16 01:05:59.969045 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 690/1493] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:05:59.976886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:05:59.977915 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:05:59.990499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.991343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:05:59.992891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:05:59.994277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:05:59.995155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:00.002392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:00.036872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:00.046104 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d46593ee-fbcd-4dcc-86ae-f09f8dac9098 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 0.698034 Oct 16 01:06:00.058657 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 804/1494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:59 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:00.362232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22889679-5344-496a-a7d2-98495afd4462 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e422310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:00.439100 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22889679-5344-496a-a7d2-98495afd4462 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.080717 Oct 16 01:06:00.440385 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 805/1495] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:00 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:06:00.622396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:00.659312 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-da43c56d-4a4c-407b-beb2-d946f200e0a5 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1534 microversion: 2.1 time: 0.687828 Oct 16 01:06:00.664427 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 691/1496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:05:59 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1534 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:00.925674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:00.926696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:00.947290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:00.948315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:00.951515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:00.955720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:00.956536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:00.960803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:01.075139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:01.076537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:01.081839 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=62 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:01.109692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:01.110682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:01.111287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:01.114026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:01.116731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:01.118938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:01.846645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:01.855399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:01.877440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:01.884811 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49156c38-1885-4dd6-b00f-8d8b290b576e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1281 microversion: 2.25 time: 0.963262 Oct 16 01:06:01.892676 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 806/1497] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:00 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1281 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:01.900428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7623971a-d2d7-4c6c-be58-7b9d37e6b45d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e3be5e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:02.007530 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7623971a-d2d7-4c6c-be58-7b9d37e6b45d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.113331 Oct 16 01:06:02.008580 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 807/1498] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:01 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:02.026661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:02.041103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:02.043348 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fe089cb1-b8c5-48b7-8ffa-c8804b51583f tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 0.971946 Oct 16 01:06:02.044272 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 692/1499] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:01 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:06:02.045284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:02.062552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:02.067589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:02.070892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:02.074420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:02.077587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:02.078549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:03.005889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:03.010947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-145190198", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "1389199b-a791-4ada-a1f5-cfa3485db519"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:03.015454 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b038ec73-84bf-4d7d-a7b1-17f1f83b44bf tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 200 len: 1534 microversion: 2.1 time: 1.005697 Oct 16 01:06:03.022117 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 808/1500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:02 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 1534 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:03.042241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:03.044411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:03.073011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:03.082694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:03.083620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:03.089847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:03.091756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:03.093020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:03.110439 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] validate_networks() for [('1389199b-a791-4ada-a1f5-cfa3485db519', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:06:06.002087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:06.022425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:06.027839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:06.029244 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22ba5b79-d7f1-47f0-addd-e9dc56d5781f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1281 microversion: 2.25 time: 3.004467 Oct 16 01:06:06.047185 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 809/1501] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:03 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1281 bytes in 3024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:06.054695 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-672437f3-e012-45bf-b697-e3310604b336 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e13e160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:06.112167 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-672437f3-e012-45bf-b697-e3310604b336 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.063747 Oct 16 01:06:06.113880 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 810/1502] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:06 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:06.124445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:06.125359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:06.132296 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:06.145310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:06.147171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:06.148819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:06.149725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:06.153400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:06.153848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:06.583916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:06.594904 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67dcbaf5-a391-49d4-8b99-971e04116ba9 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 0.479221 Oct 16 01:06:06.613967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 811/1503] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:06 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:06.640217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:06.644085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 12066daa-d04c-4f73-b4ee-45b8a17cecc8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:06.675270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:06.679406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:06.682427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:06.683374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:06.692436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:06.695979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:06.755406 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] HTTP exception thrown: Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 could not be found. Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Request method failure captured: Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 HTTP/1.1 Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1euohWsARRfOQvyspOvA00WOP0ZME8bB7eZz2-xdg7Tztp521xWqi2r2io54wyVhGtlz5qa06SC9Pb2en4wcHvP5YySL7p8GcZ-mfrJe4A7Q7mTxZBuUdO3LaXqTUWd9TVvdCNZUodOIJPGRmqfy_qjS822WLruvgNZnpRvArK4AmI Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f6556287cca54d74b4971ef3e666cc1e Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:06.757121 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6556287cca54d74b4971ef3e666cc1e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f6556287cca54d74b4971ef3e666cc1e Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-MigrationsAdminTest-908404407-project Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: f3b14e05c41648159d8ed97719c68862 Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-MigrationsAdminTest-908404407-project Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 could not be found. Oct 16 01:06:06.758523 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '12066daa-d04c-4f73-b4ee-45b8a17cecc8'} Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 could not be found. Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:06.759356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 could not be found. Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 could not be found. Oct 16 01:06:06.760629 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:06.761860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Returning 404 to user: Instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:06.774180 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cffcb95c-e5b5-4855-b32c-96c9249325d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8" status: 404 len: 111 microversion: 2.1 time: 0.143321 Oct 16 01:06:06.774840 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 812/1504] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:06 2022] GET /compute/v2.1/servers/12066daa-d04c-4f73-b4ee-45b8a17cecc8 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:06.788101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f04ba305-8ee8-4931-b0c8-202968f651e3 req-a6f93d56-3af2-4762-af62-fbfe1a5b7d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12066daa-d04c-4f73-b4ee-45b8a17cecc8", "name": "network-vif-deleted", "tag": "462f1588-13d7-4346-bf9e-fb24a7f41f90"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:06.841824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f04ba305-8ee8-4931-b0c8-202968f651e3 req-a6f93d56-3af2-4762-af62-fbfe1a5b7d0c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:06.842467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f04ba305-8ee8-4931-b0c8-202968f651e3 req-a6f93d56-3af2-4762-af62-fbfe1a5b7d0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:06.842944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f04ba305-8ee8-4931-b0c8-202968f651e3 req-a6f93d56-3af2-4762-af62-fbfe1a5b7d0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:06.881134 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f04ba305-8ee8-4931-b0c8-202968f651e3 req-a6f93d56-3af2-4762-af62-fbfe1a5b7d0c service nova] Creating event network-vif-deleted:462f1588-13d7-4346-bf9e-fb24a7f41f90 for instance 12066daa-d04c-4f73-b4ee-45b8a17cecc8 on n-h2-master-1 Oct 16 01:06:06.909496 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f04ba305-8ee8-4931-b0c8-202968f651e3 req-a6f93d56-3af2-4762-af62-fbfe1a5b7d0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122787 Oct 16 01:06:06.910134 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 813/1505] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:06.936565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-817959147", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "a5e706d8-a668-4337-ad37-edd049e6eb97"}], "security_groups": [{"name": "tempest-securitygroup--1903519153"}], "key_name": "tempest-keypair-1021869812", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:07.553377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] validate_networks() for [('a5e706d8-a668-4337-ad37-edd049e6eb97', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:06:07.639597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:06:07.640159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:06:07.640464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:06:07.640869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:06:07.641817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:06:07.697942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:07.699947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:07.704623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:07.707304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:07.710513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:07.714120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:07.779256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Getting quotas for project ba43dd17d7974221a59efaa1452b3b2f. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:07.787571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Getting quotas for user 5d9ecc8887874f989006a848b818ac84 and project ba43dd17d7974221a59efaa1452b3b2f. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:07.821872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:06:07.826188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:06:07.919450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0c0be34e-ae8e-4566-822d-f6a4928311a2 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 5.034970 Oct 16 01:06:07.923907 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 693/1506] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:06:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 5041 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:06:07.932026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d7e3734d-fd8f-45db-943f-ed707e0d46a0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '.version_select at 0x7fd64e95e9d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:07.981578 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d7e3734d-fd8f-45db-943f-ed707e0d46a0 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976747058" status: 202 len: 0 microversion: 2.1 time: 0.055796 Oct 16 01:06:07.982673 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 694/1507] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:06:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976747058 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:06:07.988151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:07.989410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:07.998051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:07.998818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:07.999451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:08.000329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:08.001697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:08.002961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:08.078586 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:09.844191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:09.857554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:09.859048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:09.860718 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3e8db78b-f318-4373-b98b-c742ff6da322 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1281 microversion: 2.25 time: 1.876702 Oct 16 01:06:09.867300 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 695/1508] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:07 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1281 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:09.878981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15b9b918-ac8d-4b55-ae1b-1b44008f935e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64ea69280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:09.970503 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-15b9b918-ac8d-4b55-ae1b-1b44008f935e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.101883 Oct 16 01:06:09.979518 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 696/1509] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:09 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:09.985812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f1513dd6-89d3-448b-b7c7-d56f3d788e5a req-0c4ad8d8-875e-4051-8c66-89bb0bf078d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f7f1bd-fedf-492a-9a95-88280c25a805", "name": "network-vif-plugged", "status": "completed", "tag": "67777f8b-edc4-4944-a928-8eb9a896e837"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:10.017925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f1513dd6-89d3-448b-b7c7-d56f3d788e5a req-0c4ad8d8-875e-4051-8c66-89bb0bf078d7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.018851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f1513dd6-89d3-448b-b7c7-d56f3d788e5a req-0c4ad8d8-875e-4051-8c66-89bb0bf078d7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.020139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f1513dd6-89d3-448b-b7c7-d56f3d788e5a req-0c4ad8d8-875e-4051-8c66-89bb0bf078d7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.042522 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f1513dd6-89d3-448b-b7c7-d56f3d788e5a req-0c4ad8d8-875e-4051-8c66-89bb0bf078d7 service nova] Creating event network-vif-plugged:67777f8b-edc4-4944-a928-8eb9a896e837 for instance 07f7f1bd-fedf-492a-9a95-88280c25a805 on n-h2-master-1 Oct 16 01:06:10.052712 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f1513dd6-89d3-448b-b7c7-d56f3d788e5a req-0c4ad8d8-875e-4051-8c66-89bb0bf078d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071883 Oct 16 01:06:10.054070 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 697/1510] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:10.065951 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:10.066669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:10.088321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.088685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.089128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.089852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.090306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.091340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.453282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:06:10.454407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:06:10.455419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:06:10.455988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:06:10.456588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:06:10.478085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.479114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.479734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.485737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.486985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.487908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.495297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:10.513379 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85c1155d-2044-48a2-b374-299ce03f5b34 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 0.449791 Oct 16 01:06:10.514057 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 698/1511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:10 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:10.551150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for project 05a68224ef104af2963c881faa8383de. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:10.599843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for user 3c33afd9ae144eb185203c30baa70351 and project 05a68224ef104af2963c881faa8383de. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:10.618354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:06:10.621864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:06:10.742774 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d6d4428-fa82-415d-bc6b-658774ed95f0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.831383 Oct 16 01:06:10.747291 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 814/1512] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:06:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 3836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:06:10.758167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:10.775427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:10.791975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.792927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.793587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.794551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.795470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.796058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.885570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:10.897653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:10.899504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:10.901241 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82897f05-bad7-4a96-a5ea-e5db08149ee1 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1316 microversion: 2.21 time: 0.151490 Oct 16 01:06:10.902300 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 815/1513] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:10 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:10.909657 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:10.910324 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:10.918740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.919960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.920544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.921553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:10.922417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:10.923208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:10.958632 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:06:11.019480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-89022908-2e92-4eaf-a5ab-ac25c8b333fb tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] Calling method '.version_select at 0x7fd64e82cd30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:11.106741 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1b49e83d-d44b-4041-8ab8-c471260a30a3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 204 len: 0 microversion: 2.1 time: 0.202310 Oct 16 01:06:11.107748 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 816/1514] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:06:10 2022] DELETE /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:06:11.114770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c4b0327-3dcf-46c8-bb56-af25dca0bf2d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:11.120088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4c4b0327-3dcf-46c8-bb56-af25dca0bf2d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:11.131181 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-89022908-2e92-4eaf-a5ab-ac25c8b333fb tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.615668 Oct 16 01:06:11.131982 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 699/1515] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:06:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:06:11.149447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:11.152290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:11.174387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:11.175632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:11.176491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:11.179174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:11.181561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:11.182868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:11.207864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4c4b0327-3dcf-46c8-bb56-af25dca0bf2d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:11.215030 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c4b0327-3dcf-46c8-bb56-af25dca0bf2d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1234 microversion: 2.1 time: 0.105576 Oct 16 01:06:11.244607 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 817/1516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:11 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1234 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:11.249532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-00b7927d-f53c-472f-8a0e-037f87b768ec tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e6a1d30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:11.376761 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-00b7927d-f53c-472f-8a0e-037f87b768ec tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.130938 Oct 16 01:06:11.377366 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 818/1517] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:11 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:11.415238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:11.416444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:11.423052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:11.424094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:11.424659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:11.425564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:11.426246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:11.429417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:11.552666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:11.577841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:11.580913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:11.588089 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b39f8d54-e3d6-4442-b946-bc03e6f096e0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1281 microversion: 2.25 time: 0.443678 Oct 16 01:06:11.588644 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 700/1518] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:11 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1281 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:11.603041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56fe31b5-4b14-4b1e-a4e0-ad9409ad62af tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] Action: 'create', calling method: .version_select at 0x7fd64e45b9d0>, body: {"pool": "non_exist_pool"} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:11.735373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-56fe31b5-4b14-4b1e-a4e0-ad9409ad62af tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] HTTP exception thrown: Floating IP pool not found. Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56fe31b5-4b14-4b1e-a4e0-ad9409ad62af tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] Request method failure captured: Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 26 Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1j_y99d81wzLuLRjFLGx9ZN5lZ11jH5ejDKGrr7Y2Dk-0-iHPPUDnkGbN1y7JAepRD6jpVTLpYuGwXb6Jnu8jmb3PwP9RjCzjQiRFSzHa1DOOsOfWo8dX2lUiWsqLUDTFg-qX9-H0outMmF3TB9KNLgGEqOoF8WmFzGOOIkZtU2FmQ Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 6134cfbb8dc9412886f06387d75ccf6f Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-259945397 Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:11.737310 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6134cfbb8dc9412886f06387d75ccf6f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6134cfbb8dc9412886f06387d75ccf6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6134cfbb8dc9412886f06387d75ccf6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6134cfbb8dc9412886f06387d75ccf6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-259945397 Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 6134cfbb8dc9412886f06387d75ccf6f Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-259945397 Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-FloatingIPsNegativeTestJSON-259945397-project Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: c44d7f87c3564cb681b680f389265c74 Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-259945397-project Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: {"pool": "non_exist_pool"} Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: exception: Floating IP pool not found. Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 16 01:06:11.739191 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:11.740446 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 16 01:06:11.742180 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:11.748572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56fe31b5-4b14-4b1e-a4e0-ad9409ad62af tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] Returning 404 to user: Floating IP pool not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:11.749779 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56fe31b5-4b14-4b1e-a4e0-ad9409ad62af tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.156479 Oct 16 01:06:11.753121 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 701/1519] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:06:11 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:06:11.771493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:11.773678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:11.802780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:11.804902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:11.805677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:11.808812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:11.809452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:11.811046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:11.874019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:11.886017 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc2c588c-bc02-41ad-ba21-57a8f02d50e3 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1469 microversion: 2.1 time: 0.497929 Oct 16 01:06:11.888007 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 819/1520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:11 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1469 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:11.894755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42ac35ae-f74c-4c86-8988-91a0e45f6662 tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] Calling method '.version_select at 0x7fd64e3bec10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:12.768781 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-42ac35ae-f74c-4c86-8988-91a0e45f6662 tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6552c9ec-6e16-4520-8447-e38b798b14d8 could not be found", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:06:12.769505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-42ac35ae-f74c-4c86-8988-91a0e45f6662 tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] HTTP exception thrown: Floating IP not found for ID 6552c9ec-6e16-4520-8447-e38b798b14d8 Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42ac35ae-f74c-4c86-8988-91a0e45f6662 tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] Request method failure captured: Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-floating-ips/6552c9ec-6e16-4520-8447-e38b798b14d8 HTTP/1.1 Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1j_y99d81wzLuLRjFLGx9ZN5lZ11jH5ejDKGrr7Y2Dk-0-iHPPUDnkGbN1y7JAepRD6jpVTLpYuGwXb6Jnu8jmb3PwP9RjCzjQiRFSzHa1DOOsOfWo8dX2lUiWsqLUDTFg-qX9-H0outMmF3TB9KNLgGEqOoF8WmFzGOOIkZtU2FmQ Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 6134cfbb8dc9412886f06387d75ccf6f Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-259945397 Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:12.771541 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6134cfbb8dc9412886f06387d75ccf6f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6134cfbb8dc9412886f06387d75ccf6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6134cfbb8dc9412886f06387d75ccf6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6134cfbb8dc9412886f06387d75ccf6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-259945397 Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 6134cfbb8dc9412886f06387d75ccf6f Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-259945397 Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FloatingIPsNegativeTestJSON-259945397-project Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c44d7f87c3564cb681b680f389265c74 Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-259945397-project Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: exception: Floating IP not found for ID 6552c9ec-6e16-4520-8447-e38b798b14d8 Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6552c9ec-6e16-4520-8447-e38b798b14d8'} Oct 16 01:06:12.772992 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:06:12.773833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6552c9ec-6e16-4520-8447-e38b798b14d8 could not be found Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60d2e8b5-fff0-46cd-a5f2-93fa9badd0d1'] Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6552c9ec-6e16-4520-8447-e38b798b14d8. Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:12.775156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6552c9ec-6e16-4520-8447-e38b798b14d8 Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:12.776436 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:12.777687 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6552c9ec-6e16-4520-8447-e38b798b14d8 Oct 16 01:06:12.777687 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:12.777687 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42ac35ae-f74c-4c86-8988-91a0e45f6662 tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] Returning 404 to user: Floating IP not found for ID 6552c9ec-6e16-4520-8447-e38b798b14d8 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:12.777687 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42ac35ae-f74c-4c86-8988-91a0e45f6662 tempest-FloatingIPsNegativeTestJSON-259945397 tempest-FloatingIPsNegativeTestJSON-259945397-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/6552c9ec-6e16-4520-8447-e38b798b14d8" status: 404 len: 111 microversion: 2.1 time: 0.884669 Oct 16 01:06:12.777687 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 820/1521] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:06:11 2022] DELETE /compute/v2.1/os-floating-ips/6552c9ec-6e16-4520-8447-e38b798b14d8 => generated 111 bytes in 886 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:12.781816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:12.781816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:12.827881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:12.833934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:12.834953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:12.836957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:12.837721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:12.840275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:13.095638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:13.108291 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a4079fc-0bf5-4b8a-bc76-de77125da6ea tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1314 microversion: 2.1 time: 1.352198 Oct 16 01:06:13.109576 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 702/1522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:11 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1314 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:13.114753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:13.115405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:13.121400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:13.121883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:13.122345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:13.123129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:13.123593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:13.137237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:13.207871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:13.219694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:13.221599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:13.223642 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-64c67116-a7d4-4516-95e2-1a9a293912ea tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1358 microversion: 2.21 time: 0.447427 Oct 16 01:06:13.225744 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 821/1523] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:12 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1358 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:13.241110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ea8854b-4d90-43fb-8011-6a846fb36522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e15a310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:13.342429 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ea8854b-4d90-43fb-8011-6a846fb36522 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1413 microversion: 2.1 time: 0.114600 Oct 16 01:06:13.359693 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 822/1524] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:13 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:13.388384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:13.392682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:13.400030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:13.417072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1b6d61c-d9a5-445b-9641-f23e823498c5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1286 microversion: 2.1 time: 0.306257 Oct 16 01:06:13.421746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:13.423204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:13.427087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:13.429201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:13.431052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:13.432364 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 703/1525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:13 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1286 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:13.434636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:13.452261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:13.454740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:13.476407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:13.480893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:13.482944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:13.488152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:13.496443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:13.497310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:14.201196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:14.220471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:14.225723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:14.232612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b477b903-dedb-4035-a55e-fd59dde1494b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1281 microversion: 2.25 time: 0.866904 Oct 16 01:06:14.233360 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 823/1526] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:13 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1281 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:14.304452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:14.316697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-05c5e4c0-2b82-4e33-9a52-3dcb986386a1 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1469 microversion: 2.1 time: 0.878612 Oct 16 01:06:14.322621 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 704/1527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:13 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1469 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:14.341243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:14.342528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:14.378733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:14.380009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:14.382345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:14.383339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:14.386100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:14.388812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:14.660791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb9f1128-e902-4c7e-9798-b11ce939b00d tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Action: 'create', calling method: .version_select at 0x7fd64e15a3a0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI7fryl20/U2oWCgH9Fg3cynO3pB+3gsxDQa0v/ksSufw5Vm65OZfJRqlnZgBgCg+OH5jNiLGnFl8fIJGIY8oGEkHDvhtSbmdWwBOUFv1uny+hw342zWfJT2MmIw89Fdg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb9f1128-e902-4c7e-9798-b11ce939b00d tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Request method failure captured: Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 257 Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1kF9bDv8MVOdpAuRZzAT1fdrGgaQFK_o6CLjlpkpumSE0pdw9s-qb7wwCJIuXh2bHymcgLXbwt2KWmIBXfDY5wOfP6l2bM7i83odTvLuQtMvw_RcQc9ZJAfl71pjYSrDIn5W811iWQKSDR1erSCxsv6F9BNZCrJq6u_BcJ4DoXbX-c Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:14.670675 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fef9d51a911c47919ee3589efc80b986", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:06:14.672470 n-d-master-1 devstack@n-api.service[120545]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI7fryl20/U2oWCgH9Fg3cynO3pB+3gsxDQa0v/ksSufw5Vm65OZfJRqlnZgBgCg+OH5jNiLGnFl8fIJGIY8oGEkHDvhtSbmdWwBOUFv1uny+hw342zWfJT2MmIw89Fdg=="}} Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI7fryl20/U2oWCgH9Fg3cynO3pB+3gsxDQa0v/ksSufw5Vm65OZfJRqlnZgBgCg+OH5jNiLGnFl8fIJGIY8oGEkHDvhtSbmdWwBOUFv1uny+hw342zWfJT2MmIw89Fdg=='}}} Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:14.673330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:14.674972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:06:14.676832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:06:14.678312 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 16 01:06:14.678312 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:14.678312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb9f1128-e902-4c7e-9798-b11ce939b00d tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:14.690081 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb9f1128-e902-4c7e-9798-b11ce939b00d tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.450097 Oct 16 01:06:14.690523 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 824/1528] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:06:14 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 455 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:06:14.707832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:14.714127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:14.730843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:14.732067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:14.732616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:14.735016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:14.735823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:14.736523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:14.887543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:14.906791 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-847ee59c-be01-486d-a6bc-97401d4b2ab6 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1464 microversion: 2.1 time: 0.581912 Oct 16 01:06:14.928639 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 705/1529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:14 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1464 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:14.943940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4fa5851-5d6d-47d4-a5a9-eb35431bfc22 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e4d8af0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:15.005575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4fa5851-5d6d-47d4-a5a9-eb35431bfc22 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1422 microversion: 2.1 time: 0.071921 Oct 16 01:06:15.006731 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 706/1530] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:14 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:15.013316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:15.014244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:15.023841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.024789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.025765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.026780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.027754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.028768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.100485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:15.110943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:15.113456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:15.114885 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e126295d-272e-4990-9384-9909ed6f19e0 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1358 microversion: 2.21 time: 0.419879 Oct 16 01:06:15.116244 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 825/1531] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:14 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:15.122173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1c6224dc-fe5b-437a-a75b-87dfdaa730f6 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Action: 'create', calling method: .version_select at 0x7fd64e15af70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-705008485", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:15.140832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1c6224dc-fe5b-437a-a75b-87dfdaa730f6 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:15.147781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1c6224dc-fe5b-437a-a75b-87dfdaa730f6 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for user 9bdd2d0be04c469083df1dd7a0ddf986 and project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:15.175587 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1c6224dc-fe5b-437a-a75b-87dfdaa730f6 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1c6224dc-fe5b-437a-a75b-87dfdaa730f6 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Request method failure captured: Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 2166 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1kF9bDv8MVOdpAuRZzAT1fdrGgaQFK_o6CLjlpkpumSE0pdw9s-qb7wwCJIuXh2bHymcgLXbwt2KWmIBXfDY5wOfP6l2bM7i83odTvLuQtMvw_RcQc9ZJAfl71pjYSrDIn5W811iWQKSDR1erSCxsv6F9BNZCrJq6u_BcJ4DoXbX-c Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fef9d51a911c47919ee3589efc80b986", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-705008485", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:15.196976 n-d-master-1 devstack@n-api.service[120545]: exception: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-705008485', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:15.199542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:15.202210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:15.206171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1c6224dc-fe5b-437a-a75b-87dfdaa730f6 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:15.206171 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1c6224dc-fe5b-437a-a75b-87dfdaa730f6 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.087811 Oct 16 01:06:15.206171 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 826/1532] 10.222.0.39 () {60 vars in 1160 bytes} [Sun Oct 16 01:06:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:15.210757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3b16eecc-36be-4fe8-917b-3c117d4faae0 req-27a85869-97bc-432a-a502-ca9881495570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e", "name": "network-vif-plugged", "status": "completed", "tag": "b8782224-70e0-4ab1-8247-575f68f8e9c0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:15.222832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3b16eecc-36be-4fe8-917b-3c117d4faae0 req-27a85869-97bc-432a-a502-ca9881495570 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.223560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3b16eecc-36be-4fe8-917b-3c117d4faae0 req-27a85869-97bc-432a-a502-ca9881495570 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.223751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3b16eecc-36be-4fe8-917b-3c117d4faae0 req-27a85869-97bc-432a-a502-ca9881495570 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.238764 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3b16eecc-36be-4fe8-917b-3c117d4faae0 req-27a85869-97bc-432a-a502-ca9881495570 service nova] Creating event network-vif-plugged:b8782224-70e0-4ab1-8247-575f68f8e9c0 for instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e on n-h2-master-1 Oct 16 01:06:15.244751 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3b16eecc-36be-4fe8-917b-3c117d4faae0 req-27a85869-97bc-432a-a502-ca9881495570 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037409 Oct 16 01:06:15.246866 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 827/1533] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:15.248153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:15.264672 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6656fde6-2372-46cf-90d6-3dd6ad5f4015 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1292 microversion: 2.1 time: 0.256600 Oct 16 01:06:15.269523 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 707/1534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:15 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1292 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:15.278735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ad8ccd3a-3b94-4587-8335-a8d97c24b997 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64ea768b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:15.349152 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ad8ccd3a-3b94-4587-8335-a8d97c24b997 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 200 len: 1422 microversion: 2.1 time: 0.077765 Oct 16 01:06:15.356456 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 708/1535] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:15 2022] GET /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:15.374061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-370e6032-5177-4dda-837d-f691876eeb2f tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Action: 'create', calling method: .version_select at 0x7fd64e8d41f0>, body: {"keypair": {"name": "tempest-keypair-601516409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAakVfh080wZg8511UdjzvaKEcNVuCdltmDCIjMdYDhiQe12X3OkssMbPeXBJSRktu6BYRDSRwrLr2NAexNJZbEKlrodW4z5TqY4F+AkxsjYHGH1M7xveucYA2gusX1tMA=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:15.451027 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-370e6032-5177-4dda-837d-f691876eeb2f tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:15.466982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-370e6032-5177-4dda-837d-f691876eeb2f tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for user 9bdd2d0be04c469083df1dd7a0ddf986 and project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:15.512303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f604a144-17b0-439f-bff2-b6c7e4e5e1d1 tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Calling method '.version_select at 0x7fd64e66cc10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:15.526305 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-370e6032-5177-4dda-837d-f691876eeb2f tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168269 Oct 16 01:06:15.527286 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 709/1536] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:06:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:15.532528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f604a144-17b0-439f-bff2-b6c7e4e5e1d1 tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.533016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f604a144-17b0-439f-bff2-b6c7e4e5e1d1 tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.540243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:15.540869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:15.549411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.549970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.550316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f604a144-17b0-439f-bff2-b6c7e4e5e1d1 tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.550455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.551188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.555064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.558404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.583925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f604a144-17b0-439f-bff2-b6c7e4e5e1d1 tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.584529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f604a144-17b0-439f-bff2-b6c7e4e5e1d1 tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.584966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f604a144-17b0-439f-bff2-b6c7e4e5e1d1 tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.622632 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f604a144-17b0-439f-bff2-b6c7e4e5e1d1 tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/c4d93522c54c4449926b8ddfeda3d96e?start=2022-10-15T01%3A06%3A14.930205&end=2022-10-17T01%3A06%3A14.930205" status: 200 len: 696 microversion: 2.1 time: 0.373254 Oct 16 01:06:15.632905 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 828/1537] 10.222.0.39 () {58 vars in 1412 bytes} [Sun Oct 16 01:06:15 2022] GET /compute/v2.1/os-simple-tenant-usage/c4d93522c54c4449926b8ddfeda3d96e?start=2022-10-15T01%3A06%3A14.930205&end=2022-10-17T01%3A06%3A14.930205 => generated 696 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:15.639498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:15.640541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:15.648832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.649836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.650476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.651501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:15.652316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:15.656846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:15.851654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:15.868862 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:15.885084 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67c112e7-d069-481e-893c-c5af6b722cf2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1427 microversion: 2.1 time: 0.249450 Oct 16 01:06:15.898595 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 829/1538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:15 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1427 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:15.933412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45a73908-4502-404b-b153-2407d2141ca0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e15a550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:15.989500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:15.998580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:16.017790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:16.021223 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-63142b67-d13b-4cd1-b234-37f8bfe1bb11 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1281 microversion: 2.25 time: 0.492896 Oct 16 01:06:16.022720 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 710/1539] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:15 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1281 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:16.034008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7ceace8b-43f3-4ff0-a5d7-780a6d6af4a8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Action: 'create', calling method: .version_select at 0x7fd64eb031f0>, body: {"keypair": {"name": "tempest-keypair-601516409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxUaEmJ1ASThtYb2oAUh0b+gWF+8PCPgyUPg6kBeZZPWFBbwB1xwKQNVx1N7/AeuV6XzHIUUd+3FnheIs9fD3aBiJ4a12IOzlzHU7QwgSz9/J/YwpvyTEYYhIgErbMDpw=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:16.065848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7ceace8b-43f3-4ff0-a5d7-780a6d6af4a8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:16.084002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7ceace8b-43f3-4ff0-a5d7-780a6d6af4a8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for user 9bdd2d0be04c469083df1dd7a0ddf986 and project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:16.129660 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7ceace8b-43f3-4ff0-a5d7-780a6d6af4a8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] HTTP exception thrown: Key pair 'tempest-keypair-601516409' already exists. Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7ceace8b-43f3-4ff0-a5d7-780a6d6af4a8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Request method failure captured: Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 272 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1kF9bDv8MVOdpAuRZzAT1fdrGgaQFK_o6CLjlpkpumSE0pdw9s-qb7wwCJIuXh2bHymcgLXbwt2KWmIBXfDY5wOfP6l2bM7i83odTvLuQtMvw_RcQc9ZJAfl71pjYSrDIn5W811iWQKSDR1erSCxsv6F9BNZCrJq6u_BcJ4DoXbX-c Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fef9d51a911c47919ee3589efc80b986", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: {"keypair": {"name": "tempest-keypair-601516409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxUaEmJ1ASThtYb2oAUh0b+gWF+8PCPgyUPg6kBeZZPWFBbwB1xwKQNVx1N7/AeuV6XzHIUUd+3FnheIs9fD3aBiJ4a12IOzlzHU7QwgSz9/J/YwpvyTEYYhIgErbMDpw=="}} Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: exception: Key pair 'tempest-keypair-601516409' already exists. Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-601516409', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxUaEmJ1ASThtYb2oAUh0b+gWF+8PCPgyUPg6kBeZZPWFBbwB1xwKQNVx1N7/AeuV6XzHIUUd+3FnheIs9fD3aBiJ4a12IOzlzHU7QwgSz9/J/YwpvyTEYYhIgErbMDpw=='}}} Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result.read() Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '9bdd2d0be04c469083df1dd7a0ddf986-tempest-keypair-601516409' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 16 01:06:16.141485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi session.flush() Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result.read() Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 16 01:06:16.146351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '9bdd2d0be04c469083df1dd7a0ddf986-tempest-keypair-601516409' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 16, 1, 6, 16, 112747), 'updated_at': None, 'name': 'tempest-keypair-601516409', 'user_id': '9bdd2d0be04c469083df1dd7a0ddf986', 'fingerprint': 'da:0a:94:1c:bb:df:c1:02:b5:ca:77:48:f6:4a:5a:21', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxUaEmJ1ASThtYb2oAUh0b+gWF+8PCPgyUPg6kBeZZPWFBbwB1xwKQNVx1N7/AeuV6XzHIUUd+3FnheIs9fD3aBiJ4a12IOzlzHU7QwgSz9/J/YwpvyTEYYhIgErbMDpw==', 'type': 'ssh'}] Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi keypair.create() Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._create() Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-601516409' already exists. Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 16 01:06:16.150170 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-601516409' already exists. Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-601516409' already exists. Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:16.159994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7ceace8b-43f3-4ff0-a5d7-780a6d6af4a8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Returning 409 to user: Key pair 'tempest-keypair-601516409' already exists. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:16.163700 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7ceace8b-43f3-4ff0-a5d7-780a6d6af4a8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.132464 Oct 16 01:06:16.165741 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 711/1540] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:06:16 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:06:16.176539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59c6ce14-44a4-4a6f-a63e-8eee550b0fe1 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '.version_select at 0x7fd64e8b8670>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:16.209636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c6ce14-44a4-4a6f-a63e-8eee550b0fe1 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:16.210684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c6ce14-44a4-4a6f-a63e-8eee550b0fe1 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:16.213276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c6ce14-44a4-4a6f-a63e-8eee550b0fe1 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:16.261533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c6ce14-44a4-4a6f-a63e-8eee550b0fe1 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:16.263215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c6ce14-44a4-4a6f-a63e-8eee550b0fe1 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:16.264752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c6ce14-44a4-4a6f-a63e-8eee550b0fe1 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:16.318155 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59c6ce14-44a4-4a6f-a63e-8eee550b0fe1 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/c4d93522c54c4449926b8ddfeda3d96e?start=2022-10-15T01%3A06%3A14.930205&end=2022-10-17T01%3A06%3A14.930205" status: 200 len: 695 microversion: 2.1 time: 0.151049 Oct 16 01:06:16.336016 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 712/1541] 10.222.0.39 () {58 vars in 1412 bytes} [Sun Oct 16 01:06:16 2022] GET /compute/v2.1/os-simple-tenant-usage/c4d93522c54c4449926b8ddfeda3d96e?start=2022-10-15T01%3A06%3A14.930205&end=2022-10-17T01%3A06%3A14.930205 => generated 695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:16.353615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d95ceb65-c9bd-4262-8638-d4e926d916ef req-f7804deb-11e3-4ef2-b099-c2b079955d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d321f72e-d548-4179-a3dc-f28a9be43253", "tag": "8106fa13-8d49-4187-808e-40053bd1ed91"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:16.372824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d95ceb65-c9bd-4262-8638-d4e926d916ef req-f7804deb-11e3-4ef2-b099-c2b079955d29 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:16.373609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d95ceb65-c9bd-4262-8638-d4e926d916ef req-f7804deb-11e3-4ef2-b099-c2b079955d29 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:16.375047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d95ceb65-c9bd-4262-8638-d4e926d916ef req-f7804deb-11e3-4ef2-b099-c2b079955d29 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:16.409440 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d95ceb65-c9bd-4262-8638-d4e926d916ef req-f7804deb-11e3-4ef2-b099-c2b079955d29 service nova] Creating event network-changed:8106fa13-8d49-4187-808e-40053bd1ed91 for instance d321f72e-d548-4179-a3dc-f28a9be43253 on n-h1-master-1 Oct 16 01:06:16.416627 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d95ceb65-c9bd-4262-8638-d4e926d916ef req-f7804deb-11e3-4ef2-b099-c2b079955d29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079001 Oct 16 01:06:16.422788 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 713/1542] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:16.438774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:16.439915 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:16.460391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:16.462414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:16.465610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:16.466609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:16.467930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:16.471667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:16.914642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:16.929987 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:16.935668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:16.937675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:16.939325 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b69f5a1-892f-4725-aeca-371febb5e234 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1358 microversion: 2.21 time: 0.514469 Oct 16 01:06:16.940535 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 714/1543] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:16 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1358 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:16.949099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73b2b8ef-b6bf-448b-9469-010132e28257 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Calling method '.version_select at 0x7fd64ea9a940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:17.017315 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73b2b8ef-b6bf-448b-9469-010132e28257 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601516409" status: 202 len: 0 microversion: 2.1 time: 0.075327 Oct 16 01:06:17.020065 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 715/1544] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:06:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601516409 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:06:17.046500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:17.049549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:17.075397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.077546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.081541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.086601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.088620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.091934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.093071 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45a73908-4502-404b-b153-2407d2141ca0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 204 len: 0 microversion: 2.1 time: 1.192146 Oct 16 01:06:17.093921 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 830/1545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:15 2022] DELETE /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 0 bytes in 1194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:06:17.100209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e3ec7503-4666-466b-b135-4182bdc1f19f tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Calling method '.version_select at 0x7fd64e15a160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:17.129421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3ec7503-4666-466b-b135-4182bdc1f19f tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.129915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3ec7503-4666-466b-b135-4182bdc1f19f tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.130354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3ec7503-4666-466b-b135-4182bdc1f19f tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.214009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3ec7503-4666-466b-b135-4182bdc1f19f tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.216158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3ec7503-4666-466b-b135-4182bdc1f19f tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.220627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3ec7503-4666-466b-b135-4182bdc1f19f tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.347699 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e3ec7503-4666-466b-b135-4182bdc1f19f tempest-TenantUsagesTestJSON-1416092935 tempest-TenantUsagesTestJSON-1416092935-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-15T01%3A06%3A14.930205&end=2022-10-17T01%3A06%3A14.930205&detailed=1" status: 200 len: 17224 microversion: 2.1 time: 0.251598 Oct 16 01:06:17.349093 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 831/1546] 10.222.0.39 () {58 vars in 1335 bytes} [Sun Oct 16 01:06:17 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-15T01%3A06%3A14.930205&end=2022-10-17T01%3A06%3A14.930205&detailed=1 => generated 17224 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:06:17.355481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:17.356404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:17.365071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.365688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.366526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.367280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.367750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.368176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.415111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.415897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.416590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.417102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lazy-loading 'fault' on Instance uuid 7f22d93f-cfd6-4917-932e-9373f71dcb72 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:06:17.443309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:17.457359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f250b5e5-95e1-4e63-916b-be54db9699ca tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1360 microversion: 2.1 time: 0.435647 Oct 16 01:06:17.457958 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 716/1547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:17 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1360 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:17.462730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4edeb350-3799-4c0e-ad0f-b0900f50e4ae tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Action: 'create', calling method: .version_select at 0x7fd64e99b820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeJy2sELCTawiP/4TWmzuPFgTinLkPrTrC08i2po74RQxGMRRPEevn7YA6/HIsWp9nhzMFC9xqSpEiU4M4SWj2rFfPWfHPv9/2UdUzZPRcDJVkjSW48ZXtxu/Nh05QLzA=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4edeb350-3799-4c0e-ad0f-b0900f50e4ae tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Request method failure captured: Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 247 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1kF9bDv8MVOdpAuRZzAT1fdrGgaQFK_o6CLjlpkpumSE0pdw9s-qb7wwCJIuXh2bHymcgLXbwt2KWmIBXfDY5wOfP6l2bM7i83odTvLuQtMvw_RcQc9ZJAfl71pjYSrDIn5W811iWQKSDR1erSCxsv6F9BNZCrJq6u_BcJ4DoXbX-c Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fef9d51a911c47919ee3589efc80b986", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeJy2sELCTawiP/4TWmzuPFgTinLkPrTrC08i2po74RQxGMRRPEevn7YA6/HIsWp9nhzMFC9xqSpEiU4M4SWj2rFfPWfHPv9/2UdUzZPRcDJVkjSW48ZXtxu/Nh05QLzA=="}} Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeJy2sELCTawiP/4TWmzuPFgTinLkPrTrC08i2po74RQxGMRRPEevn7YA6/HIsWp9nhzMFC9xqSpEiU4M4SWj2rFfPWfHPv9/2UdUzZPRcDJVkjSW48ZXtxu/Nh05QLzA=='}}} Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi '' Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:06:17.473188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:06:17.477476 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.480695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4edeb350-3799-4c0e-ad0f-b0900f50e4ae tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:17.484454 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4edeb350-3799-4c0e-ad0f-b0900f50e4ae tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.024051 Oct 16 01:06:17.486487 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 717/1548] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:06:17 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:06:17.497551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:17.498165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:17.507580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.508086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.508528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.509238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.509851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.510286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.546600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:17.558167 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a8616f6b-7de2-414b-955f-ffb3e4f1fa21 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 200 len: 1303 microversion: 2.1 time: 0.207202 Oct 16 01:06:17.558763 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 832/1549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:17 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:17.574842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:17.576050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:17.592769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.593553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.594393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.595477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.596478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.597103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.660379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:06:17.757033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:17.772243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:17.775396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:17.776898 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23f3c595-02fa-4b5a-bfdf-e0d7cb803b0c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1477 microversion: 2.25 time: 0.289402 Oct 16 01:06:17.786625 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 718/1550] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:17 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1477 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:17.797461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:17.802050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:17.817764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.818582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.819921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.820970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.822146 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-acd688cf-1e55-458c-ac0c-ec4dac1fb9b1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 204 len: 0 microversion: 2.1 time: 0.256029 Oct 16 01:06:17.822658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.823273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.824329 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 833/1551] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:06:17 2022] DELETE /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:06:17.830628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b027f18d-4b45-4d84-a773-f30e74b8fb29 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Action: 'create', calling method: .version_select at 0x7fd64e684c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1993904203", "public_key": " "}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:17.851792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b027f18d-4b45-4d84-a773-f30e74b8fb29 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:17.858701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b027f18d-4b45-4d84-a773-f30e74b8fb29 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for user 9bdd2d0be04c469083df1dd7a0ddf986 and project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:17.888179 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b027f18d-4b45-4d84-a773-f30e74b8fb29 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b027f18d-4b45-4d84-a773-f30e74b8fb29 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Request method failure captured: Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 95 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1kF9bDv8MVOdpAuRZzAT1fdrGgaQFK_o6CLjlpkpumSE0pdw9s-qb7wwCJIuXh2bHymcgLXbwt2KWmIBXfDY5wOfP6l2bM7i83odTvLuQtMvw_RcQc9ZJAfl71pjYSrDIn5W811iWQKSDR1erSCxsv6F9BNZCrJq6u_BcJ4DoXbX-c Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fef9d51a911c47919ee3589efc80b986", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1993904203", "public_key": " "}} Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: exception: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1993904203', 'public_key': ' '}}} Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:17.901173 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:17.907665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:17.913927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b027f18d-4b45-4d84-a773-f30e74b8fb29 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:17.914851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:06:17.916604 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b027f18d-4b45-4d84-a773-f30e74b8fb29 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.091068 Oct 16 01:06:17.917380 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 834/1552] 10.222.0.39 () {60 vars in 1158 bytes} [Sun Oct 16 01:06:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:17.931213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4a2a344e-9c6e-4eec-881c-4ce990e1089e req-fc0022b2-466d-4cec-9924-36cd1ae864e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebfbc75a-8d3f-4561-b380-95d95f9c23fe", "tag": "24e4f451-8cff-409b-8a75-99b4af5dbfd3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:17.943640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4a2a344e-9c6e-4eec-881c-4ce990e1089e req-fc0022b2-466d-4cec-9924-36cd1ae864e8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:17.944176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4a2a344e-9c6e-4eec-881c-4ce990e1089e req-fc0022b2-466d-4cec-9924-36cd1ae864e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:17.944605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4a2a344e-9c6e-4eec-881c-4ce990e1089e req-fc0022b2-466d-4cec-9924-36cd1ae864e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:17.957665 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4a2a344e-9c6e-4eec-881c-4ce990e1089e req-fc0022b2-466d-4cec-9924-36cd1ae864e8 service nova] Creating event network-changed:24e4f451-8cff-409b-8a75-99b4af5dbfd3 for instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe on n-h1-master-1 Oct 16 01:06:17.964412 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4a2a344e-9c6e-4eec-881c-4ce990e1089e req-fc0022b2-466d-4cec-9924-36cd1ae864e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045765 Oct 16 01:06:17.965266 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 835/1553] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:18.102025 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a13491c-36d7-4529-8aa3-ff377e8b14df tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "DELETE /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 204 len: 0 microversion: 2.1 time: 0.312875 Oct 16 01:06:18.107013 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 719/1554] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:06:17 2022] DELETE /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:06:18.120025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa8dcf71-710c-4841-a848-0df99ab0daa8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Action: 'create', calling method: .version_select at 0x7fd64ea13b80>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAftqMq0EN6qoAnJOTmXR3gFDE7n+UqY6NJqYcfVRU32g2i4bzk4LCYfHHeQRlfOswpIMlK+ikQPEjhVxmWwW1EbN1opOfnN6DuC/UHpRlH3qXYeBuT5QN4T6GESHc7vHg=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa8dcf71-710c-4841-a848-0df99ab0daa8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Request method failure captured: Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 507 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1kF9bDv8MVOdpAuRZzAT1fdrGgaQFK_o6CLjlpkpumSE0pdw9s-qb7wwCJIuXh2bHymcgLXbwt2KWmIBXfDY5wOfP6l2bM7i83odTvLuQtMvw_RcQc9ZJAfl71pjYSrDIn5W811iWQKSDR1erSCxsv6F9BNZCrJq6u_BcJ4DoXbX-c Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fef9d51a911c47919ee3589efc80b986", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAftqMq0EN6qoAnJOTmXR3gFDE7n+UqY6NJqYcfVRU32g2i4bzk4LCYfHHeQRlfOswpIMlK+ikQPEjhVxmWwW1EbN1opOfnN6DuC/UHpRlH3qXYeBuT5QN4T6GESHc7vHg=="}} Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAftqMq0EN6qoAnJOTmXR3gFDE7n+UqY6NJqYcfVRU32g2i4bzk4LCYfHHeQRlfOswpIMlK+ikQPEjhVxmWwW1EbN1opOfnN6DuC/UHpRlH3qXYeBuT5QN4T6GESHc7vHg=='}}} Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 16 01:06:18.137467 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa8dcf71-710c-4841-a848-0df99ab0daa8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:18.141740 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa8dcf71-710c-4841-a848-0df99ab0daa8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.030845 Oct 16 01:06:18.144086 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 720/1555] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:06:18 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:06:18.159851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:18.160919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:18.172947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:18.175190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:18.175659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:18.177309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:18.178721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:18.180082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:18.200995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:18.201766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:18.225688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:18.227621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:18.228091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:18.231022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:18.231520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:18.231955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:18.767971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:18.780823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:06:18.788268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:18.792239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:18.797127 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f3f6b590-b3e1-4cd5-8f9f-641adc2cc0b7 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1970 microversion: 2.25 time: 0.830521 Oct 16 01:06:18.798020 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6477ba7-5e30-42e3-842d-87898cd8bdfd tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1358 microversion: 2.21 time: 0.651547 Oct 16 01:06:18.798972 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 836/1556] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:17 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1970 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:18.802977 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 721/1557] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:18 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1358 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:18.812242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:18.813113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:18.826965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1189090384", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "ba2039d4-7a1a-4c70-b987-1dd870ff50d7"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:18.832106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:18.832739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:18.833290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:18.834260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:18.837656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:18.838234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:18.895365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] validate_networks() for [('ba2039d4-7a1a-4c70-b987-1dd870ff50d7', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:06:19.307744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:19.315865 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a73c8ec0-cbc2-4df7-81d3-d17eec10095e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1470 microversion: 2.1 time: 0.511748 Oct 16 01:06:19.316447 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 722/1558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:18 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1470 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:19.320961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84f2969a-e16d-4d40-a758-ec6f3a7dbbff tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Action: 'create', calling method: .version_select at 0x7fd64e1ba430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1235577164", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:19.338767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-84f2969a-e16d-4d40-a758-ec6f3a7dbbff tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:19.343569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-84f2969a-e16d-4d40-a758-ec6f3a7dbbff tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Getting quotas for user 9bdd2d0be04c469083df1dd7a0ddf986 and project fef9d51a911c47919ee3589efc80b986. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:19.352239 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:19.364828 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-84f2969a-e16d-4d40-a758-ec6f3a7dbbff tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84f2969a-e16d-4d40-a758-ec6f3a7dbbff tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Request method failure captured: Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 118 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1kF9bDv8MVOdpAuRZzAT1fdrGgaQFK_o6CLjlpkpumSE0pdw9s-qb7wwCJIuXh2bHymcgLXbwt2KWmIBXfDY5wOfP6l2bM7i83odTvLuQtMvw_RcQc9ZJAfl71pjYSrDIn5W811iWQKSDR1erSCxsv6F9BNZCrJq6u_BcJ4DoXbX-c Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fef9d51a911c47919ee3589efc80b986", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1235577164", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: exception: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1235577164', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 16 01:06:19.367345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84f2969a-e16d-4d40-a758-ec6f3a7dbbff tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-84f2969a-e16d-4d40-a758-ec6f3a7dbbff tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.051380 Oct 16 01:06:19.372187 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 723/1559] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:06:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:19.376749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-43bcf5b6-9043-44d7-8717-c20c44d3181f req-56c7d56e-7ddf-4c57-bfb3-780edbb00fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90", "name": "network-vif-unplugged", "status": "completed", "tag": "04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:19.387128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-43bcf5b6-9043-44d7-8717-c20c44d3181f req-56c7d56e-7ddf-4c57-bfb3-780edbb00fe8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:19.387604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-43bcf5b6-9043-44d7-8717-c20c44d3181f req-56c7d56e-7ddf-4c57-bfb3-780edbb00fe8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:19.388032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-43bcf5b6-9043-44d7-8717-c20c44d3181f req-56c7d56e-7ddf-4c57-bfb3-780edbb00fe8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:19.399164 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-43bcf5b6-9043-44d7-8717-c20c44d3181f req-56c7d56e-7ddf-4c57-bfb3-780edbb00fe8 service nova] Creating event network-vif-unplugged:04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3 for instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 on n-h2-master-1 Oct 16 01:06:19.404308 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-43bcf5b6-9043-44d7-8717-c20c44d3181f req-56c7d56e-7ddf-4c57-bfb3-780edbb00fe8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033634 Oct 16 01:06:19.405171 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 724/1560] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:19.413268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:19.413268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:19.419296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:19.419788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:19.420225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:19.420922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:19.421378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:19.421814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.071925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:20.080713 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-da2a5dd4-5af7-47b3-a368-d6a89c0ceb41 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1360 microversion: 2.1 time: 0.672510 Oct 16 01:06:20.081294 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 725/1561] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:19 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1360 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:20.086592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-cfcedcc8-77b5-4a88-9287-e550f75e04e5 req-0a505fff-db86-423b-aea4-4358593fe77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f22d93f-cfd6-4917-932e-9373f71dcb72", "name": "network-vif-deleted", "tag": "8f9e0a66-1573-4e6d-88da-36e0c3c25b99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:20.097977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cfcedcc8-77b5-4a88-9287-e550f75e04e5 req-0a505fff-db86-423b-aea4-4358593fe77d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.099271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cfcedcc8-77b5-4a88-9287-e550f75e04e5 req-0a505fff-db86-423b-aea4-4358593fe77d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.100144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cfcedcc8-77b5-4a88-9287-e550f75e04e5 req-0a505fff-db86-423b-aea4-4358593fe77d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.113142 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-cfcedcc8-77b5-4a88-9287-e550f75e04e5 req-0a505fff-db86-423b-aea4-4358593fe77d service nova] Creating event network-vif-deleted:8f9e0a66-1573-4e6d-88da-36e0c3c25b99 for instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 on n-h2-master-1 Oct 16 01:06:20.118181 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-cfcedcc8-77b5-4a88-9287-e550f75e04e5 req-0a505fff-db86-423b-aea4-4358593fe77d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035330 Oct 16 01:06:20.119171 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 726/1562] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:20.125462 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:20.126357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: 7f22d93f-cfd6-4917-932e-9373f71dcb72] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:20.133219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.133964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.134404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.135223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.135839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.136272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.154156 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] HTTP exception thrown: Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 could not be found. Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Request method failure captured: Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 HTTP/1.1 Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1euohWsARRfOQvyspOvA00WOP0ZME8bB7eZz2-xdg7Tztp521xWqi2r2io54wyVhGtlz5qa06SC9Pb2en4wcHvP5YySL7p8GcZ-mfrJe4A7Q7mTxZBuUdO3LaXqTUWd9TVvdCNZUodOIJPGRmqfy_qjS822WLruvgNZnpRvArK4AmI Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f6556287cca54d74b4971ef3e666cc1e Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6556287cca54d74b4971ef3e666cc1e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f6556287cca54d74b4971ef3e666cc1e Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-MigrationsAdminTest-908404407-project Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: f3b14e05c41648159d8ed97719c68862 Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-MigrationsAdminTest-908404407-project Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 could not be found. Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7f22d93f-cfd6-4917-932e-9373f71dcb72'} Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 could not be found. Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 could not be found. Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:20.156318 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.162136 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:20.162136 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:20.162136 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:20.162136 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:20.162136 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:20.162136 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 could not be found. Oct 16 01:06:20.162136 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.164067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Returning 404 to user: Instance 7f22d93f-cfd6-4917-932e-9373f71dcb72 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:20.164946 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d059b22-a4f2-4703-9b52-6b84843556a8 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72" status: 404 len: 111 microversion: 2.1 time: 0.044693 Oct 16 01:06:20.165714 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 727/1563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:20 2022] GET /compute/v2.1/servers/7f22d93f-cfd6-4917-932e-9373f71dcb72 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:20.172367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:20.173203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:20.179727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.180214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.180657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.181359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.181815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.182242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.219284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:06:20.220937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:06:20.220937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:06:20.221542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:06:20.222278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:06:20.233025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.233516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.233948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.234813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.236967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.237411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.259124 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:06:20.263916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for user 875dca9ed4914e379601ddbdba035cb2 and project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:06:20.277141 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:20.278907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:06:20.283344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:06:20.344677 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45aacb02-cc53-4184-8115-25d7aa50240c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544268 Oct 16 01:06:20.351098 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 837/1564] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:06:20.355640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b88436d-a3ad-4d62-a740-ff8c5f3e61e8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Calling method '.version_select at 0x7fd64e15af70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:20.371507 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-3b88436d-a3ad-4d62-a740-ff8c5f3e61e8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1339018418 not found for user 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b88436d-a3ad-4d62-a740-ff8c5f3e61e8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Request method failure captured: Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1339018418 HTTP/1.1 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1kF9bDv8MVOdpAuRZzAT1fdrGgaQFK_o6CLjlpkpumSE0pdw9s-qb7wwCJIuXh2bHymcgLXbwt2KWmIBXfDY5wOfP6l2bM7i83odTvLuQtMvw_RcQc9ZJAfl71pjYSrDIn5W811iWQKSDR1erSCxsv6F9BNZCrJq6u_BcJ4DoXbX-c Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fef9d51a911c47919ee3589efc80b986", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fef9d51a911c47919ee3589efc80b986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fef9d51a911c47919ee3589efc80b986 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2001085338 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2001085338-project Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: exception: Keypair tempest-keypair-non-existent-1339018418 not found for user 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'tempest-keypair-non-existent-1339018418'} Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1339018418 not found for user 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.373637 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1339018418 not found for user 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1339018418 not found for user 9bdd2d0be04c469083df1dd7a0ddf986 Oct 16 01:06:20.379051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:20.383190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b88436d-a3ad-4d62-a740-ff8c5f3e61e8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1339018418 not found for user 9bdd2d0be04c469083df1dd7a0ddf986 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:20.383190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b88436d-a3ad-4d62-a740-ff8c5f3e61e8 tempest-KeyPairsNegativeTestJSON-2001085338 tempest-KeyPairsNegativeTestJSON-2001085338-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1339018418" status: 404 len: 145 microversion: 2.1 time: 0.033965 Oct 16 01:06:20.383190 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 838/1565] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:06:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1339018418 => generated 145 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:20.390060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:20.391192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:20.400824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.401632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.402241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.403309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.404134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.404816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.500209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:06:20.528632 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9adbca0-fcfc-484f-ac25-55869c30347f tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1970 microversion: 2.25 time: 0.361533 Oct 16 01:06:20.531352 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 728/1566] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:20 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1970 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:20.551979 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:20.554674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:20.575500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.578093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.586967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.589689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.591049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.591709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.645041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:20.661776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:20.664477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:06:20.667240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:20.668823 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10714c0e-34fa-4bf2-9694-4938297c83ac tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1358 microversion: 2.21 time: 0.284947 Oct 16 01:06:20.682951 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 839/1567] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:20 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:20.688424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:20.696240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:20.709972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.710505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.718683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.718683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:20.718683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:20.718683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:20.821834 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eb881530-838f-4246-8f1d-450eb404ce17 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 204 len: 0 microversion: 2.1 time: 0.286536 Oct 16 01:06:20.822553 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 729/1568] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:06:20 2022] DELETE /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:06:20.837764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d9a64b5-b688-43af-9279-0c2b59411f73 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:20.838530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d9a64b5-b688-43af-9279-0c2b59411f73 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:21.073291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d9a64b5-b688-43af-9279-0c2b59411f73 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:21.091893 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d9a64b5-b688-43af-9279-0c2b59411f73 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1208 microversion: 2.1 time: 0.256983 Oct 16 01:06:21.092535 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 730/1569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:20 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1208 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:21.098606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81505b28-68f8-4b75-a955-35b22167ba47 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:21.108222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81505b28-68f8-4b75-a955-35b22167ba47 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.109095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81505b28-68f8-4b75-a955-35b22167ba47 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.109763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81505b28-68f8-4b75-a955-35b22167ba47 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.110693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81505b28-68f8-4b75-a955-35b22167ba47 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.111366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81505b28-68f8-4b75-a955-35b22167ba47 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.112120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81505b28-68f8-4b75-a955-35b22167ba47 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.145399 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81505b28-68f8-4b75-a955-35b22167ba47 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051170 Oct 16 01:06:21.146899 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 731/1570] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Oct 16 01:06:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:06:21.152167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:21.153154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:21.162396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.163046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.163610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.164678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.165382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.166030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.211628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:21.221197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-35da9643-614e-40f5-8aa1-4ce8dd67600e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1470 microversion: 2.1 time: 0.545818 Oct 16 01:06:21.230943 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 840/1571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:20 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1470 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:21.243525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:21.244643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:21.253320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.254404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.255680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.257210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.258112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.258840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.492138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:21.509406 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c0f8c9d4-4b9d-44c3-a908-3169f65227d2 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1469 microversion: 2.1 time: 0.360836 Oct 16 01:06:21.514862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:21.521178 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 732/1572] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:21 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:21.527331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:21.529009 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-11a11509-aaed-49fa-ac5f-3b75cf575f68 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1360 microversion: 2.1 time: 0.289302 Oct 16 01:06:21.529691 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 841/1573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:21 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1360 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:21.530683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:21.552196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.552898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.553400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.554128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.554877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.555390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.612209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'flavor' on Instance uuid bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:06:21.642619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Going to try to live migrate instance to n-h1-master-1 {{(pid=120546) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:06:21.698739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:21.700380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:21.710435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.711477 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:21.713480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.715231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.716267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:21.716741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:21.720152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:21.989363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:21.999546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:22.002024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:22.003461 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5700f219-1039-462b-8fb6-6e60bc07eb4c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1358 microversion: 2.21 time: 0.308683 Oct 16 01:06:22.023782 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 842/1574] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:21 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:06:22.116190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:22.117277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:22.129222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:22.131490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:22.132037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:22.134622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:22.135711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:22.136682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:22.280320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:22.302792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-949dee8b-76d0-4ab7-a407-adfaea251665 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1260 microversion: 2.1 time: 0.186297 Oct 16 01:06:22.306104 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 843/1575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:22 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:22.314441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:22.315541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:22.334513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:22.339183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:22.347844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:22.348787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:22.350538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:22.354436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:23.057059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c224f40dc3447d2b3bec25f1ca968fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d93522c54c4449926b8ddfeda3d96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:23.070387 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-75016875-76db-4209-b1d3-43ffd86d5d2e tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 200 len: 1470 microversion: 2.1 time: 0.757930 Oct 16 01:06:23.088766 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 844/1576] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:22 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 1470 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:23.103508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c20643bb-fc10-41a6-b34c-8813ab60dbf9 req-77c7dc4c-f6f5-4681-a20b-10ad8f582c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f7f1bd-fedf-492a-9a95-88280c25a805", "name": "network-vif-unplugged", "status": "completed", "tag": "67777f8b-edc4-4944-a928-8eb9a896e837"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:23.151104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c20643bb-fc10-41a6-b34c-8813ab60dbf9 req-77c7dc4c-f6f5-4681-a20b-10ad8f582c25 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:23.152047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c20643bb-fc10-41a6-b34c-8813ab60dbf9 req-77c7dc4c-f6f5-4681-a20b-10ad8f582c25 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:23.152648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c20643bb-fc10-41a6-b34c-8813ab60dbf9 req-77c7dc4c-f6f5-4681-a20b-10ad8f582c25 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:23.171245 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c20643bb-fc10-41a6-b34c-8813ab60dbf9 req-77c7dc4c-f6f5-4681-a20b-10ad8f582c25 service nova] Creating event network-vif-unplugged:67777f8b-edc4-4944-a928-8eb9a896e837 for instance 07f7f1bd-fedf-492a-9a95-88280c25a805 on n-h2-master-1 Oct 16 01:06:23.192769 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c20643bb-fc10-41a6-b34c-8813ab60dbf9 req-77c7dc4c-f6f5-4681-a20b-10ad8f582c25 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102321 Oct 16 01:06:23.193868 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 845/1577] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:23.211758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:23.212810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:23.220308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:23.225408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:23.226097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:23.227066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:23.229849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:23.230551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:23.823073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:23.833614 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bf86879e-0bb1-4447-b9a7-361e3f27d576 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1469 microversion: 2.1 time: 0.638203 Oct 16 01:06:23.841329 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 846/1578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:23 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1469 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:23.871039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:23.871657 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:23.885483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:23.885483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:23.885483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:23.886519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:23.886620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:23.887034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:24.353239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:24.363619 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-03702066-201f-4c73-a68d-9c425ed1427f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1360 microversion: 2.1 time: 0.496468 Oct 16 01:06:24.368324 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 847/1579] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:23 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1360 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:24.375621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b5e87860-c977-4970-b028-9d6e7d81e764 req-6cb8c7fd-9679-44e0-a3b3-b8b52272e83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90", "name": "network-vif-deleted", "tag": "04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:24.426856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b5e87860-c977-4970-b028-9d6e7d81e764 req-6cb8c7fd-9679-44e0-a3b3-b8b52272e83d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:24.429324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b5e87860-c977-4970-b028-9d6e7d81e764 req-6cb8c7fd-9679-44e0-a3b3-b8b52272e83d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:24.431543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b5e87860-c977-4970-b028-9d6e7d81e764 req-6cb8c7fd-9679-44e0-a3b3-b8b52272e83d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:24.473965 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b5e87860-c977-4970-b028-9d6e7d81e764 req-6cb8c7fd-9679-44e0-a3b3-b8b52272e83d service nova] Creating event network-vif-deleted:04e2eac5-1037-4e5b-a0a3-2ddf8b96c6c3 for instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 on n-h2-master-1 Oct 16 01:06:24.499540 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b5e87860-c977-4970-b028-9d6e7d81e764 req-6cb8c7fd-9679-44e0-a3b3-b8b52272e83d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113917 Oct 16 01:06:24.502242 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 848/1580] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:24.518214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:24.518961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:24.561497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:24.561497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:24.561497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:24.563822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:24.564545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:24.566628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:24.926366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:24.937982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:24.939963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:24.954537 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-32fe1707-ac10-461a-9a1d-0cfa9370418c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1358 microversion: 2.21 time: 0.449652 Oct 16 01:06:24.955180 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 849/1581] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:24 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1358 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:24.975711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:24.983760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:25.010658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.011435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.012049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.012936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.013556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.014151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.051620 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:25.251774 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c727c17d-3751-4576-b329-162ea9e2ce98 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e/action" status: 202 len: 0 microversion: 2.25 time: 3.729312 Oct 16 01:06:25.252724 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 733/1582] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:06:21 2022] POST /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e/action => generated 0 bytes in 3731 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:06:25.259007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:25.259634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] [instance: 07f7f1bd-fedf-492a-9a95-88280c25a805] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:25.295009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.295528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.296823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.304733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.308033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.308845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.361757 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] HTTP exception thrown: Instance 07f7f1bd-fedf-492a-9a95-88280c25a805 could not be found. Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Request method failure captured: Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 HTTP/1.1 Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1jknI-YZJq3vaITWqfbWNevdLN9nJQMVG8BcDAI9DwNADJ7RkgknBKmAhNoTtHrSyGVzZZZFD3TjlSsmAm1Mzw6OH2xHFGw3ItCrDvOE0UD-Q1gLPkmB4N9PAyB_MYaRgOsKUvbI5QGnR0RALHv1Axp5G0zSePqccp7U9SmuvLyL6I Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: c4d93522c54c4449926b8ddfeda3d96e Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TenantUsagesTestJSON-973895650 Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c4d93522c54c4449926b8ddfeda3d96e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c4d93522c54c4449926b8ddfeda3d96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4d93522c54c4449926b8ddfeda3d96e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4d93522c54c4449926b8ddfeda3d96e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TenantUsagesTestJSON-973895650 Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: c4d93522c54c4449926b8ddfeda3d96e Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TenantUsagesTestJSON-973895650 Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TenantUsagesTestJSON-973895650-project Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 5c224f40dc3447d2b3bec25f1ca968fa Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TenantUsagesTestJSON-973895650-project Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 07f7f1bd-fedf-492a-9a95-88280c25a805 could not be found. Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '07f7f1bd-fedf-492a-9a95-88280c25a805'} Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f7f1bd-fedf-492a-9a95-88280c25a805 could not be found. Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f7f1bd-fedf-492a-9a95-88280c25a805 could not be found. Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:25.374025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f7f1bd-fedf-492a-9a95-88280c25a805 could not be found. Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] Returning 404 to user: Instance 07f7f1bd-fedf-492a-9a95-88280c25a805 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:25.378908 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35ad2d41-f20d-440d-9966-2d4057612f29 tempest-TenantUsagesTestJSON-973895650 tempest-TenantUsagesTestJSON-973895650-project] 10.222.0.39 "GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805" status: 404 len: 111 microversion: 2.1 time: 0.124219 Oct 16 01:06:25.382998 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 734/1583] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:25 2022] GET /compute/v2.1/servers/07f7f1bd-fedf-492a-9a95-88280c25a805 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:25.399301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f703013c-e5a0-41bc-9104-fa9c34a2451f req-66510f6a-c827-4a38-bf55-6d2a3e6ade76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e192d949-f638-4890-ae93-709a7cde5fc9", "name": "network-vif-deleted", "tag": "6acb8c4d-9089-480a-99ad-6c45fdf5d04c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:25.424912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f703013c-e5a0-41bc-9104-fa9c34a2451f req-66510f6a-c827-4a38-bf55-6d2a3e6ade76 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.425908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f703013c-e5a0-41bc-9104-fa9c34a2451f req-66510f6a-c827-4a38-bf55-6d2a3e6ade76 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.426350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f703013c-e5a0-41bc-9104-fa9c34a2451f req-66510f6a-c827-4a38-bf55-6d2a3e6ade76 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.445615 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f703013c-e5a0-41bc-9104-fa9c34a2451f req-66510f6a-c827-4a38-bf55-6d2a3e6ade76 service nova] Creating event network-vif-deleted:6acb8c4d-9089-480a-99ad-6c45fdf5d04c for instance e192d949-f638-4890-ae93-709a7cde5fc9 on n-h1-master-1 Oct 16 01:06:25.468883 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f703013c-e5a0-41bc-9104-fa9c34a2451f req-66510f6a-c827-4a38-bf55-6d2a3e6ade76 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074509 Oct 16 01:06:25.473790 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 735/1584] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:25.481917 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:25.482682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:25.496820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.497534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.498189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.499162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.499780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.500661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.551828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:25.571921 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9a04ccef-b21d-4e4d-9a19-b20cd9477dcc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 0.608633 Oct 16 01:06:25.572490 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 850/1585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:24 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:25.583036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.585315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.585831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.586222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lazy-loading 'fault' on Instance uuid e192d949-f638-4890-ae93-709a7cde5fc9 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:06:25.603452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:25.605250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:25.624835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.625264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.625891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.627084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.632844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.636922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.834064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b14e05c41648159d8ed97719c68862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6556287cca54d74b4971ef3e666cc1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:25.848961 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-edd151f4-3d09-489b-a1a5-ac32c7c61ecd tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 200 len: 1303 microversion: 2.1 time: 0.373044 Oct 16 01:06:25.850228 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 736/1586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:25 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 1303 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:25.854992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-da1fa878-0f1b-47f0-842d-544b60151bdd req-2adebb4d-91b8-4e26-9cc6-3de499fcc8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d321f72e-d548-4179-a3dc-f28a9be43253", "name": "network-vif-plugged", "status": "completed", "tag": "8106fa13-8d49-4187-808e-40053bd1ed91"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:25.879034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-da1fa878-0f1b-47f0-842d-544b60151bdd req-2adebb4d-91b8-4e26-9cc6-3de499fcc8ac service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.879846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-da1fa878-0f1b-47f0-842d-544b60151bdd req-2adebb4d-91b8-4e26-9cc6-3de499fcc8ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.880865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-da1fa878-0f1b-47f0-842d-544b60151bdd req-2adebb4d-91b8-4e26-9cc6-3de499fcc8ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.896544 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-da1fa878-0f1b-47f0-842d-544b60151bdd req-2adebb4d-91b8-4e26-9cc6-3de499fcc8ac service nova] Creating event network-vif-plugged:8106fa13-8d49-4187-808e-40053bd1ed91 for instance d321f72e-d548-4179-a3dc-f28a9be43253 on n-h1-master-1 Oct 16 01:06:25.903526 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-da1fa878-0f1b-47f0-842d-544b60151bdd req-2adebb4d-91b8-4e26-9cc6-3de499fcc8ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051926 Oct 16 01:06:25.904664 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 737/1587] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:25.910352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:25.911511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:25.927593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.928076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.928504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:25.929490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:25.929683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:25.930121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.292222 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:26.307300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:26.309529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:26.311196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a1a2376-9e87-48bb-96ac-baedea609ad9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.734600 Oct 16 01:06:26.311870 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 851/1588] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:25 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:26.343564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:26.345260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:26.359493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:26.360949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:26.362339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.364370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:26.365302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:26.365906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.507371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:26.527247 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b15c6271-66a8-4068-814a-154abbaf84d9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1360 microversion: 2.1 time: 0.617190 Oct 16 01:06:26.528693 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 738/1589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:25 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1360 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:26.536705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-55b3b644-4755-4a60-8c73-9b8838e3ab53 req-109c887f-fbfd-4dcd-b795-057b4c00d66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f7f1bd-fedf-492a-9a95-88280c25a805", "name": "network-vif-deleted", "tag": "67777f8b-edc4-4944-a928-8eb9a896e837"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:26.552856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-55b3b644-4755-4a60-8c73-9b8838e3ab53 req-109c887f-fbfd-4dcd-b795-057b4c00d66f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:26.553344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-55b3b644-4755-4a60-8c73-9b8838e3ab53 req-109c887f-fbfd-4dcd-b795-057b4c00d66f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:26.556588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-55b3b644-4755-4a60-8c73-9b8838e3ab53 req-109c887f-fbfd-4dcd-b795-057b4c00d66f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.583576 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-55b3b644-4755-4a60-8c73-9b8838e3ab53 req-109c887f-fbfd-4dcd-b795-057b4c00d66f service nova] Creating event network-vif-deleted:67777f8b-edc4-4944-a928-8eb9a896e837 for instance 07f7f1bd-fedf-492a-9a95-88280c25a805 on n-h2-master-1 Oct 16 01:06:26.615882 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-55b3b644-4755-4a60-8c73-9b8838e3ab53 req-109c887f-fbfd-4dcd-b795-057b4c00d66f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083185 Oct 16 01:06:26.617711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 739/1590] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:26.632381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:26.633218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:26.644153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:26.645536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:26.645974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.646741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:26.648416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:26.648915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.681005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:26.693612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:26.699860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:26.701072 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-089a053a-a7db-43f5-94fa-42dda254f22b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1358 microversion: 2.21 time: 0.364355 Oct 16 01:06:26.701650 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 852/1591] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:26 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1358 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:26.873711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:26.874625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] [instance: e192d949-f638-4890-ae93-709a7cde5fc9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:26.882492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:26.883265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:26.884405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.885369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:26.886099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:26.886848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:26.905212 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] HTTP exception thrown: Instance e192d949-f638-4890-ae93-709a7cde5fc9 could not be found. Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Request method failure captured: Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 HTTP/1.1 Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1euohWsARRfOQvyspOvA00WOP0ZME8bB7eZz2-xdg7Tztp521xWqi2r2io54wyVhGtlz5qa06SC9Pb2en4wcHvP5YySL7p8GcZ-mfrJe4A7Q7mTxZBuUdO3LaXqTUWd9TVvdCNZUodOIJPGRmqfy_qjS822WLruvgNZnpRvArK4AmI Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f6556287cca54d74b4971ef3e666cc1e Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6556287cca54d74b4971ef3e666cc1e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6556287cca54d74b4971ef3e666cc1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f6556287cca54d74b4971ef3e666cc1e Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-MigrationsAdminTest-908404407 Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-MigrationsAdminTest-908404407-project Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: f3b14e05c41648159d8ed97719c68862 Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-MigrationsAdminTest-908404407-project Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e192d949-f638-4890-ae93-709a7cde5fc9 could not be found. Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e192d949-f638-4890-ae93-709a7cde5fc9'} Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e192d949-f638-4890-ae93-709a7cde5fc9 could not be found. Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e192d949-f638-4890-ae93-709a7cde5fc9 could not be found. Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:26.908652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:26.913353 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:26.913353 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:26.913353 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:26.913353 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:26.913353 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:26.913353 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e192d949-f638-4890-ae93-709a7cde5fc9 could not be found. Oct 16 01:06:26.913353 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:26.915221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] Returning 404 to user: Instance e192d949-f638-4890-ae93-709a7cde5fc9 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:26.916505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-57a8cab3-ab5b-4664-be82-aa68e1d1a387 tempest-MigrationsAdminTest-908404407 tempest-MigrationsAdminTest-908404407-project] 10.222.0.39 "GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9" status: 404 len: 111 microversion: 2.1 time: 0.046660 Oct 16 01:06:26.917551 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 853/1592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:26 2022] GET /compute/v2.1/servers/e192d949-f638-4890-ae93-709a7cde5fc9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:06:27.017493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:27.026487 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0b1099d2-270f-4f8a-a6a4-bf463a42b316 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 0.406425 Oct 16 01:06:27.030069 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 740/1593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:26 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:27.341891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:27.342534 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:27.377841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:27.379976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:27.382101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:27.384878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:27.387451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:27.393331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:27.570783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:27.571471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:27.582686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:27.583135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:27.583577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:27.587897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:27.590895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:27.591618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:28.276616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:28.306887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:28.339736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:28.341387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6cfb4010-efa8-4bc4-a93f-bfef241b74f3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1360 microversion: 2.1 time: 0.782261 Oct 16 01:06:28.342202 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 741/1594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:27 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1360 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:28.350193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:28.358246 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dfcb1e29-fe6d-4a03-acc0-d2c00dab5e4e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 1.023117 Oct 16 01:06:28.361992 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 854/1595] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:27 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:28.365207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:28.365821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:28.378125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f2b15844-976d-4b26-b63a-53a72d2e5618 req-0a15ff87-748f-4f60-a5cb-03d837eb5352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfbc75a-8d3f-4561-b380-95d95f9c23fe", "name": "network-vif-plugged", "status": "completed", "tag": "24e4f451-8cff-409b-8a75-99b4af5dbfd3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:28.386141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:28.389515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:28.403043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:28.404252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:28.408235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:28.408513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f2b15844-976d-4b26-b63a-53a72d2e5618 req-0a15ff87-748f-4f60-a5cb-03d837eb5352 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:28.409100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:28.409235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f2b15844-976d-4b26-b63a-53a72d2e5618 req-0a15ff87-748f-4f60-a5cb-03d837eb5352 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:28.411296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f2b15844-976d-4b26-b63a-53a72d2e5618 req-0a15ff87-748f-4f60-a5cb-03d837eb5352 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:28.467367 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f2b15844-976d-4b26-b63a-53a72d2e5618 req-0a15ff87-748f-4f60-a5cb-03d837eb5352 service nova] Creating event network-vif-plugged:24e4f451-8cff-409b-8a75-99b4af5dbfd3 for instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe on n-h1-master-1 Oct 16 01:06:28.486695 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f2b15844-976d-4b26-b63a-53a72d2e5618 req-0a15ff87-748f-4f60-a5cb-03d837eb5352 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119675 Oct 16 01:06:28.489281 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 855/1596] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:28.506361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:28.507504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:28.520635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:28.525925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:28.528521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:28.534143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:28.534957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:28.537228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:29.591474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:29.628325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:29.634211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:29.645057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:29.652652 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d70bfb0-9fd6-4aab-817c-260458878a9d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 1.157594 Oct 16 01:06:29.654138 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-97f7a0f9-0647-4a64-ab7c-4381f6f01f5b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1552 microversion: 2.21 time: 1.308180 Oct 16 01:06:29.655417 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 856/1597] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:28 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:29.672005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d9116c3e-b0b1-43d1-b43f-10b134ed0e5d req-ffe2d64c-5a20-40f0-a5c0-6b1bfea8cdb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6612f5c-0f92-4cc2-8fcd-083e8b2b4892", "tag": "ae024ce0-ed0d-458b-9286-03065d260103"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:29.681701 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 742/1598] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:28 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1552 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:29.695683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:29.696929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:29.705357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d9116c3e-b0b1-43d1-b43f-10b134ed0e5d req-ffe2d64c-5a20-40f0-a5c0-6b1bfea8cdb2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:29.705789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d9116c3e-b0b1-43d1-b43f-10b134ed0e5d req-ffe2d64c-5a20-40f0-a5c0-6b1bfea8cdb2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:29.706240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d9116c3e-b0b1-43d1-b43f-10b134ed0e5d req-ffe2d64c-5a20-40f0-a5c0-6b1bfea8cdb2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:29.721469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:29.722746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:29.723728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:29.724800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:29.725826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:29.726571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:29.751638 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d9116c3e-b0b1-43d1-b43f-10b134ed0e5d req-ffe2d64c-5a20-40f0-a5c0-6b1bfea8cdb2 service nova] Creating event network-changed:ae024ce0-ed0d-458b-9286-03065d260103 for instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 on n-h2-master-1 Oct 16 01:06:29.765674 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d9116c3e-b0b1-43d1-b43f-10b134ed0e5d req-ffe2d64c-5a20-40f0-a5c0-6b1bfea8cdb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106542 Oct 16 01:06:29.771447 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 857/1599] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:29.788397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:29.789122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:29.812059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:29.812587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:29.815837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:29.817064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:29.820379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:29.823483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:30.246075 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:30.273795 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=22 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:30.773704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:30.823683 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8818393-3a14-40f0-991a-32d51ab73f27 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1360 microversion: 2.1 time: 1.140011 Oct 16 01:06:30.830506 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 743/1600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:29 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1360 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:30.849798 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:30.851479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:30.889789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:30.891830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:30.893061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:30.894673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:30.903223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:30.905414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:30.935952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:30.965498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:30.973402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:30.978044 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22f329af-ed12-4ae3-91f4-5794e6a52bc6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 1.205264 Oct 16 01:06:30.980546 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 858/1601] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:29 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:30.993362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:30.994432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:31.013057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:31.015754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:31.017676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:31.021044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:31.021823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:31.022427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:31.106147 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=20 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:31.127335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:06:31.168634 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:31.357067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:31.367423 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8c2c528f-c200-4866-8bc6-073bbe0fc953 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 0.385553 Oct 16 01:06:31.373656 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 859/1602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:30 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:31.407186 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b608838-1846-47c4-a3a7-ee19aa75ee6d tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 204 len: 0 microversion: 2.21 time: 0.573808 Oct 16 01:06:31.412898 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 744/1603] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:06:30 2022] DELETE /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:06:31.424963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:31.425587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:31.442127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:31.442640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:31.445671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:31.448139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:31.448660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:31.452926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:31.797851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:31.812653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:31.820869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:31.824627 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-06d0fb14-9d61-4cec-8847-2b4d8d90161c tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1558 microversion: 2.21 time: 0.408591 Oct 16 01:06:31.848603 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 860/1604] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:31 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1558 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:31.893241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:31.896147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:31.909950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:31.910830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:31.912275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:31.914746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:31.917624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:31.918471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:32.035017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:32.036484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:32.051416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:32.054618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:32.056485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:32.058706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:32.059852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:32.061197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:32.898604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:32.909933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:32.911950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:32.913513 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-26ee900c-5115-4653-ba78-8c9503f8bfda tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.883760 Oct 16 01:06:32.914635 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 861/1605] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:32 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:32.921311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:32.922408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:32.931409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:32.932234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:32.932816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:32.933689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:32.934287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:32.935008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:33.324870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:33.339631 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3d5d9ead-01c9-4b8e-baa7-0c9c8b051610 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1543 microversion: 2.1 time: 1.462430 Oct 16 01:06:33.342138 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 745/1606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:31 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1543 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:33.358416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:33.361032 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:33.379288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:33.380705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:33.389120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:33.389120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:33.389120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:33.389120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:33.528611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:33.538061 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3377e618-4752-4fe9-9e53-c7c052abcba9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 0.622090 Oct 16 01:06:33.538649 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 862/1607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:32 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:33.551304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:33.554946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:33.568170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:33.573258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:33.573938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:33.574839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:33.575629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:33.576964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:34.150822 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-af201c75-26d2-4b3d-8d1d-8fc566d25ed5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.604291 Oct 16 01:06:34.151912 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 863/1608] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:06:33 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-interface => generated 284 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:34.166280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:34.167188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:34.179746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:34.181715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:34.182349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:34.184647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:34.186474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:34.191549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:34.535996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:34.553284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:34.555207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:34.556730 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1b0174bd-039a-452f-b344-4f44296fe08a tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1558 microversion: 2.21 time: 1.212550 Oct 16 01:06:34.557586 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 746/1609] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:33 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1558 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:34.761855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:34.774638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:34.778784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:34.784654 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b2bbc50-3114-419e-9d8f-6fb8ed0907a2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.622388 Oct 16 01:06:34.785484 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 864/1610] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:34 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:34.790340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:34.799858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:34.811921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:34.813994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:34.814756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:34.817946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:34.820852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:34.822502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:34.871429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7598f9e3-0bf5-4bec-a0bd-8855d94f8833 tempest-NetworksTest-936191088 tempest-NetworksTest-936191088-project-admin] Calling method '.version_select at 0x7fd64e95e9d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:36.354569 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7598f9e3-0bf5-4bec-a0bd-8855d94f8833 tempest-NetworksTest-936191088 tempest-NetworksTest-936191088-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks" status: 200 len: 8118 microversion: 2.1 time: 1.795360 Oct 16 01:06:36.355701 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 747/1611] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:06:34 2022] GET /compute/v2.1/os-networks => generated 8118 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:36.361873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:36.363347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:36.369830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:36.379476 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b3cde3a-40c0-4733-b4a5-7ec7acb413fc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 1.592511 Oct 16 01:06:36.379768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:36.380242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:36.380690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:36.386216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:36.386883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:36.387362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:36.399766 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 865/1612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:34 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:36.416015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:36.416652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:36.433742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:36.434447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:36.434909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:36.435687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:36.436155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:36.436584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:37.729864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:37.734397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:37.739090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:37.740710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:37.741727 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-76800b1b-d2f7-4881-9aa9-9cf26cb7c588 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 1.340853 Oct 16 01:06:37.742300 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 866/1613] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:36 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:37.754332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:37.762872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d9ecc8887874f989006a848b818ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba43dd17d7974221a59efaa1452b3b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:37.768106 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb32360b-f2cb-422e-8095-275216c6bf9b tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 200 len: 1558 microversion: 2.21 time: 1.411179 Oct 16 01:06:37.772574 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 748/1614] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:36 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 1558 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:37.787571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-68b72d39-4a88-4e6d-9b3f-944c01b564f8 req-3f0ab301-97b7-4c5c-9320-1be5e41d9daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebfbc75a-8d3f-4561-b380-95d95f9c23fe", "tag": "24e4f451-8cff-409b-8a75-99b4af5dbfd3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:37.804046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f01459a6-3bab-4cd5-affb-39de89cc6e74 tempest-NetworksTest-936191088 tempest-NetworksTest-936191088-project-admin] Calling method '.version_select at 0x7fd64e0d2b80>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:37.823730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-68b72d39-4a88-4e6d-9b3f-944c01b564f8 req-3f0ab301-97b7-4c5c-9320-1be5e41d9daf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:37.824432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-68b72d39-4a88-4e6d-9b3f-944c01b564f8 req-3f0ab301-97b7-4c5c-9320-1be5e41d9daf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:37.824953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-68b72d39-4a88-4e6d-9b3f-944c01b564f8 req-3f0ab301-97b7-4c5c-9320-1be5e41d9daf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:37.894068 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-68b72d39-4a88-4e6d-9b3f-944c01b564f8 req-3f0ab301-97b7-4c5c-9320-1be5e41d9daf service nova] Creating event network-changed:24e4f451-8cff-409b-8a75-99b4af5dbfd3 for instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe on n-h1-master-1 Oct 16 01:06:37.904770 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-68b72d39-4a88-4e6d-9b3f-944c01b564f8 req-3f0ab301-97b7-4c5c-9320-1be5e41d9daf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128597 Oct 16 01:06:37.910412 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 749/1615] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:37.920691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-89ead0a1-6233-46bf-acb3-7d921c53410a req-8f12b1a5-a1ff-4d01-98c6-ff807f6db672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d321f72e-d548-4179-a3dc-f28a9be43253", "name": "network-vif-deleted", "tag": "8106fa13-8d49-4187-808e-40053bd1ed91"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:37.959974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-89ead0a1-6233-46bf-acb3-7d921c53410a req-8f12b1a5-a1ff-4d01-98c6-ff807f6db672 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:37.961080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-89ead0a1-6233-46bf-acb3-7d921c53410a req-8f12b1a5-a1ff-4d01-98c6-ff807f6db672 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:37.961524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-89ead0a1-6233-46bf-acb3-7d921c53410a req-8f12b1a5-a1ff-4d01-98c6-ff807f6db672 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:38.000116 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-89ead0a1-6233-46bf-acb3-7d921c53410a req-8f12b1a5-a1ff-4d01-98c6-ff807f6db672 service nova] Creating event network-vif-deleted:8106fa13-8d49-4187-808e-40053bd1ed91 for instance d321f72e-d548-4179-a3dc-f28a9be43253 on n-h1-master-1 Oct 16 01:06:38.008661 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-89ead0a1-6233-46bf-acb3-7d921c53410a req-8f12b1a5-a1ff-4d01-98c6-ff807f6db672 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096370 Oct 16 01:06:38.009727 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 750/1616] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:38.017864 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:38.024196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:38.041548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:38.042825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:38.043969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:38.048493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:38.049597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:38.050329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:38.236428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f01459a6-3bab-4cd5-affb-39de89cc6e74 tempest-NetworksTest-936191088 tempest-NetworksTest-936191088-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks/a05b7879-f267-4cd4-857d-0be01dfc12b3" status: 200 len: 652 microversion: 2.1 time: 0.463289 Oct 16 01:06:38.237786 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 867/1617] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:06:37 2022] GET /compute/v2.1/os-networks/a05b7879-f267-4cd4-857d-0be01dfc12b3 => generated 652 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:38.254101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85f64951-a2a8-4050-b417-706b8fcdc0b6 tempest-NetworksTest-936191088 tempest-NetworksTest-936191088-project-admin] Calling method '.version_select at 0x7fd64e0d2a60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:39.079667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:39.088770 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4292e925-afee-454f-bf19-cb627ac32282 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 1.077715 Oct 16 01:06:39.100272 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 751/1618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:38 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:39.125570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:39.126639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:39.136007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:39.136859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:39.144110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:39.145210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:39.145865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:39.146476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:39.194571 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85f64951-a2a8-4050-b417-706b8fcdc0b6 tempest-NetworksTest-936191088 tempest-NetworksTest-936191088-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks" status: 200 len: 8118 microversion: 2.1 time: 0.951371 Oct 16 01:06:39.196144 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 868/1619] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:06:38 2022] GET /compute/v2.1/os-networks => generated 8118 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:39.209624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:39.215045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:39.232657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:39.236649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:39.238587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:39.239642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:39.240430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:39.245034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:39.283399 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] HTTP exception thrown: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Request method failure captured: Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 HTTP/1.1 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1j6EYr5xwWJwANbH_YkW8rWOiruTRGb-3lZ4rVXQeWH6lwc64Jn6eErZWbYMAnDTtoeCvECtl1_S6c1blX2DZwWdVtNQ0OuktjnDEs1BPJRlvif2kgEpdZKhYBo2RK_V91qIyC2m_RBPn5OVHgWjZnJT2JOvR_NuFk_pdjG81UzFDQ Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.21 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: ba43dd17d7974221a59efaa1452b3b2f Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba43dd17d7974221a59efaa1452b3b2f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: ba43dd17d7974221a59efaa1452b3b2f Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-InstanceActionsV221TestJSON-1921214959-project Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 5d9ecc8887874f989006a848b818ac84 Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-InstanceActionsV221TestJSON-1921214959-project Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: exception: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'd321f72e-d548-4179-a3dc-f28a9be43253'} Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:39.291395 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:39.297492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:39.297492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:39.297492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:39.297492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:39.297492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:39.297492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:39.297492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:39.297492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:39.301596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Returning 404 to user: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:39.302628 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-360dfbe0-34aa-4ebe-9255-ed6da0ffa713 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 404 len: 111 microversion: 2.21 time: 0.105443 Oct 16 01:06:39.305591 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 869/1620] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:39 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:06:39.411369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-693b8dfe-bd84-4d3f-922c-c74d07a96938 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e0d2550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-27797937", "description": "tempest-description-1377779405"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:39.900520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:39.918169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:39.919857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:39.924530 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e169064d-5172-4684-8308-26470dd50af0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.822508 Oct 16 01:06:39.925298 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 752/1621] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:39 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:39.951026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ab2f7f54-3db3-4749-8e02-6aa1d15ec89f req-b071391f-3ad7-4dbb-a3ed-f9f8e1fa2d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6612f5c-0f92-4cc2-8fcd-083e8b2b4892", "name": "network-vif-plugged", "status": "completed", "tag": "ae024ce0-ed0d-458b-9286-03065d260103"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:39.969881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ab2f7f54-3db3-4749-8e02-6aa1d15ec89f req-b071391f-3ad7-4dbb-a3ed-f9f8e1fa2d10 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:39.970588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ab2f7f54-3db3-4749-8e02-6aa1d15ec89f req-b071391f-3ad7-4dbb-a3ed-f9f8e1fa2d10 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:39.971300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ab2f7f54-3db3-4749-8e02-6aa1d15ec89f req-b071391f-3ad7-4dbb-a3ed-f9f8e1fa2d10 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:39.975358 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:39.994810 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ab2f7f54-3db3-4749-8e02-6aa1d15ec89f req-b071391f-3ad7-4dbb-a3ed-f9f8e1fa2d10 service nova] Creating event network-vif-plugged:ae024ce0-ed0d-458b-9286-03065d260103 for instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 on n-h2-master-1 Oct 16 01:06:40.009350 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ab2f7f54-3db3-4749-8e02-6aa1d15ec89f req-b071391f-3ad7-4dbb-a3ed-f9f8e1fa2d10 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067574 Oct 16 01:06:40.010517 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 753/1622] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:40.016847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '.version_select at 0x7fd64e7309d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:40.017823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:40.053758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:40.054498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:40.055326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:40.056265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:40.065843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:40.066653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:40.264140 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-502bf901-dc93-45ce-b3a3-f4ca3335d167 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.252063 Oct 16 01:06:40.280249 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 754/1623] 10.222.0.39 () {60 vars in 1337 bytes} [Sun Oct 16 01:06:40 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253/os-instance-actions => generated 611 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:06:40.292446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:40.293667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:40.310149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:40.310656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:40.311127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:40.313076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:40.313318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:40.313710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:41.061379 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-693b8dfe-bd84-4d3f-922c-c74d07a96938 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.752751 Oct 16 01:06:41.062120 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 870/1624] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:06:39 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:41.080695 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:41.086109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:41.097081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:41.104260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:41.105096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:41.105834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:41.106777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:41.108423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:41.109378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:41.112008 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-48718c5b-1031-440a-9ea0-4e30c09e214d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 0.830389 Oct 16 01:06:41.112661 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 755/1625] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:40 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:41.131248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:41.131850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:41.147989 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] HTTP exception thrown: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.150162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Request method failure captured: Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 HTTP/1.1 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1j6EYr5xwWJwANbH_YkW8rWOiruTRGb-3lZ4rVXQeWH6lwc64Jn6eErZWbYMAnDTtoeCvECtl1_S6c1blX2DZwWdVtNQ0OuktjnDEs1BPJRlvif2kgEpdZKhYBo2RK_V91qIyC2m_RBPn5OVHgWjZnJT2JOvR_NuFk_pdjG81UzFDQ Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.21 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: ba43dd17d7974221a59efaa1452b3b2f Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba43dd17d7974221a59efaa1452b3b2f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: ba43dd17d7974221a59efaa1452b3b2f Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-InstanceActionsV221TestJSON-1921214959-project Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 5d9ecc8887874f989006a848b818ac84 Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-InstanceActionsV221TestJSON-1921214959-project Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: exception: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'd321f72e-d548-4179-a3dc-f28a9be43253'} Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:06:41.150379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Returning 404 to user: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10178a12-c785-44dd-866a-6739fea994d4 tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 404 len: 111 microversion: 2.21 time: 0.078159 Oct 16 01:06:41.155378 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 871/1626] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:06:41 2022] DELETE /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:06:41.156659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:41.156659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:41.160282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:41.160773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:41.161216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:41.167161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5053b938-0735-4e1c-9ec0-cfe5576ce2fa tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e0d2790>, body: {"security_group_rule": {"parent_group_id": "d53ebeed-537d-4ef2-a302-dc90b8c0db98", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:41.705228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:41.714668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:41.717059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:41.718684 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e74942ad-a724-42be-96cc-1cae0db1d6fe tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.604887 Oct 16 01:06:41.719795 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 756/1627] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:41 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:41.724959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:41.725767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] [instance: d321f72e-d548-4179-a3dc-f28a9be43253] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:41.738024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:41.738775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:41.739781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:41.740025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:41.740480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:41.741244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:41.758271 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] HTTP exception thrown: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Request method failure captured: Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 HTTP/1.1 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1j6EYr5xwWJwANbH_YkW8rWOiruTRGb-3lZ4rVXQeWH6lwc64Jn6eErZWbYMAnDTtoeCvECtl1_S6c1blX2DZwWdVtNQ0OuktjnDEs1BPJRlvif2kgEpdZKhYBo2RK_V91qIyC2m_RBPn5OVHgWjZnJT2JOvR_NuFk_pdjG81UzFDQ Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.21 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: ba43dd17d7974221a59efaa1452b3b2f Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba43dd17d7974221a59efaa1452b3b2f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba43dd17d7974221a59efaa1452b3b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: ba43dd17d7974221a59efaa1452b3b2f Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1921214959 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-InstanceActionsV221TestJSON-1921214959-project Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 5d9ecc8887874f989006a848b818ac84 Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-InstanceActionsV221TestJSON-1921214959-project Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: exception: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'd321f72e-d548-4179-a3dc-f28a9be43253'} Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.760028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] Returning 404 to user: Instance d321f72e-d548-4179-a3dc-f28a9be43253 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-87fa4ac9-139b-4911-b891-62ba1058a46e tempest-InstanceActionsV221TestJSON-1921214959 tempest-InstanceActionsV221TestJSON-1921214959-project] 10.222.0.39 "GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253" status: 404 len: 111 microversion: 2.21 time: 0.040550 Oct 16 01:06:41.764970 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 757/1628] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:41 2022] GET /compute/v2.1/servers/d321f72e-d548-4179-a3dc-f28a9be43253 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:06:42.143101 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:42.148955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:42.169747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:42.171565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:42.173279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:42.176867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:42.177553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:42.178146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:42.412117 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5053b938-0735-4e1c-9ec0-cfe5576ce2fa tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.258127 Oct 16 01:06:42.414058 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 872/1629] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:06:41 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:42.429134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2c9bcd2-357d-4cdc-a9d6-289b67637c1c tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e1120d0>, body: {"security_group_rule": {"parent_group_id": "d53ebeed-537d-4ef2-a302-dc90b8c0db98", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:42.748116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:42.763036 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c453718d-aa8a-4b48-ab3a-9c265e8c749a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1308 microversion: 2.1 time: 0.626509 Oct 16 01:06:42.775670 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 758/1630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:42 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1308 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:42.796876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:42.798064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:42.799809 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f2c9bcd2-357d-4cdc-a9d6-289b67637c1c tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] HTTP exception thrown: This rule already exists in group d53ebeed-537d-4ef2-a302-dc90b8c0db98 Oct 16 01:06:42.804508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:42.805006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:42.805449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:42.806159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:42.806618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:42.807076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2c9bcd2-357d-4cdc-a9d6-289b67637c1c tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Request method failure captured: Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 138 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ke_zYrD3LetNoAS7-iC__L9PdrBh9SglZDRES-N98sg_FpGoadrl1hRO3bNJL_uSYWuusDo0y0oNRqWZap-_XrC5BPP0TsJpToq10-zhHbSKzlha9-a-085lo9HTq7H37x4f3gTcyGm0lPSPK_79FmYr2zmEs093VoPgperg2q5A8 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06ffa5dcbbb745ba8b09806f2202e95d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e6f9ebc41aaf4f2895c5f2fb02e28166 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: {"security_group_rule": {"parent_group_id": "d53ebeed-537d-4ef2-a302-dc90b8c0db98", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: exception: This rule already exists in group d53ebeed-537d-4ef2-a302-dc90b8c0db98 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd53ebeed-537d-4ef2-a302-dc90b8c0db98', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group d53ebeed-537d-4ef2-a302-dc90b8c0db98 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group d53ebeed-537d-4ef2-a302-dc90b8c0db98 Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:42.810628 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:42.818026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:42.818026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:42.818026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group d53ebeed-537d-4ef2-a302-dc90b8c0db98 Oct 16 01:06:42.818026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:42.818026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2c9bcd2-357d-4cdc-a9d6-289b67637c1c tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Returning 400 to user: This rule already exists in group d53ebeed-537d-4ef2-a302-dc90b8c0db98 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:42.818026 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2c9bcd2-357d-4cdc-a9d6-289b67637c1c tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.390004 Oct 16 01:06:42.818026 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 873/1631] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:06:42 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:06:42.826168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-121bef21-2dd5-4fbe-b059-5a315b448109 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Calling method '.version_select at 0x7fd64e0c4790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:43.227889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:43.244407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:43.252669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:43.258997 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fc03bd7c-386e-4c59-b56c-0df2e5e6cf9b tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.481008 Oct 16 01:06:43.263080 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 759/1632] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:42 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:43.292444 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-121bef21-2dd5-4fbe-b059-5a315b448109 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/8f50bfc3-c988-4c55-8d1e-034b463c6eca" status: 202 len: 0 microversion: 2.1 time: 0.470489 Oct 16 01:06:43.293729 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 874/1633] 10.222.0.39 () {58 vars in 1287 bytes} [Sun Oct 16 01:06:42 2022] DELETE /compute/v2.1/os-security-group-rules/8f50bfc3-c988-4c55-8d1e-034b463c6eca => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:06:43.311050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-38cc9c26-e62c-4804-b8ae-d472b1da35b4 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e730280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1847857096", "description": "tempest-description-1394300893"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:43.604045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ad08eba-6c6f-4727-a658-dd88371fe0d1 tempest-FloatingIPDetailsNegativeTestJSON-1072531821 tempest-FloatingIPDetailsNegativeTestJSON-1072531821-project] Calling method '.version_select at 0x7fd64e1120d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:43.993475 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-4ad08eba-6c6f-4727-a658-dd88371fe0d1 tempest-FloatingIPDetailsNegativeTestJSON-1072531821 tempest-FloatingIPDetailsNegativeTestJSON-1072531821-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 40e83b8b-af69-4d5c-bca8-567a57ef6231 could not be found", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:06:43.994227 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4ad08eba-6c6f-4727-a658-dd88371fe0d1 tempest-FloatingIPDetailsNegativeTestJSON-1072531821 tempest-FloatingIPDetailsNegativeTestJSON-1072531821-project] HTTP exception thrown: Floating IP not found for ID 40e83b8b-af69-4d5c-bca8-567a57ef6231 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ad08eba-6c6f-4727-a658-dd88371fe0d1 tempest-FloatingIPDetailsNegativeTestJSON-1072531821 tempest-FloatingIPDetailsNegativeTestJSON-1072531821-project] Request method failure captured: Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-floating-ips/40e83b8b-af69-4d5c-bca8-567a57ef6231 HTTP/1.1 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1kjO5wmhzQJ38URpnx4SqTmZg63T4och_6bqR2ohy9Y4P9yf-8Hv8zLjN7jK-S_9bBp5suNVTKMa950ncDrng4q-M249d5f54zYuXcbCeqmYNQi8h7CDG69MYB2aaajNF5hMxX19Vl-e75kBj0ycbjpgF5zRqmUngNECBZ8tsfEgCg Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 7d149768b97a4e3985a0be62510997f3 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1072531821 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d149768b97a4e3985a0be62510997f3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d149768b97a4e3985a0be62510997f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d149768b97a4e3985a0be62510997f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d149768b97a4e3985a0be62510997f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1072531821 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 7d149768b97a4e3985a0be62510997f3 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1072531821 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1072531821-project Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d739d3fe2e744013b322ecb3b887be07 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1072531821-project Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: exception: Floating IP not found for ID 40e83b8b-af69-4d5c-bca8-567a57ef6231 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '40e83b8b-af69-4d5c-bca8-567a57ef6231'} Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:06:43.996074 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 40e83b8b-af69-4d5c-bca8-567a57ef6231 could not be found Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00a545fd-6028-4f32-a71c-9ad5486bb728'] Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 40e83b8b-af69-4d5c-bca8-567a57ef6231. Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 40e83b8b-af69-4d5c-bca8-567a57ef6231 Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 40e83b8b-af69-4d5c-bca8-567a57ef6231 Oct 16 01:06:44.001577 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.006943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ad08eba-6c6f-4727-a658-dd88371fe0d1 tempest-FloatingIPDetailsNegativeTestJSON-1072531821 tempest-FloatingIPDetailsNegativeTestJSON-1072531821-project] Returning 404 to user: Floating IP not found for ID 40e83b8b-af69-4d5c-bca8-567a57ef6231 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:44.006943 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ad08eba-6c6f-4727-a658-dd88371fe0d1 tempest-FloatingIPDetailsNegativeTestJSON-1072531821 tempest-FloatingIPDetailsNegativeTestJSON-1072531821-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/40e83b8b-af69-4d5c-bca8-567a57ef6231" status: 404 len: 111 microversion: 2.1 time: 0.676854 Oct 16 01:06:44.007414 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 875/1634] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:06:43 2022] GET /compute/v2.1/os-floating-ips/40e83b8b-af69-4d5c-bca8-567a57ef6231 => generated 111 bytes in 679 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:06:44.016247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:44.017151 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:44.037765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:44.038574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:44.039355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:44.040381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:44.041008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:44.041602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:44.104557 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-38cc9c26-e62c-4804-b8ae-d472b1da35b4 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.804557 Oct 16 01:06:44.115062 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 760/1635] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:06:43 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:44.122943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e37e273c-fe0e-4cd1-9fbd-9f11026c00c3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e827d30>, body: {"security_group_rule": {"parent_group_id": "99765135-5310-473f-8937-cac720b36baa", "ip_protocol": "tcp", "from_port": 342504469, "to_port": 22}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:44.338768 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e37e273c-fe0e-4cd1-9fbd-9f11026c00c3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] HTTP exception thrown: Invalid port range 342504469:22. Former value cannot be greater than the later Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e37e273c-fe0e-4cd1-9fbd-9f11026c00c3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Request method failure captured: Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 145 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ke_zYrD3LetNoAS7-iC__L9PdrBh9SglZDRES-N98sg_FpGoadrl1hRO3bNJL_uSYWuusDo0y0oNRqWZap-_XrC5BPP0TsJpToq10-zhHbSKzlha9-a-085lo9HTq7H37x4f3gTcyGm0lPSPK_79FmYr2zmEs093VoPgperg2q5A8 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06ffa5dcbbb745ba8b09806f2202e95d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e6f9ebc41aaf4f2895c5f2fb02e28166 Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: {"security_group_rule": {"parent_group_id": "99765135-5310-473f-8937-cac720b36baa", "ip_protocol": "tcp", "from_port": 342504469, "to_port": 22}} Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid port range 342504469:22. Former value cannot be greater than the later Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'security_group_rule': {'parent_group_id': '99765135-5310-473f-8937-cac720b36baa', 'ip_protocol': 'tcp', 'from_port': 342504469, 'to_port': 22}}} Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 342504469:22. Former value cannot be greater than the later Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 342504469:22. Former value cannot be greater than the later Oct 16 01:06:44.341645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 342504469:22. Former value cannot be greater than the later Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e37e273c-fe0e-4cd1-9fbd-9f11026c00c3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Returning 400 to user: Invalid port range 342504469:22. Former value cannot be greater than the later {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:44.348525 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e37e273c-fe0e-4cd1-9fbd-9f11026c00c3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.226795 Oct 16 01:06:44.354192 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 761/1636] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:06:44 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:06:44.612466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6d8245d0-90f7-444e-8d75-e002447a1996 tempest-QuotaClassesAdminTestJSON-1872534071 tempest-QuotaClassesAdminTestJSON-1872534071-project-admin] Calling method '.version_select at 0x7fd64e125040>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:44.659738 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6d8245d0-90f7-444e-8d75-e002447a1996 tempest-QuotaClassesAdminTestJSON-1872534071 tempest-QuotaClassesAdminTestJSON-1872534071-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.309277 Oct 16 01:06:44.662323 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 762/1637] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Oct 16 01:06:44 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:44.683540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:44.687372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:44.708604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:44.711218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:44.711945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:44.713712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:44.715996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:44.717884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:44.911239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:44.919888 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2723140b-b262-41dd-8787-d39bca174d36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1488 microversion: 2.1 time: 0.911003 Oct 16 01:06:44.942119 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 876/1638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:44 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1488 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:44.957093 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e084251d-65ea-4e84-aaed-ab864e0bc9c4 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e112790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1313382682", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:44.962312 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-e084251d-65ea-4e84-aaed-ab864e0bc9c4 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] HTTP exception thrown: Security group id should be uuid Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e084251d-65ea-4e84-aaed-ab864e0bc9c4 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Request method failure captured: Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 131 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ke_zYrD3LetNoAS7-iC__L9PdrBh9SglZDRES-N98sg_FpGoadrl1hRO3bNJL_uSYWuusDo0y0oNRqWZap-_XrC5BPP0TsJpToq10-zhHbSKzlha9-a-085lo9HTq7H37x4f3gTcyGm0lPSPK_79FmYr2zmEs093VoPgperg2q5A8 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06ffa5dcbbb745ba8b09806f2202e95d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e6f9ebc41aaf4f2895c5f2fb02e28166 Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1313382682", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: exception: Security group id should be uuid Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1313382682', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:44.970273 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:44.976614 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 16 01:06:44.976614 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:44.976614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e084251d-65ea-4e84-aaed-ab864e0bc9c4 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Returning 400 to user: Security group id should be uuid {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:44.976614 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e084251d-65ea-4e84-aaed-ab864e0bc9c4 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028699 Oct 16 01:06:44.976614 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 877/1639] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:06:44 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:44.985354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6be887d-5776-478b-94a8-b3409e851681 tempest-QuotaClassesAdminTestJSON-1872534071 tempest-QuotaClassesAdminTestJSON-1872534071-project-admin] Action: 'update', calling method: .version_select at 0x7fd64e6873a0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:45.261994 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:45.263208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:45.283859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:45.291195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:45.295440 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0c49b0a6-ea78-4d26-a671-6011e5cc246f tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.631619 Oct 16 01:06:45.299009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 763/1640] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:44 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:45.310160 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:45.327585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:45.352517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:45.353676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:45.354418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:45.356801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:45.359893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:45.362380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:45.427086 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6be887d-5776-478b-94a8-b3409e851681 tempest-QuotaClassesAdminTestJSON-1872534071 tempest-QuotaClassesAdminTestJSON-1872534071-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.453310 Oct 16 01:06:45.434530 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 878/1641] 10.222.0.39 () {60 vars in 1206 bytes} [Sun Oct 16 01:06:44 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:45.439593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f5eb201-22cb-450c-84de-cb6b756a47bc tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e1fb160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1801172312", "description": "tempest-description-581030783"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:45.444778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lazy-loading 'flavor' on Instance uuid d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:06:45.668610 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b745ed50-946c-4874-8919-5b14d8982a8e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892/action" status: 202 len: 0 microversion: 2.1 time: 0.353093 Oct 16 01:06:45.673352 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 764/1642] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:06:45 2022] POST /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:06:45.682494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-50d29d33-d0d6-4413-a2c7-da1474855872 tempest-QuotaClassesAdminTestJSON-1872534071 tempest-QuotaClassesAdminTestJSON-1872534071-project-admin] Calling method '.version_select at 0x7fd64e2f58b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:45.710712 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-50d29d33-d0d6-4413-a2c7-da1474855872 tempest-QuotaClassesAdminTestJSON-1872534071 tempest-QuotaClassesAdminTestJSON-1872534071-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.035360 Oct 16 01:06:45.719326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 765/1643] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Oct 16 01:06:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:45.724617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:45.725364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:45.731288 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:45.739651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:45.740501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:45.741158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:45.742210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:45.742909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:45.743919 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:46.513198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:46.530942 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db5a0f44-c099-4659-92a4-31b8be1d90c0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1496 microversion: 2.1 time: 0.808630 Oct 16 01:06:46.533563 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 766/1644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:45 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1496 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:46.553384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cfccc968-f851-418b-bdaa-f06b251b503e tempest-QuotaClassesAdminTestJSON-1872534071 tempest-QuotaClassesAdminTestJSON-1872534071-project-admin] Action: 'update', calling method: .version_select at 0x7fd64e149430>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:46.807366 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cfccc968-f851-418b-bdaa-f06b251b503e tempest-QuotaClassesAdminTestJSON-1872534071 tempest-QuotaClassesAdminTestJSON-1872534071-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.270881 Oct 16 01:06:46.818256 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 767/1645] 10.222.0.39 () {60 vars in 1206 bytes} [Sun Oct 16 01:06:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:46.830199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:46.831891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:46.863059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:46.865766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:46.866486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:46.871906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:46.872895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:46.873756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:47.285618 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f5eb201-22cb-450c-84de-cb6b756a47bc tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.856414 Oct 16 01:06:47.287151 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 879/1646] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:06:45 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:47.292396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-822d2e5b-a527-441b-b206-a7c8e207de40 req-68602c71-85ae-43bb-8440-82d8b0bdb58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e", "name": "network-vif-unplugged", "status": "completed", "tag": "b8782224-70e0-4ab1-8247-575f68f8e9c0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:47.316898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-822d2e5b-a527-441b-b206-a7c8e207de40 req-68602c71-85ae-43bb-8440-82d8b0bdb58e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:47.329191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-822d2e5b-a527-441b-b206-a7c8e207de40 req-68602c71-85ae-43bb-8440-82d8b0bdb58e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:47.341191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-822d2e5b-a527-441b-b206-a7c8e207de40 req-68602c71-85ae-43bb-8440-82d8b0bdb58e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:47.402725 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-822d2e5b-a527-441b-b206-a7c8e207de40 req-68602c71-85ae-43bb-8440-82d8b0bdb58e service nova] Creating event network-vif-unplugged:b8782224-70e0-4ab1-8247-575f68f8e9c0 for instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e on n-h2-master-1 Oct 16 01:06:47.435727 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-822d2e5b-a527-441b-b206-a7c8e207de40 req-68602c71-85ae-43bb-8440-82d8b0bdb58e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131723 Oct 16 01:06:47.437637 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 880/1647] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:47.453173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-21f74247-1e1c-4e11-be06-4895d57b8cf6 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e1fbe50>, body: {"security_group_rule": {"parent_group_id": "73825d28-d435-4d65-a171-f1c3a8b5a5cb", "ip_protocol": "tempest-999-166489797", "from_port": 22, "to_port": 22}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:47.988606 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-21f74247-1e1c-4e11-be06-4895d57b8cf6 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] HTTP exception thrown: Invalid IP protocol tempest-999-166489797. Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-21f74247-1e1c-4e11-be06-4895d57b8cf6 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Request method failure captured: Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 156 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ke_zYrD3LetNoAS7-iC__L9PdrBh9SglZDRES-N98sg_FpGoadrl1hRO3bNJL_uSYWuusDo0y0oNRqWZap-_XrC5BPP0TsJpToq10-zhHbSKzlha9-a-085lo9HTq7H37x4f3gTcyGm0lPSPK_79FmYr2zmEs093VoPgperg2q5A8 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06ffa5dcbbb745ba8b09806f2202e95d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e6f9ebc41aaf4f2895c5f2fb02e28166 Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: {"security_group_rule": {"parent_group_id": "73825d28-d435-4d65-a171-f1c3a8b5a5cb", "ip_protocol": "tempest-999-166489797", "from_port": 22, "to_port": 22}} Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid IP protocol tempest-999-166489797. Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'security_group_rule': {'parent_group_id': '73825d28-d435-4d65-a171-f1c3a8b5a5cb', 'ip_protocol': 'tempest-999-166489797', 'from_port': 22, 'to_port': 22}}} Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-166489797. Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-166489797. Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:47.990278 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-166489797. Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-21f74247-1e1c-4e11-be06-4895d57b8cf6 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Returning 400 to user: Invalid IP protocol tempest-999-166489797. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:47.994624 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-21f74247-1e1c-4e11-be06-4895d57b8cf6 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.550294 Oct 16 01:06:47.996546 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 881/1648] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:06:47 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 558 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:48.001929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:48.002677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:48.020979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:48.021493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:48.021919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:48.022641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:48.023150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:48.023583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:48.076208 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:48.103627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:48.139296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:48.150128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:48.163777 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a0954cb7-9548-43a0-bca4-59e45c3507f4 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 1.335741 Oct 16 01:06:48.167119 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 768/1649] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:46 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:48.192675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1425306e-f295-468e-b1e7-3c8cc55e1374 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e827f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1648662413", "description": "tempest-description-1741240970"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:48.634016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:48.642874 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d3eeabf-aa5b-4518-b01d-bed4129e4b88 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 200 len: 1479 microversion: 2.1 time: 0.645195 Oct 16 01:06:48.647042 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 882/1650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:06:47 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 1479 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:48.676184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1356383601"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:48.679230 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:48.716078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:48.720902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:48.723789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:48.727328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:48.728741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:48.733584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:49.042629 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1425306e-f295-468e-b1e7-3c8cc55e1374 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.873047 Oct 16 01:06:49.044469 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 769/1651] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:06:48 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:49.060596 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b4a8699-c539-4c5a-8ddd-5aaae0d185f3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e2f5af0>, body: {"security_group_rule": {"parent_group_id": "e01f92c4-094f-4231-a2be-6b055b428499", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:49.265138 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7b4a8699-c539-4c5a-8ddd-5aaae0d185f3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b4a8699-c539-4c5a-8ddd-5aaae0d185f3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Request method failure captured: Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 138 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ke_zYrD3LetNoAS7-iC__L9PdrBh9SglZDRES-N98sg_FpGoadrl1hRO3bNJL_uSYWuusDo0y0oNRqWZap-_XrC5BPP0TsJpToq10-zhHbSKzlha9-a-085lo9HTq7H37x4f3gTcyGm0lPSPK_79FmYr2zmEs093VoPgperg2q5A8 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06ffa5dcbbb745ba8b09806f2202e95d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e6f9ebc41aaf4f2895c5f2fb02e28166 Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: {"security_group_rule": {"parent_group_id": "e01f92c4-094f-4231-a2be-6b055b428499", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e01f92c4-094f-4231-a2be-6b055b428499', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 16 01:06:49.268574 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 16 01:06:49.274417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:49.276102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b4a8699-c539-4c5a-8ddd-5aaae0d185f3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:49.277195 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7b4a8699-c539-4c5a-8ddd-5aaae0d185f3 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.222799 Oct 16 01:06:49.278038 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 770/1652] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:06:49 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:06:49.294327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:49.296536 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:49.313972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:49.315128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:49.317551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:49.319260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:49.320493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:49.323499 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7579aae-337b-411b-bb69-c534250bf436 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892/action" status: 202 len: 0 microversion: 2.1 time: 0.651730 Oct 16 01:06:49.324035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:49.324796 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 883/1653] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:06:48 2022] POST /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 16 01:06:49.333083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59893ddf-6915-4f84-996e-a01f406e08cd tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e070e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1703437202", "description": "tempest-description-1330847248"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:49.861793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:49.877739 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:49.883525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:49.888189 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85fe3d15-36a6-4ba7-b346-41d64c7b10b0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.607548 Oct 16 01:06:49.889351 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 771/1654] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:49 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:49.903528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-08154b33-b171-4d73-a96f-60bdaeb58e52 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e2e5280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:50.021465 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-08154b33-b171-4d73-a96f-60bdaeb58e52 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.124605 Oct 16 01:06:50.022278 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 772/1655] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:49 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:50.041613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-79d2e5e9-e2ee-4911-83ba-c32a719a4a24 req-65da4ea6-7e28-4b92-96ff-900693c27e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e", "tag": "b8782224-70e0-4ab1-8247-575f68f8e9c0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:50.063885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-79d2e5e9-e2ee-4911-83ba-c32a719a4a24 req-65da4ea6-7e28-4b92-96ff-900693c27e1f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:50.064678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-79d2e5e9-e2ee-4911-83ba-c32a719a4a24 req-65da4ea6-7e28-4b92-96ff-900693c27e1f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:50.066331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-79d2e5e9-e2ee-4911-83ba-c32a719a4a24 req-65da4ea6-7e28-4b92-96ff-900693c27e1f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:50.088897 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-79d2e5e9-e2ee-4911-83ba-c32a719a4a24 req-65da4ea6-7e28-4b92-96ff-900693c27e1f service nova] Creating event network-changed:b8782224-70e0-4ab1-8247-575f68f8e9c0 for instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e on n-h2-master-1 Oct 16 01:06:50.100658 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-79d2e5e9-e2ee-4911-83ba-c32a719a4a24 req-65da4ea6-7e28-4b92-96ff-900693c27e1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067002 Oct 16 01:06:50.101705 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 773/1656] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:50.488112 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-59893ddf-6915-4f84-996e-a01f406e08cd tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.160906 Oct 16 01:06:50.490479 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 884/1657] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:06:49 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:50.507624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b26376e4-4cff-4e69-a894-206242a257f1 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e827f70>, body: {"security_group_rule": {"parent_group_id": "cb956d14-91fb-4aa0-90d6-3c9fd3907bcd", "ip_protocol": "tcp", "from_port": 22, "to_port": 912330586}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:50.871505 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-b26376e4-4cff-4e69-a894-206242a257f1 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] HTTP exception thrown: Invalid port range 22:912330586. Valid TCP ports should be between 1-65535 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b26376e4-4cff-4e69-a894-206242a257f1 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Request method failure captured: Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 145 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ke_zYrD3LetNoAS7-iC__L9PdrBh9SglZDRES-N98sg_FpGoadrl1hRO3bNJL_uSYWuusDo0y0oNRqWZap-_XrC5BPP0TsJpToq10-zhHbSKzlha9-a-085lo9HTq7H37x4f3gTcyGm0lPSPK_79FmYr2zmEs093VoPgperg2q5A8 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06ffa5dcbbb745ba8b09806f2202e95d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e6f9ebc41aaf4f2895c5f2fb02e28166 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: {"security_group_rule": {"parent_group_id": "cb956d14-91fb-4aa0-90d6-3c9fd3907bcd", "ip_protocol": "tcp", "from_port": 22, "to_port": 912330586}} Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid port range 22:912330586. Valid TCP ports should be between 1-65535 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cb956d14-91fb-4aa0-90d6-3c9fd3907bcd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 912330586}}} Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:912330586. Valid TCP ports should be between 1-65535 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:912330586. Valid TCP ports should be between 1-65535 Oct 16 01:06:50.873157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:912330586. Valid TCP ports should be between 1-65535 Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b26376e4-4cff-4e69-a894-206242a257f1 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Returning 400 to user: Invalid port range 22:912330586. Valid TCP ports should be between 1-65535 {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:50.879225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b26376e4-4cff-4e69-a894-206242a257f1 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.373268 Oct 16 01:06:50.881876 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 774/1658] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:06:50 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:06:50.889856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b712cdc-bac6-4ce6-b543-488a07f527f0 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Action: 'create', calling method: .version_select at 0x7fd64e1549d0>, body: {"security_group_rule": {"parent_group_id": "f5e0ce76-b098-45e2-86d3-df97aafc2454", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:50.921985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:50.923978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:50.946350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:50.949809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:50.950328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:50.951178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:50.951588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:50.952027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:51.169818 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-2b712cdc-bac6-4ce6-b543-488a07f527f0 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5e0ce76-b098-45e2-86d3-df97aafc2454 does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:06:51.170428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-2b712cdc-bac6-4ce6-b543-488a07f527f0 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Neutron security group f5e0ce76-b098-45e2-86d3-df97aafc2454 not found {{(pid=120545) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:06:51.171191 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2b712cdc-bac6-4ce6-b543-488a07f527f0 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] HTTP exception thrown: Security group f5e0ce76-b098-45e2-86d3-df97aafc2454 does not exist Oct 16 01:06:51.171191 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-cfcb510e-a2ba-42ad-8167-00525a507282'] Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b712cdc-bac6-4ce6-b543-488a07f527f0 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Request method failure captured: Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 138 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ke_zYrD3LetNoAS7-iC__L9PdrBh9SglZDRES-N98sg_FpGoadrl1hRO3bNJL_uSYWuusDo0y0oNRqWZap-_XrC5BPP0TsJpToq10-zhHbSKzlha9-a-085lo9HTq7H37x4f3gTcyGm0lPSPK_79FmYr2zmEs093VoPgperg2q5A8 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06ffa5dcbbb745ba8b09806f2202e95d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e6f9ebc41aaf4f2895c5f2fb02e28166 Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: {"security_group_rule": {"parent_group_id": "f5e0ce76-b098-45e2-86d3-df97aafc2454", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: exception: Security group f5e0ce76-b098-45e2-86d3-df97aafc2454 does not exist Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-cfcb510e-a2ba-42ad-8167-00525a507282'] Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f5e0ce76-b098-45e2-86d3-df97aafc2454', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:06:51.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5e0ce76-b098-45e2-86d3-df97aafc2454 does not exist Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfcb510e-a2ba-42ad-8167-00525a507282'] Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5e0ce76-b098-45e2-86d3-df97aafc2454 does not exist Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfcb510e-a2ba-42ad-8167-00525a507282'] Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5e0ce76-b098-45e2-86d3-df97aafc2454 does not exist Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfcb510e-a2ba-42ad-8167-00525a507282'] Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5e0ce76-b098-45e2-86d3-df97aafc2454 does not exist Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfcb510e-a2ba-42ad-8167-00525a507282'] Oct 16 01:06:51.179452 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.195328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b712cdc-bac6-4ce6-b543-488a07f527f0 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Returning 404 to user: Security group f5e0ce76-b098-45e2-86d3-df97aafc2454 does not exist Oct 16 01:06:51.195328 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-cfcb510e-a2ba-42ad-8167-00525a507282'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:51.196661 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2b712cdc-bac6-4ce6-b543-488a07f527f0 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.314819 Oct 16 01:06:51.197936 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 885/1659] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:06:50 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 317 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:06:51.208923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c3824ca-a7da-435d-a1e0-a97ee7777652 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e0bbaf0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:51.301094 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c3824ca-a7da-435d-a1e0-a97ee7777652 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.096247 Oct 16 01:06:51.311827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 886/1660] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:51 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:51.324408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05af2df3-b7e6-43dc-a66d-b99b6b10a756 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Calling method '.version_select at 0x7fd64e070e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:51.482894 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-05af2df3-b7e6-43dc-a66d-b99b6b10a756 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:06:51.483734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-05af2df3-b7e6-43dc-a66d-b99b6b10a756 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Neutron security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 not found {{(pid=120545) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 16 01:06:51.484316 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-05af2df3-b7e6-43dc-a66d-b99b6b10a756 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] HTTP exception thrown: Security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 does not exist Oct 16 01:06:51.484316 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3c29dec0-5f1d-4a4f-a5b8-864124b08489'] Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05af2df3-b7e6-43dc-a66d-b99b6b10a756 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Request method failure captured: Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-security-group-rules/8a6193f9-ec95-4c77-933f-83851119a2b8 HTTP/1.1 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ke_zYrD3LetNoAS7-iC__L9PdrBh9SglZDRES-N98sg_FpGoadrl1hRO3bNJL_uSYWuusDo0y0oNRqWZap-_XrC5BPP0TsJpToq10-zhHbSKzlha9-a-085lo9HTq7H37x4f3gTcyGm0lPSPK_79FmYr2zmEs093VoPgperg2q5A8 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06ffa5dcbbb745ba8b09806f2202e95d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06ffa5dcbbb745ba8b09806f2202e95d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 06ffa5dcbbb745ba8b09806f2202e95d Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e6f9ebc41aaf4f2895c5f2fb02e28166 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877830059-project Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: exception: Security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 does not exist Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3c29dec0-5f1d-4a4f-a5b8-864124b08489'] Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8a6193f9-ec95-4c77-933f-83851119a2b8'} Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:06:51.486684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 does not exist Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c29dec0-5f1d-4a4f-a5b8-864124b08489'] Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 does not exist Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c29dec0-5f1d-4a4f-a5b8-864124b08489'] Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 does not exist Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c29dec0-5f1d-4a4f-a5b8-864124b08489'] Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 does not exist Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c29dec0-5f1d-4a4f-a5b8-864124b08489'] Oct 16 01:06:51.492191 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:06:51.497494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05af2df3-b7e6-43dc-a66d-b99b6b10a756 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Returning 404 to user: Security group rule 8a6193f9-ec95-4c77-933f-83851119a2b8 does not exist Oct 16 01:06:51.497494 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3c29dec0-5f1d-4a4f-a5b8-864124b08489'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:06:51.499443 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05af2df3-b7e6-43dc-a66d-b99b6b10a756 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/8a6193f9-ec95-4c77-933f-83851119a2b8" status: 404 len: 199 microversion: 2.1 time: 0.186416 Oct 16 01:06:51.508025 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 887/1661] 10.222.0.39 () {58 vars in 1287 bytes} [Sun Oct 16 01:06:51 2022] DELETE /compute/v2.1/os-security-group-rules/8a6193f9-ec95-4c77-933f-83851119a2b8 => generated 199 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:51.522807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-838cb5cc-3a2c-45af-9924-8a742c457e32 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Calling method '.version_select at 0x7fd64e076040>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:51.738471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:51.753005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:51.754666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:51.756090 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b75f50b-5d17-45cd-bf35-ec21e2e71bed tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.839973 Oct 16 01:06:51.784730 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 775/1662] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:50 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:52.325677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e6eb6439-c2cf-4306-8aef-12d4e441ebb6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e827550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:52.433365 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e6eb6439-c2cf-4306-8aef-12d4e441ebb6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.119281 Oct 16 01:06:52.435298 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 776/1663] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:52 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:06:52.653432 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-838cb5cc-3a2c-45af-9924-8a742c457e32 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/cb956d14-91fb-4aa0-90d6-3c9fd3907bcd" status: 202 len: 0 microversion: 2.1 time: 1.140128 Oct 16 01:06:52.664019 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 888/1664] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:06:51 2022] DELETE /compute/v2.1/os-security-groups/cb956d14-91fb-4aa0-90d6-3c9fd3907bcd => generated 0 bytes in 1146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:06:52.666294 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7404988d-831c-4456-8c49-0f13b0e4032d tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Calling method '.version_select at 0x7fd64e149820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:52.805033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:52.806604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:52.835356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:52.838273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:52.839095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:52.840248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:52.844572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:52.847600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:53.984558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:54.025705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:54.036203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:54.052780 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-99c3437f-35cf-4a3f-9744-a403425b1e9c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 1.260205 Oct 16 01:06:54.057798 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 889/1665] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:52 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:54.080826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-efbf36ec-d038-4db3-a902-bdc76d2d0ffd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e06d040>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:54.155730 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7404988d-831c-4456-8c49-0f13b0e4032d tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e01f92c4-094f-4231-a2be-6b055b428499" status: 202 len: 0 microversion: 2.1 time: 1.495303 Oct 16 01:06:54.156347 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 777/1666] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:06:52 2022] DELETE /compute/v2.1/os-security-groups/e01f92c4-094f-4231-a2be-6b055b428499 => generated 0 bytes in 1497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:06:54.183457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-17d6cf98-7827-42ff-a8af-8db13e8c97dc tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Calling method '.version_select at 0x7fd64e851e50>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:54.198770 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-efbf36ec-d038-4db3-a902-bdc76d2d0ffd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.135730 Oct 16 01:06:54.203043 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 890/1667] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:54 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:55.092381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:55.093252 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:55.120605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:55.126358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:55.127194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:55.128451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:55.131486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:55.132173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:55.419516 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=23,nova_cell0:UPDATE=7 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:56.347128 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-17d6cf98-7827-42ff-a8af-8db13e8c97dc tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/73825d28-d435-4d65-a171-f1c3a8b5a5cb" status: 202 len: 0 microversion: 2.1 time: 2.185408 Oct 16 01:06:56.349037 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 778/1668] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:06:54 2022] DELETE /compute/v2.1/os-security-groups/73825d28-d435-4d65-a171-f1c3a8b5a5cb => generated 0 bytes in 2188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:06:56.356288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6de46b67-8e10-4054-835f-051488229f2f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e8a14c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:56.455237 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6de46b67-8e10-4054-835f-051488229f2f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.104741 Oct 16 01:06:56.456282 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 779/1669] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:56 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:56.696723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:56.716792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:56.730036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:56.731675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6d455e9-7f54-464f-a31f-98d0f9335f96 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 1.648598 Oct 16 01:06:56.754633 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 891/1670] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:55 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:06:56.770456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2a7ce0ef-4201-4a56-a355-5f296906e246 req-cd97f005-3e45-4c4f-b3e5-03249d6ea26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6612f5c-0f92-4cc2-8fcd-083e8b2b4892", "name": "network-vif-plugged", "status": "completed", "tag": "ae024ce0-ed0d-458b-9286-03065d260103"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:56.799109 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:56.805435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2a7ce0ef-4201-4a56-a355-5f296906e246 req-cd97f005-3e45-4c4f-b3e5-03249d6ea26e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:56.805943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2a7ce0ef-4201-4a56-a355-5f296906e246 req-cd97f005-3e45-4c4f-b3e5-03249d6ea26e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:56.806436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2a7ce0ef-4201-4a56-a355-5f296906e246 req-cd97f005-3e45-4c4f-b3e5-03249d6ea26e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:56.857224 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2a7ce0ef-4201-4a56-a355-5f296906e246 req-cd97f005-3e45-4c4f-b3e5-03249d6ea26e service nova] Creating event network-vif-plugged:ae024ce0-ed0d-458b-9286-03065d260103 for instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 on n-h2-master-1 Oct 16 01:06:56.878801 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2a7ce0ef-4201-4a56-a355-5f296906e246 req-cd97f005-3e45-4c4f-b3e5-03249d6ea26e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118690 Oct 16 01:06:56.882762 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 892/1671] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:56.889056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a850781-c471-43f2-a653-2fab8963b7fd tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Calling method '.version_select at 0x7fd64e0808b0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:56.958481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-074d3c3e-2f8c-404e-ad51-16556f185a18 tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] Action: 'create', calling method: .version_select at 0x7fd64ea9ac10>, body: {"security_group": {"name": "tempest-securitygroup-1849542129", "description": "tempest-description-1503483599"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:57.899248 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a850781-c471-43f2-a653-2fab8963b7fd tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/99765135-5310-473f-8937-cac720b36baa" status: 202 len: 0 microversion: 2.1 time: 1.014228 Oct 16 01:06:57.900376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 893/1672] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:06:56 2022] DELETE /compute/v2.1/os-security-groups/99765135-5310-473f-8937-cac720b36baa => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:06:57.909477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ecb86426-45f4-4531-8d0c-4ce1a46185b0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e06daf0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:58.033628 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ecb86426-45f4-4531-8d0c-4ce1a46185b0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.131816 Oct 16 01:06:58.043532 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 894/1673] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:57 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:06:58.050650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:58.051416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:58.066572 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-074d3c3e-2f8c-404e-ad51-16556f185a18 tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.602634 Oct 16 01:06:58.067142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:58.067410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:58.067952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:58.068286 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 780/1674] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:06:56 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:06:58.076378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74ac4473-40e8-4f9c-a463-5391baf0a0e1 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] Calling method '.version_select at 0x7fd652873670>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:58.076603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:58.076969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:58.077472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:58.604554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:58.618163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:58.626791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:06:58.635220 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8c7cd04b-33b6-46d4-b91d-fd97c0c8daee tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.590328 Oct 16 01:06:58.636408 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 895/1675] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:58 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:06:58.659196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec5ba51f-4d7b-4a22-9d40-c6f5e89ceecf tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] Action: 'create', calling method: .version_select at 0x7fd64e06dee0>, body: {"security_group": {"name": "tempest-securitygroup-425035436", "description": "tempest-description-1124944059"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:06:58.862433 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74ac4473-40e8-4f9c-a463-5391baf0a0e1 tempest-SecurityGroupRulesNegativeTestJSON-877830059 tempest-SecurityGroupRulesNegativeTestJSON-877830059-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/d53ebeed-537d-4ef2-a302-dc90b8c0db98" status: 202 len: 0 microversion: 2.1 time: 0.792880 Oct 16 01:06:58.863048 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 781/1676] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:06:58 2022] DELETE /compute/v2.1/os-security-groups/d53ebeed-537d-4ef2-a302-dc90b8c0db98 => generated 0 bytes in 794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:06:59.050374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03df35b2-bee7-4780-ba2b-31d86ef342f6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd652873550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:59.148969 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03df35b2-bee7-4780-ba2b-31d86ef342f6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.103154 Oct 16 01:06:59.157780 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 782/1677] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:59 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:06:59.663067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:06:59.664208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:06:59.681032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:59.682064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:59.684599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:06:59.688450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:06:59.689327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:06:59.690004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:00.224772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec5ba51f-4d7b-4a22-9d40-c6f5e89ceecf tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.586854 Oct 16 01:07:00.226518 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 896/1678] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:06:58 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:00.239015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f08c353e-a996-4a10-bad4-465767d02068 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e0bb9d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:00.396284 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f08c353e-a996-4a10-bad4-465767d02068 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.167025 Oct 16 01:07:00.398075 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 897/1679] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:00 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:01.091177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b267b177-9b02-4615-97ef-0598b2ce06b6 tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] Action: 'create', calling method: .version_select at 0x7fd64e06ddc0>, body: {"security_group": {"name": "tempest-securitygroup-528075895", "description": "tempest-description-1453984682"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:01.306031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:01.323057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:01.329092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:01.334721 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-533e71c5-4621-4d8c-8398-7ea0a297dfb0 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 1.675040 Oct 16 01:07:01.337713 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 783/1680] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:06:59 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:07:01.414199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e7a9d966-183a-4be3-aa6d-14d901f1e88b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd652871c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:01.501726 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e7a9d966-183a-4be3-aa6d-14d901f1e88b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.093319 Oct 16 01:07:01.503282 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 784/1681] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:01 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:07:01.820107 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b004eee7-3ddf-48ce-8ce7-f268a36eee8e tempest-AbsoluteLimitsTestJSON-928437633 tempest-AbsoluteLimitsTestJSON-928437633-project] Calling method '.version_select at 0x7fd652815310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:01.849104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b004eee7-3ddf-48ce-8ce7-f268a36eee8e tempest-AbsoluteLimitsTestJSON-928437633 tempest-AbsoluteLimitsTestJSON-928437633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:01.851549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b004eee7-3ddf-48ce-8ce7-f268a36eee8e tempest-AbsoluteLimitsTestJSON-928437633 tempest-AbsoluteLimitsTestJSON-928437633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:01.854261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b004eee7-3ddf-48ce-8ce7-f268a36eee8e tempest-AbsoluteLimitsTestJSON-928437633 tempest-AbsoluteLimitsTestJSON-928437633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:01.855636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b004eee7-3ddf-48ce-8ce7-f268a36eee8e tempest-AbsoluteLimitsTestJSON-928437633 tempest-AbsoluteLimitsTestJSON-928437633-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:01.858215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b004eee7-3ddf-48ce-8ce7-f268a36eee8e tempest-AbsoluteLimitsTestJSON-928437633 tempest-AbsoluteLimitsTestJSON-928437633-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:01.858878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b004eee7-3ddf-48ce-8ce7-f268a36eee8e tempest-AbsoluteLimitsTestJSON-928437633 tempest-AbsoluteLimitsTestJSON-928437633-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:01.904842 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b004eee7-3ddf-48ce-8ce7-f268a36eee8e tempest-AbsoluteLimitsTestJSON-928437633 tempest-AbsoluteLimitsTestJSON-928437633-project] 10.222.0.39 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.400210 Oct 16 01:07:01.919080 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 785/1682] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:02.370876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:02.372436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:02.383452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:02.385963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:02.386605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:02.390572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:02.392952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:02.396317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:03.112991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:03.136483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:03.144419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:03.148021 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11572ca1-e123-4061-ae37-ae630884eb62 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1487 microversion: 2.25 time: 0.779679 Oct 16 01:07:03.160079 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 786/1683] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:02 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1487 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:03.174498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ca55e83-ad3c-4769-8bd4-25eab232e179 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd6528150d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:03.232399 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ca55e83-ad3c-4769-8bd4-25eab232e179 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.068058 Oct 16 01:07:03.242458 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 787/1684] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:03 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:03.737861 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b267b177-9b02-4615-97ef-0598b2ce06b6 tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 3.336304 Oct 16 01:07:03.740284 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 898/1685] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:07:00 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 3341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:03.755065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22c54b2e-7496-4d88-aa7c-d4a61296becf tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] Action: 'create', calling method: .version_select at 0x7fd64e155ca0>, body: {"security_group": {"name": "tempest-securitygroup-1952811506", "description": "tempest-description-976531735"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:04.184504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:04.185402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:04.208357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:04.211364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:04.213603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:04.217269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:04.218043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:04.221245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:05.076798 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22c54b2e-7496-4d88-aa7c-d4a61296becf tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.325029 Oct 16 01:07:05.092669 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 788/1686] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:07:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:05.099468 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e140429-a6f3-45ad-8107-1ace120dbf3a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd652873550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:05.184655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:05.199075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:05.207688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:05.225476 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e140429-a6f3-45ad-8107-1ace120dbf3a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.131142 Oct 16 01:07:05.226070 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 789/1687] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:05 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:05.228932 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67603e58-d36a-4be1-81de-2069b76f51f6 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1477 microversion: 2.25 time: 1.040898 Oct 16 01:07:05.248175 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 899/1688] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:04 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1477 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:07:05.261984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6190931-54df-485d-a69a-1857faaefb0f tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] Calling method '.version_select at 0x7fd64ea9ac10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:05.264393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09f58046-4b8a-4ac1-b0d1-46ecb0e7d565 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '.version_select at 0x7fd64e0c48b0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:05.275164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09f58046-4b8a-4ac1-b0d1-46ecb0e7d565 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:05.275887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09f58046-4b8a-4ac1-b0d1-46ecb0e7d565 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:05.278030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09f58046-4b8a-4ac1-b0d1-46ecb0e7d565 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:05.290205 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-09f58046-4b8a-4ac1-b0d1-46ecb0e7d565 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 2783 microversion: 2.25 time: 0.031789 Oct 16 01:07:05.303949 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 900/1689] 10.222.0.39 () {60 vars in 1184 bytes} [Sun Oct 16 01:07:05 2022] GET /compute/v2.1/os-migrations => generated 2783 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:05.310367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:05.311265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:05.327618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:05.328291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:05.328809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:05.329614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:05.330076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:05.330507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:05.869872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] Lazy-loading 'services' on Instance uuid bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:07:05.904304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0314aca-0fac-4d21-a3f0-b68f32506e41 tempest-LiveAutoBlockMigrationV225Test-1822799548 tempest-LiveAutoBlockMigrationV225Test-1822799548-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1970 microversion: 2.25 time: 0.597063 Oct 16 01:07:05.947113 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 901/1690] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:05 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1970 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:07:05.967897 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:05.969319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:05.987183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:05.989321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:05.990806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:05.992413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:05.993177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:05.993927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:06.029035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:07:06.367571 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e8475c4-fd33-41af-888f-16abf994e6e3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 204 len: 0 microversion: 2.25 time: 0.417402 Oct 16 01:07:06.372910 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 902/1691] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:07:05 2022] DELETE /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:07:06.392898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-63307d01-39b0-487b-aa29-fe5c90aae785 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e0c4ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:06.532019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-63307d01-39b0-487b-aa29-fe5c90aae785 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.151932 Oct 16 01:07:06.541582 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 903/1692] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:06 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:06.585650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:06.586929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:06.603160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:06.614726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:06.616537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:06.622239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:06.623927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:06.626882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:07.454938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:07.467807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:07.469340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:07.470591 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-af8978f3-e93f-4839-a02d-9d0685f7d017 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1483 microversion: 2.25 time: 0.927486 Oct 16 01:07:07.475458 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 904/1693] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:06 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1483 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:07.783213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da6272eb-daf0-4c50-a1a9-54e5a24dee2b tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Calling method '.version_select at 0x7fd64e0c43a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:07.820167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da6272eb-daf0-4c50-a1a9-54e5a24dee2b tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:07.821080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da6272eb-daf0-4c50-a1a9-54e5a24dee2b tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:07.821990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da6272eb-daf0-4c50-a1a9-54e5a24dee2b tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:07.823007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da6272eb-daf0-4c50-a1a9-54e5a24dee2b tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:07.827878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da6272eb-daf0-4c50-a1a9-54e5a24dee2b tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:07.828997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da6272eb-daf0-4c50-a1a9-54e5a24dee2b tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:07.885628 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da6272eb-daf0-4c50-a1a9-54e5a24dee2b tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] 10.222.0.39 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.408201 Oct 16 01:07:07.886792 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 905/1694] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:07:07 2022] GET /compute/v2.1/limits => generated 511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:07.895918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-466d661a-0d33-468b-914f-672f2aea6f01 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e080430>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:08.065658 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-466d661a-0d33-468b-914f-672f2aea6f01 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.177494 Oct 16 01:07:08.066356 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 906/1695] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:07 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:08.128478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-90190d3b-5e31-4703-b8af-98d4a83a0a21 tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1194846663", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:08.238000 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-90190d3b-5e31-4703-b8af-98d4a83a0a21 tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:07:10.037345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-90190d3b-5e31-4703-b8af-98d4a83a0a21 tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Getting quotas for project 181b321b1e104ee29512c219f7db1e90. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:10.073939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-90190d3b-5e31-4703-b8af-98d4a83a0a21 tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Getting quotas for user cc9d35bb66124eea8cf5870ab7524a10 and project 181b321b1e104ee29512c219f7db1e90. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:10.138727 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-90190d3b-5e31-4703-b8af-98d4a83a0a21 tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-90190d3b-5e31-4703-b8af-98d4a83a0a21 tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Request method failure captured: Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 1752 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1k75fyYFQNrS6qILHhmc5c-OzJs5C9A4m4BTTuhvXD7KWBRTlBWJCU3zUcrac9HXbDSfChEy9c-7NbODYhLnWYjlGUb7MiGUqx5naFLNIehfERDJPuprqGJg83eLhQZbpj3doDFHhOrWma_h_-_kSRwbgbJm8BDJqJ3p6zMPiBLObw Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 181b321b1e104ee29512c219f7db1e90 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1261999247 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_181b321b1e104ee29512c219f7db1e90", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/181b321b1e104ee29512c219f7db1e90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/181b321b1e104ee29512c219f7db1e90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/181b321b1e104ee29512c219f7db1e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1261999247 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 181b321b1e104ee29512c219f7db1e90 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1261999247 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: cc9d35bb66124eea8cf5870ab7524a10 Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1194846663", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:07:10.146169 n-d-master-1 devstack@n-api.service[120545]: exception: Maximum number of metadata items exceeds 128 Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1194846663', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:07:10.149129 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 16 01:07:10.154591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:10.160244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-90190d3b-5e31-4703-b8af-98d4a83a0a21 tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:07:10.163715 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-90190d3b-5e31-4703-b8af-98d4a83a0a21 tempest-AbsoluteLimitsNegativeTestJSON-1261999247 tempest-AbsoluteLimitsNegativeTestJSON-1261999247-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 2.090674 Oct 16 01:07:10.173133 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 907/1696] 10.222.0.39 () {60 vars in 1148 bytes} [Sun Oct 16 01:07:08 2022] POST /compute/v2.1/servers => generated 87 bytes in 2104 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:07:10.222073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:10.223428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:10.244310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:10.251623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:10.254068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:10.259458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:10.263248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:10.263972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:10.434266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:10.448789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:10.450755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:10.452424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2662dc5-8414-4cbf-805c-5eb73295770e tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1266 microversion: 2.25 time: 0.266770 Oct 16 01:07:10.470257 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 908/1697] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:10 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:10.483880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d92468a6-91c5-4380-90d5-ed1bbf7f8e98 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e112280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:10.574835 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d92468a6-91c5-4380-90d5-ed1bbf7f8e98 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.097316 Oct 16 01:07:10.575616 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 909/1698] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:10 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:10.614818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4637f7d8-1c4d-44e9-8888-0a8d6f7c413b req-aafa4ee4-8521-4032-ad71-d8636b4b454a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e", "name": "network-vif-deleted", "tag": "b8782224-70e0-4ab1-8247-575f68f8e9c0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:10.661552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4637f7d8-1c4d-44e9-8888-0a8d6f7c413b req-aafa4ee4-8521-4032-ad71-d8636b4b454a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:10.664891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4637f7d8-1c4d-44e9-8888-0a8d6f7c413b req-aafa4ee4-8521-4032-ad71-d8636b4b454a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:10.667543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4637f7d8-1c4d-44e9-8888-0a8d6f7c413b req-aafa4ee4-8521-4032-ad71-d8636b4b454a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:10.721507 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4637f7d8-1c4d-44e9-8888-0a8d6f7c413b req-aafa4ee4-8521-4032-ad71-d8636b4b454a service nova] Creating event network-vif-deleted:b8782224-70e0-4ab1-8247-575f68f8e9c0 for instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e on n-h1-master-1 Oct 16 01:07:10.741251 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4637f7d8-1c4d-44e9-8888-0a8d6f7c413b req-aafa4ee4-8521-4032-ad71-d8636b4b454a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163330 Oct 16 01:07:10.745351 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 910/1699] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:10.767890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:10.775227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:10.797599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:10.798437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:10.799309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:10.801921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:10.802661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:10.807627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:11.845211 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:11.877794 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:12.377583 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=12 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:12.605733 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a33069b-4127-4d90-8e19-f2cfa981400c tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1812 microversion: 2.1 time: 1.856602 Oct 16 01:07:12.636308 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 911/1700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:10 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1812 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:12.641869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:12.677368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:12.708064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:12.724373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:12.725094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:12.726030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:12.729837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:12.730469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:13.127796 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:13.424254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:13.455317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:13.462854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:13.470981 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3dafbc27-dfa6-4165-a6d8-5130973c2706 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1266 microversion: 2.25 time: 0.831516 Oct 16 01:07:13.494640 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 912/1701] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:12 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1266 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:13.508061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-891ae4ac-11d1-45ea-b24f-935be488515b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e0bbaf0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:17.366811 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6190931-54df-485d-a69a-1857faaefb0f tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] 10.222.0.39 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11677 microversion: 2.1 time: 12.138387 Oct 16 01:07:17.382094 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 790/1702] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Oct 16 01:07:05 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11677 bytes in 12155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:07:17.395632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22a46ef3-f0aa-49a6-9cc0-39e2ce25a7da tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:17.420740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a46ef3-f0aa-49a6-9cc0-39e2ce25a7da tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:17.428762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a46ef3-f0aa-49a6-9cc0-39e2ce25a7da tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:17.429325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a46ef3-f0aa-49a6-9cc0-39e2ce25a7da tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:17.435930 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-891ae4ac-11d1-45ea-b24f-935be488515b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 3.939845 Oct 16 01:07:17.437410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a46ef3-f0aa-49a6-9cc0-39e2ce25a7da tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:17.438428 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 913/1703] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:13 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 3943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:17.452012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a46ef3-f0aa-49a6-9cc0-39e2ce25a7da tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:17.452471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a46ef3-f0aa-49a6-9cc0-39e2ce25a7da tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:17.459073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:17.461417 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:17.484573 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=61,nova_api:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:17.495813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:17.496593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:17.497921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:17.503862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:17.508388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:17.509722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:17.575004 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22a46ef3-f0aa-49a6-9cc0-39e2ce25a7da tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.188621 Oct 16 01:07:17.580204 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 791/1704] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:07:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:17.632565 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:17.849313 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:18.017323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:18.032875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:18.035945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:18.049430 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6937295f-3717-4705-a986-faf535271210 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1266 microversion: 2.25 time: 0.608616 Oct 16 01:07:18.052415 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 914/1705] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:17 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1266 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:18.092983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-faaba4aa-bc32-4b6d-851a-d5cee34b198d tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] Calling method '.version_select at 0x7fd64e3be940>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:18.156971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-065e1162-1a44-40fb-ac0f-4c740901ab6a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'create', calling method: .version_select at 0x7fd64e77bb80>, body: {"keypair": {"name": "tempest-keypair-2088659820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0hStTRWMIrSpHM9DVAYna3h2o34IY/Ov3sPzGHv+VSrJXLcB62cjYHpxURNVq4Fk9eHiLf4+P2uPfhEXxy9PvL3ivG2LAqbByRKS+i6e71HrqH2bZUT/mzDdZTv2+uoQ=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:18.183989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-065e1162-1a44-40fb-ac0f-4c740901ab6a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:18.193249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-065e1162-1a44-40fb-ac0f-4c740901ab6a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for user 0c8da9a32cb54d0a87d914234b1e9f40 and project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:18.277322 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-065e1162-1a44-40fb-ac0f-4c740901ab6a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.695953 Oct 16 01:07:18.291307 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 792/1706] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:07:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:18.460036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f518c1c0-d511-4e03-868d-3df9db1853a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e1495e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:18.626427 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f518c1c0-d511-4e03-868d-3df9db1853a8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.170983 Oct 16 01:07:18.633132 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 793/1707] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:18 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:19.083750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:19.084826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:19.107597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:19.115334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:19.117349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:19.124045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:19.124553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:19.127527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:20.112304 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:20.427177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:20.450841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:20.458224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:20.461819 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-042259a5-d964-4393-a355-741344f05552 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1266 microversion: 2.25 time: 1.384325 Oct 16 01:07:20.476137 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 794/1708] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:19 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1266 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:20.503198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-46f94a74-5524-47fc-a0d1-7e134d336572 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e155a60>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:20.668916 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-46f94a74-5524-47fc-a0d1-7e134d336572 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.190128 Oct 16 01:07:20.671199 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 795/1709] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:20 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:21.503928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:21.504720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:21.549380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:21.551319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:21.551997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:21.553523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:21.565447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:21.566091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:21.666292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-faaba4aa-bc32-4b6d-851a-d5cee34b198d tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 3.612588 Oct 16 01:07:21.667993 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 915/1710] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Oct 16 01:07:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 3615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:21.696876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3102a981-6dc1-4309-9083-c1de45a1e4e4 tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] Calling method '.version_select at 0x7fd64e6a1d30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:22.167371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:22.199232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:22.209132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:22.213215 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4ba68e2-cd8c-41f6-b0af-67e1102fb742 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1266 microversion: 2.25 time: 0.716971 Oct 16 01:07:22.218149 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 796/1711] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:21 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1266 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:22.235910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2fe7b4fd-35b1-4eda-9beb-26d1060be0c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64ea9a790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:22.336165 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2fe7b4fd-35b1-4eda-9beb-26d1060be0c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.116075 Oct 16 01:07:22.346651 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 797/1712] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:22 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:23.079898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3102a981-6dc1-4309-9083-c1de45a1e4e4 tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/d31acb47-fe25-4ba3-8adf-bd7469b76613" status: 202 len: 0 microversion: 2.1 time: 1.388620 Oct 16 01:07:23.081348 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 916/1713] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:07:21 2022] DELETE /compute/v2.1/os-security-groups/d31acb47-fe25-4ba3-8adf-bd7469b76613 => generated 0 bytes in 1391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:07:23.090573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8cfc45b-8d81-4c7e-bb03-e6d0ab699b2f tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] Calling method '.version_select at 0x7fd65286f940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:23.272666 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:23.273680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:23.292433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:23.299057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:23.299707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:23.300954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:23.301581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:23.303453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:24.742167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:24.765101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:24.772748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:24.776442 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6d93ec74-59a4-4803-8b4c-a3c588e63372 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 200 len: 1266 microversion: 2.25 time: 1.522613 Oct 16 01:07:24.782307 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 917/1714] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:23 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 1266 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:07:24.793523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1a30e883-63c2-4648-b337-1073dee02fd0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e6a1d30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:25.061760 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1a30e883-63c2-4648-b337-1073dee02fd0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 0.276810 Oct 16 01:07:25.073543 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 918/1715] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:24 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:25.104786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "640f7a33-3b2e-4424-b939-70a79df6fb1e", "device": "/dev/xvdb"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:25.113737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:25.137297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:25.138260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:25.138901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:25.139910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:25.140544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:25.141491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:26.241362 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0cc1e6f1-681e-4aab-b45c-436e5ba21f9a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "POST /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.154619 Oct 16 01:07:26.243998 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 919/1716] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:07:25 2022] POST /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments => generated 194 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:26.278255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1500494935", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd811960-e386-493f-95bb-934b5e94fe90"}], "security_groups": [{"name": "tempest-securitygroup--2094598859"}], "key_name": "tempest-keypair-2088659820", "user_data": "}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:26.435399 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8cfc45b-8d81-4c7e-bb03-e6d0ab699b2f tempest-SecurityGroupsTestAdminJSON-1645644019 tempest-SecurityGroupsTestAdminJSON-1645644019-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e0177fe7-a345-4408-91c6-dbe3162bcad0" status: 202 len: 0 microversion: 2.1 time: 3.349309 Oct 16 01:07:26.440157 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 798/1717] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:07:23 2022] DELETE /compute/v2.1/os-security-groups/e0177fe7-a345-4408-91c6-dbe3162bcad0 => generated 0 bytes in 3355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:07:26.449273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:26.450888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:26.480419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:26.480752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:26.491953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:26.494108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:26.501534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:26.502596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:26.558221 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] HTTP exception thrown: Instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e could not be found. Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Request method failure captured: Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e HTTP/1.1 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ev3eDdMLtrVCKbt5MPCKFEb63IsAX_mPEI-JyytcZ1920sbZb6Ie4y-6aDMF_Fje8d496exfqNfGCIfI-bdM_QLZf0G8mPhweUjUsEaHwtjXTR8fKyHcc2IW_MKdK9hsDKsek_gLJVLXwulIYkUIjGFExbvsStLke0d42QGiAgJYI Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.25 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e9173928e9c94d31b8d2eca240e28d50 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e9173928e9c94d31b8d2eca240e28d50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e9173928e9c94d31b8d2eca240e28d50 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-LiveAutoBlockMigrationV225Test-1624385451-project Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 5f46ddd0268d44bfacff0400e3f38e7e Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451-project Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: exception: Instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e could not be found. Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e'} Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e could not be found. Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e could not be found. Oct 16 01:07:26.566021 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e could not be found. Oct 16 01:07:26.572801 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:26.575733 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Returning 404 to user: Instance bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:07:26.579688 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a0f7e01-7917-487a-b769-30d2100708b8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e" status: 404 len: 111 microversion: 2.25 time: 0.138147 Oct 16 01:07:26.582738 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 799/1718] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:26 2022] GET /compute/v2.1/servers/bdd8d4c4-2cdd-41ee-a9ca-8dc24ec74d0e => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:07:26.601207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f69eb68c-fb77-48ab-aaf2-6fcde69b323c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd6528739d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:27.480512 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:28.231826 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:32.519482 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f69eb68c-fb77-48ab-aaf2-6fcde69b323c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1440 microversion: 2.1 time: 5.934350 Oct 16 01:07:32.521747 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 800/1719] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:26 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1440 bytes in 5938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:32.555559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e6d90351-bd84-4eb5-ba2f-b9a3527081d5 tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] Calling method '.version_select at 0x7fd652873a60>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:32.862736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] validate_networks() for [('dd811960-e386-493f-95bb-934b5e94fe90', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:07:35.804430 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e6d90351-bd84-4eb5-ba2f-b9a3527081d5 tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e47b34de-0ff3-4b06-b0ee-76ecd5947c4d" status: 202 len: 0 microversion: 2.1 time: 3.278809 Oct 16 01:07:35.804430 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 801/1720] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:07:32 2022] DELETE /compute/v2.1/os-security-groups/e47b34de-0ff3-4b06-b0ee-76ecd5947c4d => generated 0 bytes in 3281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:07:35.815563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cb7292e-6966-4dbf-910f-c098fc54ccd8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd652830940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:35.931756 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2cb7292e-6966-4dbf-910f-c098fc54ccd8 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1449 microversion: 2.1 time: 0.123684 Oct 16 01:07:35.946030 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 802/1721] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:35 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:35.960758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4b2b5ec-742f-452e-9f01-372b424a2361 tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] Calling method '.version_select at 0x7fd652876670>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:36.208964 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:36.464306 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:36.530698 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=16 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:36.851770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:07:36.852204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:07:36.852679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:07:36.853089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:07:36.853502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:07:36.885205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:36.885205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:36.885205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:36.885816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:36.886277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:36.886703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:36.986509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:37.013519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for user 0c8da9a32cb54d0a87d914234b1e9f40 and project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:37.114707 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:07:37.128767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:07:37.195269 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4b2b5ec-742f-452e-9f01-372b424a2361 tempest-SecurityGroupsTestAdminJSON-877375279 tempest-SecurityGroupsTestAdminJSON-877375279-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/60ec5fdc-7946-4f27-a853-6c859008c644" status: 202 len: 0 microversion: 2.1 time: 1.245811 Oct 16 01:07:37.195948 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 803/1722] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:07:35 2022] DELETE /compute/v2.1/os-security-groups/60ec5fdc-7946-4f27-a853-6c859008c644 => generated 0 bytes in 1249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:07:37.203544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f18bcba7-0e42-45e4-92de-c49ab7f2bac5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd652830a60>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:37.375467 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f18bcba7-0e42-45e4-92de-c49ab7f2bac5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 200 len: 1449 microversion: 2.1 time: 0.177866 Oct 16 01:07:37.377680 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8b435af-83f3-42a5-a200-21e8cacdc72b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 11.129444 Oct 16 01:07:37.380794 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 804/1723] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:07:37 2022] GET /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 1449 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:37.394725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3e8b5ae0-1ec5-4936-917b-2ee3ef12d215 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:37.400853 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 920/1724] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:07:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 11156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:07:37.402796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3e8b5ae0-1ec5-4936-917b-2ee3ef12d215 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:37.434206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45287ce6-dbb3-4082-b148-882fb6333bca tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e08ff70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:37.523879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e8b5ae0-1ec5-4936-917b-2ee3ef12d215 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:37.535270 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3e8b5ae0-1ec5-4936-917b-2ee3ef12d215 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1239 microversion: 2.1 time: 0.147283 Oct 16 01:07:37.536575 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 805/1725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:37 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1239 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:38.627667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4f1f2f0a-43d2-4b76-8e0b-4f5cfcb7829a tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Action: 'create', calling method: .version_select at 0x7fd64ea9aaf0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:38.708591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4f1f2f0a-43d2-4b76-8e0b-4f5cfcb7829a tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Getting quotas for project 7777fe2afdda4571bf43cee54828d89a. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:38.744867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4f1f2f0a-43d2-4b76-8e0b-4f5cfcb7829a tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Getting quotas for user 0fcaf607c2ef4e64bb227622907dbfc5 and project 7777fe2afdda4571bf43cee54828d89a. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:38.929418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4f1f2f0a-43d2-4b76-8e0b-4f5cfcb7829a tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Getting quotas for project 7777fe2afdda4571bf43cee54828d89a. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:38.967656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4f1f2f0a-43d2-4b76-8e0b-4f5cfcb7829a tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Getting quotas for user 0fcaf607c2ef4e64bb227622907dbfc5 and project 7777fe2afdda4571bf43cee54828d89a. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:39.040565 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4f1f2f0a-43d2-4b76-8e0b-4f5cfcb7829a tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.502522 Oct 16 01:07:39.082073 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 806/1726] 10.222.0.39 () {62 vars in 1214 bytes} [Sun Oct 16 01:07:37 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:07:39.119381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:39.131780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:39.179193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:39.181964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:39.182988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:39.185213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:39.189548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:39.190359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:39.294273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:07:39.626273 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f33f7908-4a91-4214-8a94-ba628ae4d5e2 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "DELETE /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 204 len: 0 microversion: 2.25 time: 0.530584 Oct 16 01:07:39.629948 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 807/1727] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:07:39 2022] DELETE /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:07:39.661368 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:39.669866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:39.715289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:39.716518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:39.717250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:39.718205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:39.719081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:39.719751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:40.032579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:40.043555 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-63000e1e-91d4-4957-94b7-9808d3b8f6f0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1235 microversion: 2.1 time: 0.409088 Oct 16 01:07:40.044240 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 808/1728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:39 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1235 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:40.066392 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1069fff2-51d6-4d48-85a7-dc0f81e52f60 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:40.120160 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1069fff2-51d6-4d48-85a7-dc0f81e52f60 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.059285 Oct 16 01:07:40.123341 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 809/1729] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Oct 16 01:07:40 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:07:40.138119 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45287ce6-dbb3-4082-b148-882fb6333bca tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 204 len: 0 microversion: 2.1 time: 2.736085 Oct 16 01:07:40.139358 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 921/1730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:37 2022] DELETE /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 0 bytes in 2738 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:07:40.158963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:40.161878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:40.170963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:40.179629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:40.180406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:40.181671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:40.182597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:40.190598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:40.352219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1842061588", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "eed7ef3e-72df-4c1d-bb4a-7b70fc585bb7"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:40.496216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] validate_networks() for [('eed7ef3e-72df-4c1d-bb4a-7b70fc585bb7', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:07:40.632682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:40.652340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:40.654485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:40.659170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be5f56ee-1329-4ef5-a8fc-bf46147cf2a3 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1730 microversion: 2.25 time: 0.525767 Oct 16 01:07:40.659985 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 810/1731] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:40 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1730 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:40.669359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1fbc8a4b-bd73-4d59-9cbc-968268a27029 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:40.731415 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1fbc8a4b-bd73-4d59-9cbc-968268a27029 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/22ff8d6c-2c80-401a-aa8c-2d79b876dffe" status: 200 len: 235 microversion: 2.64 time: 0.068685 Oct 16 01:07:40.743683 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 811/1732] 10.222.0.39 () {60 vars in 1304 bytes} [Sun Oct 16 01:07:40 2022] GET /compute/v2.1/os-server-groups/22ff8d6c-2c80-401a-aa8c-2d79b876dffe => generated 235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:07:40.756554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:40.757583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:40.784838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:40.786676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:40.788264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:40.790807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:40.794275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:40.796433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:40.880451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:07:41.105144 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1f3ceac2-7f66-4988-bd81-85064aaad2c7 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 204 len: 0 microversion: 2.1 time: 0.357270 Oct 16 01:07:41.109570 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 812/1733] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:07:40 2022] DELETE /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:07:41.159179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a24475c7-498a-40a8-8c28-89710376c57d tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:41.301219 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a24475c7-498a-40a8-8c28-89710376c57d tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/22ff8d6c-2c80-401a-aa8c-2d79b876dffe" status: 204 len: 0 microversion: 2.64 time: 0.179718 Oct 16 01:07:41.308942 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 813/1734] 10.222.0.39 () {60 vars in 1307 bytes} [Sun Oct 16 01:07:41 2022] DELETE /compute/v2.1/os-server-groups/22ff8d6c-2c80-401a-aa8c-2d79b876dffe => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:07:41.324001 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:41.325058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:41.346869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:41.347796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:41.351488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:41.356254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:41.357895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:41.359194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:41.785464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:41.798269 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-00ac934c-b7da-4c30-bc81-2a51afb18d29 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1297 microversion: 2.1 time: 0.486497 Oct 16 01:07:41.802342 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 814/1735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:41 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1297 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:41.816709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-47d126a7-b50e-40df-b63a-a1fd213c15e1 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:41.830375 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-47d126a7-b50e-40df-b63a-a1fd213c15e1 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] HTTP exception thrown: Instance group 22ff8d6c-2c80-401a-aa8c-2d79b876dffe could not be found. Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-47d126a7-b50e-40df-b63a-a1fd213c15e1 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Request method failure captured: Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/os-server-groups/22ff8d6c-2c80-401a-aa8c-2d79b876dffe HTTP/1.1 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1lZ3LskSbV4-fw4bayChxHGgJzVESLxo77x1R7gRGL1P-SN6hegX6AH9ZDqOTfhCb-Ji0tG9x_smwdlPJEVnWCHds-Emyv49Jj9n0QZSUPFjTBKgmPfLNFfZFsAoVKB3sBYlJP1p-YBm1eeF-_XJfoTLtUPF6FuoMoU8dy6UsYnGfI Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.64 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 7777fe2afdda4571bf43cee54828d89a Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerGroup264TestJSON-1444633699 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7777fe2afdda4571bf43cee54828d89a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7777fe2afdda4571bf43cee54828d89a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7777fe2afdda4571bf43cee54828d89a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7777fe2afdda4571bf43cee54828d89a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerGroup264TestJSON-1444633699 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 7777fe2afdda4571bf43cee54828d89a Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1444633699 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerGroup264TestJSON-1444633699-project Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 0fcaf607c2ef4e64bb227622907dbfc5 Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerGroup264TestJSON-1444633699-project Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: exception: Instance group 22ff8d6c-2c80-401a-aa8c-2d79b876dffe could not be found. Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '22ff8d6c-2c80-401a-aa8c-2d79b876dffe'} Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 22ff8d6c-2c80-401a-aa8c-2d79b876dffe could not be found. Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 22ff8d6c-2c80-401a-aa8c-2d79b876dffe could not be found. Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:41.840970 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:41.846626 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:41.846626 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:41.846626 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:07:41.846626 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:07:41.846626 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 22ff8d6c-2c80-401a-aa8c-2d79b876dffe could not be found. Oct 16 01:07:41.846626 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:07:41.848043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-47d126a7-b50e-40df-b63a-a1fd213c15e1 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] Returning 404 to user: Instance group 22ff8d6c-2c80-401a-aa8c-2d79b876dffe could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:07:41.849076 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-47d126a7-b50e-40df-b63a-a1fd213c15e1 tempest-ServerGroup264TestJSON-1444633699 tempest-ServerGroup264TestJSON-1444633699-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/22ff8d6c-2c80-401a-aa8c-2d79b876dffe" status: 404 len: 117 microversion: 2.64 time: 0.045022 Oct 16 01:07:41.850849 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 815/1736] 10.222.0.39 () {60 vars in 1307 bytes} [Sun Oct 16 01:07:41 2022] DELETE /compute/v2.1/os-server-groups/22ff8d6c-2c80-401a-aa8c-2d79b876dffe => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:07:41.859046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1362274670", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "ba2039d4-7a1a-4c70-b987-1dd870ff50d7"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:41.993242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] validate_networks() for [('ba2039d4-7a1a-4c70-b987-1dd870ff50d7', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:07:42.163349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:07:42.163815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:07:42.164227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:07:42.164822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:07:42.165243 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:07:42.206337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:42.210563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:42.221398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:42.226829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:42.228086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:42.230061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:42.325429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Getting quotas for project e26830af72bd451a97abc960c77b2e84. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:42.338231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Getting quotas for user 4659517918be43da927a7f465efe0143 and project e26830af72bd451a97abc960c77b2e84. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:42.409547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:07:42.422623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:07:42.619905 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05a969cb-3aeb-43a6-a2a2-d30d7893232e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.471813 Oct 16 01:07:42.628166 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 922/1737] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:07:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:07:42.642781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-7b6c24d7-8667-4bae-8367-c7d04f05b587 req-36ef546f-7d83-443e-819f-0bb46022b2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6612f5c-0f92-4cc2-8fcd-083e8b2b4892", "name": "network-vif-unplugged", "status": "completed", "tag": "ae024ce0-ed0d-458b-9286-03065d260103"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:42.689526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7b6c24d7-8667-4bae-8367-c7d04f05b587 req-36ef546f-7d83-443e-819f-0bb46022b2d9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:42.691855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7b6c24d7-8667-4bae-8367-c7d04f05b587 req-36ef546f-7d83-443e-819f-0bb46022b2d9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:42.692600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7b6c24d7-8667-4bae-8367-c7d04f05b587 req-36ef546f-7d83-443e-819f-0bb46022b2d9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:42.726880 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-7b6c24d7-8667-4bae-8367-c7d04f05b587 req-36ef546f-7d83-443e-819f-0bb46022b2d9 service nova] Creating event network-vif-unplugged:ae024ce0-ed0d-458b-9286-03065d260103 for instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 on n-h2-master-1 Oct 16 01:07:42.754848 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-7b6c24d7-8667-4bae-8367-c7d04f05b587 req-36ef546f-7d83-443e-819f-0bb46022b2d9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125165 Oct 16 01:07:42.755534 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 923/1738] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:42.778536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:42.778766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:42.803460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:42.805418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:42.805861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:42.806599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:42.807095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:42.807517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:43.421857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:43.443900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:43.449891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:43.455063 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abf5dc48-3071-4d7e-91cb-228f2fa1d1f8 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1663 microversion: 2.25 time: 0.695055 Oct 16 01:07:43.459672 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 924/1739] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:42 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1663 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:43.486253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd5b89c6-dd56-4c24-a0c4-7963c2c5429c tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:43.489537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd5b89c6-dd56-4c24-a0c4-7963c2c5429c tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:43.641782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:07:43.642321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:07:43.642874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:07:43.643418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:07:43.643933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:07:43.665454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:43.675282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:43.676044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:43.678163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:43.680656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:43.681885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:43.757231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:43.780116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for user 875dca9ed4914e379601ddbdba035cb2 and project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:43.827861 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:07:43.830739 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:07:43.856576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd5b89c6-dd56-4c24-a0c4-7963c2c5429c tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:43.886756 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd5b89c6-dd56-4c24-a0c4-7963c2c5429c tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1217 microversion: 2.1 time: 0.419311 Oct 16 01:07:43.887999 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 925/1740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:43 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1217 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:43.893805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:43.894649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:43.901488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:43.902186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:43.903234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:43.904325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:43.905158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:43.905755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:44.004315 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b0958dfb-a9bf-44b8-9854-56fde9c64bb2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.146874 Oct 16 01:07:44.015428 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 816/1741] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:07:44.030282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-69eb9400-0af0-4f76-88f7-8ab5daf74718 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:44.030505 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-69eb9400-0af0-4f76-88f7-8ab5daf74718 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:44.428384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:44.441262 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0406246-97d1-4b4b-8c95-183b29ef9120 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1297 microversion: 2.1 time: 0.551857 Oct 16 01:07:44.442206 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 926/1742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:43 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1297 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:44.486797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:44.491611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:44.510006 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-69eb9400-0af0-4f76-88f7-8ab5daf74718 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:44.518757 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-69eb9400-0af0-4f76-88f7-8ab5daf74718 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1208 microversion: 2.1 time: 0.501631 Oct 16 01:07:44.525321 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 817/1743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:44 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1208 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:44.539369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:44.539369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:44.539369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:44.539825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:44.541324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:44.541324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:44.792897 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:44.802082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:44.815769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:44.819498 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe145dc6-e247-4731-83ec-9a1bab381843 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1663 microversion: 2.25 time: 0.337518 Oct 16 01:07:44.825184 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 927/1744] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:44 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1663 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:44.916634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:44.917310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:44.952151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:44.952644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:44.957298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:44.959769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:44.962767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:44.965966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:45.227855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:45.248346 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1c4e6ae-d2bd-422f-984a-035b38d8ae25 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1269 microversion: 2.1 time: 0.336239 Oct 16 01:07:45.257525 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 818/1745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:44 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1269 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:45.478486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:45.479886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:45.495612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:45.504903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:45.507765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:45.508791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:45.513125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:45.513858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:45.551259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcb563ae-ddff-4244-9d7a-5ff5576023aa tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:45.551887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bcb563ae-ddff-4244-9d7a-5ff5576023aa tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:45.834029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:45.852558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bcb563ae-ddff-4244-9d7a-5ff5576023aa tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:45.898635 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f07a2587-bcda-4d50-83ba-51ff9844a300 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1297 microversion: 2.1 time: 0.433270 Oct 16 01:07:45.904929 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 928/1746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:45 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1297 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:45.930660 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bcb563ae-ddff-4244-9d7a-5ff5576023aa tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1208 microversion: 2.1 time: 0.382436 Oct 16 01:07:45.963311 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 819/1747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:45 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1208 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:45.988493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:45.989141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:46.015753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.016306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.022893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.023630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.024105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.029009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.286768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:46.287555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:46.314945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.315875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.317882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.320441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.325194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.327233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.649263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:46.654341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:46.669891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:46.680295 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9871c259-144d-4912-b428-c73ea5544172 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1275 microversion: 2.1 time: 0.398766 Oct 16 01:07:46.683025 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 820/1748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:46 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1275 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:46.685865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:46.688074 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3802b93f-6371-4b39-9fad-f523756054bd tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 200 len: 1663 microversion: 2.25 time: 0.755211 Oct 16 01:07:46.703993 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 929/1749] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:45 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 1663 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:46.724249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f913655d-b38e-4cc6-ae2c-74854c598a73 req-b736a57f-74e0-4cce-9f08-57b90d9683c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981200a2-5a9d-469f-9f65-ad75dbe1b422", "name": "network-vif-deleted", "tag": "f0442b98-20e1-4888-8035-39c00f3965ce"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:46.758096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f913655d-b38e-4cc6-ae2c-74854c598a73 req-b736a57f-74e0-4cce-9f08-57b90d9683c5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.763254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f913655d-b38e-4cc6-ae2c-74854c598a73 req-b736a57f-74e0-4cce-9f08-57b90d9683c5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.763734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f913655d-b38e-4cc6-ae2c-74854c598a73 req-b736a57f-74e0-4cce-9f08-57b90d9683c5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.795523 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f913655d-b38e-4cc6-ae2c-74854c598a73 req-b736a57f-74e0-4cce-9f08-57b90d9683c5 service nova] Creating event network-vif-deleted:f0442b98-20e1-4888-8035-39c00f3965ce for instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 on n-h1-master-1 Oct 16 01:07:46.811449 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f913655d-b38e-4cc6-ae2c-74854c598a73 req-b736a57f-74e0-4cce-9f08-57b90d9683c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125779 Oct 16 01:07:46.812118 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 821/1750] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:46.930569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:46.931509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:46.943814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.949453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.951241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.953738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.967687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:46.969479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:46.972715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:46.974391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:46.985817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:46.999562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:47.000696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:47.001610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:47.002076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:47.002510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:47.709832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:47.717993 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-43c2047a-7630-4294-940e-3bda3d8cc899 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1260 microversion: 2.1 time: 0.754889 Oct 16 01:07:47.731618 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 822/1751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:46 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1260 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:47.891941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:47.900194 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b8a7483-c0c6-42a3-b89e-b5223edb11ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1365 microversion: 2.1 time: 0.974799 Oct 16 01:07:47.909675 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 930/1752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:46 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1365 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:47.930739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:47.932655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:47.933363 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:47.983066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:47.987214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:47.992035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:47.999026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:48.001053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:48.001533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:48.129144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-711538070", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:48.158893 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:48.219341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:07:48.831921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:48.844753 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd17895d-3449-4692-968d-47303164309e tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1275 microversion: 2.1 time: 0.933887 Oct 16 01:07:48.863291 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 931/1753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:47 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1275 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:48.869202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:48.870167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: 981200a2-5a9d-469f-9f65-ad75dbe1b422] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:48.888659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:48.890309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:48.891431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:48.894969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:48.896440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:48.900827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:48.939362 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] HTTP exception thrown: Instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 could not be found. Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Request method failure captured: Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 HTTP/1.1 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ev3eDdMLtrVCKbt5MPCKFEb63IsAX_mPEI-JyytcZ1920sbZb6Ie4y-6aDMF_Fje8d496exfqNfGCIfI-bdM_QLZf0G8mPhweUjUsEaHwtjXTR8fKyHcc2IW_MKdK9hsDKsek_gLJVLXwulIYkUIjGFExbvsStLke0d42QGiAgJYI Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.25 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e9173928e9c94d31b8d2eca240e28d50 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e9173928e9c94d31b8d2eca240e28d50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e9173928e9c94d31b8d2eca240e28d50 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-LiveAutoBlockMigrationV225Test-1624385451-project Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 5f46ddd0268d44bfacff0400e3f38e7e Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451-project Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 could not be found. Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '981200a2-5a9d-469f-9f65-ad75dbe1b422'} Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 could not be found. Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 could not be found. Oct 16 01:07:48.945972 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 could not be found. Oct 16 01:07:48.952236 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:07:48.955426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Returning 404 to user: Instance 981200a2-5a9d-469f-9f65-ad75dbe1b422 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:07:48.957514 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-59319bd4-e542-48ca-8dd7-ae5b34e28a86 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422" status: 404 len: 111 microversion: 2.25 time: 0.102839 Oct 16 01:07:48.960905 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 932/1754] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:48 2022] GET /compute/v2.1/servers/981200a2-5a9d-469f-9f65-ad75dbe1b422 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:07:48.967160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:48.968060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:48.976560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:48.977255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:48.978192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:48.979101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:48.979728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:48.980326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:49.273255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:49.289053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b693b413-00db-47dd-a889-ef752f5d0b7a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1266 microversion: 2.1 time: 0.325625 Oct 16 01:07:49.289944 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 933/1755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:48 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:49.323188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:49.325576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:49.340621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:49.345008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:49.346459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:49.354231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:49.356371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:49.357192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:49.467241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:07:49.468405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:07:49.469140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:07:49.469761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:07:49.470365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:07:49.490267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:49.497218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:49.497913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:49.500556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:49.501439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:49.507851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:49.543196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:07:49.554376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:07:49.569801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:07:49.572751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:07:49.659973 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f1b98823-6e10-41ba-981d-89ab7ed1668b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925038 Oct 16 01:07:49.661261 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 823/1756] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:07:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:07:49.670861 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80634fac-7d64-46af-a748-7d87c0a21dac tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '.version_select at 0x7fd65282e1f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:49.721081 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80634fac-7d64-46af-a748-7d87c0a21dac tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702599486" status: 204 len: 0 microversion: 2.25 time: 0.058545 Oct 16 01:07:49.724688 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 824/1757] 10.222.0.39 () {60 vars in 1259 bytes} [Sun Oct 16 01:07:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702599486 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:07:49.745303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c4123a00-4e4c-4c30-8370-25151732b82d req-b5f945f7-eacf-4156-9448-649c4e6dd81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6612f5c-0f92-4cc2-8fcd-083e8b2b4892", "name": "network-vif-deleted", "tag": "ae024ce0-ed0d-458b-9286-03065d260103"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:49.776717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c4123a00-4e4c-4c30-8370-25151732b82d req-b5f945f7-eacf-4156-9448-649c4e6dd81b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:49.777190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c4123a00-4e4c-4c30-8370-25151732b82d req-b5f945f7-eacf-4156-9448-649c4e6dd81b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:49.777621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c4123a00-4e4c-4c30-8370-25151732b82d req-b5f945f7-eacf-4156-9448-649c4e6dd81b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:49.799467 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c4123a00-4e4c-4c30-8370-25151732b82d req-b5f945f7-eacf-4156-9448-649c4e6dd81b service nova] Creating event network-vif-deleted:ae024ce0-ed0d-458b-9286-03065d260103 for instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 on n-h2-master-1 Oct 16 01:07:49.815018 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c4123a00-4e4c-4c30-8370-25151732b82d req-b5f945f7-eacf-4156-9448-649c4e6dd81b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088481 Oct 16 01:07:49.815638 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 825/1758] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:49.842420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-984ad57c-5b29-4cfc-a6bc-104a5c7c9177 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:49.843527 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-984ad57c-5b29-4cfc-a6bc-104a5c7c9177 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:50.220683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-984ad57c-5b29-4cfc-a6bc-104a5c7c9177 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:50.229563 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-984ad57c-5b29-4cfc-a6bc-104a5c7c9177 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1216 microversion: 2.1 time: 0.412449 Oct 16 01:07:50.232939 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 826/1759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:49 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1216 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:50.244125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:50.244745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:50.268163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:50.268748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:50.269198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:50.269931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:50.272077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:50.272686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:50.432156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:50.446460 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3839ca83-9579-4201-9b6f-c44a2ddfe8a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1365 microversion: 2.1 time: 1.131201 Oct 16 01:07:50.449375 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 934/1760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:49 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1365 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:50.464613 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:50.465560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:50.489736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:50.492836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:50.495409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:50.500641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:50.501543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:50.504275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:50.880773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:50.901322 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9c9cd13b-5a56-4260-adc0-c87dbcc940a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1266 microversion: 2.1 time: 0.450455 Oct 16 01:07:50.905917 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 935/1761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:50 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1266 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:51.256910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:51.259412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:51.288970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:51.296801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:51.298732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:51.299726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:51.302395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:51.304160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:51.304442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:51.318889 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c5ff7b4-e453-4f46-87ec-ac51e7bd0ede tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1317 microversion: 2.1 time: 1.082372 Oct 16 01:07:51.320595 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 827/1762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:50 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1317 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:51.483483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:51.484475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:51.497504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:51.498191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:51.498590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:51.499322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:51.500498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:51.506620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:51.710488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:51.737185 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac200037-edc3-4c5e-95de-317385adcfea tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1212 microversion: 2.1 time: 0.481552 Oct 16 01:07:51.738854 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 936/1763] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:51 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1212 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:51.932847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:51.933580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:51.951721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:51.954368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:51.961514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:51.964228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:51.965649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:51.966976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:52.272767 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:52.878080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:52.890306 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1823796-95a8-459a-96c6-d3077f93fcad tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1365 microversion: 2.1 time: 1.410501 Oct 16 01:07:52.908975 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 828/1764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:51 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1365 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:52.915306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:52.916141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:52.917744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:52.926095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:52.926770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:52.927242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:52.927959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:52.928467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:52.928893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:52.932698 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-07e7075b-467d-468a-9483-53f6def3f2ee tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1308 microversion: 2.1 time: 1.002267 Oct 16 01:07:52.933350 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 937/1765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:51 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1308 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:52.953943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:52.954648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:52.975388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:52.976216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:52.982162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:52.983325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:52.983989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:52.984719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:53.250509 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e02ca2f5-e8ea-42f7-b4fa-3463ebad83a3 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1858 microversion: 2.1 time: 0.338513 Oct 16 01:07:53.252621 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 829/1766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:52 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1858 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:53.270478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:53.271121 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:53.295195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:53.295697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:53.296136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:53.297524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:53.317756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:53.318424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:53.539746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:53.547910 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:53.554297 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2fcf060-56a0-450f-a4f7-1db47357c1ee tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1274 microversion: 2.1 time: 0.297139 Oct 16 01:07:53.556034 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 830/1767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:53 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1274 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:53.583046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:53.586006 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:53.601053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:53.601688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:53.604109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:53.604858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:53.605337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:53.605754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:53.623438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:53.638499 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58d00034-0ea2-4e0c-9202-210980df8d6f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1317 microversion: 2.1 time: 0.699739 Oct 16 01:07:53.639509 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 938/1768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:52 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:53.657875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-66a9f228-33c6-4aab-939a-6eca62fa5b85 req-8f63e14f-607c-4554-b3ff-61b890690bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:53.691428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lazy-loading 'flavor' on Instance uuid ebfbc75a-8d3f-4561-b380-95d95f9c23fe {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:07:53.693139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-66a9f228-33c6-4aab-939a-6eca62fa5b85 req-8f63e14f-607c-4554-b3ff-61b890690bf8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:53.696648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-66a9f228-33c6-4aab-939a-6eca62fa5b85 req-8f63e14f-607c-4554-b3ff-61b890690bf8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:53.697966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-66a9f228-33c6-4aab-939a-6eca62fa5b85 req-8f63e14f-607c-4554-b3ff-61b890690bf8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:53.713465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Going to try to live migrate instance to n-h2-master-1 {{(pid=120546) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:07:53.727525 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-66a9f228-33c6-4aab-939a-6eca62fa5b85 req-8f63e14f-607c-4554-b3ff-61b890690bf8 service nova] Creating event network-changed:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:07:53.744801 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-66a9f228-33c6-4aab-939a-6eca62fa5b85 req-8f63e14f-607c-4554-b3ff-61b890690bf8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103828 Oct 16 01:07:53.750140 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 939/1769] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:53.917263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:53.918213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:53.929951 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=14 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:53.933566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:53.935425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:53.937353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:53.938698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:53.939225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:53.939657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:54.403292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:54.417657 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f96a515c-3ae2-4457-b139-6949d519c6c6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1365 microversion: 2.1 time: 0.501366 Oct 16 01:07:54.418559 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 940/1770] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:53 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1365 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:07:54.440604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:54.441542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:54.448028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:54.448787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:54.449383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:54.450254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:54.450961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:54.451580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.215195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:55.221741 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:55.224093 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d91cace-1377-427f-b0ba-16b39f3ff58a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1308 microversion: 2.1 time: 0.791831 Oct 16 01:07:55.241974 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 941/1771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:54 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1308 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:55.241974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:55.241974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:55.261054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:55.261671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:55.262195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.263584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:55.264128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:55.264631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.384139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:55.392495 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-14344d5f-8519-4740-bbb8-c6231da752ac tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1274 microversion: 2.1 time: 0.158242 Oct 16 01:07:55.398255 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 942/1772] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:55 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:55.407906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:55.409459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:55.420984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:55.421614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:55.423270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.424048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:55.425345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:55.426123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.865767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:55.887381 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e9393a52-8e60-4197-911f-72e5162e728a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1317 microversion: 2.1 time: 0.481399 Oct 16 01:07:55.888020 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 943/1773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:55 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:55.907337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:55.908010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:55.924653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:55.925152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:55.926182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.926894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:55.927405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:55.927900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:55.999294 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:07:56.190878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-66d6a726-5365-40de-8c4a-593b26360d40 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "DELETE /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 204 len: 0 microversion: 2.25 time: 0.298226 Oct 16 01:07:56.191737 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 944/1774] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:07:55 2022] DELETE /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:07:56.207262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-121d7d80-5e67-4ddc-81e4-5f82464cefaa req-f80bd8db-642c-404c-b048-5c6675f460e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9503402-a817-49f4-82fa-f213c8159edc", "tag": "51fed29d-d895-44b3-a5d6-9ba0dc45a746"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:56.223338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-121d7d80-5e67-4ddc-81e4-5f82464cefaa req-f80bd8db-642c-404c-b048-5c6675f460e2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:56.224022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-121d7d80-5e67-4ddc-81e4-5f82464cefaa req-f80bd8db-642c-404c-b048-5c6675f460e2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:56.224226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-121d7d80-5e67-4ddc-81e4-5f82464cefaa req-f80bd8db-642c-404c-b048-5c6675f460e2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:56.260216 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-121d7d80-5e67-4ddc-81e4-5f82464cefaa req-f80bd8db-642c-404c-b048-5c6675f460e2 service nova] Creating event network-changed:51fed29d-d895-44b3-a5d6-9ba0dc45a746 for instance a9503402-a817-49f4-82fa-f213c8159edc on n-h1-master-1 Oct 16 01:07:56.270336 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-121d7d80-5e67-4ddc-81e4-5f82464cefaa req-f80bd8db-642c-404c-b048-5c6675f460e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073466 Oct 16 01:07:56.271610 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 945/1775] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:56.291032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:56.292245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:56.302963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:56.309131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:56.309871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:56.310867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:56.311541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:56.312157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:56.528173 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-83353e8e-0d6f-4796-b779-63fb1eeb5ca7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/action" status: 202 len: 0 microversion: 2.1 time: 2.967587 Oct 16 01:07:56.529481 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 831/1776] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:07:53 2022] POST /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/action => generated 0 bytes in 2970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:07:56.536915 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-4a00d794-ca71-4906-b18d-4a3163a237ea req-8fbb3ed0-8432-4f0b-ac35-5db62efc918d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c87038-bf55-4f6d-96af-cbb68dfbf4f3", "tag": "17566a67-86b0-4f6b-b24f-5504af254705"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:56.585534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4a00d794-ca71-4906-b18d-4a3163a237ea req-8fbb3ed0-8432-4f0b-ac35-5db62efc918d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:56.591709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4a00d794-ca71-4906-b18d-4a3163a237ea req-8fbb3ed0-8432-4f0b-ac35-5db62efc918d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:56.594973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4a00d794-ca71-4906-b18d-4a3163a237ea req-8fbb3ed0-8432-4f0b-ac35-5db62efc918d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:56.671494 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-4a00d794-ca71-4906-b18d-4a3163a237ea req-8fbb3ed0-8432-4f0b-ac35-5db62efc918d service nova] Creating event network-changed:17566a67-86b0-4f6b-b24f-5504af254705 for instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 on n-h1-master-1 Oct 16 01:07:56.679949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-4a00d794-ca71-4906-b18d-4a3163a237ea req-8fbb3ed0-8432-4f0b-ac35-5db62efc918d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148538 Oct 16 01:07:56.683570 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 832/1777] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:56.690119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:56.691300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:56.710844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:56.714581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:56.782681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.066s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:56.791384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:56.791987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:56.792452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:57.229312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:57.252003 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd8cdebd-e640-4619-b6be-4540fb488dfb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1365 microversion: 2.1 time: 0.978584 Oct 16 01:07:57.255953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 946/1778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:56 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1365 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:57.276375 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:57.277613 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:57.302178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:57.307489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:57.308485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:57.309908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:57.310882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:57.311838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:57.560176 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:57.594002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:57.603426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:57.605710 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5e584982-6878-4adb-9af3-7d323941a8f9 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1548 microversion: 2.25 time: 0.920175 Oct 16 01:07:57.607172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 833/1779] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:56 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1548 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:57.627892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:57.629380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:57.649094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:57.652130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:57.652594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:57.656166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:57.657247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:57.657687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:58.192005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:58.223920 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d26fb4c-eb22-4c26-84fb-aa30a152a1f1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1308 microversion: 2.1 time: 0.961506 Oct 16 01:07:58.225707 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 947/1780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:57 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1308 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:58.235108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:58.237353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:58.247840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:58.249470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:58.251093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:58.252602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:58.254306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:58.255583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:58.534852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:58.564520 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-91e9edff-c7e7-48be-b257-9d0759b612aa tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1316 microversion: 2.1 time: 0.955822 Oct 16 01:07:58.567989 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 834/1781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:57 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1316 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:58.582779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:58.583607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:58.590703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:58.591749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:58.592297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:58.593360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:58.594271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:58.595047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.052021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:59.065406 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f641683-12ca-456d-889b-193862507579 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.837627 Oct 16 01:07:59.067256 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 948/1782] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:58 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:59.094828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:59.101220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:59.114679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.118093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.119510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.120370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.122265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.124584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.447394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:59.467728 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-84e1de78-fb31-4508-a923-42a98e915ee3 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1317 microversion: 2.1 time: 0.893612 Oct 16 01:07:59.470355 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 835/1783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:58 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1317 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:59.486611 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:59.487291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:59.493912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.494417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.494863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.495625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.496089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.496518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.526134 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:59.771582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:59.792116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:59.793669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:59.794870 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d22ada07-f29d-4bfc-897e-7a5021cd5b1c tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1548 microversion: 2.25 time: 0.321673 Oct 16 01:07:59.795637 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 836/1784] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:07:59 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1548 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:07:59.814766 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:59.815690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:59.830846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:07:59.831733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.832250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.839078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.839991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.840474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.840903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.842744 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be8e0109-c09a-4eb3-a79e-2fb5042843bf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1365 microversion: 2.1 time: 0.765645 Oct 16 01:07:59.861202 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 949/1785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:59 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1365 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:07:59.874400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6f923bde-35aa-4dcf-8791-d95c7421b232 req-696bd513-7e5b-4682-9461-bf2e93e37044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "name": "network-vif-plugged", "status": "completed", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:07:59.897972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6f923bde-35aa-4dcf-8791-d95c7421b232 req-696bd513-7e5b-4682-9461-bf2e93e37044 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.900664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6f923bde-35aa-4dcf-8791-d95c7421b232 req-696bd513-7e5b-4682-9461-bf2e93e37044 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.901342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6f923bde-35aa-4dcf-8791-d95c7421b232 req-696bd513-7e5b-4682-9461-bf2e93e37044 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.931973 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6f923bde-35aa-4dcf-8791-d95c7421b232 req-696bd513-7e5b-4682-9461-bf2e93e37044 service nova] Creating event network-vif-plugged:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:07:59.940519 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6f923bde-35aa-4dcf-8791-d95c7421b232 req-696bd513-7e5b-4682-9461-bf2e93e37044 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077701 Oct 16 01:07:59.943267 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 950/1786] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:07:59.956502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:07:59.958020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:07:59.973932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.975488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.979139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:07:59.980166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:07:59.981355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:07:59.983306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:00.225752 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=28 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:00.411451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:00.420065 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea7ca097-b335-41c9-930b-a181ba5a39e3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1316 microversion: 2.1 time: 0.475310 Oct 16 01:08:00.436974 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 951/1787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:59 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:00.449627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:00.450900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:00.470398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:00.471320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:00.472016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:00.473003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:00.474048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:00.477934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:00.553434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:00.580718 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85ae143c-0a2f-4942-bd48-1ed9e4a83832 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1308 microversion: 2.1 time: 0.783828 Oct 16 01:08:00.584194 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 837/1788] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:07:59 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1308 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:00.599082 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:00.600000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:00.617280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:00.618430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:00.620084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:00.620865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:00.621360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:00.624863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:00.916640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:00.949671 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-703dd8f0-6c6c-4636-8c48-765ba026583a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.509420 Oct 16 01:08:00.952368 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 952/1789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:00 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:01.009631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:01.018877 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1d7af9b-5d47-4672-acc6-5d5039b6c287 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1317 microversion: 2.1 time: 0.431652 Oct 16 01:08:01.036465 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 838/1790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:00 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:01.042473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2a187f86-058a-495e-a3df-5472d25b8163 req-b471504e-c624-46f3-92f4-3f4db524cc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcd2fd0-7e22-4fd8-8351-40036992c044", "name": "network-vif-deleted", "tag": "999d0092-14b3-4ca8-9e4f-4b440ec19b20"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:01.054051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a187f86-058a-495e-a3df-5472d25b8163 req-b471504e-c624-46f3-92f4-3f4db524cc6a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.054790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a187f86-058a-495e-a3df-5472d25b8163 req-b471504e-c624-46f3-92f4-3f4db524cc6a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.055445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a187f86-058a-495e-a3df-5472d25b8163 req-b471504e-c624-46f3-92f4-3f4db524cc6a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.070812 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2a187f86-058a-495e-a3df-5472d25b8163 req-b471504e-c624-46f3-92f4-3f4db524cc6a service nova] Creating event network-vif-deleted:999d0092-14b3-4ca8-9e4f-4b440ec19b20 for instance efcd2fd0-7e22-4fd8-8351-40036992c044 on n-h1-master-1 Oct 16 01:08:01.076129 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2a187f86-058a-495e-a3df-5472d25b8163 req-b471504e-c624-46f3-92f4-3f4db524cc6a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037994 Oct 16 01:08:01.077407 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 839/1791] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:01.083661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:01.084574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:01.092131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.092828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.094477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.096112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.096843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.097591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.153131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.154052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.154808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.155453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lazy-loading 'fault' on Instance uuid efcd2fd0-7e22-4fd8-8351-40036992c044 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:08:01.218380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:01.228923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:01.230384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:01.231697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64acc0a4-fa45-4910-b84e-5c92f5b47a45 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 200 len: 1351 microversion: 2.25 time: 0.152968 Oct 16 01:08:01.232421 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 840/1792] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:01 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 1351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:01.256755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:01.257670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:01.266277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.266979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.279444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.280686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.282834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.283724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.556256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:01.575616 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aeefa923-32ed-4f8b-9590-3bb7f0036210 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1365 microversion: 2.1 time: 0.329281 Oct 16 01:08:01.576676 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 841/1793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:01 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:01.577363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ee920de-edb6-42d8-8b72-63f4b0a49a62 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Action: 'create', calling method: .version_select at 0x7fd64e02b1f0>, body: {"keypair": {"name": "tempest-keypair-245168964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5KptbMgL4K6laZhi+37iLuovbEIyeNeSFN4UQVrThg3KB4pLnBUt4S/cEPG7Nw6gDZVTcwjkh0yNacJY6lCm5687UYFkNiSNfoOHkWbvdiP1se5cV0LkozG8fQKSgWGQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:01.591504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:01.595136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:01.598330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4ee920de-edb6-42d8-8b72-63f4b0a49a62 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Getting quotas for project 622fb0e0967148838b71b51b4d572d38. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:01.605798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.606545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.607340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.607585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4ee920de-edb6-42d8-8b72-63f4b0a49a62 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Getting quotas for user a745e8bb56574606b709907e661b9cd8 and project 622fb0e0967148838b71b51b4d572d38. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:01.608425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.610253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.611058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.645043 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ee920de-edb6-42d8-8b72-63f4b0a49a62 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.690786 Oct 16 01:08:01.646834 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 953/1794] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:08:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:01.693293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:01.698143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:01.715367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.718054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.721875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.722761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.728568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.729016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.825644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:01.838084 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5dd4030f-bebf-4798-a363-f2e82953cb4b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1316 microversion: 2.1 time: 0.256748 Oct 16 01:08:01.839249 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 842/1795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:01 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:01.978344 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:01.979396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:01.990411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.991978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.994364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:01.995595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:01.997169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:01.997809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:01.998423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.012946 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b346cb8b-bf8d-42a1-a6fe-0d8b01689a81 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1308 microversion: 2.1 time: 0.363177 Oct 16 01:08:02.014256 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 954/1796] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:01 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:02.021471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-78618e82-2a8c-4468-8557-6663329a77ed req-d439f54d-66e4-4db6-8d1d-d5780290a12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c87038-bf55-4f6d-96af-cbb68dfbf4f3", "name": "network-vif-plugged", "status": "completed", "tag": "17566a67-86b0-4f6b-b24f-5504af254705"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:02.032784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-78618e82-2a8c-4468-8557-6663329a77ed req-d439f54d-66e4-4db6-8d1d-d5780290a12d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.033694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-78618e82-2a8c-4468-8557-6663329a77ed req-d439f54d-66e4-4db6-8d1d-d5780290a12d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.034302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-78618e82-2a8c-4468-8557-6663329a77ed req-d439f54d-66e4-4db6-8d1d-d5780290a12d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.052076 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-78618e82-2a8c-4468-8557-6663329a77ed req-d439f54d-66e4-4db6-8d1d-d5780290a12d service nova] Creating event network-vif-plugged:17566a67-86b0-4f6b-b24f-5504af254705 for instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 on n-h1-master-1 Oct 16 01:08:02.057740 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-78618e82-2a8c-4468-8557-6663329a77ed req-d439f54d-66e4-4db6-8d1d-d5780290a12d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041857 Oct 16 01:08:02.058605 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 955/1797] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:02.070416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:02.071476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:02.081045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.081839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.082473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.083421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.084058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.084661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.277153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:02.291415 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9057e19e-929b-430d-8ef7-6cc960a9e41b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.316859 Oct 16 01:08:02.293248 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 843/1798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:01 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:02.367674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:02.377189 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3586ee00-3e1a-419a-a77b-ac7c6f46e36a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1317 microversion: 2.1 time: 0.315802 Oct 16 01:08:02.377773 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 956/1799] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:02 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:02.384797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:02.391660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: efcd2fd0-7e22-4fd8-8351-40036992c044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:02.409810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.410292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.410947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.411856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.412491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.413087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.428913 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] HTTP exception thrown: Instance efcd2fd0-7e22-4fd8-8351-40036992c044 could not be found. Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Request method failure captured: Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 HTTP/1.1 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ev3eDdMLtrVCKbt5MPCKFEb63IsAX_mPEI-JyytcZ1920sbZb6Ie4y-6aDMF_Fje8d496exfqNfGCIfI-bdM_QLZf0G8mPhweUjUsEaHwtjXTR8fKyHcc2IW_MKdK9hsDKsek_gLJVLXwulIYkUIjGFExbvsStLke0d42QGiAgJYI Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.25 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e9173928e9c94d31b8d2eca240e28d50 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e9173928e9c94d31b8d2eca240e28d50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e9173928e9c94d31b8d2eca240e28d50 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-LiveAutoBlockMigrationV225Test-1624385451-project Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 5f46ddd0268d44bfacff0400e3f38e7e Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451-project Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: exception: Instance efcd2fd0-7e22-4fd8-8351-40036992c044 could not be found. Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'efcd2fd0-7e22-4fd8-8351-40036992c044'} Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efcd2fd0-7e22-4fd8-8351-40036992c044 could not be found. Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efcd2fd0-7e22-4fd8-8351-40036992c044 could not be found. Oct 16 01:08:02.430665 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efcd2fd0-7e22-4fd8-8351-40036992c044 could not be found. Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Returning 404 to user: Instance efcd2fd0-7e22-4fd8-8351-40036992c044 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:02.436454 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2685650f-4d64-4d63-a6d8-262153784098 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044" status: 404 len: 111 microversion: 2.25 time: 0.051141 Oct 16 01:08:02.437451 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 957/1800] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:02 2022] GET /compute/v2.1/servers/efcd2fd0-7e22-4fd8-8351-40036992c044 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:08:02.442314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:02.442851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:02.450262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.450876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.451333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.452128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.452645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.453868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.492372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:08:02.535420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-411182461", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": "none"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:02.588934 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:02.613687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:02.614130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:02.614601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:02.615250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:02.615835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:02.627930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.628687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.629763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.631331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.632284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.632800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.636339 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-84090590-2ab4-4ff7-99aa-871912d9c396 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 204 len: 0 microversion: 2.25 time: 0.197771 Oct 16 01:08:02.637559 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 958/1801] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:08:02 2022] DELETE /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:08:02.643740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:02.644766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:02.651976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.652764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.653442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.654325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.654989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.655398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Getting quotas for project 011a6b8a86274f2db2cf1c66338790b2. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:02.655835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.662773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Getting quotas for user 040056f7aa7e4630813628aa516e3842 and project 011a6b8a86274f2db2cf1c66338790b2. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:02.678478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:08:02.681883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: 905a951c-0fae-4627-a2a4-469717d34a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:02.735454 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-70dae6e7-63b5-4727-b1ba-e4f3bd458e0a tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.435574 Oct 16 01:08:02.736122 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 844/1802] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:08:02.749221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:02.750998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:02.757665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.759649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.760435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.761166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:02.761631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:02.762063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:02.947909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:02.961321 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f530de25-b662-4562-96c2-f84869a46e09 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1552 microversion: 2.1 time: 0.321939 Oct 16 01:08:02.961859 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 959/1803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:02 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1552 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:02.969273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-64c9ce19-4add-41ab-89b1-5a380974a511 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:02.969886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-64c9ce19-4add-41ab-89b1-5a380974a511 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: 905a951c-0fae-4627-a2a4-469717d34a70] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:03.017273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:03.029857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:03.035990 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:03.037296 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a08b73f8-c01d-4aff-b5ec-35831a00e354 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1563 microversion: 2.25 time: 0.299502 Oct 16 01:08:03.042401 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 845/1804] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:02 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1563 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:03.057756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:03.061461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:03.071714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.072898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64c9ce19-4add-41ab-89b1-5a380974a511 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:03.074216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.075202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.077764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.079337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.080068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.089259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64c9ce19-4add-41ab-89b1-5a380974a511 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:03.090452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64c9ce19-4add-41ab-89b1-5a380974a511 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:03.096132 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-64c9ce19-4add-41ab-89b1-5a380974a511 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70" status: 200 len: 1277 microversion: 2.47 time: 0.128854 Oct 16 01:08:03.103204 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 960/1805] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:02 2022] GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:03.127694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:03.128208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:03.164210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.164861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.165377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.166141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.166600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.167149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.330809 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a74859d8-1bae-4f0e-8b92-9e74dc83051b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.225140 Oct 16 01:08:03.331953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 961/1806] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:08:03 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/os-interface => generated 285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:03.337494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:03.337916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:03.353058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.354727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.355221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.356802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.357427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.360075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.446954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:03.465986 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2f4b7823-a843-4eb7-826b-cc27b3f6fa62 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1316 microversion: 2.1 time: 0.422073 Oct 16 01:08:03.467662 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 846/1807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:03 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:03.484156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a99e619f-3e8a-4e82-befb-0eddf4bfe390 req-5663b05a-0875-4cc5-86c9-63a7f9190bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e39cd63e-32b5-496f-aeb2-fc6855585aa5", "tag": "69180027-9adb-46d9-ad22-857bbfe67cdb"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:03.496927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a99e619f-3e8a-4e82-befb-0eddf4bfe390 req-5663b05a-0875-4cc5-86c9-63a7f9190bdd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.497642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a99e619f-3e8a-4e82-befb-0eddf4bfe390 req-5663b05a-0875-4cc5-86c9-63a7f9190bdd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.498255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a99e619f-3e8a-4e82-befb-0eddf4bfe390 req-5663b05a-0875-4cc5-86c9-63a7f9190bdd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.523380 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:03.526605 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a99e619f-3e8a-4e82-befb-0eddf4bfe390 req-5663b05a-0875-4cc5-86c9-63a7f9190bdd service nova] Creating event network-changed:69180027-9adb-46d9-ad22-857bbfe67cdb for instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 on n-h2-master-1 Oct 16 01:08:03.533943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a99e619f-3e8a-4e82-befb-0eddf4bfe390 req-5663b05a-0875-4cc5-86c9-63a7f9190bdd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064667 Oct 16 01:08:03.535114 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 847/1808] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:03.544175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1858371127", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": "none"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:03.642857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:03.643300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:03.643786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:03.644281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:03.644689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:03.667520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.668007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.669021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.670008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.670650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.671264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.710445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Getting quotas for project 011a6b8a86274f2db2cf1c66338790b2. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:03.726708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Getting quotas for user 040056f7aa7e4630813628aa516e3842 and project 011a6b8a86274f2db2cf1c66338790b2. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:03.733161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:03.743290 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e71245ea-7ec3-4808-8c4a-1608be74956a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1308 microversion: 2.1 time: 0.410220 Oct 16 01:08:03.744077 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 962/1809] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:03 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:03.764727 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:03.768689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:03.783733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.785876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.786319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.788904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:08:03.791216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.791354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:03.791751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.792358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.849052 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:03.879369 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ea7c830-90a1-428c-bbb1-db4208d82bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.342813 Oct 16 01:08:03.898194 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 848/1810] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 362 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:08:03.903646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:03.904258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:03.920691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.921187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.921724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:03.922451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:03.922899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:03.923345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:04.483729 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:04.496479 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d767746-37b8-4404-9e2a-778cd68036d4 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1506 microversion: 2.1 time: 0.596975 Oct 16 01:08:04.517190 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 849/1811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:03 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:04.532694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1304b01d-f20d-4184-9179-a33eed405e8d tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:04.539300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1304b01d-f20d-4184-9179-a33eed405e8d tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:04.571052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:04.589586 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f3543ca-8c54-4188-996c-dcd19badc04b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.826528 Oct 16 01:08:04.590278 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 963/1812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:03 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:04.596953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:04.609802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:04.637956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:04.638463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:04.638902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:04.639635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:04.640098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:04.641061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:04.669667 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1304b01d-f20d-4184-9179-a33eed405e8d tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "PUT /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 992 microversion: 2.47 time: 0.144240 Oct 16 01:08:04.670753 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 850/1813] 10.222.0.39 () {62 vars in 1297 bytes} [Sun Oct 16 01:08:04 2022] PUT /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 992 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:08:04.683253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ff37ba2c-38a1-45b1-a408-49ab28c0cc00 req-84c965e9-632d-4fe9-8c35-a335765bc194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9503402-a817-49f4-82fa-f213c8159edc", "name": "network-vif-plugged", "status": "completed", "tag": "51fed29d-d895-44b3-a5d6-9ba0dc45a746"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:04.706459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff37ba2c-38a1-45b1-a408-49ab28c0cc00 req-84c965e9-632d-4fe9-8c35-a335765bc194 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:04.709613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff37ba2c-38a1-45b1-a408-49ab28c0cc00 req-84c965e9-632d-4fe9-8c35-a335765bc194 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:04.710292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff37ba2c-38a1-45b1-a408-49ab28c0cc00 req-84c965e9-632d-4fe9-8c35-a335765bc194 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:04.730383 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ff37ba2c-38a1-45b1-a408-49ab28c0cc00 req-84c965e9-632d-4fe9-8c35-a335765bc194 service nova] Creating event network-vif-plugged:51fed29d-d895-44b3-a5d6-9ba0dc45a746 for instance a9503402-a817-49f4-82fa-f213c8159edc on n-h1-master-1 Oct 16 01:08:04.742859 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ff37ba2c-38a1-45b1-a408-49ab28c0cc00 req-84c965e9-632d-4fe9-8c35-a335765bc194 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070164 Oct 16 01:08:04.743711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 851/1814] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:04.754141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:04.761715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:04.781866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:04.782187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:04.782564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:04.783554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:04.784251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:04.784656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.505215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:05.515148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:05.517697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:05.519465 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a29bd75-df4f-4721-8df5-1af20178d5d5 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1521 microversion: 2.25 time: 0.926803 Oct 16 01:08:05.520118 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 964/1815] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:04 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1521 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:05.525032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:05.525672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:05.532929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:05.533701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:05.534398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.535358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:05.536043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:05.536709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.579131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:05.580135 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e13a0c1-9ede-4ddc-9adf-de3ff3eb8a12 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3/os-instance-actions/req-05a969cb-3aeb-43a6-a2a2-d30d7893232e" status: 200 len: 313 microversion: 2.1 time: 0.058705 Oct 16 01:08:05.580727 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 965/1816] 10.222.0.39 () {58 vars in 1419 bytes} [Sun Oct 16 01:08:05 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3/os-instance-actions/req-05a969cb-3aeb-43a6-a2a2-d30d7893232e => generated 313 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:05.586848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:05.590002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:05.591408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:05.596591 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6ad4825f-cb37-454d-833d-a417cbeeb5ca tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1316 microversion: 2.1 time: 0.851353 Oct 16 01:08:05.597870 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 852/1817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:04 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1316 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:05.599787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:05.600283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:05.600720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.601437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:05.601897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:05.602321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.604316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:05.605155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:05.619982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:05.620750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:05.621766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.622629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:05.623265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:05.623846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:05.766817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:05.783181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:05.784618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:05.785770 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-003afe51-b323-41c3-9399-3a5d83a99bce tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1330 microversion: 2.47 time: 0.200099 Oct 16 01:08:05.799296 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 966/1818] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:05 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1330 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:05.806166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1172575498", "imageRef": "1a177d04-145e-4cc9-b1d4-e78bd05fd371", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f2a4bf37-8cd4-49e4-bf46-0f5822ae39b4"}], "security_groups": [{"name": "tempest-securitygroup--1141479097"}], "key_name": "tempest-keypair-245168964", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:06.159559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:06.160850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] validate_networks() for [('f2a4bf37-8cd4-49e4-bf46-0f5822ae39b4', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:08:06.174054 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f315d479-d325-4927-9679-d51515f92ea2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1308 microversion: 2.1 time: 0.574644 Oct 16 01:08:06.188620 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 853/1819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:05 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1308 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:06.195170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-dac6cbd6-77ef-4a11-8cd4-c5b8a7575e72 req-50aecff1-ad3a-4f48-b640-0018e1c6bcbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0a075a-d3cd-41c7-bf45-14b134b9edbc", "name": "network-vif-deleted", "tag": "ba7f5844-fb1b-4a88-a6ae-169867236249"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:06.209359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dac6cbd6-77ef-4a11-8cd4-c5b8a7575e72 req-50aecff1-ad3a-4f48-b640-0018e1c6bcbf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.210216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dac6cbd6-77ef-4a11-8cd4-c5b8a7575e72 req-50aecff1-ad3a-4f48-b640-0018e1c6bcbf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.210937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dac6cbd6-77ef-4a11-8cd4-c5b8a7575e72 req-50aecff1-ad3a-4f48-b640-0018e1c6bcbf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.227950 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-dac6cbd6-77ef-4a11-8cd4-c5b8a7575e72 req-50aecff1-ad3a-4f48-b640-0018e1c6bcbf service nova] Creating event network-vif-deleted:ba7f5844-fb1b-4a88-a6ae-169867236249 for instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc on n-h1-master-1 Oct 16 01:08:06.233164 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-dac6cbd6-77ef-4a11-8cd4-c5b8a7575e72 req-50aecff1-ad3a-4f48-b640-0018e1c6bcbf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043018 Oct 16 01:08:06.234363 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 854/1820] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:06.241195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:06.243895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:06.250896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.251657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.252273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.253149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.253767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.254370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.340369 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-05aaf11f-7aa2-4842-b73f-d6741388cf34 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "POST /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3/action" status: 202 len: 0 microversion: 2.1 time: 0.104179 Oct 16 01:08:06.341668 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 855/1821] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:08:06 2022] POST /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:08:06.349866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:06.350741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:06.359049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.359747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.360542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.361101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.361661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.362186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.654956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:06.675263 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4e38c18-296d-4ae0-98bf-fdb1c7cec27a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.331914 Oct 16 01:08:06.692252 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 856/1822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:06 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:06.698016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:06.698860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:06.708048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.708968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.709598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.710757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.711434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.712035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.913632 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:06.914906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:06.915625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:06.916242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:06.917126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:06.922892 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:06.931115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.931924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.932891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.934108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:06.934784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:06.935476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:06.944347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:06.959252 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-44d41ee6-de9d-4899-8c8c-356cfd9c43a9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1508 microversion: 2.1 time: 0.267466 Oct 16 01:08:06.963707 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Getting quotas for project 622fb0e0967148838b71b51b4d572d38. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:06.971014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Getting quotas for user a745e8bb56574606b709907e661b9cd8 and project 622fb0e0967148838b71b51b4d572d38. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:06.975694 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 857/1823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:06 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:06.989377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:08:06.990933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-96290ccc-53cd-412e-bf4c-988ad0e9885f req-1ed693ec-033b-4527-a922-bc82fb31d854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:06.991998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a177d04-145e-4cc9-b1d4-e78bd05fd371',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:07.001588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-96290ccc-53cd-412e-bf4c-988ad0e9885f req-1ed693ec-033b-4527-a922-bc82fb31d854 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.002330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-96290ccc-53cd-412e-bf4c-988ad0e9885f req-1ed693ec-033b-4527-a922-bc82fb31d854 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.003054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-96290ccc-53cd-412e-bf4c-988ad0e9885f req-1ed693ec-033b-4527-a922-bc82fb31d854 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.017119 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-96290ccc-53cd-412e-bf4c-988ad0e9885f req-1ed693ec-033b-4527-a922-bc82fb31d854 service nova] Creating event network-changed:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:08:07.024310 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-96290ccc-53cd-412e-bf4c-988ad0e9885f req-1ed693ec-033b-4527-a922-bc82fb31d854 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042597 Oct 16 01:08:07.025793 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 858/1824] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:07.037689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:07.038800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:07.051351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.052418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.053245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.054174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.054997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.055772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.061212 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-889e374f-8040-46ff-b9f6-221fe84f9f60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.259935 Oct 16 01:08:07.063016 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 967/1825] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:08:07.069039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:07.070061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:07.078728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.079626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.080291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.081309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.082304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.083184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.153786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.154416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.155036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.155902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lazy-loading 'fault' on Instance uuid ac0a075a-d3cd-41c7-bf45-14b134b9edbc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:08:07.244624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:07.260096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:07.264029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:07.266598 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-12490355-59a2-4d37-b97d-550f421dbdba tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1351 microversion: 2.25 time: 0.238862 Oct 16 01:08:07.269931 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 859/1826] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:07 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1351 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:07.281914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:07.282831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:07.295771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.296152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.296643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.308914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.309420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.322258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.417416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:07.425701 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fded2a6b-7c92-41cb-9c4b-e6e79be2c000 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1316 microversion: 2.1 time: 0.361352 Oct 16 01:08:07.426549 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 968/1827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:07 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:07.443591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f013dc56-fcf2-4649-93a9-cad1b53c12cb req-2d3df54f-dcc2-4744-8415-cd69d64ba629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39cd63e-32b5-496f-aeb2-fc6855585aa5", "name": "network-vif-plugged", "status": "completed", "tag": "69180027-9adb-46d9-ad22-857bbfe67cdb"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:07.456693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f013dc56-fcf2-4649-93a9-cad1b53c12cb req-2d3df54f-dcc2-4744-8415-cd69d64ba629 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.457447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f013dc56-fcf2-4649-93a9-cad1b53c12cb req-2d3df54f-dcc2-4744-8415-cd69d64ba629 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.458076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f013dc56-fcf2-4649-93a9-cad1b53c12cb req-2d3df54f-dcc2-4744-8415-cd69d64ba629 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.473417 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f013dc56-fcf2-4649-93a9-cad1b53c12cb req-2d3df54f-dcc2-4744-8415-cd69d64ba629 service nova] Creating event network-vif-plugged:69180027-9adb-46d9-ad22-857bbfe67cdb for instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 on n-h2-master-1 Oct 16 01:08:07.479821 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f013dc56-fcf2-4649-93a9-cad1b53c12cb req-2d3df54f-dcc2-4744-8415-cd69d64ba629 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052012 Oct 16 01:08:07.481089 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 969/1828] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:07.494514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-faa4d3fd-2c3d-4da0-b779-33bcc861c5e5 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:07.495548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-faa4d3fd-2c3d-4da0-b779-33bcc861c5e5 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:07.594379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-faa4d3fd-2c3d-4da0-b779-33bcc861c5e5 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:07.606612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-faa4d3fd-2c3d-4da0-b779-33bcc861c5e5 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1245 microversion: 2.1 time: 0.122940 Oct 16 01:08:07.609811 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 970/1829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:07 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:07.622690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:07.624020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:07.644993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.645900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.646604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.648743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.651574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.652228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.661718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:07.686351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:07.688549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:07.695623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ea59395-8402-46da-96ea-fa4c5c281f03 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1336 microversion: 2.47 time: 0.424436 Oct 16 01:08:07.699037 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 860/1830] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:07 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1336 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:07.724533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:07.725209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:07.732108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.732607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.733040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:07.733943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:07.735181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:07.735803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.005717 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.013112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.014587 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49561929-2825-4e2a-83d9-225036b8965e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 200 len: 1488 microversion: 2.1 time: 0.403488 Oct 16 01:08:08.015556 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 971/1831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:07 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 1488 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:08.023467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:08.024074 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:08.024627 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-77774b64-c90c-4852-8455-9388bf090215 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.311906 Oct 16 01:08:08.025271 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 861/1832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:07 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:08.030271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.031675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.032474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.033185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.033628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.034051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.048935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-578018333"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:08.051647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:08.058519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.059083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.059581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.060287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.060786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.061501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.187218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.196646 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5bdc3ea6-e925-4c59-95d8-97aa6a5a22b9 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1508 microversion: 2.1 time: 0.179829 Oct 16 01:08:08.213233 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 972/1833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:08 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:08.295756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:08.298119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:08.308343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.309096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.311531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.312753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.315127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.315549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.330767 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ebf5b86-3123-4d93-897c-c7e759b45686 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc/action" status: 202 len: 0 microversion: 2.1 time: 0.286471 Oct 16 01:08:08.335835 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 862/1834] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:08:08 2022] POST /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 16 01:08:08.349208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11892ebb-6dba-4086-afcc-f7e8bb6223f0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd652747550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:08.396099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.396487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.397048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.397505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lazy-loading 'fault' on Instance uuid ac0a075a-d3cd-41c7-bf45-14b134b9edbc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:08:08.406776 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11892ebb-6dba-4086-afcc-f7e8bb6223f0 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83" status: 200 len: 1413 microversion: 2.1 time: 0.064873 Oct 16 01:08:08.408551 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 863/1835] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:08 2022] GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:08.455583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:08.456466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:08.458276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.465659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.466153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.466585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.467318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.467773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.468094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.468263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.470254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f46ddd0268d44bfacff0400e3f38e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9173928e9c94d31b8d2eca240e28d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.471475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8675308d-eade-464a-a27f-4b18b6af4b46 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 200 len: 1351 microversion: 2.25 time: 0.180418 Oct 16 01:08:08.472037 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 973/1836] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:08 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 1351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:08:08.602867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.610828 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7b35e34a-7193-4737-bd1a-2d7208406bcc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1316 microversion: 2.1 time: 0.161712 Oct 16 01:08:08.611449 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 864/1837] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:08 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:08.632026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:08.632644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:08.639922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.641274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.641916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.642903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.643573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.644159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.728040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:08.728658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:08.739422 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.746999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.747586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.748096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.748878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:08.749559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:08.750386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d5fe33f-94b9-40fe-90f2-06d68d3cfa53 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1249 microversion: 2.1 time: 0.120986 Oct 16 01:08:08.751108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:08.751965 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 974/1838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:08 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1249 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:08.818532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.826542 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.828595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:08.829720 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db0e6fff-4ebc-454d-9e45-7b4f5924716c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1336 microversion: 2.47 time: 0.105609 Oct 16 01:08:08.830287 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 865/1839] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:08 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:09.052064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:09.052683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:09.059297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.059788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.060222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.060916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.061373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.061798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.222175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:09.222817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:09.228976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.229466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.229900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.230608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.231107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.231722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.245645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:09.254540 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:09.256238 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30767d4b-f231-42f8-b35f-4b286a4f7e14 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.209317 Oct 16 01:08:09.257579 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 975/1840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:09 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:09.385773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:09.395251 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6099c8e4-2720-4d43-a1a3-26d307bf7a08 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1508 microversion: 2.1 time: 0.178105 Oct 16 01:08:09.395948 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 866/1841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:09 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:09.424346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-deebc2c1-8179-464d-bbae-cf06758d69cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64dffc310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:09.468400 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-deebc2c1-8179-464d-bbae-cf06758d69cd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83" status: 200 len: 1413 microversion: 2.1 time: 0.048355 Oct 16 01:08:09.469822 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 976/1842] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:09 2022] GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 => generated 1413 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:09.496040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:09.496651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] [instance: ac0a075a-d3cd-41c7-bf45-14b134b9edbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:09.503393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.503881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.504324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.505033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.505574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.506016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.520072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] HTTP exception thrown: Instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc could not be found. Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Request method failure captured: Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc HTTP/1.1 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ev3eDdMLtrVCKbt5MPCKFEb63IsAX_mPEI-JyytcZ1920sbZb6Ie4y-6aDMF_Fje8d496exfqNfGCIfI-bdM_QLZf0G8mPhweUjUsEaHwtjXTR8fKyHcc2IW_MKdK9hsDKsek_gLJVLXwulIYkUIjGFExbvsStLke0d42QGiAgJYI Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.25 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e9173928e9c94d31b8d2eca240e28d50 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e9173928e9c94d31b8d2eca240e28d50", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e9173928e9c94d31b8d2eca240e28d50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e9173928e9c94d31b8d2eca240e28d50 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451 Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-LiveAutoBlockMigrationV225Test-1624385451-project Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 5f46ddd0268d44bfacff0400e3f38e7e Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1624385451-project Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc could not be found. Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ac0a075a-d3cd-41c7-bf45-14b134b9edbc'} Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc could not be found. Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc could not be found. Oct 16 01:08:09.521752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc could not be found. Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] Returning 404 to user: Instance ac0a075a-d3cd-41c7-bf45-14b134b9edbc could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1d84a57-95d6-4667-991a-ac8aad54e545 tempest-LiveAutoBlockMigrationV225Test-1624385451 tempest-LiveAutoBlockMigrationV225Test-1624385451-project] 10.222.0.39 "GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc" status: 404 len: 111 microversion: 2.25 time: 0.031664 Oct 16 01:08:09.527240 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 867/1843] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:09 2022] GET /compute/v2.1/servers/ac0a075a-d3cd-41c7-bf45-14b134b9edbc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:08:09.633584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:09.634185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:09.641717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.642205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.642635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.643338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.643788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.644209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.774631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:09.775397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:09.782041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.782780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.783444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.784150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.784604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.785045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.879511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:09.895187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:09.903283 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac7fb9a0-1b09-44db-a71a-a467181076a9 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1297 microversion: 2.1 time: 0.132806 Oct 16 01:08:09.904182 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 868/1844] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:09 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:09.920728 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b506a173-d617-4321-8275-fbd5ad0caea1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1466 microversion: 2.1 time: 0.290911 Oct 16 01:08:09.921427 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 977/1845] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:09 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1466 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:09.923988 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:09.924609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:09.933438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.933914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.939612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:09.941500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:09.943745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:09.944874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.107240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:10.121804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:10.122425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:10.128307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:10.129034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.129541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.129965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.130854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.131352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.131854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.133917 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:10.136003 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c91ba09-0651-42a7-b5ee-70b61722ade0 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1357 microversion: 2.47 time: 0.231175 Oct 16 01:08:10.137569 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 869/1846] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:09 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:10.170875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:10.174377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:10.195839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.198487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.198969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.199886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.200522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.201121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.323535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:10.324237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:10.324881 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:10.325654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:10.326255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:10.399145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:10.406479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.407189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.407786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.408652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.409292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.409884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.446611 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2e6c731c-01ec-4ae6-bad2-ad6c97eef905 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1617 microversion: 2.1 time: 0.505328 Oct 16 01:08:10.447254 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 978/1847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:09 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1617 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:10.462405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:10.463961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:10.466003 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bc983b35-fb95-4b66-ab16-d5cf1256ee2c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "POST /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927/action" status: 202 len: 1079 microversion: 2.47 time: 0.299005 Oct 16 01:08:10.467194 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 870/1848] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:08:10 2022] POST /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927/action => generated 1079 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 16 01:08:10.473496 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:10.474642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:10.483017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.483458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.483991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.485593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.486182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.486604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.505329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.505832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.506281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.507025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.507485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.507909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.714185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:10.718370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:10.722699 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-02742d60-fdb8-4c6d-aab2-3a17f4a6739f tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1513 microversion: 2.1 time: 0.254267 Oct 16 01:08:10.723647 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 871/1849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:10 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:10.724181 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:10.728196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0bf38f2-6203-4371-bd6b-ebb465cd2d0b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Action: 'create', calling method: .version_select at 0x7fd65282e5e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-242073053", "policies": ["affinity"]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:10.733522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e2a9a252-b143-4d78-aab3-7a41cd379a6f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.281457 Oct 16 01:08:10.735173 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 979/1850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:10 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:10.739903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8dfc465e-2a1e-4b10-b457-79305317505e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e0c4e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:10.762825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f0bf38f2-6203-4371-bd6b-ebb465cd2d0b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:10.768114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f0bf38f2-6203-4371-bd6b-ebb465cd2d0b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:10.792056 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8dfc465e-2a1e-4b10-b457-79305317505e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83" status: 200 len: 1413 microversion: 2.1 time: 0.055383 Oct 16 01:08:10.792765 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 980/1851] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:10 2022] GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 => generated 1413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:10.799767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:10.800640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:10.807792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.808459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.808704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.809407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.809990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.810276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.818772 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f0bf38f2-6203-4371-bd6b-ebb465cd2d0b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:10.824380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f0bf38f2-6203-4371-bd6b-ebb465cd2d0b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:10.838383 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f0bf38f2-6203-4371-bd6b-ebb465cd2d0b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.113705 Oct 16 01:08:10.839178 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 872/1852] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:08:10 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:10.885001 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:10.894339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:10.896105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:10.904751 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-98bcacc4-1dee-40a3-a054-3693459232e2 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.110060 Oct 16 01:08:10.911675 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 981/1853] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:10 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:10.928056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:10.928666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:10.934664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.935172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.935601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.936992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:10.939496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:10.939943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:10.966437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-268397391", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "de8f9fa1-2ab7-423b-899b-2571a5bf4d68"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:11.043004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:11.047968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:08:11.052452 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a55aa681-b3e4-4f00-9335-92383284b36a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1297 microversion: 2.1 time: 0.128784 Oct 16 01:08:11.053124 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 873/1854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:10 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:11.489077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:11.489691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:11.490140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:11.490546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:11.490973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:11.567200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:11.568901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:11.569558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:11.570811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:11.571521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:11.572176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:11.595939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:11.602824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:11.618074 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Going to run 2 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:08:11.620712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:11.662373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120545) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 16 01:08:11.683534 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:11.689222 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:11.732924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:11.739421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:11.751128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:11.753055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:11.765145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:11.767176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:11.769580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:11.771996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:11.777078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:11.787242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:11.788275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:11.841127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:11.848147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:11.868167 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:11.929893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:11.947654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:12.044369 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89a6babf-3c12-45f7-b47f-869841e1bb36 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.078921 Oct 16 01:08:12.047820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 982/1855] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 16 01:08:12.060165 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:12.062152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:12.074449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:12.076185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.079838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.080620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.081908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.082461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.083056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.086808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73d0a4fc-34cf-409c-963b-7b5d1a979622 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1506 microversion: 2.1 time: 0.343247 Oct 16 01:08:12.089666 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 874/1856] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:11 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:12.110606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fa634023-6ce3-4d0e-9a96-cbbae3eed7a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd6526edaf0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:12.189839 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fa634023-6ce3-4d0e-9a96-cbbae3eed7a2 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83" status: 200 len: 1413 microversion: 2.1 time: 0.099947 Oct 16 01:08:12.197972 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 875/1857] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:12 2022] GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:12.210834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:12.212036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:12.222533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.223056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.223501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.224212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.224670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.225312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.403356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:12.416191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:12.420920 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:12.422228 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82c4e7d2-f4b5-4800-b887-e83946b0158c tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.223057 Oct 16 01:08:12.427117 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 876/1858] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:12 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:12.432052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:12.457918 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:12.466312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Searching by: {'deleted': False, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:08:12.509296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.509789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.510254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.510950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.511413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.511826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.628763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:12.648400 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1ed7f403-f773-4f2d-80ae-a94d9a63c027 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.598793 Oct 16 01:08:12.658306 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 983/1859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:12 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:12.662528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:12.663164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:12.685055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.686783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.691218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.692705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.693501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.694649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.799736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:08:12.882800 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9fac9e37-55bd-4f09-b650-fd290591c6d7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.454294 Oct 16 01:08:12.883739 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 877/1860] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:08:12 2022] GET /compute/v2.1/servers => generated 1001 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:12.900142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '.version_select at 0x7fd64e149820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:12.900735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:12.916389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.926727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.927209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:12.927960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:12.928419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:12.933226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.014387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5bb9909a-1e50-4ed0-bd75-c8e8a86f016a tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.125458 Oct 16 01:08:13.019940 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 878/1861] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Oct 16 01:08:12 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3/os-instance-actions => generated 611 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:13.026650 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0dda5875-a48d-42e4-8e88-df84e286c801 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:13.052689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0dda5875-a48d-42e4-8e88-df84e286c801 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:13.197282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:13.242158 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a966ab87-51e0-4356-b327-49911b5713fc tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1303 microversion: 2.1 time: 0.583383 Oct 16 01:08:13.245330 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 984/1862] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:12 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1303 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:13.283301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:13.285668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:13.314497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.315242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.316090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.318251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.318841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.323624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.404556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0dda5875-a48d-42e4-8e88-df84e286c801 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:13.417808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0dda5875-a48d-42e4-8e88-df84e286c801 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1218 microversion: 2.1 time: 0.393315 Oct 16 01:08:13.419928 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 879/1863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:13 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1218 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:13.431143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:08:13.435479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3f705af2-7676-4044-8355-c951a70bdbe6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd6526ed4c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:13.635054 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0a37fc24-c24c-467e-93d4-8f05f4006cef tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 204 len: 0 microversion: 2.1 time: 0.374701 Oct 16 01:08:13.636130 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 985/1864] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:08:13 2022] DELETE /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:08:13.651463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:13.658637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:13.681743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.683126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.684053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.685071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.685792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.687114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.836024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:13.847524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:13.851301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:13.854002 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5fa275aa-9721-4863-bec3-1a74dc12828e tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.216527 Oct 16 01:08:13.855788 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 986/1865] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:13 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:13.867757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:13.868778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:13.886390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.889139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.889884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:13.892691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:13.893537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:13.894156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.309215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:14.320491 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b4ab7753-7336-4be2-ad5f-d9d931b54c95 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1512 microversion: 2.1 time: 0.462507 Oct 16 01:08:14.329354 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 987/1866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:13 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1512 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:14.336284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:14.342295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:14.355094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.357873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.359438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.360542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.363133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.363765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.568431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:14.578500 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9af493d7-ef2f-42b5-ac17-16defb437ebf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.247106 Oct 16 01:08:14.579128 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 988/1867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:14 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:14.584780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:14.585391 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:14.591531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.592022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.592462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.593165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.593804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.594452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.775666 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:14.792285 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2a4203ec-0587-4951-950a-7388442ad511 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.212095 Oct 16 01:08:14.815033 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 989/1868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:14 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:14.820872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9af870d1-9433-4d28-9583-390fb6686e00 req-0bbffd4e-45af-4df3-ac98-78f8788b8de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9503402-a817-49f4-82fa-f213c8159edc", "name": "network-vif-plugged", "status": "completed", "tag": "51fed29d-d895-44b3-a5d6-9ba0dc45a746"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:14.831834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9af870d1-9433-4d28-9583-390fb6686e00 req-0bbffd4e-45af-4df3-ac98-78f8788b8de8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.832571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9af870d1-9433-4d28-9583-390fb6686e00 req-0bbffd4e-45af-4df3-ac98-78f8788b8de8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.833172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9af870d1-9433-4d28-9583-390fb6686e00 req-0bbffd4e-45af-4df3-ac98-78f8788b8de8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.845177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9af870d1-9433-4d28-9583-390fb6686e00 req-0bbffd4e-45af-4df3-ac98-78f8788b8de8 service nova] Creating event network-vif-plugged:51fed29d-d895-44b3-a5d6-9ba0dc45a746 for instance a9503402-a817-49f4-82fa-f213c8159edc on n-h1-master-1 Oct 16 01:08:14.850196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9af870d1-9433-4d28-9583-390fb6686e00 req-0bbffd4e-45af-4df3-ac98-78f8788b8de8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033024 Oct 16 01:08:14.852725 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 990/1869] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:14.858903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:14.860129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:14.867029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.867803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.868432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.869325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:14.869971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:14.870566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:14.963747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:14.976418 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff57901f-337e-4ec7-89e1-edec7d6bcc71 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1222 microversion: 2.1 time: 0.121121 Oct 16 01:08:14.979735 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 991/1870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:14 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:14.986321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:14.987208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:14.996624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:15.004335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:15.005245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:15.008393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:15.009066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:15.009677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:15.226241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:15.249210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:15.256945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:15.258522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-212249df-3343-4b8a-8547-83e99944bbe7 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.277651 Oct 16 01:08:15.259866 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 992/1871] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:14 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:15.346109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:15.347191 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:15.354372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:15.355435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:15.356107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:15.370783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:15.371721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:15.372390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:15.771854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:15.791661 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-df5eb68a-5f37-41e1-924b-6217b6c5ae30 tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1512 microversion: 2.1 time: 0.447512 Oct 16 01:08:15.794896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 993/1872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:15 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:15.809317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:15.811118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:15.839653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:15.841445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:15.844223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:15.847211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:15.847905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:15.850191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:17.527223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:17.566584 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a6bdeb61-3325-4408-b0de-a68155fd243c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 1.766583 Oct 16 01:08:17.567265 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 994/1873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:15 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:17.579965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:17.587810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:17.596270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:17.597141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:17.597813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:17.598776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:17.599482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:17.600120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.309670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:18.335854 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-14e3aa22-9431-40d6-becb-c696f2e99bca tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.767477 Oct 16 01:08:18.336448 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 995/1874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:17 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:18.367759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:18.368659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:18.383338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.384397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.385018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.385932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.386564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.387189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.568278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:18.577554 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5e8b044-65ff-4746-a347-d09e6a918ece tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1270 microversion: 2.1 time: 0.222692 Oct 16 01:08:18.578720 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 996/1875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:18 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:18.586645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:18.587662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:18.594573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.595375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.602733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.608015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.608791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.613684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.629388 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:18.795467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:18.829953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:18.833628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:18.837082 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-08a2ebb8-e31a-4901-8110-31af1628b6e5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.257037 Oct 16 01:08:18.891448 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 997/1876] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:18 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:18.909293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:18.911975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:18.930514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.931346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.932016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:18.933083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:18.933714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:18.934312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:19.496571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659517918be43da927a7f465efe0143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e26830af72bd451a97abc960c77b2e84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:19.541348 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d90e7e4-9a56-4363-8edf-ceda759c7acf tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 200 len: 1302 microversion: 2.1 time: 0.642372 Oct 16 01:08:19.575555 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 998/1877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:18 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 1302 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:19.596763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b2122994-7e94-4b17-b899-2067d520d1cd req-4647d8ac-590e-411d-970e-4e039eaed0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfbc75a-8d3f-4561-b380-95d95f9c23fe", "name": "network-vif-unplugged", "status": "completed", "tag": "24e4f451-8cff-409b-8a75-99b4af5dbfd3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:19.639042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b2122994-7e94-4b17-b899-2067d520d1cd req-4647d8ac-590e-411d-970e-4e039eaed0c1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:19.653035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b2122994-7e94-4b17-b899-2067d520d1cd req-4647d8ac-590e-411d-970e-4e039eaed0c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:19.653910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b2122994-7e94-4b17-b899-2067d520d1cd req-4647d8ac-590e-411d-970e-4e039eaed0c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:19.690749 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b2122994-7e94-4b17-b899-2067d520d1cd req-4647d8ac-590e-411d-970e-4e039eaed0c1 service nova] Creating event network-vif-unplugged:24e4f451-8cff-409b-8a75-99b4af5dbfd3 for instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe on n-h1-master-1 Oct 16 01:08:19.709093 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b2122994-7e94-4b17-b899-2067d520d1cd req-4647d8ac-590e-411d-970e-4e039eaed0c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126495 Oct 16 01:08:19.711771 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 999/1878] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:19.724390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:19.727781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:19.747790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:19.751590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:19.752182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:19.752989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:19.755468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:19.755812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:20.290772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:20.290772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-43fbed84-1655-435a-bc54-aa91a4d75170 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.567960 Oct 16 01:08:20.290772 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1000/1879] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:19 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:20.303383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:20.304214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:20.321008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:20.321654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:20.322237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:20.323135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:20.323903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:20.332634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:21.239276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:21.254864 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9a35278e-1d91-4b0c-b7c8-66f7bb90088b tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.966567 Oct 16 01:08:21.287164 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1001/1880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:20 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:21.306393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:21.309344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:21.328454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:21.330351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:21.330809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:21.334363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:21.335745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:21.338558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:21.585912 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:21.775741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:21.789965 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2acc27c9-988c-4634-9c21-a656732cbf96 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1276 microversion: 2.1 time: 0.501587 Oct 16 01:08:21.792739 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1002/1881] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:21 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1276 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:21.802691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:21.807041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:21.824944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:21.825439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:21.829864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:21.831716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:21.832217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:21.833297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:21.979766 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=36 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:22.146268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:22.161844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:22.168800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:22.172342 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-62e4d63b-32b7-42bd-bee0-2f98bd220623 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.378484 Oct 16 01:08:22.175353 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1003/1882] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:21 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:22.189015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:22.192627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] [instance: b0c87038-bf55-4f6d-96af-cbb68dfbf4f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:22.213958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:22.214602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:22.215063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:22.215779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:22.216566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:22.216703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:22.237540 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] HTTP exception thrown: Instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 could not be found. Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Request method failure captured: Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 HTTP/1.1 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lbbhPcKMRn9rzX2ik9bItrfNRIBEnD8t8hnFSQuTZHzM_uHB3H6pPPXojYHrSShgqEttvLbwtnKl1qtkTrfc8XN3813nlmXxlLVZ12uKiO0AxbdO0MuQ0j4gnsK3rfO4XYXPScBPNcPtfY6n3UXvNlbS35nAnzDuegtBV_TNNG17Y Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e26830af72bd451a97abc960c77b2e84 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-InstanceActionsTestJSON-1548204732 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e26830af72bd451a97abc960c77b2e84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e26830af72bd451a97abc960c77b2e84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e26830af72bd451a97abc960c77b2e84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e26830af72bd451a97abc960c77b2e84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-InstanceActionsTestJSON-1548204732 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e26830af72bd451a97abc960c77b2e84 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1548204732 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-InstanceActionsTestJSON-1548204732-project Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 4659517918be43da927a7f465efe0143 Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-InstanceActionsTestJSON-1548204732-project Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: exception: Instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 could not be found. Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'b0c87038-bf55-4f6d-96af-cbb68dfbf4f3'} Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 could not be found. Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 could not be found. Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:22.239487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 could not be found. Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] Returning 404 to user: Instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-573e24b9-ec60-4ad4-9987-e85107da19bb tempest-InstanceActionsTestJSON-1548204732 tempest-InstanceActionsTestJSON-1548204732-project] 10.222.0.39 "GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3" status: 404 len: 111 microversion: 2.1 time: 0.065011 Oct 16 01:08:22.244790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1004/1883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:22 2022] GET /compute/v2.1/servers/b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:08:22.261306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ee26ebea-1405-49ef-8036-61d850bfec42 req-d3015527-c6db-4005-9205-0d2d63f5c179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b371b2df-c758-4e6c-87fd-1bb8bebac0c7", "tag": "d0054275-f5b2-4635-b2b2-577ae8658e69"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:22.285650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee26ebea-1405-49ef-8036-61d850bfec42 req-d3015527-c6db-4005-9205-0d2d63f5c179 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:22.286142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee26ebea-1405-49ef-8036-61d850bfec42 req-d3015527-c6db-4005-9205-0d2d63f5c179 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:22.286780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee26ebea-1405-49ef-8036-61d850bfec42 req-d3015527-c6db-4005-9205-0d2d63f5c179 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:22.309260 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ee26ebea-1405-49ef-8036-61d850bfec42 req-d3015527-c6db-4005-9205-0d2d63f5c179 service nova] Creating event network-changed:d0054275-f5b2-4635-b2b2-577ae8658e69 for instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 on n-h1-master-1 Oct 16 01:08:22.348838 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ee26ebea-1405-49ef-8036-61d850bfec42 req-d3015527-c6db-4005-9205-0d2d63f5c179 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101363 Oct 16 01:08:22.349883 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1005/1884] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:22.360518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:22.361199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:22.380718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:22.381117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:22.381561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:22.382267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:22.382728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:22.383184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:22.623292 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:23.009668 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:23.080847 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:23.411301 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=22 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:23.941760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:23.951400 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-255fd7d7-6b6f-4463-927b-fd4e48128a21 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 1.600168 Oct 16 01:08:23.964036 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1006/1885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:22 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:23.969731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2e41a5df-1a1d-45f0-9b6c-425e521ba78e req-60917a97-f98b-4d8d-84e9-6826049d2ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c87038-bf55-4f6d-96af-cbb68dfbf4f3", "name": "network-vif-deleted", "tag": "17566a67-86b0-4f6b-b24f-5504af254705"}, {"name": "network-changed", "server_uuid": "ebfbc75a-8d3f-4561-b380-95d95f9c23fe", "tag": "24e4f451-8cff-409b-8a75-99b4af5dbfd3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:24.015769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2e41a5df-1a1d-45f0-9b6c-425e521ba78e req-60917a97-f98b-4d8d-84e9-6826049d2ff0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:24.017175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2e41a5df-1a1d-45f0-9b6c-425e521ba78e req-60917a97-f98b-4d8d-84e9-6826049d2ff0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:24.017924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2e41a5df-1a1d-45f0-9b6c-425e521ba78e req-60917a97-f98b-4d8d-84e9-6826049d2ff0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:24.064147 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2e41a5df-1a1d-45f0-9b6c-425e521ba78e req-60917a97-f98b-4d8d-84e9-6826049d2ff0 service nova] Creating event network-vif-deleted:17566a67-86b0-4f6b-b24f-5504af254705 for instance b0c87038-bf55-4f6d-96af-cbb68dfbf4f3 on n-h1-master-1 Oct 16 01:08:24.065019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2e41a5df-1a1d-45f0-9b6c-425e521ba78e req-60917a97-f98b-4d8d-84e9-6826049d2ff0 service nova] Creating event network-changed:24e4f451-8cff-409b-8a75-99b4af5dbfd3 for instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe on n-h1-master-1 Oct 16 01:08:24.075288 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2e41a5df-1a1d-45f0-9b6c-425e521ba78e req-60917a97-f98b-4d8d-84e9-6826049d2ff0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108877 Oct 16 01:08:24.076326 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1007/1886] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:24.089487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:24.091160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:24.113151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:24.114060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:24.114829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:24.115842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:24.118896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:24.134764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:24.954512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:24.982013 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-256e4417-a646-4049-93b1-2cc3662ffecb tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.902579 Oct 16 01:08:24.982619 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1008/1887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:24 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:25.002300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:25.003261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:25.016801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:25.021944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:25.022612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:25.023615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:25.034170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:25.034677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:26.431904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:26.448173 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52110497-f8c8-43bf-a483-aaa69cc58890 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 1.455464 Oct 16 01:08:26.451555 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1009/1888] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:24 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:26.463608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:26.466500 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:26.483838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:26.484415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:26.484866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:26.485593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:26.489618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:26.490170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:26.694020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:26.708599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:26.710312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:26.714885 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2a64a0d0-411a-4d6f-b481-f348cce659d9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.258567 Oct 16 01:08:26.715611 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1010/1889] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:26 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:26.728054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:26.728806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:26.746764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:26.747307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:26.749223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:26.750585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:26.753741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:26.754219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:27.337212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:27.349351 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9bb0f5ab-6cd3-4305-9189-28e35c850b63 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.629646 Oct 16 01:08:27.362949 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1011/1890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:26 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:27.362949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:27.371915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:27.395158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:27.395871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:27.396347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:27.397116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:27.397567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:27.397993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:28.061948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:28.073713 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b10a9218-6c55-4af4-9c96-6a815606c130 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.720884 Oct 16 01:08:28.094206 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1012/1891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:27 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:28.105156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:28.105789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:28.122494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:28.124203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:28.124770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:28.125643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:28.126061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:28.128645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:28.738752 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:28.779999 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52e9e69c-0f56-4f30-a7a7-22be3ca04274 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 0.673568 Oct 16 01:08:28.782054 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1013/1892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:28 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:28.804218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:28.805097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:28.817085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:28.817634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:28.818083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:28.819665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:28.820415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:28.820856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:29.256414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:29.276057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:29.283025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:29.296976 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5fd971da-06e4-4af2-8bea-34972e9611ac tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.513483 Oct 16 01:08:29.312666 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1014/1893] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:28 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:29.342506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:29.346434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:29.383295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:29.384101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:29.385761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:29.388235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:29.391977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:29.395992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:30.300309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:30.319838 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4e0d733b-2187-4d77-abe7-b84e56db1085 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.996657 Oct 16 01:08:30.329772 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1015/1894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:29 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:30.338714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4a4b3c0c-03f9-4dcc-9a4d-b32cbff133b8 req-d759837a-e2a7-4770-890c-0b7c321171e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd", "tag": "d8fc1c0d-6620-41e0-b82f-05674b90f342"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:30.391254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4a4b3c0c-03f9-4dcc-9a4d-b32cbff133b8 req-d759837a-e2a7-4770-890c-0b7c321171e8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:30.391758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4a4b3c0c-03f9-4dcc-9a4d-b32cbff133b8 req-d759837a-e2a7-4770-890c-0b7c321171e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:30.394798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4a4b3c0c-03f9-4dcc-9a4d-b32cbff133b8 req-d759837a-e2a7-4770-890c-0b7c321171e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:30.447904 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4a4b3c0c-03f9-4dcc-9a4d-b32cbff133b8 req-d759837a-e2a7-4770-890c-0b7c321171e8 service nova] Creating event network-changed:d8fc1c0d-6620-41e0-b82f-05674b90f342 for instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd on n-h1-master-1 Oct 16 01:08:30.462029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4a4b3c0c-03f9-4dcc-9a4d-b32cbff133b8 req-d759837a-e2a7-4770-890c-0b7c321171e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127501 Oct 16 01:08:30.465540 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1016/1895] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:30.481036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:30.494772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:30.513792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:30.514295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:30.514736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:30.526111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:30.526984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:30.527448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:30.553058 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:31.191871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:31.200377 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65f2fade-eb9f-4888-b27a-42e6b76ce8a4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.730814 Oct 16 01:08:31.201161 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1017/1896] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:30 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:31.212914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:31.213528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:31.269927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:31.273687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:31.274910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:31.283432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:31.286263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:31.287354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:31.574981 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:31.584430 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f4c0e487-e08e-44aa-852a-cc86a7e29dbc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 0.379264 Oct 16 01:08:31.598136 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3f705af2-7676-4044-8355-c951a70bdbe6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83" status: 200 len: 1422 microversion: 2.1 time: 18.175499 Oct 16 01:08:31.599448 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 880/1897] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:13 2022] GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 => generated 1422 bytes in 18179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:31.608404 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1018/1898] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:31 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:31.611095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:31.611721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:31.623606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:31.624523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:31.634402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:31.634900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:31.635362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:31.636076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:31.636535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:31.636956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:31.651379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:31.651817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:31.652719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:31.653645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:31.654782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:31.661124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:31.806194 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:31.821134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:31.824235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:31.826855 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b7fd6549-5a08-41e9-91f4-c1093761c6c3 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.222430 Oct 16 01:08:31.853192 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1019/1899] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:31 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:31.858303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3f8b9c5a-5b28-4023-8601-b99409ba375f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64df9c0d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:31.946864 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3f8b9c5a-5b28-4023-8601-b99409ba375f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83" status: 200 len: 1422 microversion: 2.1 time: 0.092329 Oct 16 01:08:31.947803 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1020/1900] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:31 2022] GET /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:32.152304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:32.168247 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9cafc50-f49f-405a-8c29-93cc967be82a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.554989 Oct 16 01:08:32.169434 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 881/1901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:31 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:32.180821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1690747292", "imageRef": "e1bbd56e-45d2-4e47-b64c-cc3719bdbe83", "flavorRef": "452", "networks": [{"uuid": "ba2039d4-7a1a-4c70-b987-1dd870ff50d7"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:32.225026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:32.226011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:32.237594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:32.238767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:32.240950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:32.241810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:32.243499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:32.244771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:32.554785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] validate_networks() for [('ba2039d4-7a1a-4c70-b987-1dd870ff50d7', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:08:32.804399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:32.814353 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c9c7d70c-0d83-4701-be6b-9cdfb45a014c tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.593325 Oct 16 01:08:32.822473 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 882/1902] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:32 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:32.831895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d447f024-86ec-4020-b971-af9f7e15beb2 req-c0ff9eaa-4cfc-4ecf-8ba5-ee345a38e96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32be475-1191-40ba-a6d8-eec04d0c2cb9", "tag": "9de0040b-fdd5-4e2d-8263-86982613cbef"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:32.853062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d447f024-86ec-4020-b971-af9f7e15beb2 req-c0ff9eaa-4cfc-4ecf-8ba5-ee345a38e96e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:32.860376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d447f024-86ec-4020-b971-af9f7e15beb2 req-c0ff9eaa-4cfc-4ecf-8ba5-ee345a38e96e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:32.862727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d447f024-86ec-4020-b971-af9f7e15beb2 req-c0ff9eaa-4cfc-4ecf-8ba5-ee345a38e96e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:32.928216 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d447f024-86ec-4020-b971-af9f7e15beb2 req-c0ff9eaa-4cfc-4ecf-8ba5-ee345a38e96e service nova] Creating event network-changed:9de0040b-fdd5-4e2d-8263-86982613cbef for instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 on n-h1-master-1 Oct 16 01:08:32.940792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d447f024-86ec-4020-b971-af9f7e15beb2 req-c0ff9eaa-4cfc-4ecf-8ba5-ee345a38e96e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115499 Oct 16 01:08:32.945173 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 883/1903] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:32.958335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:32.959138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:32.990249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:32.990758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:33.004420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:33.010063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:33.010597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:33.011082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:33.888436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:33.891790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:33.892529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:33.892953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:33.893584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:33.915774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:33.919631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:33.920638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:33.924405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:33.925058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:33.926574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:33.927718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:33.948214 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f990aefc-1aa5-4192-af4d-ec880b849d1a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 1.001286 Oct 16 01:08:33.949158 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 884/1904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:32 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:33.968903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:33.975478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:33.983042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:33.988009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:33.988740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:33.989699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:33.990414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:33.991230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:33.999878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:34.006215 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:34.009285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for user 875dca9ed4914e379601ddbdba035cb2 and project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:34.040697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:08:34.043779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1bbd56e-45d2-4e47-b64c-cc3719bdbe83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:34.129380 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9261e16c-c752-4acd-8db2-546c8fcea1ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952441 Oct 16 01:08:34.137061 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1021/1905] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:08:34.151617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:34.152495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:34.169010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:34.170653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:34.172809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:34.174360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:34.177151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:34.180570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:34.510433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:34.535110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:34.542504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:34.546114 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-173aaf0d-2afe-477f-93d7-2a83fc93dc20 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.595648 Oct 16 01:08:34.553158 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 885/1906] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:33 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:34.560674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:34.565386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:34.594878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:34.600075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:34.600075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:34.601816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:34.602633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:34.606282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:34.879788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:34.896132 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d48dead9-8ace-471c-bb1f-f84fde1e799d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.761225 Oct 16 01:08:34.897953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1022/1907] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:34 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:34.910179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c7a9119-853c-433c-b5a0-5bf742bc5414 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:34.911914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4c7a9119-853c-433c-b5a0-5bf742bc5414 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:35.862834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4c7a9119-853c-433c-b5a0-5bf742bc5414 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:35.870730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c7a9119-853c-433c-b5a0-5bf742bc5414 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1208 microversion: 2.1 time: 0.969308 Oct 16 01:08:35.875311 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1023/1908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:34 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1208 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:35.881967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:35.882576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:35.901434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:35.903264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:35.904190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:35.905099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:35.905847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:35.907508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:36.053102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:36.090625 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7f6e6adb-7647-4e30-be48-3d0ab2d340b1 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 1.535270 Oct 16 01:08:36.094855 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 886/1909] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:34 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:36.109620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-40948d7e-aa89-4562-9078-3f2296538874 req-1e4331a9-fbc2-45f6-b95f-8b10d521a9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd", "name": "network-vif-plugged", "status": "completed", "tag": "d8fc1c0d-6620-41e0-b82f-05674b90f342"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:36.138230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-40948d7e-aa89-4562-9078-3f2296538874 req-1e4331a9-fbc2-45f6-b95f-8b10d521a9fd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:36.139522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-40948d7e-aa89-4562-9078-3f2296538874 req-1e4331a9-fbc2-45f6-b95f-8b10d521a9fd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:36.139969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-40948d7e-aa89-4562-9078-3f2296538874 req-1e4331a9-fbc2-45f6-b95f-8b10d521a9fd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:36.143871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:36.154849 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-391cab72-d42f-4e06-8af1-b54ace43aee6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 0.277690 Oct 16 01:08:36.161919 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-40948d7e-aa89-4562-9078-3f2296538874 req-1e4331a9-fbc2-45f6-b95f-8b10d521a9fd service nova] Creating event network-vif-plugged:d8fc1c0d-6620-41e0-b82f-05674b90f342 for instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd on n-h1-master-1 Oct 16 01:08:36.167267 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-40948d7e-aa89-4562-9078-3f2296538874 req-1e4331a9-fbc2-45f6-b95f-8b10d521a9fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070110 Oct 16 01:08:36.167953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1024/1910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:35 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:36.174310 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 887/1911] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:36.180141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:36.181026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:36.181751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:36.182732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:36.188772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:36.189600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:36.190284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:36.191102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:36.191880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:36.192484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:36.192672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:36.193368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:36.197818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:36.198639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:36.199441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:36.200078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:36.365179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:36.375602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:36.377047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:36.378225 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5abe62ac-af21-4f43-8031-8a3dffd98d50 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.209023 Oct 16 01:08:36.378782 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1025/1912] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:36 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:36.481308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:36.490716 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88e2360a-717f-4f17-8a67-dbad4aa830e9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.314410 Oct 16 01:08:36.503185 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 888/1913] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:36 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:36.901126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:36.902146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:36.920358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:36.922891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:36.924194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:36.927783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:36.928711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:36.929467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.059490 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:37.090380 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d6978db-b96a-4843-8d44-6b3fc848348d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1260 microversion: 2.1 time: 0.193990 Oct 16 01:08:37.092954 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1026/1914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:36 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:37.117626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:37.118889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:37.131129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.133285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.135753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.136703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.137341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.145886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.179347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:37.180275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:37.192453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.193224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.195539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.196475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.197127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.199429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.797754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:37.800558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:37.809451 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1ebb2fe4-13c8-4dac-993e-a5e55c0ca6b5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 0.634123 Oct 16 01:08:37.810030 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1027/1915] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:37 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:37.810775 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bc8339f-ee24-413a-9e1c-9b03e742001f tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.695401 Oct 16 01:08:37.811662 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 889/1916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:37 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:37.818569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:37.819556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:37.821002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:37.823776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:37.834646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.835850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.836775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.837816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.838486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.839178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.844761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.845274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.845710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.846415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:37.846866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:37.847313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:37.980846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:37.996914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:38.003501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:38.007521 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-efb5a58b-e303-45a6-9bd5-3d818aa4aea6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.193311 Oct 16 01:08:38.008583 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 890/1917] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:37 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:38.118063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:38.118791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:38.131597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:38.132395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:38.132923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:38.135306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:38.138122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:38.138834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:38.211204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:38.225299 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c372a551-9295-4c04-9a1b-1b9a5280286b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.409957 Oct 16 01:08:38.226201 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1028/1918] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:37 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:38.306942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:38.320874 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-986d047c-8576-47a8-a920-cc4018894c8b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1266 microversion: 2.1 time: 0.205427 Oct 16 01:08:38.321888 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 891/1919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:38 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:38.345237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-baba300e-003c-4d36-aa50-09b96f164e23 req-bdbac091-f723-414d-94ba-ec43f73f2c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9503402-a817-49f4-82fa-f213c8159edc", "name": "network-vif-unplugged", "status": "completed", "tag": "51fed29d-d895-44b3-a5d6-9ba0dc45a746"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:38.357626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-baba300e-003c-4d36-aa50-09b96f164e23 req-bdbac091-f723-414d-94ba-ec43f73f2c09 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:38.358346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-baba300e-003c-4d36-aa50-09b96f164e23 req-bdbac091-f723-414d-94ba-ec43f73f2c09 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:38.359034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-baba300e-003c-4d36-aa50-09b96f164e23 req-bdbac091-f723-414d-94ba-ec43f73f2c09 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:38.371893 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-baba300e-003c-4d36-aa50-09b96f164e23 req-bdbac091-f723-414d-94ba-ec43f73f2c09 service nova] Creating event network-vif-unplugged:51fed29d-d895-44b3-a5d6-9ba0dc45a746 for instance a9503402-a817-49f4-82fa-f213c8159edc on n-h1-master-1 Oct 16 01:08:38.378728 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-baba300e-003c-4d36-aa50-09b96f164e23 req-bdbac091-f723-414d-94ba-ec43f73f2c09 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041719 Oct 16 01:08:38.379982 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 892/1920] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:38.816249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3ad48fb-fdc0-4f4f-83e4-c5013783876d tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-554472514", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:38.824623 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a3ad48fb-fdc0-4f4f-83e4-c5013783876d tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] HTTP exception thrown: min_count must be <= max_count Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3ad48fb-fdc0-4f4f-83e4-c5013783876d tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Request method failure captured: Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 183 Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mVfydajoCWtziWNn6K_IJIsubGaRu6RwrfSM7JosEEG-9S-LlQHXhUy7GDvlqwPQWz00CTT1HiaBiBNQuo9F8wFiazPj2PcQfn0tpxPbbcsEts7WvFJWo5uwxcecQepR6WCZkK7ehXThIo_KpUy7iRatvjlql3DIVqiLrAr83hrso Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b6131663e36b42a4927bc315de1b839b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ddb8afba545d46278cf751e2087801a1 Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-554472514", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: exception: min_count must be <= max_count Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-554472514', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 16 01:08:38.826992 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:38.838298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3ad48fb-fdc0-4f4f-83e4-c5013783876d tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Returning 400 to user: min_count must be <= max_count {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:38.838464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:38.839213 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a3ad48fb-fdc0-4f4f-83e4-c5013783876d tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.611875 Oct 16 01:08:38.839558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:38.840119 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1029/1921] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:38 2022] POST /compute/v2.1/servers => generated 74 bytes in 613 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:38.844873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:38.845488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:38.855806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:38.856308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:38.856746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:38.857511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:38.857995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:38.858123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:38.858432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:38.858551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:38.859663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:38.859851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:38.860327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:38.860758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:39.383782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:39.398498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:39.412209 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3872201e-34c9-4593-8920-31c88f1fec75 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.570925 Oct 16 01:08:39.413464 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c4c47370-4453-4480-a232-59296623da3a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 0.566353 Oct 16 01:08:39.416096 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 893/1922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:38 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:39.427735 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1030/1923] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:38 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:39.434039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b51ecd1-7ff7-418c-8b0c-c7e49766aebc tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1283000056", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "max_count": 0}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b51ecd1-7ff7-418c-8b0c-c7e49766aebc tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Request method failure captured: Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 168 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1mVfydajoCWtziWNn6K_IJIsubGaRu6RwrfSM7JosEEG-9S-LlQHXhUy7GDvlqwPQWz00CTT1HiaBiBNQuo9F8wFiazPj2PcQfn0tpxPbbcsEts7WvFJWo5uwxcecQepR6WCZkK7ehXThIo_KpUy7iRatvjlql3DIVqiLrAr83hrso Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b6131663e36b42a4927bc315de1b839b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ddb8afba545d46278cf751e2087801a1 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1283000056", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "max_count": 0}} Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1283000056', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'max_count': 0}}} Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 0 Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:08:39.452660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 16 01:08:39.459399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:39.463059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b51ecd1-7ff7-418c-8b0c-c7e49766aebc tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:39.473975 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b51ecd1-7ff7-418c-8b0c-c7e49766aebc tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.055692 Oct 16 01:08:39.474996 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 894/1924] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:39 2022] POST /compute/v2.1/servers => generated 130 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:08:39.486247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:39.490563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:39.503256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:39.504754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:39.505417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:39.506363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:39.507083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:39.507729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:39.542728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-792273574", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:39.654489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:08:39.800811 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:39.819408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:39.821240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:39.824520 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-304655f3-6b1c-4d07-af54-9cd4d59a6b8b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.348110 Oct 16 01:08:39.832119 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 895/1925] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:39 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:39.837625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:39.843188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:39.860489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:39.864632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:39.867369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:39.869509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:39.873911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:39.875725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.193045 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:40.204894 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed49334c-6957-4aa4-930c-daf354394506 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.371095 Oct 16 01:08:40.224059 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 896/1926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:39 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:40.229651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:40.230070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:40.230835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:40.231337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:40.231829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:40.240193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:40.241132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:40.248446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.249086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.249631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.250640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.251198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.251441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.251838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.251985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.254264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.255141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.263834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.264800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.303972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Getting quotas for project 9b63ec6e0e3c4f268e63ae8da2ffe884. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:40.314366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Getting quotas for user d0caedd0bc41435c9426ee622b9d2113 and project 9b63ec6e0e3c4f268e63ae8da2ffe884. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:40.340128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:08:40.342314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:40.404196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-94a56461-360b-44f3-99af-87df59702ba7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971147 Oct 16 01:08:40.405565 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1031/1927] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:08:40.417170 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22fc4cdf-3f1a-4620-86aa-398b22b2afff tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-575145031", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "max_count": 2.5}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22fc4cdf-3f1a-4620-86aa-398b22b2afff tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Request method failure captured: Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 169 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mVfydajoCWtziWNn6K_IJIsubGaRu6RwrfSM7JosEEG-9S-LlQHXhUy7GDvlqwPQWz00CTT1HiaBiBNQuo9F8wFiazPj2PcQfn0tpxPbbcsEts7WvFJWo5uwxcecQepR6WCZkK7ehXThIo_KpUy7iRatvjlql3DIVqiLrAr83hrso Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b6131663e36b42a4927bc315de1b839b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ddb8afba545d46278cf751e2087801a1 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-575145031", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "max_count": 2.5}} Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-575145031', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'max_count': 2.5}}} Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 2.5 Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:08:40.424923 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 16 01:08:40.430801 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.432055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22fc4cdf-3f1a-4620-86aa-398b22b2afff tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:40.432640 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22fc4cdf-3f1a-4620-86aa-398b22b2afff tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025857 Oct 16 01:08:40.434771 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1032/1928] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:08:40.441688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1019ae34-1173-47a3-ac1b-f7f40f6f94b9 req-28f88803-526e-42ba-bd16-6c00bbad5ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32be475-1191-40ba-a6d8-eec04d0c2cb9", "name": "network-vif-plugged", "status": "completed", "tag": "9de0040b-fdd5-4e2d-8263-86982613cbef"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:40.453235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1019ae34-1173-47a3-ac1b-f7f40f6f94b9 req-28f88803-526e-42ba-bd16-6c00bbad5ac0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.454082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1019ae34-1173-47a3-ac1b-f7f40f6f94b9 req-28f88803-526e-42ba-bd16-6c00bbad5ac0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.454687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1019ae34-1173-47a3-ac1b-f7f40f6f94b9 req-28f88803-526e-42ba-bd16-6c00bbad5ac0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.467195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:40.475657 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-48026ed0-5581-424d-b70a-fa6c1c287ec9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.250405 Oct 16 01:08:40.477553 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 897/1929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:40 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:40.483724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1019ae34-1173-47a3-ac1b-f7f40f6f94b9 req-28f88803-526e-42ba-bd16-6c00bbad5ac0 service nova] Creating event network-vif-plugged:9de0040b-fdd5-4e2d-8263-86982613cbef for instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 on n-h1-master-1 Oct 16 01:08:40.486467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a3520a0b-2898-4ea7-b7fb-6d37f2ec8cd0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:40.490410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a3520a0b-2898-4ea7-b7fb-6d37f2ec8cd0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:40.492067 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1019ae34-1173-47a3-ac1b-f7f40f6f94b9 req-28f88803-526e-42ba-bd16-6c00bbad5ac0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055265 Oct 16 01:08:40.493386 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1033/1930] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:40.503171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:40.504206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:40.511716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.512628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.513352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.514320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.515135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.515871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.616314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a3520a0b-2898-4ea7-b7fb-6d37f2ec8cd0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:40.628844 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a3520a0b-2898-4ea7-b7fb-6d37f2ec8cd0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1221 microversion: 2.1 time: 0.147640 Oct 16 01:08:40.630819 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 898/1931] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:40 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:40.642183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:40.644956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:40.658579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.660756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.672613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.678300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:40.679148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:40.679786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:40.930937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:40.943190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c5313269-6a48-4c31-bf97-b6388b6c7d60 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.447892 Oct 16 01:08:40.950949 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1034/1932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:40 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:40.962477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-479201f9-0d9c-4eb4-8f7f-8fed4a3bd994 tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1825896369", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 0}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-479201f9-0d9c-4eb4-8f7f-8fed4a3bd994 tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Request method failure captured: Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 168 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mVfydajoCWtziWNn6K_IJIsubGaRu6RwrfSM7JosEEG-9S-LlQHXhUy7GDvlqwPQWz00CTT1HiaBiBNQuo9F8wFiazPj2PcQfn0tpxPbbcsEts7WvFJWo5uwxcecQepR6WCZkK7ehXThIo_KpUy7iRatvjlql3DIVqiLrAr83hrso Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b6131663e36b42a4927bc315de1b839b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ddb8afba545d46278cf751e2087801a1 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1825896369", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 0}} Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1825896369', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'min_count': 0}}} Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 0 Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:08:40.970156 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 16 01:08:40.975472 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:40.977774 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-479201f9-0d9c-4eb4-8f7f-8fed4a3bd994 tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:40.978840 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-479201f9-0d9c-4eb4-8f7f-8fed4a3bd994 tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.026853 Oct 16 01:08:40.991726 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1035/1933] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:08:40.998635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:41.011960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:41.012611 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d6b1ec1f-40d1-45a3-9a28-ba54ebb60974 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 0.377814 Oct 16 01:08:41.013340 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 899/1934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:40 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:41.014237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:41.023007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.023843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:41.024503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:41.025431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.026053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:41.026687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:41.111163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:41.119158 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-48156406-fc00-4e75-bec2-4d9ebed17644 tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-164867540", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 2.5}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-48156406-fc00-4e75-bec2-4d9ebed17644 tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Request method failure captured: Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 169 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1mVfydajoCWtziWNn6K_IJIsubGaRu6RwrfSM7JosEEG-9S-LlQHXhUy7GDvlqwPQWz00CTT1HiaBiBNQuo9F8wFiazPj2PcQfn0tpxPbbcsEts7WvFJWo5uwxcecQepR6WCZkK7ehXThIo_KpUy7iRatvjlql3DIVqiLrAr83hrso Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b6131663e36b42a4927bc315de1b839b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b6131663e36b42a4927bc315de1b839b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b6131663e36b42a4927bc315de1b839b Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1897190221 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ddb8afba545d46278cf751e2087801a1 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1897190221-project Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-164867540", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 2.5}} Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-164867540', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'min_count': 2.5}}} Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 2.5 Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:08:41.127795 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-48156406-fc00-4e75-bec2-4d9ebed17644 tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:41.132460 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-48156406-fc00-4e75-bec2-4d9ebed17644 tempest-MultipleCreateNegativeTestJSON-1897190221 tempest-MultipleCreateNegativeTestJSON-1897190221-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021170 Oct 16 01:08:41.143984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:41.144226 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 900/1935] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:08:41.144329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:41.144329 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e04ecf32-912a-4e6f-a9d5-8bb6921d5da9 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.143694 Oct 16 01:08:41.144329 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1036/1936] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:40 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:41.235498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:41.236483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:41.244540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.245338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:41.245980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:41.246886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.247535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:41.248217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:41.459936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:41.473098 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e07a871-8cec-4493-bf06-fef610412597 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.241133 Oct 16 01:08:41.475381 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 901/1937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:41 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:41.501754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:41.503200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:41.512633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.513127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:41.513721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:41.514629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.515370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:41.516072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:41.654961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:41.655687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:41.666078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.666764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:41.667246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:41.667961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.668425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:41.668853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:41.684611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:41.694344 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3fb99dca-6d91-4224-895f-6f4471d1fb87 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.197754 Oct 16 01:08:41.695338 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1037/1938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:41 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:41.696651 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:41.750307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:41.758018 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35c2038e-904c-428a-b266-925308a24779 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1225 microversion: 2.1 time: 0.107802 Oct 16 01:08:41.758574 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 902/1939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:41 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:41.977072 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:41.977908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:41.998076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:41.999415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.000959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.001951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.002636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.003312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.037535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:42.038143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:42.045316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.046202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.047176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.048194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.048933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.049772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.319138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:42.327655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a85434b-2007-49bf-bf8c-ea02c8bf249e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.356520 Oct 16 01:08:42.331802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1038/1940] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:41 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:42.338984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:42.346407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:42.348700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:42.354734 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa878f98-6776-44a6-b07c-0095c1a96e3d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1318 microversion: 2.1 time: 0.319305 Oct 16 01:08:42.355019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.355712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.356212 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 903/1941] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:42 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:42.356615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.357576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.358037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.358458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.443558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:42.452102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:42.454123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:42.455425 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fdf9d0c4-7ce1-46b8-8d3a-7d065c796202 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.122514 Oct 16 01:08:42.455856 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1039/1942] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:42 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:42.496788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:42.497810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:42.508427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.508797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.509299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.520437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.521231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.521711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.523684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9876311a-651f-44c2-b8d2-b9f2a3436f70 req-b20f0e5c-7d30-4204-8515-435d04e084b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b371b2df-c758-4e6c-87fd-1bb8bebac0c7", "name": "network-vif-plugged", "status": "completed", "tag": "d0054275-f5b2-4635-b2b2-577ae8658e69"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:42.537622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9876311a-651f-44c2-b8d2-b9f2a3436f70 req-b20f0e5c-7d30-4204-8515-435d04e084b4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.547546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9876311a-651f-44c2-b8d2-b9f2a3436f70 req-b20f0e5c-7d30-4204-8515-435d04e084b4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.548073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9876311a-651f-44c2-b8d2-b9f2a3436f70 req-b20f0e5c-7d30-4204-8515-435d04e084b4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.563359 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9876311a-651f-44c2-b8d2-b9f2a3436f70 req-b20f0e5c-7d30-4204-8515-435d04e084b4 service nova] Creating event network-vif-plugged:d0054275-f5b2-4635-b2b2-577ae8658e69 for instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 on n-h1-master-1 Oct 16 01:08:42.591393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9876311a-651f-44c2-b8d2-b9f2a3436f70 req-b20f0e5c-7d30-4204-8515-435d04e084b4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078418 Oct 16 01:08:42.592612 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1040/1943] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:42.719919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:42.720949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:42.727583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:42.727853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.728274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.728708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.729405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.730070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.730765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.738071 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e58bd296-148e-4d2a-a5a2-7737e42139ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.245249 Oct 16 01:08:42.738687 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 904/1944] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:42 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:42.767745 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:42.781405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:42.782167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:42.795585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.797238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.799042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.800577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:42.801703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:42.802929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:42.923352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:42.932864 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d26c3487-99fe-4b71-b448-0cb6bf068ed8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1225 microversion: 2.1 time: 0.155087 Oct 16 01:08:42.933552 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 905/1945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:42 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:42.962114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:42.978308 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b30312a0-4e0b-49fb-b55a-c32d78304542 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.263863 Oct 16 01:08:42.979006 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1041/1946] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:42 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:43.354892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:43.355620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:43.366608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.367136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.371197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.371934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.372406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.372845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.384072 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:43.384892 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:43.394799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.395595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.396201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.397180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.403599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.407618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.707668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:43.712389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:43.729075 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5c200a17-f248-4481-a136-4cd4c42f6b2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1468 microversion: 2.1 time: 0.350880 Oct 16 01:08:43.732427 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4933c1c9-4aa7-47d2-8057-ace18d169bb4 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.382824 Oct 16 01:08:43.733018 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 906/1947] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:43 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:43.747117 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1042/1948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:43 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1468 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:43.754173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:43.755331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:43.763522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.764301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.764626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:43.764927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.765860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:43.765993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.766459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.767099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.774652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.775530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.776305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.777384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.778131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.778772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.881693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:43.902757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:43.904366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:43.914074 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b6aa336-a504-4f46-81a0-1a9ece9a67ed tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1366 microversion: 2.47 time: 0.165687 Oct 16 01:08:43.915506 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1043/1949] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:43 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:43.938545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:43.939592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:43.947737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.948878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.949578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.950833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:43.951792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:43.952481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:43.981857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:43.991482 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3149e6ce-3b52-4ac1-9c37-333ade46a865 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.243158 Oct 16 01:08:43.992710 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 907/1950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:43 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:44.010260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:44.011239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:44.024307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.025405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.027041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.030356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.035734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.036502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.276421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:44.287057 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71a6e503-6fc6-4571-a22b-8258768858fd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd" status: 200 len: 1468 microversion: 2.1 time: 0.354804 Oct 16 01:08:44.290406 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1044/1951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:43 2022] GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd => generated 1468 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:44.299966 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:44.307078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:44.316342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.317817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.319433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.319581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:44.321468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.322126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.322745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.339354 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f62a3b2f-4e79-4cd7-a1b2-2417bdcf0654 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.345229 Oct 16 01:08:44.340108 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 908/1952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:43 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:44.351518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:44.352265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:44.370100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.370781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.371366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.372221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.372897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.383610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.425059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:44.434545 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2dd07309-c380-4b0f-b3d4-9d119bdb4ab0 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1225 microversion: 2.1 time: 0.142278 Oct 16 01:08:44.435669 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1045/1953] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:44 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:44.440567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:44.441400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:44.447772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.448482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.449190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.450149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.450773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.451373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.683372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:44.696236 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5d3130f4-1b1f-450b-b40e-8a4890e9724f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.348402 Oct 16 01:08:44.698843 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 909/1954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:44 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:44.699335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:44.710658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:44.720437 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0136e42-6223-490f-8d01-dd251435d515 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.283535 Oct 16 01:08:44.722188 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1046/1955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:44 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:44.722316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:44.723127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Searching by: {'reservation_id': 'r-rj8fgky5', 'deleted': False, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:08:44.737366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.738204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.739844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.744478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.745181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.745983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.752129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:44.752901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:44.766342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.768158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.769986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.772200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:44.774356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:44.782540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:44.992106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:08:45.079840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:45.087978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45e1977e-9fa7-497c-8a6d-c3ac0201ad77 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.341472 Oct 16 01:08:45.092430 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1047/1956] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:44 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:45.105924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:45.113275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:45.122073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.122949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.123321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:45.124031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.124554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.125225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:45.455785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:45.472548 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bb4ebef7-832f-4ed6-bf3b-821b8c3ec891 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1371 microversion: 2.1 time: 0.377963 Oct 16 01:08:45.473904 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1048/1957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:45 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:45.482560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:45.485379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:45.486434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:45.499854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.503636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.504406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:45.506363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.507080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.507719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:45.508802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.509276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.509766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:45.630882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:45.642632 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:45.646838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:45.648150 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22ce944d-2ab1-4623-b8c8-a2aa29fafcaa tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1372 microversion: 2.47 time: 0.172751 Oct 16 01:08:45.658097 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1049/1958] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:45 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:45.668161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1549423798"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:45.668161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:45.687895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.688452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.688950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:45.689758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.690359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.690806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:45.822337 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-462bdff6-3630-4cdb-86f2-c56610b721e8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?reservation_id=r-rj8fgky5" status: 200 len: 2929 microversion: 2.1 time: 1.122337 Oct 16 01:08:45.825543 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 910/1959] 10.222.0.39 () {58 vars in 1197 bytes} [Sun Oct 16 01:08:44 2022] GET /compute/v2.1/servers/detail?reservation_id=r-rj8fgky5 => generated 2929 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:45.831289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:45.832234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:45.858902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.864320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.865302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:45.866752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:45.867632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:45.868316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.150656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:46.164836 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0333c4ff-8dfe-42cf-813a-80a48c10ac03 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.337831 Oct 16 01:08:46.168579 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-155d0f14-85c5-43f0-bb35-75fbc119c0f3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.515535 Oct 16 01:08:46.187775 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 911/1960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:45 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:46.188223 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1050/1961] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:08:45 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 16 01:08:46.188344 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:46.188344 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:46.188811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:46.188811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:46.196312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.203454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.204768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.205052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.205550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.206030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.206527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.207292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.207996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.214533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.215395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.216095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.317438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:46.326476 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2fcd063a-18e9-45f6-bcc8-81afa0be83cf tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1225 microversion: 2.1 time: 0.155391 Oct 16 01:08:46.327452 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 912/1962] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:46 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:46.333094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9616d9e1-9cf3-4cc1-b06f-bf5e41c28113 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:46.376890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.server_groups [None req-9616d9e1-9cf3-4cc1-b06f-bf5e41c28113 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Querying cell 15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) for 2 instances {{(pid=120546) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 16 01:08:46.377661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9616d9e1-9cf3-4cc1-b06f-bf5e41c28113 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.378151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9616d9e1-9cf3-4cc1-b06f-bf5e41c28113 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.380475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9616d9e1-9cf3-4cc1-b06f-bf5e41c28113 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.504694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:46.511646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9616d9e1-9cf3-4cc1-b06f-bf5e41c28113 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/de8f9fa1-2ab7-423b-899b-2571a5bf4d68" status: 200 len: 265 microversion: 2.1 time: 0.182180 Oct 16 01:08:46.512234 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 913/1963] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:08:46 2022] GET /compute/v2.1/os-server-groups/de8f9fa1-2ab7-423b-899b-2571a5bf4d68 => generated 265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:46.525730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:46.527402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:46.532379 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bbced8f8-ac0e-4ae4-91ad-d9a976751720 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.353192 Oct 16 01:08:46.533346 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1051/1964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:46 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:46.549528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:46.553603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.561041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:46.561600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.567862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.568657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.569154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.569735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.579396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.580384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.581069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:46.582020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:46.582686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:46.583360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.002102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:47.010196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-164a4b02-cdc9-48c6-9c2d-c7acb4f796ae tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd" status: 200 len: 1619 microversion: 2.1 time: 0.475718 Oct 16 01:08:47.010782 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1052/1965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:46 2022] GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd => generated 1619 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:47.016485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:47.025010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:47.039093 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ca5e78b6-43d7-46d0-b70b-a732db19e695 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1555 microversion: 2.1 time: 0.509996 Oct 16 01:08:47.039764 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 914/1966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:46 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1555 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:47.047339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.052789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.053469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.054395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.055151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.056121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.064340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:47.065125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:47.085896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.086386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.086826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.087717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.088178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.088941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.210182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:47.219680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:47.229622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:47.231366 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a27da2b6-d9e4-4fe9-82f9-96d304307af4 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1372 microversion: 2.47 time: 0.219255 Oct 16 01:08:47.261801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1053/1967] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:47 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:47.277629 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:47.279727 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:47.298533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.301892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.302841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.307212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.308011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.308698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.448940 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a5d03c2f-edaa-455d-a039-5fca10e22507 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1619 microversion: 2.1 time: 0.408075 Oct 16 01:08:47.452272 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 915/1968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:47 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1619 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:47.457853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:47.461325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:47.477062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.484777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.485385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.486219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.486752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.487414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.493933 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-400a08b2-ec3f-4f78-aa5f-737f138c336e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230608 Oct 16 01:08:47.494589 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1054/1969] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:08:47 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:47.507087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:47.508240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:47.525814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.526887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.527600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.528567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:47.529434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:47.530088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:47.728006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:47.736302 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f5cc8db-57ec-4fd0-8746-dedfc46b6082 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1225 microversion: 2.1 time: 0.240158 Oct 16 01:08:47.739541 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1055/1970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:47 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1225 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:47.752766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-db5871c1-7541-4ea2-af7b-208832a6e273 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Action: 'create', calling method: .version_select at 0x7fd64df2a9d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1649586791", "policies": ["anti-affinity"]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:47.801361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-db5871c1-7541-4ea2-af7b-208832a6e273 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_groups'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:47.815675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-db5871c1-7541-4ea2-af7b-208832a6e273 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_groups'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:47.897992 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:47.965341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-db5871c1-7541-4ea2-af7b-208832a6e273 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_groups'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:47.983586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-db5871c1-7541-4ea2-af7b-208832a6e273 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_groups'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:48.011730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-db5871c1-7541-4ea2-af7b-208832a6e273 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.271062 Oct 16 01:08:48.020824 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1056/1971] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:08:47 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:48.026681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:48.027618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:48.047180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:48.048101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:48.048772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:48.049722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:48.050390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:48.051411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:48.169577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:48.187282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-558e7749-aaab-4738-b383-2c61dea96840 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1717 microversion: 2.1 time: 0.732981 Oct 16 01:08:48.188702 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 916/1972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:47 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1717 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:48.246631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1815061323", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a1658ad2-522e-42c2-b3e7-c97ba50c69d1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:48.398521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:08:49.225331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:49.253037 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34ef5c33-494b-45e1-bf55-5ad3f7c28f25 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 1.228759 Oct 16 01:08:49.254250 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1057/1973] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:48 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:49.271760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:49.277796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:49.289277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:49.289774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:49.290271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:49.291002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:49.291460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:49.291885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:49.296335 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:49.582082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:49.596670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:49.604660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:49.606487 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c2b63005-5028-4de7-84a1-873a75f90fca tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1357 microversion: 2.47 time: 0.350476 Oct 16 01:08:49.606726 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1058/1974] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:49 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:49.615669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:49.619861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:49.637256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:49.637827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:49.638266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:49.639577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:49.640901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:49.645038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:49.783245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:49.783838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:49.784471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:49.785086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:49.785679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:49.826891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:49.827403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:49.828639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:49.829584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:49.830229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:49.830852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:49.853153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:49.860928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:49.871108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:49.876222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Going to run 2 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:08:49.879586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 59168582-a758-488c-81af-e65d94c8e4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:49.892243 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aaa6675c-79ae-4979-8a76-208ba5501834 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1273 microversion: 2.1 time: 0.284199 Oct 16 01:08:49.893252 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1059/1975] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:49 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:49.924005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120546) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 16 01:08:49.925852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:49.928075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:49.950529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:49.951068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:49.951775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:49.952501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:49.953750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:49.954463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:49.958188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:49.960584 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:49.964537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:50.040937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:50.047577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:50.067452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=59168582-a758-488c-81af-e65d94c8e4c2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:50.129378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:50.136917 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:50.187586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:50.194867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:50.247701 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fa5d8a93-4d52-42fe-9900-d8fb23d71527 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.004528 Oct 16 01:08:50.249057 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 917/1976] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 2008 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 16 01:08:50.255402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:50.260851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:50.262096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Searching by: {'deleted': False, 'project_id': '011a6b8a86274f2db2cf1c66338790b2'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:08:50.270601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:50.271500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:50.272514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:50.273517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:50.274867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:50.275562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:50.280768 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:50.613908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:08:50.793984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:50.818671 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a32c8f8-ff5c-459c-8994-87d3b2ca0cff tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1707 microversion: 2.1 time: 0.910935 Oct 16 01:08:50.819119 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1060/1977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:49 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1707 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:50.821246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:50.844647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:50.845140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:50.845784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:50.856016 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:50.865665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:50.871931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:50.885453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:50.889723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:50.894617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Searching by: {'deleted': False, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:08:50.940174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:50.941630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:50.942810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:50.943722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:50.944286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:50.944812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.096160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:08:51.173395 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bca27d7a-1dfd-4e4c-981e-485ecefb85bb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.316910 Oct 16 01:08:51.174315 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1061/1978] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:08:50 2022] GET /compute/v2.1/servers => generated 1663 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:51.179628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:51.180447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:51.187599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.190664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.191494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.192841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.193781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.194373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.234630 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-86e07837-afd7-4c5b-a134-54f71e035b83 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.983929 Oct 16 01:08:51.239787 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 918/1979] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Oct 16 01:08:50 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:51.254657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-635eb4a5-53b0-4d42-907a-bfd99a9add21 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '.version_select at 0x7fd64db03c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:51.261225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635eb4a5-53b0-4d42-907a-bfd99a9add21 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.271822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635eb4a5-53b0-4d42-907a-bfd99a9add21 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.272912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635eb4a5-53b0-4d42-907a-bfd99a9add21 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.302987 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-635eb4a5-53b0-4d42-907a-bfd99a9add21 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1169 microversion: 2.1 time: 0.061399 Oct 16 01:08:51.310377 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 919/1980] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:08:51 2022] GET /compute/v2.1/os-migrations => generated 1169 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:51.323175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:51.328896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:51.344311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.345285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.346063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.347202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.348231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.350039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.633848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:51.645577 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a759bfb-0926-49df-9f5c-e09a8da5bced tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1279 microversion: 2.1 time: 0.328128 Oct 16 01:08:51.648820 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 920/1981] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:51 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:51.664921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d93c0404-efc1-4e76-b8c8-e5a46b07fdef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:51.666805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d93c0404-efc1-4e76-b8c8-e5a46b07fdef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:51.819859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d93c0404-efc1-4e76-b8c8-e5a46b07fdef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:51.832708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:51.838042 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d93c0404-efc1-4e76-b8c8-e5a46b07fdef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1219 microversion: 2.1 time: 0.187626 Oct 16 01:08:51.839555 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 921/1982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:51 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:51.849077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:51.854583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:51.857052 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fbbfda93-e893-4426-8f94-23bc8a99e19e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.681233 Oct 16 01:08:51.857874 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1062/1983] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:51 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:51.867174 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:51.868179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:51.868741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.869528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.870169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.879772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.882781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.883549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.884514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.884992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:51.885509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.886573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.886937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:51.887495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:51.929747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:08:52.077131 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-162cce76-3cb7-48dc-aafb-d91adcbfc36f tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 204 len: 0 microversion: 2.47 time: 0.236090 Oct 16 01:08:52.077786 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 922/1984] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:08:51 2022] DELETE /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:08:52.268090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1644803894", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "24dad0f1-6e58-410b-b2f1-956d40d665aa"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:52.453559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] validate_networks() for [('24dad0f1-6e58-410b-b2f1-956d40d665aa', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:08:52.685547 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0eeeebe7-bf7c-4e11-a71b-19a45f58491e tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1858 microversion: 2.1 time: 0.821359 Oct 16 01:08:52.687681 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1063/1985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:51 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1858 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:52.717672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:52.722409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:52.750763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:52.752779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:52.753435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:52.760085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:52.763465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:52.764744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:52.931196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:52.945299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:52.950635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:52.962575 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ef48256-ecd3-495a-8c8e-2fafd16c8cb5 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1363 microversion: 2.47 time: 0.252603 Oct 16 01:08:52.967136 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1064/1986] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:52 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:52.988023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:52.991704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:53.012905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:53.013745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:53.014888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:53.017732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:53.019156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:53.020413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.008002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:54.019955 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb3f7320-51a1-438a-835f-9be33fd60696 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 1.051452 Oct 16 01:08:54.023260 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1065/1987] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:52 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:54.027815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:54.034881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:54.054689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.055479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.056103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.056992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.057612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.058213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.314879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:08:54.315703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:08:54.316185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:08:54.316591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:08:54.316994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:08:54.323101 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-32b02648-cf71-44a2-aa64-d909595cd036 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1858 microversion: 2.1 time: 0.296195 Oct 16 01:08:54.324096 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1066/1988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:54 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1858 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:54.333918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-608eb478-efb1-4bbb-9462-c9e0347465f5 req-4dbc07e1-a83d-4c34-bdc3-9e667078b741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b371b2df-c758-4e6c-87fd-1bb8bebac0c7", "tag": "d0054275-f5b2-4635-b2b2-577ae8658e69"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:54.339219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.339936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.340564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.341529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.342158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.342783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.391867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-608eb478-efb1-4bbb-9462-c9e0347465f5 req-4dbc07e1-a83d-4c34-bdc3-9e667078b741 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.393466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-608eb478-efb1-4bbb-9462-c9e0347465f5 req-4dbc07e1-a83d-4c34-bdc3-9e667078b741 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.395437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-608eb478-efb1-4bbb-9462-c9e0347465f5 req-4dbc07e1-a83d-4c34-bdc3-9e667078b741 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.415839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Getting quotas for project 3073f1ee5beb4ec2924fd3b3297a00d5. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:08:54.425450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Getting quotas for user 3f51c8481e854aa98f0b2601260efe5d and project 3073f1ee5beb4ec2924fd3b3297a00d5. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:08:54.446818 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-608eb478-efb1-4bbb-9462-c9e0347465f5 req-4dbc07e1-a83d-4c34-bdc3-9e667078b741 service nova] Creating event network-changed:d0054275-f5b2-4635-b2b2-577ae8658e69 for instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 on n-h1-master-1 Oct 16 01:08:54.457267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:08:54.464554 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-608eb478-efb1-4bbb-9462-c9e0347465f5 req-4dbc07e1-a83d-4c34-bdc3-9e667078b741 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139096 Oct 16 01:08:54.473111 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1067/1989] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:54.479168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:08:54.491286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:54.492287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:54.535729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.536629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.540483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.542119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.542827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.543540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.618848 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b58b552c-0ee5-4ed9-a692-f969710b4dc8 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538907 Oct 16 01:08:54.620258 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 923/1990] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:08:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:08:54.628862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:54.629818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:54.637546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.638666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.639344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.640307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.641194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.641799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.695581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:54.708612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-16189409-57b6-4713-8d6f-13fa04ebc53d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1277 microversion: 2.1 time: 0.234008 Oct 16 01:08:54.711169 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1068/1991] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:54 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:54.725100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b07cb688-0072-4f46-8820-e649442af01c req-a9f73f76-4b81-4149-b042-e4e077072d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67308bb0-24fc-415d-9c20-b0f810d2501b", "tag": "ecfdb5bb-0405-4bc9-8c0e-c11c6a237d3f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:54.753797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b07cb688-0072-4f46-8820-e649442af01c req-a9f73f76-4b81-4149-b042-e4e077072d94 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.754456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b07cb688-0072-4f46-8820-e649442af01c req-a9f73f76-4b81-4149-b042-e4e077072d94 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.755354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b07cb688-0072-4f46-8820-e649442af01c req-a9f73f76-4b81-4149-b042-e4e077072d94 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.780635 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b07cb688-0072-4f46-8820-e649442af01c req-a9f73f76-4b81-4149-b042-e4e077072d94 service nova] Creating event network-changed:ecfdb5bb-0405-4bc9-8c0e-c11c6a237d3f for instance 67308bb0-24fc-415d-9c20-b0f810d2501b on n-h2-master-1 Oct 16 01:08:54.797896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b07cb688-0072-4f46-8820-e649442af01c req-a9f73f76-4b81-4149-b042-e4e077072d94 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084211 Oct 16 01:08:54.799047 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1069/1992] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:54.804742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:54.806677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:54.819558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.822511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.823171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:54.826802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:54.827464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:54.828754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.128072 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:55.146635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:55.148370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:55.149586 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-991ed0e4-5918-451e-8414-86f2ec6f8ed6 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1363 microversion: 2.47 time: 0.349333 Oct 16 01:08:55.150546 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1070/1993] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:54 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:55.155646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:55.156864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:55.166130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:55.201234 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cc9eec8c-8bf0-4e7c-972e-b0e89c517d6a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.577169 Oct 16 01:08:55.201853 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 924/1994] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:54 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:55.212724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.219503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.233386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.241054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.243943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4130001-5ea8-460e-966e-78ac7ef70c2a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:55.244185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.244966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4130001-5ea8-460e-966e-78ac7ef70c2a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:55.245410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.398134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4130001-5ea8-460e-966e-78ac7ef70c2a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:55.415273 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4130001-5ea8-460e-966e-78ac7ef70c2a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1225 microversion: 2.1 time: 0.198683 Oct 16 01:08:55.421763 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 925/1995] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:55 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1225 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:55.433388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:55.445607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:55.481708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.483724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.490353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.491482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.491960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.495040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.507770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lazy-loading 'services' on Instance uuid ebfbc75a-8d3f-4561-b380-95d95f9c23fe {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:08:55.660493 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9c0d8b57-604d-4644-903c-8b85aa4ca94e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments/640f7a33-3b2e-4424-b939-70a79df6fb1e" status: 202 len: 0 microversion: 2.1 time: 0.508253 Oct 16 01:08:55.664703 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1071/1996] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:08:55 2022] DELETE /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments/640f7a33-3b2e-4424-b939-70a79df6fb1e => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:08:55.675446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f58c8b6d-915c-4bfa-91ba-95dca95ec307 req-a034ee26-f40f-495d-a3b5-2b07788b9b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "name": "network-vif-plugged", "status": "completed", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:55.708202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f58c8b6d-915c-4bfa-91ba-95dca95ec307 req-a034ee26-f40f-495d-a3b5-2b07788b9b9b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.708786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f58c8b6d-915c-4bfa-91ba-95dca95ec307 req-a034ee26-f40f-495d-a3b5-2b07788b9b9b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.709222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f58c8b6d-915c-4bfa-91ba-95dca95ec307 req-a034ee26-f40f-495d-a3b5-2b07788b9b9b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.739024 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f58c8b6d-915c-4bfa-91ba-95dca95ec307 req-a034ee26-f40f-495d-a3b5-2b07788b9b9b service nova] Creating event network-vif-plugged:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:08:55.753210 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f58c8b6d-915c-4bfa-91ba-95dca95ec307 req-a034ee26-f40f-495d-a3b5-2b07788b9b9b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083924 Oct 16 01:08:55.755990 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1072/1997] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:55.770653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:55.778621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:55.796730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.797241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.801056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.804156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.805684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.806626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.911539 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2d1b6db1-a531-4cda-b44e-6a864946fb8c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152600 Oct 16 01:08:55.915007 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1073/1998] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:08:55 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:55.921540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:55.922373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:55.932366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.933549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.934404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.935615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:55.938378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:55.939118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:55.950040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:55.964909 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e3f9e61-995d-47c6-91c3-5bc0027e80e5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 0.541918 Oct 16 01:08:55.981550 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 926/1999] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:55 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:56.068584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:56.096320 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69440efd-62fe-4ffa-92fb-e8173c34309e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1277 microversion: 2.1 time: 0.179489 Oct 16 01:08:56.115157 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1074/2000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:55 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:56.188126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:56.190186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:56.205133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.205698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.206466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.215544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.217353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.218044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.232340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:56.236509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:56.264488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.269957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.270342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.270655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.271701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.272314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.272858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.273237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lazy-loading 'fault' on Instance uuid cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:08:56.273386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.274180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.339214 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:56.353371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:56.357405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:56.362797 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4b9dd96-67de-428a-bae9-bc76763e206b tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 200 len: 1368 microversion: 2.47 time: 0.181834 Oct 16 01:08:56.386363 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 927/2001] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:56 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:08:56.438173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:56.439016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:56.450151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.450652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.451130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.451855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.458659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.460056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.586317 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:56.597983 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4a980201-4b17-4a66-9a01-9f52db34b6f0 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1221 microversion: 2.1 time: 0.164119 Oct 16 01:08:56.601591 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 928/2002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:56 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1221 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:08:56.608266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1249578b-42d5-4bb7-817b-1b13f29e2141 req-736a3815-2a66-4c96-ac60-a4741e20171b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c669059-56d4-4e1d-a7ce-e4e0a35d78ef", "tag": "ecc82b15-cd7d-4f9b-895c-3b59eb890181"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:08:56.617033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:56.620866 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:56.648270 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de1afdd4-9876-45ca-9ff6-bb405e98e9dc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.413948 Oct 16 01:08:56.649508 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1075/2003] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:56 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:56.674449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1249578b-42d5-4bb7-817b-1b13f29e2141 req-736a3815-2a66-4c96-ac60-a4741e20171b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.675350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1249578b-42d5-4bb7-817b-1b13f29e2141 req-736a3815-2a66-4c96-ac60-a4741e20171b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.676017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1249578b-42d5-4bb7-817b-1b13f29e2141 req-736a3815-2a66-4c96-ac60-a4741e20171b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.732887 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1249578b-42d5-4bb7-817b-1b13f29e2141 req-736a3815-2a66-4c96-ac60-a4741e20171b service nova] Creating event network-changed:ecc82b15-cd7d-4f9b-895c-3b59eb890181 for instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef on n-h2-master-1 Oct 16 01:08:56.742168 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1249578b-42d5-4bb7-817b-1b13f29e2141 req-736a3815-2a66-4c96-ac60-a4741e20171b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139300 Oct 16 01:08:56.751504 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 929/2004] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:56.928953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:56.931605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:56.955039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.955708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.956159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.956854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:56.966615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:56.967420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:56.993280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:56.993999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:57.001641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:57.010808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:57.011594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:57.012560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:57.013440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:57.014062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:57.134029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22b2290a-ad00-4029-a0c8-f9be8564b7f9 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206596 Oct 16 01:08:57.143600 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1076/2005] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:08:56 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:57.166061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:57.167604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:57.196983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:57.199665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:57.200621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:57.207403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:57.208158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:57.208468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.005933 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=22 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:58.151810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:58.190209 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1eff04af-3844-497b-9b0b-e59e5138f9d8 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 1.045293 Oct 16 01:08:58.191785 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1077/2006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:57 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:58.196811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:58.197427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: cd88c7d0-ae17-4f4f-b5dd-e788f09dc927] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:58.220881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.221378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.221818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.222526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.236018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.236671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.264228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] HTTP exception thrown: Instance cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 could not be found. Oct 16 01:08:58.270866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:58.284898 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1738b16-83e0-4bfd-85d7-0667c46e47af tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 1.296237 Oct 16 01:08:58.285513 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 930/2007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:56 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:58.301090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Request method failure captured: Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 HTTP/1.1 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lyphr1fN6RYW36eQWAmOQTLxFe7-I8e6EHi0WjHvisj-7OTFcPRs8cMQPFf6BZHNXOAWxnNlk-T6O7A-tYB-5u6AxOw3j2cn1qMqC0hYzVAzONTn33Uu-Oivei-IxECG9kDgYQraI2cA2q9svqrc4RAzu_uibRvU5wwTubTfFaarw Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.47 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 011a6b8a86274f2db2cf1c66338790b2 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerShowV247Test-1153221663 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_011a6b8a86274f2db2cf1c66338790b2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/011a6b8a86274f2db2cf1c66338790b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/011a6b8a86274f2db2cf1c66338790b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/011a6b8a86274f2db2cf1c66338790b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerShowV247Test-1153221663 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 011a6b8a86274f2db2cf1c66338790b2 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerShowV247Test-1153221663 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerShowV247Test-1153221663-project Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 040056f7aa7e4630813628aa516e3842 Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerShowV247Test-1153221663-project Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: exception: Instance cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 could not be found. Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'cd88c7d0-ae17-4f4f-b5dd-e788f09dc927'} Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 could not be found. Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 could not be found. Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:08:58.303903 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:58.309040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:08:58.309040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:08:58.309040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:08:58.309040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:08:58.309040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:08:58.309040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 could not be found. Oct 16 01:08:58.309040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:08:58.309040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Returning 404 to user: Instance cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:08:58.310282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:58.311991 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5c0ccaba-33f1-4314-8f53-71f10abc4019 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927" status: 404 len: 111 microversion: 2.47 time: 0.119046 Oct 16 01:08:58.316069 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1078/2008] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:58 2022] GET /compute/v2.1/servers/cd88c7d0-ae17-4f4f-b5dd-e788f09dc927 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:08:58.318391 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:58.325849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.329877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.330643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.331214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:58.331848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:58.332436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.333545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.335489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.349980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.352358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.354051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.356061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.359047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.360426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.671715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:58.687709 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0d621196-ffdb-4c99-a27d-64dd508fd819 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1283 microversion: 2.1 time: 0.401088 Oct 16 01:08:58.688549 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 931/2009] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:58 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1283 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:58.697342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:58.712036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:58.734934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.735376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.735819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.736542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.737003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.737429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.791652 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8527225-af4e-4029-8b59-310144befd19 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101491 Oct 16 01:08:58.792923 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 932/2010] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:08:58 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:08:58.824012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:58.831051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: 905a951c-0fae-4627-a2a4-469717d34a70] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:58.847071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.851579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.853777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.855955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:58.859880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:58.861361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:58.964490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: 905a951c-0fae-4627-a2a4-469717d34a70] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:08:59.021939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:59.032330 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b75243b-a76b-4dc2-8be3-130253f2986f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.714828 Oct 16 01:08:59.042081 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1079/2011] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:58 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:08:59.220869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:59.222673 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:59.231238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:59.238856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:59.242820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:59.243960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:59.244663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:59.245504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:59.252190 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-09b0334d-cf6d-4160-9b8e-9c0d5ca90687 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "DELETE /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70" status: 204 len: 0 microversion: 2.47 time: 0.457477 Oct 16 01:08:59.255756 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 933/2012] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:08:58 2022] DELETE /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:08:59.261445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:59.262149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: 905a951c-0fae-4627-a2a4-469717d34a70] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:59.290559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:59.291255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:59.291566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:59.292637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:59.292785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:59.293144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:59.746306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:59.756090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:59.768446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:08:59.771744 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-38e1492c-ba02-448f-87cc-3a5e1e847bea tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70" status: 200 len: 1362 microversion: 2.47 time: 0.514396 Oct 16 01:08:59.772968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 934/2013] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:08:59 2022] GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70 => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:08:59.785122 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:08:59.786039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:08:59.809474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:59.813601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:59.818728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:08:59.819850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:08:59.820557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:08:59.822185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.289737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:00.308297 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:00.314836 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0f5fb44d-0719-4ad3-b92b-6b20ff1a798f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 0.540348 Oct 16 01:09:00.315677 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 935/2014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:59 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:00.344985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:00.345856 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:00.350054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:00.362612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:00.363898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52f5e468-4235-46a8-9516-3c33cfc7361a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 1.148225 Oct 16 01:09:00.364632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:00.364822 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1080/2015] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:08:59 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:00.365626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.367595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:00.368922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:00.369371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.401559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:00.406793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:00.437534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:00.438333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:00.442254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.443107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:00.455703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:00.455703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.504088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:00.516712 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed5c5624-0e56-477f-a1e0-e8421fa3437e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1283 microversion: 2.1 time: 0.199837 Oct 16 01:09:00.517523 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 936/2016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:00 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:00.521883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:00.522488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:00.554407 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-574bf514-aa46-4177-96f3-8d5eeaaf8eb6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171003 Oct 16 01:09:00.559025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:00.559544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:00.559997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.568005 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1081/2017] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:09:00 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:00.568235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:00.568902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:00.569352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.806270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:00.807286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: 905a951c-0fae-4627-a2a4-469717d34a70] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:00.817195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:00.818050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:00.819338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.823410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:00.824178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:00.824831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:00.905463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:00.915632 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f733665-6e80-4b3b-8a61-ad1582863b0f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.397286 Oct 16 01:09:00.920908 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 937/2018] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:00 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:01.005436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:01.014026 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:01.036594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:01.038540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:01.041386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-044ce99e-90b2-4da5-852c-2c2a65fdd427 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70" status: 200 len: 1362 microversion: 2.47 time: 0.239430 Oct 16 01:09:01.042587 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1082/2019] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:00 2022] GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:01.206617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-26d12c32-8637-4de6-9319-8fd96cf625af req-923270e2-fb4d-44d6-85aa-756b3989bb17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59168582-a758-488c-81af-e65d94c8e4c2", "tag": "3b0cedc3-c6e9-438a-974d-6cb5af88f656"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:01.229885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-26d12c32-8637-4de6-9319-8fd96cf625af req-923270e2-fb4d-44d6-85aa-756b3989bb17 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.230559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-26d12c32-8637-4de6-9319-8fd96cf625af req-923270e2-fb4d-44d6-85aa-756b3989bb17 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.233792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-26d12c32-8637-4de6-9319-8fd96cf625af req-923270e2-fb4d-44d6-85aa-756b3989bb17 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:01.274842 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-26d12c32-8637-4de6-9319-8fd96cf625af req-923270e2-fb4d-44d6-85aa-756b3989bb17 service nova] Creating event network-changed:3b0cedc3-c6e9-438a-974d-6cb5af88f656 for instance 59168582-a758-488c-81af-e65d94c8e4c2 on n-h1-master-1 Oct 16 01:09:01.287562 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-26d12c32-8637-4de6-9319-8fd96cf625af req-923270e2-fb4d-44d6-85aa-756b3989bb17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085768 Oct 16 01:09:01.289079 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 938/2020] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:09:01.340398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:01.341166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:01.350204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.350848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.357730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:01.363081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.363715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.365108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:01.395394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:01.396108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:01.410169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.412065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.412522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:01.413234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.417014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.418232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:01.730422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:01.743406 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b75ed91c-66c9-4f5c-b83f-34fdf25dea3b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 0.353139 Oct 16 01:09:01.744204 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 939/2021] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:01 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:01.754904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:01.756321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:01.772420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.775323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.776489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:01.779885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.783666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.784505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:01.930965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:01.943373 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3fc3714e-0f69-4bbc-b6ef-8fe47792b429 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 0.606954 Oct 16 01:09:01.944771 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1083/2022] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:01 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:01.958802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:01.973579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:01.986614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.989676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.990369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:01.991652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:01.993504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:01.994893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:02.099516 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3addb620-5efd-4dbd-b676-6ac8dd222005 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152470 Oct 16 01:09:02.105521 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1084/2023] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:09:01 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:02.117316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:02.121486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:02.131804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:02.135083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:02.136438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:02.139705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:02.141002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:02.146692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:02.280089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:02.290686 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3e37b4f7-82f9-46d4-ba38-7942b8954cab tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1325 microversion: 2.1 time: 0.541403 Oct 16 01:09:02.296210 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 940/2024] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:01 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1325 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:02.309202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:02.310232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: 905a951c-0fae-4627-a2a4-469717d34a70] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:02.324282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:02.327268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:02.330706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:02.331794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:02.334180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:02.337503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.015631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:03.025841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:03.032763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040056f7aa7e4630813628aa516e3842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011a6b8a86274f2db2cf1c66338790b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:03.035650 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-83994764-aa6c-4fc0-9090-86078e196246 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70" status: 200 len: 1362 microversion: 2.47 time: 0.737602 Oct 16 01:09:03.052198 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 941/2025] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:02 2022] GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70 => generated 1362 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:03.065283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-33be45ef-8fe6-434c-adb9-56b07b798b9a req-b0dfadbb-dc06-4e55-9d37-0ee47daef5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c669059-56d4-4e1d-a7ce-e4e0a35d78ef", "name": "network-vif-plugged", "status": "completed", "tag": "ecc82b15-cd7d-4f9b-895c-3b59eb890181"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:03.076850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-33be45ef-8fe6-434c-adb9-56b07b798b9a req-b0dfadbb-dc06-4e55-9d37-0ee47daef5ef service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.077559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-33be45ef-8fe6-434c-adb9-56b07b798b9a req-b0dfadbb-dc06-4e55-9d37-0ee47daef5ef service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.078388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-33be45ef-8fe6-434c-adb9-56b07b798b9a req-b0dfadbb-dc06-4e55-9d37-0ee47daef5ef service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.094454 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-33be45ef-8fe6-434c-adb9-56b07b798b9a req-b0dfadbb-dc06-4e55-9d37-0ee47daef5ef service nova] Creating event network-vif-plugged:ecc82b15-cd7d-4f9b-895c-3b59eb890181 for instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef on n-h2-master-1 Oct 16 01:09:03.101941 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-33be45ef-8fe6-434c-adb9-56b07b798b9a req-b0dfadbb-dc06-4e55-9d37-0ee47daef5ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048154 Oct 16 01:09:03.103235 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 942/2026] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:03.110043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:03.112664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:03.120606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.121369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.121982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.122866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.123932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.124621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.143891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:03.161111 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b321cd62-9244-4820-8d8a-5ad672019c5c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 1.049228 Oct 16 01:09:03.161790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1085/2027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:02 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:03.191271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a47ef970-17ee-4951-8f9f-7fcfff2a5a28 req-e319a802-ef66-417d-a867-d0a7770809a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf", "tag": "b7103a28-390b-42d9-8fb4-2f560f9b35d3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:03.235665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a47ef970-17ee-4951-8f9f-7fcfff2a5a28 req-e319a802-ef66-417d-a867-d0a7770809a1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.236554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a47ef970-17ee-4951-8f9f-7fcfff2a5a28 req-e319a802-ef66-417d-a867-d0a7770809a1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.237781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a47ef970-17ee-4951-8f9f-7fcfff2a5a28 req-e319a802-ef66-417d-a867-d0a7770809a1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.266617 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a47ef970-17ee-4951-8f9f-7fcfff2a5a28 req-e319a802-ef66-417d-a867-d0a7770809a1 service nova] Creating event network-changed:b7103a28-390b-42d9-8fb4-2f560f9b35d3 for instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf on n-h2-master-1 Oct 16 01:09:03.277587 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a47ef970-17ee-4951-8f9f-7fcfff2a5a28 req-e319a802-ef66-417d-a867-d0a7770809a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114425 Oct 16 01:09:03.283679 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1086/2028] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:03.304536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:03.305554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:03.312526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.313429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.314304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.315606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.319623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.322825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.523564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:03.534750 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-87fb7f0d-be42-4e03-93ee-d66c70472534 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 0.430023 Oct 16 01:09:03.556644 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 943/2029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:03 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:03.567445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:03.580052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:03.598944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.601001 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:03.607204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.610357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.611332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.614154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.614308 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10d16c11-0e63-4752-9d37-d556decd8ab8 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 0.328799 Oct 16 01:09:03.614932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.627702 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1087/2030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:03 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:03.636417 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:03.637678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:03.644161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.644909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.645521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.646398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:03.647094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:03.648070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:03.722336 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-08337b16-338a-4ca2-bcf7-79a73cfebcc5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164134 Oct 16 01:09:03.741699 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 944/2031] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:09:03 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:03.857520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:03.867269 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34d50da4-6420-4ead-b143-e9acae228091 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1325 microversion: 2.1 time: 0.238316 Oct 16 01:09:03.870865 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1088/2032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:03 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:04.070202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:04.072085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] [instance: 905a951c-0fae-4627-a2a4-469717d34a70] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:04.083055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.084675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.085368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.086353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.087109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.087771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.122017 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] HTTP exception thrown: Instance 905a951c-0fae-4627-a2a4-469717d34a70 could not be found. Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Request method failure captured: Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70 HTTP/1.1 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1lyphr1fN6RYW36eQWAmOQTLxFe7-I8e6EHi0WjHvisj-7OTFcPRs8cMQPFf6BZHNXOAWxnNlk-T6O7A-tYB-5u6AxOw3j2cn1qMqC0hYzVAzONTn33Uu-Oivei-IxECG9kDgYQraI2cA2q9svqrc4RAzu_uibRvU5wwTubTfFaarw Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.47 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 011a6b8a86274f2db2cf1c66338790b2 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerShowV247Test-1153221663 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_011a6b8a86274f2db2cf1c66338790b2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/011a6b8a86274f2db2cf1c66338790b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/011a6b8a86274f2db2cf1c66338790b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/011a6b8a86274f2db2cf1c66338790b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerShowV247Test-1153221663 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 011a6b8a86274f2db2cf1c66338790b2 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerShowV247Test-1153221663 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerShowV247Test-1153221663-project Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 040056f7aa7e4630813628aa516e3842 Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerShowV247Test-1153221663-project Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 905a951c-0fae-4627-a2a4-469717d34a70 could not be found. Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '905a951c-0fae-4627-a2a4-469717d34a70'} Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905a951c-0fae-4627-a2a4-469717d34a70 could not be found. Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905a951c-0fae-4627-a2a4-469717d34a70 could not be found. Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:04.124142 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:04.130680 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:04.130680 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:04.130680 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:04.130680 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:04.130680 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:04.130680 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905a951c-0fae-4627-a2a4-469717d34a70 could not be found. Oct 16 01:09:04.130680 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:04.134524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] Returning 404 to user: Instance 905a951c-0fae-4627-a2a4-469717d34a70 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:04.148119 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59b75a99-4158-4323-b539-c7d0fbfd08e8 tempest-ServerShowV247Test-1153221663 tempest-ServerShowV247Test-1153221663-project] 10.222.0.39 "GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70" status: 404 len: 111 microversion: 2.47 time: 0.082757 Oct 16 01:09:04.151364 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 945/2033] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:04 2022] GET /compute/v2.1/servers/905a951c-0fae-4627-a2a4-469717d34a70 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:09:04.188839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:04.189440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:04.207194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.207684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.208217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.209075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.210353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.210792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.485480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:04.494886 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6719a87-805d-485e-890d-703153c05ddc tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.311060 Oct 16 01:09:04.501733 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1089/2034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:04 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:04.563846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:04.564469 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:04.570784 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:04.573522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.574245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.575350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.576239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.576860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.577449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.641026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:04.641744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:04.652679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.653182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.653622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.661207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.661701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.662147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.808501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:04.818079 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2806ce3d-dd84-4c97-aef1-6b5533c68c34 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 0.259426 Oct 16 01:09:04.838981 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 946/2035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:04 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:04.853650 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:04.856036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:04.869974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.872912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.874114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:04.874860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:04.876279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:04.876877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:05.001594 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f32de605-33a5-42d1-9620-7afe81b183e4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168638 Oct 16 01:09:05.002419 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 947/2036] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:09:04 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:09:05.012016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:05.043533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:05.060354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:05.061391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:05.063060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:05.063998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:05.065475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:05.066084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:05.075344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:05.087580 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2eb964a0-14e2-40ea-9569-39a3ad9e8712 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 0.450885 Oct 16 01:09:05.088753 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1090/2037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:04 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:05.367932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:05.381109 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ca3211b8-c71a-4247-82e5-f9f224cd9654 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1325 microversion: 2.1 time: 0.377480 Oct 16 01:09:05.397717 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 948/2038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:05 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1325 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:05.416301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b6cd1c60-cb2b-427f-aea8-9c66599e613c req-479248c5-23bb-4270-b52f-0d4ccb714e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707c3ce6-d0cd-45c3-9230-7eda3c3dc95f", "tag": "34b40d80-b4e8-4e9f-bf92-92f22b84083d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:05.436684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b6cd1c60-cb2b-427f-aea8-9c66599e613c req-479248c5-23bb-4270-b52f-0d4ccb714e38 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:05.437670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b6cd1c60-cb2b-427f-aea8-9c66599e613c req-479248c5-23bb-4270-b52f-0d4ccb714e38 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:05.438361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b6cd1c60-cb2b-427f-aea8-9c66599e613c req-479248c5-23bb-4270-b52f-0d4ccb714e38 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:05.459304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b6cd1c60-cb2b-427f-aea8-9c66599e613c req-479248c5-23bb-4270-b52f-0d4ccb714e38 service nova] Creating event network-changed:34b40d80-b4e8-4e9f-bf92-92f22b84083d for instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f on n-h1-master-1 Oct 16 01:09:05.465896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b6cd1c60-cb2b-427f-aea8-9c66599e613c req-479248c5-23bb-4270-b52f-0d4ccb714e38 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056033 Oct 16 01:09:05.467010 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1091/2039] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:05.521390 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=38 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:05.527023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:05.528290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:05.543411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:05.546800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:05.547777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:05.549323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:05.549961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:05.550588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:05.828286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:05.840012 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c922ae1c-a406-4faa-98c1-837e7dac8237 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1308 microversion: 2.1 time: 0.320471 Oct 16 01:09:05.841165 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 949/2040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:05 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:05.844017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:05.844729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:05.858056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:05.858568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:05.860416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:05.861294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:05.862056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:05.862502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:06.012967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b578d73f-674e-4ea4-b427-35ef112546a7 req-8032faa7-6411-42db-8536-73cdec98d290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67308bb0-24fc-415d-9c20-b0f810d2501b", "name": "network-vif-plugged", "status": "completed", "tag": "ecfdb5bb-0405-4bc9-8c0e-c11c6a237d3f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:06.092481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b578d73f-674e-4ea4-b427-35ef112546a7 req-8032faa7-6411-42db-8536-73cdec98d290 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:06.100169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b578d73f-674e-4ea4-b427-35ef112546a7 req-8032faa7-6411-42db-8536-73cdec98d290 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:06.101101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b578d73f-674e-4ea4-b427-35ef112546a7 req-8032faa7-6411-42db-8536-73cdec98d290 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:06.127890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:06.144346 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b578d73f-674e-4ea4-b427-35ef112546a7 req-8032faa7-6411-42db-8536-73cdec98d290 service nova] Creating event network-vif-plugged:ecfdb5bb-0405-4bc9-8c0e-c11c6a237d3f for instance 67308bb0-24fc-415d-9c20-b0f810d2501b on n-h2-master-1 Oct 16 01:09:06.145752 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f37e791-bc67-4eed-8463-4e449884fbc6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 0.304655 Oct 16 01:09:06.147283 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1092/2041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:05 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:06.152965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:06.153597 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:06.161750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:06.162476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:06.163185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:06.166731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:06.168702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:06.169282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:06.170735 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b578d73f-674e-4ea4-b427-35ef112546a7 req-8032faa7-6411-42db-8536-73cdec98d290 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161251 Oct 16 01:09:06.173026 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 950/2042] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:06.407719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:06.408646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:06.434192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:06.441565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:06.442311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:06.445691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:06.446196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:06.446636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:06.503449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:06.517827 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-548d6d1e-95dc-4e15-9bd6-c7e1c7c1e393 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 0.368630 Oct 16 01:09:06.518868 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1093/2043] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:06 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:06.805258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:06.818479 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ac8771c-f690-4e8c-b855-e63ac9e63d5e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1325 microversion: 2.1 time: 0.416667 Oct 16 01:09:06.831573 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 951/2044] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:06 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1325 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:06.865677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:06.866495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:06.878971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:06.880232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:06.881773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:06.883514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:06.885015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:06.885799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:06.927377 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:07.078521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:07.088924 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de0470f0-5546-406a-89d6-dec305638c95 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1489 microversion: 2.1 time: 0.230099 Oct 16 01:09:07.090125 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1094/2045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:06 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1489 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:07.118170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:07.118663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:07.135798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:07.136519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:07.137093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:07.138021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:07.138611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:07.139205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:07.169350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:07.170908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:07.171840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:07.183964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:07.189400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:07.195793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:07.197430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:07.202003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:07.204936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:07.344914 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6cf5f88d-47aa-4682-9911-cfba5aa33855 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 204 len: 0 microversion: 2.1 time: 0.232137 Oct 16 01:09:07.351327 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 952/2046] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:07 2022] DELETE /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:07.379639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:07.380487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:07.410409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:07.411651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:07.413430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:07.433853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:07.435051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:07.438625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:07.501457 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:07.792722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:07.806888 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f4341c8-8afa-46db-8a26-b0527e3d6b6b tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 0.637054 Oct 16 01:09:07.808193 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1095/2047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:07 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:07.822997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:07.823925 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:07.839933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:07.840438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:07.840886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:07.844099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:07.845311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:07.845774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:08.063296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:08.079485 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6167dbd-2a2a-43b2-b80f-73a678170c08 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1495 microversion: 2.1 time: 0.723464 Oct 16 01:09:08.080091 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 953/2048] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:07 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1495 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:08.275950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:08.284000 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0b9fd5e9-3126-45e7-8547-e813f23a20ca tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1321 microversion: 2.1 time: 0.474598 Oct 16 01:09:08.284610 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1096/2049] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:07 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:08.295222 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:08.295837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:08.320137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:08.322438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:08.323994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:08.326841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:08.329549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:08.330229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:08.375404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-425488956", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": "none"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:08.696622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:08.710071 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c2465dd7-aef9-47db-b182-e9168fd6d98a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1325 microversion: 2.1 time: 0.424388 Oct 16 01:09:08.711849 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1097/2050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:08 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1325 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:08.721848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6a982de2-3548-4099-a4c4-e50fa1059b30 req-56bc9b25-de85-4c60-906c-ed4359a6b00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59168582-a758-488c-81af-e65d94c8e4c2", "name": "network-vif-plugged", "status": "completed", "tag": "3b0cedc3-c6e9-438a-974d-6cb5af88f656"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:08.740808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6a982de2-3548-4099-a4c4-e50fa1059b30 req-56bc9b25-de85-4c60-906c-ed4359a6b00e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:08.741523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6a982de2-3548-4099-a4c4-e50fa1059b30 req-56bc9b25-de85-4c60-906c-ed4359a6b00e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:08.742185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6a982de2-3548-4099-a4c4-e50fa1059b30 req-56bc9b25-de85-4c60-906c-ed4359a6b00e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:08.758481 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6a982de2-3548-4099-a4c4-e50fa1059b30 req-56bc9b25-de85-4c60-906c-ed4359a6b00e service nova] Creating event network-vif-plugged:3b0cedc3-c6e9-438a-974d-6cb5af88f656 for instance 59168582-a758-488c-81af-e65d94c8e4c2 on n-h1-master-1 Oct 16 01:09:08.768736 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6a982de2-3548-4099-a4c4-e50fa1059b30 req-56bc9b25-de85-4c60-906c-ed4359a6b00e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055334 Oct 16 01:09:08.769572 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1098/2051] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:08.831238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:08.838904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:08.848398 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:08.854283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:08.855432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:08.856050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:08.856915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:08.857518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:08.858359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:09.178975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:09.201245 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c67910e7-b671-4922-8dd0-b3f0eeeb6f39 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 0.369527 Oct 16 01:09:09.214947 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1099/2052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:08 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:09.220810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:09.221470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:09.228866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:09.229490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:09.229925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:09.230630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:09.231373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:09.231822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:09.446958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:09.457347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-03fda181-ae83-4617-8eb2-8bad21c39f1d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1495 microversion: 2.1 time: 0.254014 Oct 16 01:09:09.461655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1100/2053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:09 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1495 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:09.467176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:09.467782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:09.494327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:09.494836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:09.495291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:09.504973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:09.505568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:09.506018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:09.881690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:09.909717 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d296cb64-5733-48d4-a2f1-b713de9d5658 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1471 microversion: 2.1 time: 0.435828 Oct 16 01:09:09.910374 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1101/2054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:09 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1471 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:09.937489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:09.942164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:09.954435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:09.962992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:09.964794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:09.965793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:09.966469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:09.967125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:10.446102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:10.460069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2639e981-c1f0-4da0-a588-384e69667881 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1325 microversion: 2.1 time: 0.535596 Oct 16 01:09:10.477822 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1102/2055] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:09 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1325 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:10.752663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffe0a227-63e1-4003-aae8-338f2de0fa16 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:10.753537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ffe0a227-63e1-4003-aae8-338f2de0fa16 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] [instance: a7c2a25e-30cf-434c-8954-4926fab6fae6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:10.770372 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ffe0a227-63e1-4003-aae8-338f2de0fa16 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] HTTP exception thrown: Instance a7c2a25e-30cf-434c-8954-4926fab6fae6 could not be found. Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffe0a227-63e1-4003-aae8-338f2de0fa16 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Request method failure captured: Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/a7c2a25e-30cf-434c-8954-4926fab6fae6/action HTTP/1.1 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mW8i0iCV-D4ZUkA8Dn8wVPY-HWl3zqf3CYJskVvS0PQFZGY3hzrkQafhWymSio5YNY6l_xKult4pqI8kogTXuTaUBWcDD0YQfZp0WQe-_cfCupUTNkR-tFU16ppMezVfEArJzsv0xKkSJjzPDyd716KuQGLGEC261SeirLxePHWe4 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2d294ef805184d7ca640b17b0d696056", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 9eec60746b3b409e91a3e8942fe1c73c Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: {"migrate": {}} Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: exception: Instance a7c2a25e-30cf-434c-8954-4926fab6fae6 could not be found. Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'a7c2a25e-30cf-434c-8954-4926fab6fae6', 'body': {'migrate': {}}} Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c2a25e-30cf-434c-8954-4926fab6fae6 could not be found. Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c2a25e-30cf-434c-8954-4926fab6fae6 could not be found. Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:10.775983 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:10.779296 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:10.779296 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:10.779296 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:10.779296 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:10.779296 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c2a25e-30cf-434c-8954-4926fab6fae6 could not be found. Oct 16 01:09:10.779296 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:10.779296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffe0a227-63e1-4003-aae8-338f2de0fa16 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Returning 404 to user: Instance a7c2a25e-30cf-434c-8954-4926fab6fae6 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:10.779296 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ffe0a227-63e1-4003-aae8-338f2de0fa16 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/a7c2a25e-30cf-434c-8954-4926fab6fae6/action" status: 404 len: 111 microversion: 2.1 time: 0.298186 Oct 16 01:09:10.787801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1103/2056] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:10 2022] POST /compute/v2.1/servers/a7c2a25e-30cf-434c-8954-4926fab6fae6/action => generated 111 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:10.794813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:10.795754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:10.805468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:10.806271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:10.806896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:10.807828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:10.808477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:10.809113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:11.190563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:11.201501 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d2562ff-064a-4ef6-b408-dc4b2312b426 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1319 microversion: 2.1 time: 0.411942 Oct 16 01:09:11.215878 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1104/2057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:10 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:11.224072 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:11.224884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:11.231045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:11.231534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:11.231967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:11.232670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:11.233125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:11.233552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:11.278377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:11.279194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:11.279744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:11.280294 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lazy-loading 'fault' on Instance uuid 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:11.367183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:11.380524 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0e4c4bd-3652-40df-aa50-1f156d18940c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 200 len: 1298 microversion: 2.1 time: 0.160088 Oct 16 01:09:11.381154 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1105/2058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:11 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 1298 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:11.403905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-031140d0-5410-42c6-9e6d-4a3b7c58b4bb req-6bee50e3-50b2-41e1-bbc2-8375c0fd6ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c669059-56d4-4e1d-a7ce-e4e0a35d78ef", "name": "network-vif-deleted", "tag": "ecc82b15-cd7d-4f9b-895c-3b59eb890181"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:11.419584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-031140d0-5410-42c6-9e6d-4a3b7c58b4bb req-6bee50e3-50b2-41e1-bbc2-8375c0fd6ba1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:11.420548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-031140d0-5410-42c6-9e6d-4a3b7c58b4bb req-6bee50e3-50b2-41e1-bbc2-8375c0fd6ba1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:11.421156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-031140d0-5410-42c6-9e6d-4a3b7c58b4bb req-6bee50e3-50b2-41e1-bbc2-8375c0fd6ba1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:11.433207 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-031140d0-5410-42c6-9e6d-4a3b7c58b4bb req-6bee50e3-50b2-41e1-bbc2-8375c0fd6ba1 service nova] Creating event network-vif-deleted:ecc82b15-cd7d-4f9b-895c-3b59eb890181 for instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef on n-h2-master-1 Oct 16 01:09:11.455001 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-031140d0-5410-42c6-9e6d-4a3b7c58b4bb req-6bee50e3-50b2-41e1-bbc2-8375c0fd6ba1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055750 Oct 16 01:09:11.455849 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1106/2059] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:11.463872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-669855d3-3b35-41e1-a899-1c0931945522 req-5f281fdc-5c3c-44e6-ba69-ae952c8a41f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf", "name": "network-vif-plugged", "status": "completed", "tag": "b7103a28-390b-42d9-8fb4-2f560f9b35d3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:11.474240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-669855d3-3b35-41e1-a899-1c0931945522 req-5f281fdc-5c3c-44e6-ba69-ae952c8a41f2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:11.474652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-669855d3-3b35-41e1-a899-1c0931945522 req-5f281fdc-5c3c-44e6-ba69-ae952c8a41f2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:11.475125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-669855d3-3b35-41e1-a899-1c0931945522 req-5f281fdc-5c3c-44e6-ba69-ae952c8a41f2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:11.492416 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-669855d3-3b35-41e1-a899-1c0931945522 req-5f281fdc-5c3c-44e6-ba69-ae952c8a41f2 service nova] Creating event network-vif-plugged:b7103a28-390b-42d9-8fb4-2f560f9b35d3 for instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf on n-h2-master-1 Oct 16 01:09:11.497894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-669855d3-3b35-41e1-a899-1c0931945522 req-5f281fdc-5c3c-44e6-ba69-ae952c8a41f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040601 Oct 16 01:09:11.500616 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1107/2060] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:11.506901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-822152556", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:15.206136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:15.207148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:15.208081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:15.208706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:15.209298 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:15.214483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:09:15.224268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.225048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.225766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.226600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.227259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.227692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.247534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Getting quotas for project 021b1335de664adea720f7b92f00cff5. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:15.253265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Getting quotas for user bc122b9d7abf459fa506adcdbc0e4c50 and project 021b1335de664adea720f7b92f00cff5. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:15.269088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:09:15.271717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:09:15.326009 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bfaae5d-bb99-4d25-a4be-251dff2a6776 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 7.244841 Oct 16 01:09:15.326666 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 954/2061] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:09:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 7246 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:09:15.335187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:15.335802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:15.343921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.344888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.345008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.345884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.346385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.346998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.580164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:15.586839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:15.587734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:15.588738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:15.589131 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a5f5e97-d263-4ce3-8788-3c588412f589 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1325 microversion: 2.1 time: 0.257682 Oct 16 01:09:15.590047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:15.590158 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 955/2062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:15 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:15.591112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:15.595601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:15.596397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:15.608577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.611241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.611909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.612509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.613172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.614036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.614742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.615524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.616400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.617040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.618152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.618824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.645945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Getting quotas for project 9b63ec6e0e3c4f268e63ae8da2ffe884. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:15.652934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Getting quotas for user d0caedd0bc41435c9426ee622b9d2113 and project 9b63ec6e0e3c4f268e63ae8da2ffe884. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:15.671048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:09:15.673742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:09:15.749367 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c9df1f64-c0cb-4434-820c-c1c3a343dae1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.247208 Oct 16 01:09:15.762766 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1108/2063] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:09:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:09:15.775895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:15.777153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:15.801662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.802167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.805401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:15.806179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.807241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.808624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.809609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.815311 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0aa38a0f-4538-4a51-ab4d-58b3ae91dcd5 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1469 microversion: 2.1 time: 0.224201 Oct 16 01:09:15.816724 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 956/2064] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:15 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:15.821740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1fa561ac-fdb0-42ec-b652-6525a729f6ea req-80c4e13d-1b43-40f1-a904-5d1e3f39af66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707c3ce6-d0cd-45c3-9230-7eda3c3dc95f", "name": "network-vif-plugged", "status": "completed", "tag": "34b40d80-b4e8-4e9f-bf92-92f22b84083d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:15.841612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1fa561ac-fdb0-42ec-b652-6525a729f6ea req-80c4e13d-1b43-40f1-a904-5d1e3f39af66 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.841831 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:15.843397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1fa561ac-fdb0-42ec-b652-6525a729f6ea req-80c4e13d-1b43-40f1-a904-5d1e3f39af66 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef HTTP/1.1 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5c669059-56d4-4e1d-a7ce-e4e0a35d78ef'} Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:15.843741 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:15.847284 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:15.847284 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:15.847284 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:15.847284 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:15.847284 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:15.847284 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:15.847575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1fa561ac-fdb0-42ec-b652-6525a729f6ea req-80c4e13d-1b43-40f1-a904-5d1e3f39af66 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.848286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:15.850639 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da0066d2-39ce-4126-b5dc-4ddd114ccd0b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 404 len: 111 microversion: 2.1 time: 0.079988 Oct 16 01:09:15.851934 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1109/2065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:15 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:15.857242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:15.858029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:15.867792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.868763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.869390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.871029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:15.871687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:15.872243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:15.880664 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1fa561ac-fdb0-42ec-b652-6525a729f6ea req-80c4e13d-1b43-40f1-a904-5d1e3f39af66 service nova] Creating event network-vif-plugged:34b40d80-b4e8-4e9f-bf92-92f22b84083d for instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f on n-h1-master-1 Oct 16 01:09:15.894278 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1fa561ac-fdb0-42ec-b652-6525a729f6ea req-80c4e13d-1b43-40f1-a904-5d1e3f39af66 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076114 Oct 16 01:09:15.897251 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 957/2066] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:15.907502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3f8b3975-253a-4fe0-9920-4308a5c52026 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:15.908217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3f8b3975-253a-4fe0-9920-4308a5c52026 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:16.034623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3f8b3975-253a-4fe0-9920-4308a5c52026 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:16.044814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3f8b3975-253a-4fe0-9920-4308a5c52026 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:16.056754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3f8b3975-253a-4fe0-9920-4308a5c52026 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:16.057964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3f8b3975-253a-4fe0-9920-4308a5c52026 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1277 microversion: 2.54 time: 0.159585 Oct 16 01:09:16.058709 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 958/2067] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:15 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:16.063876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5318a9af-0563-42db-bf71-27feb8bec0e7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:16.064495 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5318a9af-0563-42db-bf71-27feb8bec0e7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:16.165698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5318a9af-0563-42db-bf71-27feb8bec0e7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:16.175388 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5318a9af-0563-42db-bf71-27feb8bec0e7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1221 microversion: 2.1 time: 0.115223 Oct 16 01:09:16.190726 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 959/2068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:16 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:16.190726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:16.190726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 59168582-a758-488c-81af-e65d94c8e4c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:16.197415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:16.198211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:16.198859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:16.199705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:16.200374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:16.200906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:16.223926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:16.238216 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f1ec353-54ca-4448-bb93-cea5ca5553f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.383612 Oct 16 01:09:16.242039 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1110/2069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:15 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:16.253456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-145d841c-9bbc-4b17-b316-50ed28acc852 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64df953a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:16.446661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:16.456822 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6ad3eb3f-3cc9-4357-a6dd-36cb8feb979f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2" status: 200 len: 1469 microversion: 2.1 time: 0.278810 Oct 16 01:09:16.456949 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 960/2070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:16 2022] GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2 => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:16.478598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-406717809"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:16.481537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:16.489347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:16.489519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:16.490102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:16.490831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:16.491594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:16.492037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.060285 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-145d841c-9bbc-4b17-b316-50ed28acc852 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83" status: 204 len: 0 microversion: 2.1 time: 0.817097 Oct 16 01:09:17.060856 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1111/2071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:16 2022] DELETE /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:17.066468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:17.071642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:17.072659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Searching by: {'reservation_id': 'r-x4wnxq4n', 'deleted': False, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:09:17.079666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.080358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.081024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.082216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.083002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.083747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.182849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:09:17.271725 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-52b84e95-3563-4c6b-a08a-9d82ae70335e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.796958 Oct 16 01:09:17.275540 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 961/2072] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:16 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 16 01:09:17.285520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:17.291532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:17.295261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.299961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.300661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:17.304263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.323426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.323846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.324284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.324984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.325444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.325866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.520130 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abe45cd7-a1c0-4c0e-9258-fbaf74cd9983 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?reservation_id=r-x4wnxq4n" status: 200 len: 2931 microversion: 2.1 time: 0.458190 Oct 16 01:09:17.521224 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1112/2073] 10.222.0.39 () {58 vars in 1197 bytes} [Sun Oct 16 01:09:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-x4wnxq4n => generated 2931 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:17.526238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:17.526839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:17.542171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.549237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.554736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.556351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.557216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.558465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.580210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:17.599184 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-13eb5ac0-474d-4cb2-a5b8-76ef1d9c30ec tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1325 microversion: 2.1 time: 0.319833 Oct 16 01:09:17.601782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 962/2074] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:17 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:17.606614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:17.607242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:17.611589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:17.613973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.614732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.615527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.616468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.616991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.617423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.690832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:17.700397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:17.701857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:17.703633 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-567a32ad-8315-435e-9efa-9dc81cb1abea tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1335 microversion: 2.54 time: 0.100166 Oct 16 01:09:17.706064 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 963/2075] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:17 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:17.709190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:17.709972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:17.714592 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:17.717089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.719053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.719684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.720417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.720882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.721318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.758499 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-252327bc-5cda-43fe-abc2-d16030bc293a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 204 len: 0 microversion: 2.1 time: 0.235493 Oct 16 01:09:17.764450 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1113/2076] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:17 2022] DELETE /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:17.771484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0cf05a60-d0fa-4804-b413-c9a5cac69ac9 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:17.800344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.compute.server_groups [None req-0cf05a60-d0fa-4804-b413-c9a5cac69ac9 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Querying cell 15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) for 2 instances {{(pid=120545) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 16 01:09:17.802284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cf05a60-d0fa-4804-b413-c9a5cac69ac9 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.803403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cf05a60-d0fa-4804-b413-c9a5cac69ac9 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.804354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cf05a60-d0fa-4804-b413-c9a5cac69ac9 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.876467 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0cf05a60-d0fa-4804-b413-c9a5cac69ac9 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/a1658ad2-522e-42c2-b3e7-c97ba50c69d1" status: 200 len: 271 microversion: 2.1 time: 0.108892 Oct 16 01:09:17.878029 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1114/2077] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:09:17 2022] GET /compute/v2.1/os-server-groups/a1658ad2-522e-42c2-b3e7-c97ba50c69d1 => generated 271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:17.885476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:17.888658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:17.889398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:17.898101 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5d04bdae-5189-4d43-81fc-ed5af75faf06 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1273 microversion: 2.1 time: 0.192412 Oct 16 01:09:17.901754 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 964/2078] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:17 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:17.909375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.910147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.911257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.912259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.912719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.913195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.951565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-40193853-c993-4fe8-a194-9bb3455c7070 req-43e9ed02-c3c0-4ac0-89b2-b560239cf40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "name": "network-vif-unplugged", "status": "completed", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:17.967118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-40193853-c993-4fe8-a194-9bb3455c7070 req-43e9ed02-c3c0-4ac0-89b2-b560239cf40a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:17.967691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-40193853-c993-4fe8-a194-9bb3455c7070 req-43e9ed02-c3c0-4ac0-89b2-b560239cf40a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:17.968224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-40193853-c993-4fe8-a194-9bb3455c7070 req-43e9ed02-c3c0-4ac0-89b2-b560239cf40a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:17.981221 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-40193853-c993-4fe8-a194-9bb3455c7070 req-43e9ed02-c3c0-4ac0-89b2-b560239cf40a service nova] Creating event network-vif-unplugged:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:09:17.987391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-40193853-c993-4fe8-a194-9bb3455c7070 req-43e9ed02-c3c0-4ac0-89b2-b560239cf40a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051288 Oct 16 01:09:17.988005 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 965/2079] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:18.013871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-175551856", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "ba2039d4-7a1a-4c70-b987-1dd870ff50d7"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:18.027301 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:18.087095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] validate_networks() for [('ba2039d4-7a1a-4c70-b987-1dd870ff50d7', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:09:18.089260 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-59cfbbd6-d1e5-4dab-931e-c5831dff7e6e tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1620 microversion: 2.1 time: 0.204741 Oct 16 01:09:18.089838 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1115/2080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:17 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1620 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:18.111984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:18.113147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] [instance: 59168582-a758-488c-81af-e65d94c8e4c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:18.119342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.120100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.120750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.121652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.122304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.122877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.313428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8eca7c9f-2c53-421b-9219-d6da09fafb9f tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2" status: 200 len: 1620 microversion: 2.1 time: 0.206174 Oct 16 01:09:18.314270 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1116/2081] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:18 2022] GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2 => generated 1620 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:18.449169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1796578929", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "e39cd63e-32b5-496f-aeb2-fc6855585aa5"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:18.514208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:09:18.643350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:18.644067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:18.644541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:18.645140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:18.645557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:18.655331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.656150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.656590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.657502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.657959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.658549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.677644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:18.684308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Getting quotas for user 875dca9ed4914e379601ddbdba035cb2 and project 880e05820ad14f60888593d56af81f70. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:18.698571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:09:18.701077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:09:18.757652 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-feab5df5-7edd-4084-9f46-6dfba50e2b86 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747957 Oct 16 01:09:18.758319 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 966/2082] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:09:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:09:18.770674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:18.772349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:18.782807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.783326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.784020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.784738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.785509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.786323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.798484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:18.799810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:18.800523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:18.801289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:18.802058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:18.814461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.815299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.815971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.816948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.817654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.818277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.839615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:18.846293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:18.860594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:09:18.863159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:09:18.941023 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4adc10f5-fbd4-44cb-8166-cbcf42bd5894 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495177 Oct 16 01:09:18.941818 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1117/2083] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:09:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:09:18.946969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:18.947760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:18.956450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.957130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.957752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.958662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:18.959333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:18.959967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:18.962042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:18.975277 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39a02ccb-0402-4f85-b37c-e8af661a6b33 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1522 microversion: 2.1 time: 0.214343 Oct 16 01:09:18.987224 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 967/2084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:18 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:18.987224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-668eedea-9a0b-400a-99dd-7876aa358fb4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:18.987224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-668eedea-9a0b-400a-99dd-7876aa358fb4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:19.070713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:19.086322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:19.089935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-668eedea-9a0b-400a-99dd-7876aa358fb4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:19.099090 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-668eedea-9a0b-400a-99dd-7876aa358fb4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1207 microversion: 2.1 time: 0.121040 Oct 16 01:09:19.099521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:19.100781 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34dfcba5-ceab-4568-a4f2-32eea29e8e34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1335 microversion: 2.54 time: 0.157881 Oct 16 01:09:19.101338 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1118/2085] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:18 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:19.111989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:19.115510 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 968/2086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:18 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1207 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:19.116962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:19.122059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1596dd91-0dac-4514-b349-574b27fbeb89 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:19.123302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1596dd91-0dac-4514-b349-574b27fbeb89 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:19.130735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.131262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.131701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.132410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.132890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.133318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.271858 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1596dd91-0dac-4514-b349-574b27fbeb89 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:19.286290 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1596dd91-0dac-4514-b349-574b27fbeb89 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1217 microversion: 2.1 time: 0.169347 Oct 16 01:09:19.287863 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 969/2087] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:19 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:19.322902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:19.324922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:19.338229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.339539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.340098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.340830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.341312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.341719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.349224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:19.370010 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a0998889-3186-49c0-9cfb-1c0a6394f689 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1273 microversion: 2.1 time: 0.262573 Oct 16 01:09:19.370614 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1119/2088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:19 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:19.378590 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] HTTP exception thrown: Instance is not a member of specified network Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Request method failure captured: Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f/ips/invalid HTTP/1.1 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1mjlTrH8jpOFEAVhueIvgXbDtv2mpNflQNf8RG2386yUrkqZlYO8vRQRdAzYVpMxrUr5zvQgzuwAKiy7ZXUSaw5T1a7uNH8qT4Rc7nH18pmoIAzo1tGDQ3lIHJ0z81TJzD1Z31TN-pdop8M07bfOb_ofMps75uf41qFev25YyiJOmc Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3073f1ee5beb4ec2924fd3b3297a00d5 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3073f1ee5beb4ec2924fd3b3297a00d5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3073f1ee5beb4ec2924fd3b3297a00d5 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerAddressesNegativeTestJSON-1710951185-project Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 3f51c8481e854aa98f0b2601260efe5d Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1710951185-project Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: exception: Instance is not a member of specified network Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': '707c3ce6-d0cd-45c3-9230-7eda3c3dc95f', 'id': 'invalid'} Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 16 01:09:19.386386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:19.389195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:19.389261 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7898650a-137e-4572-bc42-a491eb61b21d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.086891 Oct 16 01:09:19.390711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 970/2089] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:09:19 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f/ips/invalid => generated 91 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:19.401449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-319b6acb-7fac-48ac-8dce-133c2e9c7027 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:19.402047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-319b6acb-7fac-48ac-8dce-133c2e9c7027 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Failed to fetch instance by id 999 {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 16 01:09:19.402675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-319b6acb-7fac-48ac-8dce-133c2e9c7027 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] HTTP exception thrown: Instance 999 could not be found. Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-319b6acb-7fac-48ac-8dce-133c2e9c7027 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Request method failure captured: Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mjlTrH8jpOFEAVhueIvgXbDtv2mpNflQNf8RG2386yUrkqZlYO8vRQRdAzYVpMxrUr5zvQgzuwAKiy7ZXUSaw5T1a7uNH8qT4Rc7nH18pmoIAzo1tGDQ3lIHJ0z81TJzD1Z31TN-pdop8M07bfOb_ofMps75uf41qFev25YyiJOmc Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3073f1ee5beb4ec2924fd3b3297a00d5 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3073f1ee5beb4ec2924fd3b3297a00d5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3073f1ee5beb4ec2924fd3b3297a00d5 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerAddressesNegativeTestJSON-1710951185-project Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 3f51c8481e854aa98f0b2601260efe5d Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1710951185-project Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 999 could not be found. Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': '999'} Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 16 01:09:19.404747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:19.408901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-319b6acb-7fac-48ac-8dce-133c2e9c7027 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:19.409886 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-319b6acb-7fac-48ac-8dce-133c2e9c7027 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.013260 Oct 16 01:09:19.411017 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1120/2090] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:09:19 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:19.419863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:19.420386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:19.428699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.429199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.432218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.433115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.433718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.434190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.474579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:19.584750 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e7b79fb8-7e96-4ea1-9295-17c473516e6d tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "DELETE /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 204 len: 0 microversion: 2.1 time: 0.169099 Oct 16 01:09:19.585530 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 971/2091] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:19 2022] DELETE /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:19.593586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:19.594327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:19.601066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.601559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.601990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.602758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:19.603233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:19.603653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:19.763264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:19.778372 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b8799e8-92c6-4b55-a7aa-8fb15832ee59 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1528 microversion: 2.1 time: 0.187521 Oct 16 01:09:19.779591 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1121/2092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:19 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1528 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:20.127844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:20.128816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:20.131278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:20.132587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:20.135379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.135863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.136465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.137591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.138223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.138902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.142131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.143352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.143881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.144997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.146067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.146976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.226541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.237881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.239539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.240948 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c13a70a9-2c9c-4fda-8ff8-f70e0f38a8aa tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1335 microversion: 2.54 time: 0.117527 Oct 16 01:09:20.241674 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1122/2093] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:20 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:20.263382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.271857 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c107c5b-199e-4698-b5e2-a59543484e62 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1203 microversion: 2.1 time: 0.149866 Oct 16 01:09:20.272461 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 972/2094] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:20 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:20.311459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:20.312641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:20.318601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.319177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.319562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.320263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.320717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.321140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.394645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:20.395736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:20.402428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.403156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.403848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.404575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.405222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.405913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.486665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.503743 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bdb947d4-9127-4c76-a4c8-3fcdb3af839a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1281 microversion: 2.1 time: 0.113165 Oct 16 01:09:20.507483 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 973/2095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:20 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:20.629835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.638581 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-516457c7-bcd0-4942-88e8-17ddd60d8488 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1221 microversion: 2.1 time: 0.330617 Oct 16 01:09:20.639692 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1123/2096] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:20 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1221 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:20.804687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:20.805307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:20.812370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.813019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.813426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.814150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:20.814671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:20.815284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:20.820468 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:20.959772 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:20.969848 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b16bbfa4-6574-40f0-885b-f8d06fa47d89 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1528 microversion: 2.1 time: 0.169504 Oct 16 01:09:20.970842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 974/2097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:20 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1528 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:21.269045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:21.269781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:21.277126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.277759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.278200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.278908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.279667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.280106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.297840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:21.298576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:21.305723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.306295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.306779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.307667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.308141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.308572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.346101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:21.354825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:21.356577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:21.357969 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-47aebaa6-8ccf-4c90-9b57-73d6141b5f17 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1356 microversion: 2.54 time: 0.093772 Oct 16 01:09:21.358681 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1124/2098] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:21 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1356 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:09:21.387960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a9ffce3-538a-4070-a410-2a0dec798acc tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Action: 'create', calling method: .version_select at 0x7fd64dd0b430>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-650230454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSs9Aa6kYcn/oXC1mcarJokmlScsy9ejKsKBDKneCdETBPkpK/r9C7AjO/km79oSwjt4gWNbGhVw+3OvtDCVl6S56M3mO3Ao8tYjA5Qni83469XzYZXcgcBTusKKMAYAw=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:21.405127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9a9ffce3-538a-4070-a410-2a0dec798acc tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Getting quotas for project 021b1335de664adea720f7b92f00cff5. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:21.411137 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9a9ffce3-538a-4070-a410-2a0dec798acc tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Getting quotas for user bc122b9d7abf459fa506adcdbc0e4c50 and project 021b1335de664adea720f7b92f00cff5. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:21.417336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:21.426512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-41a57934-513b-47de-ae7c-8b5fcad75092 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1203 microversion: 2.1 time: 0.135020 Oct 16 01:09:21.427586 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 975/2099] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:21 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1203 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:21.441101 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9a9ffce3-538a-4070-a410-2a0dec798acc tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.056769 Oct 16 01:09:21.442001 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1125/2100] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:09:21 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:09:21.457260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-650230454", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:21.461065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:21.467958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.469418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.469851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.470558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.471043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.471624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.529520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:21.531492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:21.537901 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:21.540461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.541528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.542511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.544454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.545062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.545669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.600722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:21.601401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:21.602167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:21.602741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:21.603701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:21.779139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:21.792591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.793260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.793862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.812774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.813425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.822611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.913409 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-08914dca-8de4-4fde-96a5-c85a2545813d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "POST /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d/action" status: 202 len: 1138 microversion: 2.54 time: 0.463093 Oct 16 01:09:21.922156 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 976/2101] 10.222.0.39 () {62 vars in 1320 bytes} [Sun Oct 16 01:09:21 2022] POST /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d/action => generated 1138 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 16 01:09:21.940425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:21.941255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:21.953396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.953881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.954321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:21.959897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:21.960496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:21.960947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:22.010192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:22.026674 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-25a52988-fbab-4f67-85e1-0e0cdcd82f1f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.501841 Oct 16 01:09:22.027297 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1126/2102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:21 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:22.045207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:22.045825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:22.068304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:22.069020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:22.069612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:22.070484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:22.071123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:22.073646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:22.232645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:22.248139 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4b28c4fd-ea6c-4f52-8f5c-f24013827aec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1213 microversion: 2.1 time: 0.324855 Oct 16 01:09:22.255632 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 977/2103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:21 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1213 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:22.271186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:22.277128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:22.294217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:22.294726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:22.298183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:22.299055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:22.299547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:22.300010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:22.348548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:22.371618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:22.373782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:22.376109 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f6b7ed71-b6b0-403c-9ab5-9878e9fa71ae tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.334666 Oct 16 01:09:22.377182 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1127/2104] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:22 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:22.416608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5fd2397c-1194-46b4-a721-a64043672096 req-c976fbf9-51ee-45cd-9652-9262f50c18d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "name": "network-vif-plugged", "status": "completed", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:22.437740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5fd2397c-1194-46b4-a721-a64043672096 req-c976fbf9-51ee-45cd-9652-9262f50c18d2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:22.438412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5fd2397c-1194-46b4-a721-a64043672096 req-c976fbf9-51ee-45cd-9652-9262f50c18d2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:22.438860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5fd2397c-1194-46b4-a721-a64043672096 req-c976fbf9-51ee-45cd-9652-9262f50c18d2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:22.461898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5fd2397c-1194-46b4-a721-a64043672096 req-c976fbf9-51ee-45cd-9652-9262f50c18d2 service nova] Creating event network-vif-plugged:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:09:22.475265 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5fd2397c-1194-46b4-a721-a64043672096 req-c976fbf9-51ee-45cd-9652-9262f50c18d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064882 Oct 16 01:09:22.476407 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1128/2105] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:09:22.482318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:22.483091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:22.492434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:22.493999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:22.494472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:22.495923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:22.496421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:22.496867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.067728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:23.080799 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6ee9c105-ac8a-4eff-8c5a-e4f752e38e5a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1259 microversion: 2.1 time: 0.599457 Oct 16 01:09:23.092855 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1129/2106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:22 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1259 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:23.101840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:23.102751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:23.117010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:23.117830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:23.118488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.119366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:23.120101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:23.120790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.146304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:23.154840 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ceffd4e-5fcf-43fb-a1af-8e7878a1bb5a tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1528 microversion: 2.1 time: 0.894652 Oct 16 01:09:23.157752 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 978/2107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:22 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1528 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:23.302250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:23.307491 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:23.319483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:23.320980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:23.321633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.323463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:23.324395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:23.325037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.431937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:23.441771 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7d06044-3053-4f90-b301-e66cde88be14 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1269 microversion: 2.1 time: 0.169811 Oct 16 01:09:23.447270 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 979/2108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:23 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:23.453076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:23.453721 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:23.476284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:23.476742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:23.477183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.477902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:23.478358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:23.478778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.524668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:23.544816 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7a8e2386-a3d5-49b2-b5b1-72243a71f773 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.448854 Oct 16 01:09:23.547147 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1130/2109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:23 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:23.569607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c6bebe31-c922-4de5-bc22-6e78b0b8bd2b req-95fa086d-70e3-4746-b629-e3f435578359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707c3ce6-d0cd-45c3-9230-7eda3c3dc95f", "name": "network-vif-deleted", "tag": "34b40d80-b4e8-4e9f-bf92-92f22b84083d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:23.597091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c6bebe31-c922-4de5-bc22-6e78b0b8bd2b req-95fa086d-70e3-4746-b629-e3f435578359 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:23.597571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c6bebe31-c922-4de5-bc22-6e78b0b8bd2b req-95fa086d-70e3-4746-b629-e3f435578359 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:23.597998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c6bebe31-c922-4de5-bc22-6e78b0b8bd2b req-95fa086d-70e3-4746-b629-e3f435578359 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.653153 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c6bebe31-c922-4de5-bc22-6e78b0b8bd2b req-95fa086d-70e3-4746-b629-e3f435578359 service nova] Creating event network-vif-deleted:34b40d80-b4e8-4e9f-bf92-92f22b84083d for instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f on n-h1-master-1 Oct 16 01:09:23.666868 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c6bebe31-c922-4de5-bc22-6e78b0b8bd2b req-95fa086d-70e3-4746-b629-e3f435578359 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098428 Oct 16 01:09:23.668587 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1131/2110] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:09:23.676229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:23.711403 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:23.722991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:23.724967 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5e84036d-7d62-416f-8302-34c331b97204 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.276314 Oct 16 01:09:23.726578 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 980/2111] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:23 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:23.761340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-920cd470-3c04-4f88-8f4f-dafecf09aea6 req-258bd16a-e461-4cb4-a1c8-84f82889afe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9503402-a817-49f4-82fa-f213c8159edc", "name": "network-vif-deleted", "tag": "51fed29d-d895-44b3-a5d6-9ba0dc45a746"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:23.789713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-920cd470-3c04-4f88-8f4f-dafecf09aea6 req-258bd16a-e461-4cb4-a1c8-84f82889afe8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:23.792966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-920cd470-3c04-4f88-8f4f-dafecf09aea6 req-258bd16a-e461-4cb4-a1c8-84f82889afe8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:23.793759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-920cd470-3c04-4f88-8f4f-dafecf09aea6 req-258bd16a-e461-4cb4-a1c8-84f82889afe8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:23.832579 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-920cd470-3c04-4f88-8f4f-dafecf09aea6 req-258bd16a-e461-4cb4-a1c8-84f82889afe8 service nova] Creating event network-vif-deleted:51fed29d-d895-44b3-a5d6-9ba0dc45a746 for instance a9503402-a817-49f4-82fa-f213c8159edc on n-h1-master-1 Oct 16 01:09:23.838800 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-920cd470-3c04-4f88-8f4f-dafecf09aea6 req-258bd16a-e461-4cb4-a1c8-84f82889afe8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093420 Oct 16 01:09:23.839780 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1132/2112] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:24.120783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:24.122850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:24.146871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.148477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.148930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.150768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.154900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.168833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.187901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:24.191545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:24.210076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.211483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.212175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.213097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.213773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.214395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.370342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.375586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.376707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.377423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lazy-loading 'fault' on Instance uuid 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:24.418519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:24.435855 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e7d34230-242c-4372-a529-ed7af4e69fd9 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1265 microversion: 2.1 time: 0.322932 Oct 16 01:09:24.436810 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 981/2113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:24 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:24.470025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:24.470902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:24.488745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.489388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.489840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.490870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.491431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.492582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.503818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f51c8481e854aa98f0b2601260efe5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3073f1ee5beb4ec2924fd3b3297a00d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:24.513030 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e30eb63-9923-41b2-ac0a-7d334d1d5d65 tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 200 len: 1315 microversion: 2.1 time: 0.330548 Oct 16 01:09:24.521233 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1133/2114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:24 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:24.574767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:24.575471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:24.589073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.589580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.590008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.592461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.593815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.600607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.689233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:24.700080 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4a2dd526-7724-44cd-aebd-f0cac47fb571 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1275 microversion: 2.1 time: 0.234149 Oct 16 01:09:24.726396 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 982/2115] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:24 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:24.758865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:24.763863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:24.788036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.789378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.792539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.795196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:24.796781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:24.799476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:24.920991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:24.943683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:24.957750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:24.962426 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-810e45c8-3a70-4fa0-9042-010087986b48 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.210578 Oct 16 01:09:24.970369 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 983/2116] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:24 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:25.112016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:25.127913 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65451e6b-0db7-4c0e-b850-7e82d92562a1 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.557307 Oct 16 01:09:25.131312 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1134/2117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:24 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:25.470859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:25.472300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:25.488914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:25.489752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:25.492828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:25.493754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:25.494550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:25.495017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:25.540667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:25.541278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] [instance: 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:25.576956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:25.577593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:25.578096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:25.578836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:25.579417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:25.579840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:25.600431 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:25.634306 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] HTTP exception thrown: Instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f could not be found. Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Request method failure captured: Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f HTTP/1.1 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mjlTrH8jpOFEAVhueIvgXbDtv2mpNflQNf8RG2386yUrkqZlYO8vRQRdAzYVpMxrUr5zvQgzuwAKiy7ZXUSaw5T1a7uNH8qT4Rc7nH18pmoIAzo1tGDQ3lIHJ0z81TJzD1Z31TN-pdop8M07bfOb_ofMps75uf41qFev25YyiJOmc Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3073f1ee5beb4ec2924fd3b3297a00d5 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3073f1ee5beb4ec2924fd3b3297a00d5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3073f1ee5beb4ec2924fd3b3297a00d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3073f1ee5beb4ec2924fd3b3297a00d5 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1710951185 Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerAddressesNegativeTestJSON-1710951185-project Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 3f51c8481e854aa98f0b2601260efe5d Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1710951185-project Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f could not be found. Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '707c3ce6-d0cd-45c3-9230-7eda3c3dc95f'} Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f could not be found. Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f could not be found. Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:25.635942 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:25.639014 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:25.639014 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:25.639014 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:25.639014 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:25.639014 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:25.639014 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:25.639014 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f could not be found. Oct 16 01:09:25.639014 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:25.650047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] Returning 404 to user: Instance 707c3ce6-d0cd-45c3-9230-7eda3c3dc95f could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:25.651871 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1de8cba7-3e2a-4c09-b9d8-1dc4c4378b2e tempest-ServerAddressesNegativeTestJSON-1710951185 tempest-ServerAddressesNegativeTestJSON-1710951185-project] 10.222.0.39 "GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f" status: 404 len: 111 microversion: 2.1 time: 0.114337 Oct 16 01:09:25.652966 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1135/2118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:25 2022] GET /compute/v2.1/servers/707c3ce6-d0cd-45c3-9230-7eda3c3dc95f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:09:25.714572 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-bd8846bc-98fa-4909-a3ab-ebe8f0e1dce3 req-df4f4f8d-b8aa-4e0e-b54f-148b7a735f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3", "tag": "e1b4db59-fd7f-4dd9-8a04-7af773b586ef"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:25.732734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bd8846bc-98fa-4909-a3ab-ebe8f0e1dce3 req-df4f4f8d-b8aa-4e0e-b54f-148b7a735f75 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:25.743178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bd8846bc-98fa-4909-a3ab-ebe8f0e1dce3 req-df4f4f8d-b8aa-4e0e-b54f-148b7a735f75 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:25.744179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bd8846bc-98fa-4909-a3ab-ebe8f0e1dce3 req-df4f4f8d-b8aa-4e0e-b54f-148b7a735f75 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:25.762281 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-bd8846bc-98fa-4909-a3ab-ebe8f0e1dce3 req-df4f4f8d-b8aa-4e0e-b54f-148b7a735f75 service nova] Creating event network-changed:e1b4db59-fd7f-4dd9-8a04-7af773b586ef for instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 on n-h2-master-1 Oct 16 01:09:25.780070 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-bd8846bc-98fa-4909-a3ab-ebe8f0e1dce3 req-df4f4f8d-b8aa-4e0e-b54f-148b7a735f75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069293 Oct 16 01:09:25.781039 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1136/2119] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:09:25.788635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:25.795874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:25.810961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:25.811763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:25.816550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:25.819994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:25.820687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:25.821299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:25.997188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:26.009772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-921715ec-6680-43e1-9c8f-a3178b750505 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1275 microversion: 2.1 time: 0.227272 Oct 16 01:09:26.024474 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1137/2120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:25 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:26.039398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:26.050898 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3880cc94-fd9c-449e-8b87-fe86079def41 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1307 microversion: 2.1 time: 0.585110 Oct 16 01:09:26.051516 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 984/2121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:25 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1307 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:26.052978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:26.056686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:26.069642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:26.074297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:26.075007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:26.076442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:26.077067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:26.078608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:26.155671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:26.156232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:26.167678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:26.169926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:26.170384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:26.171159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:26.174459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:26.175119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:26.260535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:26.274805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:26.276564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:26.279508 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ed287cb6-3dc9-40d0-925f-ad466fa80142 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.250267 Oct 16 01:09:26.283482 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1138/2122] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:26 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:26.629515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:26.638519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db5bb6b7-5e8c-4ce7-b599-cfb7463240ed tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.487191 Oct 16 01:09:26.642249 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 985/2123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:26 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:27.037970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:27.038748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:27.057552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:27.066644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:27.067463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:27.071226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:27.078556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:27.079345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:27.086710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:27.087656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:27.095554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:27.097689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:27.099049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:27.108189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:27.112354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:27.112902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:27.659813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:27.668821 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8cfcfbe9-8999-436e-b083-2a8966a239fb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1317 microversion: 2.1 time: 0.634895 Oct 16 01:09:27.676269 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1139/2124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:27 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:27.681384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:27.692330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:27.698346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:27.699598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:27.700230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:27.702172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:27.715095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:27.715884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:28.202884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:28.228959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:28.241651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:28.250034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:28.254016 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-469038b4-68e7-45f4-b078-4bb4755aadf4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.569850 Oct 16 01:09:28.258816 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1140/2125] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:27 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:28.263854 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53ace6ba-ca67-4b7c-a8ff-da5f6db72478 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1307 microversion: 2.1 time: 1.189755 Oct 16 01:09:28.282334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:28.283654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:28.283783 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 986/2126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:27 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1307 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:28.303446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:28.305661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:28.307788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:28.309615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:28.312240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:28.313005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:28.592004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:28.601597 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f212124-9b36-4b07-9c15-0dddb429a096 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.341180 Oct 16 01:09:28.606717 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1141/2127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:28 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:28.705369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:28.706338 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:28.726976 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:28.731099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:28.733094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:28.735741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:28.738008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:28.739266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:28.741197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:28.893790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b107848b-ba3d-4fa0-bfc2-1529ab9eda3d req-f63ac352-66bf-4f30-9a6f-f088d64a72fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72afa838-e929-438a-82be-f5339d86e9ee", "tag": "9ce725aa-ef63-4602-82a1-ece3baf27771"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:28.919567 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:28.940067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b107848b-ba3d-4fa0-bfc2-1529ab9eda3d req-f63ac352-66bf-4f30-9a6f-f088d64a72fe service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:28.943014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b107848b-ba3d-4fa0-bfc2-1529ab9eda3d req-f63ac352-66bf-4f30-9a6f-f088d64a72fe service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:28.946379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b107848b-ba3d-4fa0-bfc2-1529ab9eda3d req-f63ac352-66bf-4f30-9a6f-f088d64a72fe service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:28.975350 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b107848b-ba3d-4fa0-bfc2-1529ab9eda3d req-f63ac352-66bf-4f30-9a6f-f088d64a72fe service nova] Creating event network-changed:9ce725aa-ef63-4602-82a1-ece3baf27771 for instance 72afa838-e929-438a-82be-f5339d86e9ee on n-h1-master-1 Oct 16 01:09:28.982235 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b107848b-ba3d-4fa0-bfc2-1529ab9eda3d req-f63ac352-66bf-4f30-9a6f-f088d64a72fe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092287 Oct 16 01:09:28.985679 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1142/2128] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:29.164540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f53bd71a-cfe5-4aa4-b3e2-9725b0448ce3 req-c4fb695c-f94b-41ae-8965-41e0c4a1624a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63dd9af-be49-4135-8268-025c44ef66e1", "tag": "2b6a0984-9d7c-48fe-8708-15d2afabf1d4"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:29.183168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f53bd71a-cfe5-4aa4-b3e2-9725b0448ce3 req-c4fb695c-f94b-41ae-8965-41e0c4a1624a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:29.187382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f53bd71a-cfe5-4aa4-b3e2-9725b0448ce3 req-c4fb695c-f94b-41ae-8965-41e0c4a1624a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:29.188109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f53bd71a-cfe5-4aa4-b3e2-9725b0448ce3 req-c4fb695c-f94b-41ae-8965-41e0c4a1624a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:29.208384 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f53bd71a-cfe5-4aa4-b3e2-9725b0448ce3 req-c4fb695c-f94b-41ae-8965-41e0c4a1624a service nova] Creating event network-changed:2b6a0984-9d7c-48fe-8708-15d2afabf1d4 for instance e63dd9af-be49-4135-8268-025c44ef66e1 on n-h1-master-1 Oct 16 01:09:29.232711 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f53bd71a-cfe5-4aa4-b3e2-9725b0448ce3 req-c4fb695c-f94b-41ae-8965-41e0c4a1624a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072941 Oct 16 01:09:29.233587 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1143/2129] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:09:29.243209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:29.251711 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef891d36-56a5-4d6a-a009-270a68818fa3 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1317 microversion: 2.1 time: 0.553405 Oct 16 01:09:29.259255 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 987/2130] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:28 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:29.292523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:29.294423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:29.295308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:29.297564 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=20 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:29.298563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:29.316500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:29.317008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:29.317454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:29.318228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:29.318694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:29.320303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:29.320992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:29.321580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:29.322483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:29.323350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:29.323970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:29.328018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:29.366036 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:29.510905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:29.523781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:29.525795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:29.527296 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8419537e-c016-4170-b748-56db8767e8e4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.244528 Oct 16 01:09:29.528355 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1144/2131] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:29 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:29.634472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:29.635332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:29.651017 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:29.653689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:29.654224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:29.660873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:29.661550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:29.662080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:29.853868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:29.866120 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8828b202-303b-4aeb-9b00-58b666b01fe4 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1307 microversion: 2.1 time: 0.577909 Oct 16 01:09:29.869861 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 988/2132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:29 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1307 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:30.278592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:30.285475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:30.286250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:30.302785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:30.306486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:30.308154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:30.309030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:30.311447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:30.312115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:30.314462 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d2fa67e-998f-4443-85f6-c1127a9dfc53 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.678600 Oct 16 01:09:30.315253 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1145/2133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:29 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:30.538596 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:30.563944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:30.564851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:30.566349 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3650d294-7f86-45e6-bf41-14060f5573e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1317 microversion: 2.1 time: 0.285383 Oct 16 01:09:30.581273 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 989/2134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:30 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:30.585869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:30.586588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:30.587237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:30.588345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:30.589132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:30.589689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:30.743686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:30.758383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:30.760110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:30.762011 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc4d9ef9-9810-4721-b65f-807c92fb1599 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.201757 Oct 16 01:09:30.787791 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1146/2135] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:30 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:30.901787 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:30.902670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:30.919836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:30.922280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:30.926515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:30.933721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:30.934830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:30.935308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:31.264394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:31.272871 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9bd13dcc-7e95-40a6-90cd-1565e099a7df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1307 microversion: 2.1 time: 0.374823 Oct 16 01:09:31.278623 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 990/2136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:30 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1307 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:31.341428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:31.342250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:31.369826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:31.370341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:31.370796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:31.372948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:31.373436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:31.373872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:31.420510 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=18 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:31.594943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:31.595511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:31.602036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:31.607414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:31.607894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:31.608653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:31.609661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:31.610094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:32.131321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:32.145441 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bde4a712-356f-41d1-aa89-c385c9798689 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1317 microversion: 2.1 time: 0.556021 Oct 16 01:09:32.153936 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 991/2137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:31 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:32.160588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:32.168654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:32.178029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e9edc72-fd8c-42af-aa9b-af079d00257b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.842869 Oct 16 01:09:32.179451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:32.185819 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1147/2138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:31 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:32.198945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:32.199602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:32.200044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:32.200911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:32.201502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:32.202062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:32.309261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:32.310059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:32.326213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:32.330542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:32.331133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:32.333050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:32.338278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:32.338841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:32.397094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:32.411142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:32.422188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:32.428764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d22c54c-bc64-4745-ab93-bb4cd8bee2df tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.272309 Oct 16 01:09:32.429831 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 992/2139] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:32 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:32.732483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:32.739992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3d09b3bc-779e-40b0-8f23-ca2ef320b90b tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1307 microversion: 2.1 time: 0.434608 Oct 16 01:09:32.740572 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1148/2140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:32 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1307 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:32.900429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f7c81672-9feb-4f85-85b1-dd448c7765a7 req-7ac5b6f6-1b17-4827-994d-6bd6e8486fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3", "name": "network-vif-plugged", "status": "completed", "tag": "e1b4db59-fd7f-4dd9-8a04-7af773b586ef"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:32.944782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7c81672-9feb-4f85-85b1-dd448c7765a7 req-7ac5b6f6-1b17-4827-994d-6bd6e8486fff service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:32.944782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7c81672-9feb-4f85-85b1-dd448c7765a7 req-7ac5b6f6-1b17-4827-994d-6bd6e8486fff service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:32.944782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7c81672-9feb-4f85-85b1-dd448c7765a7 req-7ac5b6f6-1b17-4827-994d-6bd6e8486fff service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:32.965627 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f7c81672-9feb-4f85-85b1-dd448c7765a7 req-7ac5b6f6-1b17-4827-994d-6bd6e8486fff service nova] Creating event network-vif-plugged:e1b4db59-fd7f-4dd9-8a04-7af773b586ef for instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 on n-h2-master-1 Oct 16 01:09:32.975685 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f7c81672-9feb-4f85-85b1-dd448c7765a7 req-7ac5b6f6-1b17-4827-994d-6bd6e8486fff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083487 Oct 16 01:09:32.977143 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 993/2141] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:33.183115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:33.183734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:33.190826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:33.191195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:33.191627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:33.208299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:33.208839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:33.209365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:33.220381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:33.221079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:33.245539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:33.246127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:33.246572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:33.247343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:33.247803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:33.248229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:33.753013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:33.779220 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ed405d07-16a7-4032-8870-656f626dc76c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1317 microversion: 2.1 time: 0.604738 Oct 16 01:09:33.779802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1149/2142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:33 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:33.796564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1427326267", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a5e706d8-a668-4337-ad37-edd049e6eb97"}], "block_device_mapping_v2": [{"uuid": "fde5f594-b84a-4bc2-b996-39494783f66f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:33.967414 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:33.982900 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4bcdf00-1645-4d59-a81a-9855a9b12b4b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.767354 Oct 16 01:09:33.993193 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 994/2143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:33 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:34.005364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:34.009040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:34.026088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] validate_networks() for [('a5e706d8-a668-4337-ad37-edd049e6eb97', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:09:34.027151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:34.028595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:34.029291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:34.030216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:34.032507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:34.033564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:34.411386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:34.425645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:34.427948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:34.430682 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-71f9fff3-c690-4fbf-a1f9-6e22acf945f2 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.435995 Oct 16 01:09:34.437222 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 995/2144] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:33 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:34.458588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:34.459522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:34.473074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:34.475179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:34.475792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:34.478673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:34.479374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:34.479967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:34.850653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:34.859918 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-75836a1f-7b74-4b42-8c81-cbbca9aa1e93 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1307 microversion: 2.1 time: 0.421230 Oct 16 01:09:34.865652 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 996/2145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:34 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1307 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:34.873450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:34.876437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:34.888342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:34.892636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:34.893950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:34.900113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:34.900799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:34.901417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:35.155096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:35.157288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:35.157927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:35.158516 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:35.159703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:35.202072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:35.205258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:35.210321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:35.219623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-13d5c8c3-4db1-4a15-b35c-5e2b07c0be1e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1317 microversion: 2.1 time: 0.352735 Oct 16 01:09:35.220174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:35.222601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:35.223148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:35.223600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:35.224667 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 997/2146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:34 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:35.240666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:35.244011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:35.260717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:35.262328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:35.269393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:35.270382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:35.271043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:35.271635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:35.288904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for project 05a68224ef104af2963c881faa8383de. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:35.299155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Getting quotas for user 3c33afd9ae144eb185203c30baa70351 and project 05a68224ef104af2963c881faa8383de. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:35.403907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:09:35.407125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fde5f594-b84a-4bc2-b996-39494783f66f',volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:09:35.734887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:35.751285 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3a213b1-03b1-4fcb-be83-88af9c2ee2b4 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1321 microversion: 2.1 time: 0.522009 Oct 16 01:09:35.752044 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 998/2147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:35 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:35.774781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-3d81bd71-4753-493b-92a1-dbad013ff45c req-84dfce25-ed14-41ea-92e2-da122a45ab9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72afa838-e929-438a-82be-f5339d86e9ee", "name": "network-vif-plugged", "status": "completed", "tag": "9ce725aa-ef63-4602-82a1-ece3baf27771"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:35.798062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3d81bd71-4753-493b-92a1-dbad013ff45c req-84dfce25-ed14-41ea-92e2-da122a45ab9a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:35.799299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3d81bd71-4753-493b-92a1-dbad013ff45c req-84dfce25-ed14-41ea-92e2-da122a45ab9a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:35.801360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3d81bd71-4753-493b-92a1-dbad013ff45c req-84dfce25-ed14-41ea-92e2-da122a45ab9a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:35.823923 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f930006-ae19-4852-aa1d-24823d7d6a7c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039297 Oct 16 01:09:35.827146 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1150/2148] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:09:35.829620 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-3d81bd71-4753-493b-92a1-dbad013ff45c req-84dfce25-ed14-41ea-92e2-da122a45ab9a service nova] Creating event network-vif-plugged:9ce725aa-ef63-4602-82a1-ece3baf27771 for instance 72afa838-e929-438a-82be-f5339d86e9ee on n-h1-master-1 Oct 16 01:09:35.839503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:35.847947 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-3d81bd71-4753-493b-92a1-dbad013ff45c req-84dfce25-ed14-41ea-92e2-da122a45ab9a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086115 Oct 16 01:09:35.852068 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 999/2149] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:35.855377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:35.857842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f6e4126-03a1-49c1-a7f1-48fff904e90e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:35.860841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7f6e4126-03a1-49c1-a7f1-48fff904e90e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:35.873200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:35.873715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:35.874753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:35.876177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:35.876810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:35.877306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:35.901748 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:36.266513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:36.279118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:36.291351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f6e4126-03a1-49c1-a7f1-48fff904e90e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:36.299426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:36.301030 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7cc05d3f-529b-411a-94a0-db86e0f33b74 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.471154 Oct 16 01:09:36.302383 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1151/2150] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:35 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:36.306530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:36.319173 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7f6e4126-03a1-49c1-a7f1-48fff904e90e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1053 microversion: 2.1 time: 0.465515 Oct 16 01:09:36.321704 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1000/2151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:35 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1053 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:36.331819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08642fe1-eb1d-4e50-af2a-bdae5015a858"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:36.335319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:36.339984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:36.357363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:36.360377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:36.361791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:36.362108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:36.362699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:36.365055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:36.367609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:36.370389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:36.371182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:36.372765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:36.375326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:36.377059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.071202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:37.085269 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba78187f-63a7-4eb5-9ad0-a2ee2f4fef76 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1307 microversion: 2.1 time: 0.782555 Oct 16 01:09:37.086277 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1152/2152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:36 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1307 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:37.099134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:37.099134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:37.112055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.114375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.115342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.116578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.118097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.118810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.256407 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f22de63e-bb53-4388-82e8-c8b283e35dbe tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "POST /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.933142 Oct 16 01:09:37.263378 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1001/2153] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:09:36 2022] POST /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:37.294498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:37.303860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:37.360077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.362484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.364477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.365452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.372190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.372799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.467397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:37.489007 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a96089a-2416-489c-bb7f-21fd8ce12a81 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1317 microversion: 2.1 time: 0.400520 Oct 16 01:09:37.489974 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1153/2154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:37 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:37.494651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:37.495288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:37.509032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.509835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.510473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.511353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.511951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.512526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.667836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:37.677318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:37.679055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:37.688194 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-73bd8e5f-62f7-48c8-a68e-4d7416fea4e7 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.196704 Oct 16 01:09:37.688816 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1154/2155] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:37 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:37.724628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:37.725247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:37.742140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.742636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.743173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.744777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.745813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.746251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.791596 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:37.800866 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8103c930-279a-484a-9588-add4a119c70f tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1471 microversion: 2.1 time: 0.536047 Oct 16 01:09:37.801454 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1002/2156] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:37 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1471 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:37.809205 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:37.834872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:37.835609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:37.844957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.863413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.864036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.865825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.867561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.868179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.919404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:37.930334 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-880f0f2a-6ec1-4189-bcc9-5167d3d6debd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1151 microversion: 2.1 time: 0.217880 Oct 16 01:09:37.934145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1155/2157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:37 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1151 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:37.940095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-379ab064-385d-418e-add8-3c926da7eefd req-e69e495d-a70b-4999-b2d4-14419bad1b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63dd9af-be49-4135-8268-025c44ef66e1", "name": "network-vif-plugged", "status": "completed", "tag": "2b6a0984-9d7c-48fe-8708-15d2afabf1d4"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:37.947523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lazy-loading 'flavor' on Instance uuid f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:37.965124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-379ab064-385d-418e-add8-3c926da7eefd req-e69e495d-a70b-4999-b2d4-14419bad1b54 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:37.965543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-379ab064-385d-418e-add8-3c926da7eefd req-e69e495d-a70b-4999-b2d4-14419bad1b54 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:37.966299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-379ab064-385d-418e-add8-3c926da7eefd req-e69e495d-a70b-4999-b2d4-14419bad1b54 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:37.991255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-379ab064-385d-418e-add8-3c926da7eefd req-e69e495d-a70b-4999-b2d4-14419bad1b54 service nova] Creating event network-vif-plugged:2b6a0984-9d7c-48fe-8708-15d2afabf1d4 for instance e63dd9af-be49-4135-8268-025c44ef66e1 on n-h1-master-1 Oct 16 01:09:37.997978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-379ab064-385d-418e-add8-3c926da7eefd req-e69e495d-a70b-4999-b2d4-14419bad1b54 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062412 Oct 16 01:09:37.998818 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1156/2158] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:38.085505 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4200a6a9-6dbe-4f1c-b8a3-876a4916cdf1 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.254308 Oct 16 01:09:38.093208 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1003/2159] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:37 2022] POST /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:09:38.099559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:38.100266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:38.113756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:38.114725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:38.122084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:38.122609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:38.128153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:38.128377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:38.128669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:38.132874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:38.134463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:38.135241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:38.136214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:38.138278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:38.140881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:38.141538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:38.195299 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:38.783157 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd72c1c5-95e8-455b-964d-6f5026d04e92 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1630 microversion: 2.1 time: 0.691984 Oct 16 01:09:38.786668 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1157/2160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:38 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1630 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:38.799874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:38.800593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:38.812582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:38.816443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:38.816963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:38.817543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:38.818266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:38.818740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:38.821320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:38.828670 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c9bfe2b1-b893-4cf5-b016-5b0684908152 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1307 microversion: 2.1 time: 0.718348 Oct 16 01:09:38.831302 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1004/2161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:38 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1307 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:38.843680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:38.844920 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:38.853371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:38.854096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:38.854682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:38.855573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:38.856173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:38.856741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:38.984460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:39.001211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:39.003143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:39.006391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80a17506-2c93-4eec-90ba-cfdcbaa5880b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.173884 Oct 16 01:09:39.022943 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1005/2162] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:38 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:39.024177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:39.025592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:39.042155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:39.043040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:39.044664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:39.046734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:39.047315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:39.048731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:39.243390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:39.254535 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6da5d413-82db-47c9-ac9d-99879f2fcb53 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1169 microversion: 2.1 time: 0.241305 Oct 16 01:09:39.259703 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1006/2163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:39 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1169 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:39.437438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:39.470226 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e30f2b16-74e4-491a-bec6-504c21ea1807 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1467 microversion: 2.1 time: 0.682283 Oct 16 01:09:39.473317 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1158/2164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:38 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1467 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:39.497821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:39.503363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:39.516636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:39.520146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:39.521790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:39.523786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:39.525224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:39.530089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:39.807380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:39.808185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:39.824174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:39.825360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:39.827721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:39.828652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:39.831355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:39.832873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:40.211093 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f7a698ec-ec2b-45d3-a406-ffb7ab16335d tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1618 microversion: 2.1 time: 0.719342 Oct 16 01:09:40.221146 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1007/2165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:39 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1618 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:40.229890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:40.239898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:40.260105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:40.260619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:40.261067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:40.261796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:40.262261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:40.262693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:40.632848 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1db31eea-f936-411d-9d1e-47f2b855fffd tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1613 microversion: 2.1 time: 0.829821 Oct 16 01:09:40.634811 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1159/2166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:39 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1613 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:40.641578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:40.642718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:40.665199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:40.665961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:40.667170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:40.668190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:40.669675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:40.670302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:40.972393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:40.987336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:40.991850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:40.996709 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aeddd7f3-d12b-44af-8ffc-8c57cb1a9752 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.360018 Oct 16 01:09:41.002671 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1160/2167] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:40 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:41.015864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:41.017036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:41.037778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:41.038193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:41.041938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:41.043906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:41.044752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:41.045323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:41.046071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:41.056936 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d96caba6-4b7d-4cc7-a247-d9e9d0490153 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1487 microversion: 2.1 time: 0.825682 Oct 16 01:09:41.059117 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1008/2168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:40 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1487 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:41.067079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1080595436", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["e39cd63e-32b5-496f-aeb2-fc6855585aa5"]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:41.201361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:09:41.862705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:41.876321 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b2f2701-0af2-4afe-b2ef-b8bdee94819b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 0.868746 Oct 16 01:09:41.878712 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1161/2169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:41 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:41.896304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:41.897649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:41.917127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:41.918023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:41.920198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:41.924544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:41.927117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:41.927789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.006258 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] HTTP exception thrown: Cannot 'migrate' instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 while it is in vm_state suspended Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Request method failure captured: Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3/action HTTP/1.1 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mW8i0iCV-D4ZUkA8Dn8wVPY-HWl3zqf3CYJskVvS0PQFZGY3hzrkQafhWymSio5YNY6l_xKult4pqI8kogTXuTaUBWcDD0YQfZp0WQe-_cfCupUTNkR-tFU16ppMezVfEArJzsv0xKkSJjzPDyd716KuQGLGEC261SeirLxePHWe4 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2d294ef805184d7ca640b17b0d696056", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 9eec60746b3b409e91a3e8942fe1c73c Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: {"migrate": {}} Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'migrate' instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 while it is in vm_state suspended Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3', 'body': {'migrate': {}}} Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 in vm_state suspended. Cannot resize while the instance is in this state. Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:09:42.008181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 while it is in vm_state suspended Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 while it is in vm_state suspended Oct 16 01:09:42.012115 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.015381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Returning 409 to user: Cannot 'migrate' instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 while it is in vm_state suspended {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:42.016671 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b30336a-7c9e-444d-be5e-78e2703edbc2 tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3/action" status: 409 len: 148 microversion: 2.1 time: 0.135397 Oct 16 01:09:42.017661 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1162/2170] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:41 2022] POST /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3/action => generated 148 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:42.032284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1463130634"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:42.039322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:42.066138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.067748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.068487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.069340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.069896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.070550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.145883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:42.146405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:42.146767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:42.147206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:42.147620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:42.183779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.184322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.184780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.185562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.186035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.187056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.258539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:42.271278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:42.313363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:09:42.321848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:09:42.410907 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff3d571a-d857-4467-a266-42c4455aa37f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "POST /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1/action" status: 202 len: 0 microversion: 2.1 time: 0.389645 Oct 16 01:09:42.423321 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1163/2171] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:42 2022] POST /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:09:42.440926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:42.443495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:42.471535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.472861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.473718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.477330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:42.477972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:42.479425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:42.493654 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30b49bbd-96ae-4c1f-b7f9-8f55a9a48ed1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433352 Oct 16 01:09:42.512877 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1009/2172] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:09:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:09:42.529136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-271f2eac-3db4-4cf1-84a2-19aa952e8d5e tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-271f2eac-3db4-4cf1-84a2-19aa952e8d5e tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Request method failure captured: Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b/action HTTP/1.1 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 39 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1mW8i0iCV-D4ZUkA8Dn8wVPY-HWl3zqf3CYJskVvS0PQFZGY3hzrkQafhWymSio5YNY6l_xKult4pqI8kogTXuTaUBWcDD0YQfZp0WQe-_cfCupUTNkR-tFU16ppMezVfEArJzsv0xKkSJjzPDyd716KuQGLGEC261SeirLxePHWe4 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2d294ef805184d7ca640b17b0d696056", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 9eec60746b3b409e91a3e8942fe1c73c Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: {"os-resetState": {"state": "invalid"}} Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '67308bb0-24fc-415d-9c20-b0f810d2501b', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'invalid' Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:09:42.589016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 16 01:09:42.593092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.596051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-271f2eac-3db4-4cf1-84a2-19aa952e8d5e tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:42.600154 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-271f2eac-3db4-4cf1-84a2-19aa952e8d5e tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b/action" status: 400 len: 144 microversion: 2.1 time: 0.089881 Oct 16 01:09:42.605251 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1010/2173] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:42 2022] POST /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b/action => generated 144 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:09:42.627847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-019d9962-0098-4d66-97f7-ebf151780fa6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e77bb80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:42.724085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:42.737665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:42.739151 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:42.740364 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec4a358c-f7ca-4732-b0c0-d7eb1bc9fb84 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.315298 Oct 16 01:09:42.751167 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-019d9962-0098-4d66-97f7-ebf151780fa6 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b" status: 200 len: 1414 microversion: 2.1 time: 0.144653 Oct 16 01:09:42.753868 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1011/2174] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:09:42 2022] GET /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:42.762582 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1164/2175] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:42 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:42.764156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d66f1b2f-6535-4db0-b828-46fff523af5d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:42.766574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d66f1b2f-6535-4db0-b828-46fff523af5d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:42.805876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c674b670-a52e-40e2-bc54-c09c20ea2e8a tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c674b670-a52e-40e2-bc54-c09c20ea2e8a tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Request method failure captured: Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b/action HTTP/1.1 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 31 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mW8i0iCV-D4ZUkA8Dn8wVPY-HWl3zqf3CYJskVvS0PQFZGY3hzrkQafhWymSio5YNY6l_xKult4pqI8kogTXuTaUBWcDD0YQfZp0WQe-_cfCupUTNkR-tFU16ppMezVfEArJzsv0xKkSJjzPDyd716KuQGLGEC261SeirLxePHWe4 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2d294ef805184d7ca640b17b0d696056", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 9eec60746b3b409e91a3e8942fe1c73c Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: {"os-resetState": {"state": 1}} Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '67308bb0-24fc-415d-9c20-b0f810d2501b', 'body': {'os-resetState': {'state': 1}}} Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 1 Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 16 01:09:42.837620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c674b670-a52e-40e2-bc54-c09c20ea2e8a tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:42.841159 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c674b670-a52e-40e2-bc54-c09c20ea2e8a tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b/action" status: 400 len: 120 microversion: 2.1 time: 0.041384 Oct 16 01:09:42.879796 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1165/2176] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:42 2022] POST /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b/action => generated 120 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:09:42.906866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da1e5cf9-0e08-40d7-8e89-cce1f1f6b37a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64df9c040>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.021865 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da1e5cf9-0e08-40d7-8e89-cce1f1f6b37a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b" status: 200 len: 1414 microversion: 2.1 time: 0.140229 Oct 16 01:09:43.036232 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1166/2177] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:09:42 2022] GET /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b => generated 1414 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:43.041486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d66f1b2f-6535-4db0-b828-46fff523af5d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:43.055448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0dc9b7e4-db8b-4a65-acfc-2d2dd6e92e2d tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:43.067727 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0dc9b7e4-db8b-4a65-acfc-2d2dd6e92e2d tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Failed to fetch instance by id 999 {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 16 01:09:43.068292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-0dc9b7e4-db8b-4a65-acfc-2d2dd6e92e2d tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0dc9b7e4-db8b-4a65-acfc-2d2dd6e92e2d tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Request method failure captured: Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 37 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mW8i0iCV-D4ZUkA8Dn8wVPY-HWl3zqf3CYJskVvS0PQFZGY3hzrkQafhWymSio5YNY6l_xKult4pqI8kogTXuTaUBWcDD0YQfZp0WQe-_cfCupUTNkR-tFU16ppMezVfEArJzsv0xKkSJjzPDyd716KuQGLGEC261SeirLxePHWe4 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2d294ef805184d7ca640b17b0d696056", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2d294ef805184d7ca640b17b0d696056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 2d294ef805184d7ca640b17b0d696056 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1387685354 Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 9eec60746b3b409e91a3e8942fe1c73c Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1387685354-project-admin Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: {"os-resetState": {"state": "error"}} Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 999 could not be found. Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:43.087086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:43.091510 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:43.091510 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 16 01:09:43.091510 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.092786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0dc9b7e4-db8b-4a65-acfc-2d2dd6e92e2d tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:43.094064 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0dc9b7e4-db8b-4a65-acfc-2d2dd6e92e2d tempest-ServersAdminNegativeTestJSON-1387685354 tempest-ServersAdminNegativeTestJSON-1387685354-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.054385 Oct 16 01:09:43.098844 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1167/2178] 10.222.0.39 () {60 vars in 1179 bytes} [Sun Oct 16 01:09:43 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:43.099323 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d66f1b2f-6535-4db0-b828-46fff523af5d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1217 microversion: 2.1 time: 0.340048 Oct 16 01:09:43.102617 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1012/2179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:42 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1217 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:43.120417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3d57ea5-1e10-4a44-975a-88cd4efc88df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e53e670>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.125860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.128506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:43.148496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.149002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.153184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.154049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.154542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.159166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.469311 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3d57ea5-1e10-4a44-975a-88cd4efc88df tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b" status: 204 len: 0 microversion: 2.1 time: 0.364928 Oct 16 01:09:43.469898 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1013/2180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:43 2022] DELETE /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:43.476785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.479428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:43.512082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.513094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.516215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.518419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.520107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.522794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.595021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:43.595700 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:43.613071 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0db03a19-e4e2-42b5-98ec-a8e159cbea6a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 0.512950 Oct 16 01:09:43.620726 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1168/2181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:43 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:43.669222 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a2803521-ee4f-44b1-9041-fa507d4847ac tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64df39820>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.746431 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a2803521-ee4f-44b1-9041-fa507d4847ac tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Image not found. Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a2803521-ee4f-44b1-9041-fa507d4847ac tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b HTTP/1.1 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '72936d59-ee31-40ff-ae6d-fa7d5721ce1b'} Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 72936d59-ee31-40ff-ae6d-fa7d5721ce1b Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:09:43.782041 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 72936d59-ee31-40ff-ae6d-fa7d5721ce1b could not be found. Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a2803521-ee4f-44b1-9041-fa507d4847ac tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:43.785946 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a2803521-ee4f-44b1-9041-fa507d4847ac tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b" status: 404 len: 62 microversion: 2.1 time: 0.142159 Oct 16 01:09:43.790020 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1169/2182] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:09:43 2022] GET /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b => generated 62 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:43.795194 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.796445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:43.797907 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11cb65ed-c9a8-43f6-b4aa-787e79b87a37 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 204 len: 0 microversion: 2.1 time: 0.308324 Oct 16 01:09:43.805933 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1014/2183] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:43 2022] DELETE /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:43.829384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:43.830791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:43.833261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.836659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.837100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.837833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.843451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.843981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.856230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.856723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.857158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:43.857866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:43.858897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:43.871147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:44.103422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:44.114422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:44.125439 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:44.127083 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a5a14b71-ba41-4f23-bc87-9a142d5e7f34 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.319793 Oct 16 01:09:44.128263 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1015/2184] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:43 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:44.152738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:44.157500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:44.190521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:44.193803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:44.196995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:44.203599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:44.208541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:44.214693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:44.727274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:44.737658 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-59abcab6-695d-4270-b402-378f232de2c3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1505 microversion: 2.1 time: 0.945949 Oct 16 01:09:44.737767 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1170/2185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:43 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1505 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:44.781073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:44.789319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:44.815878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:44.821082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:44.824953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:44.825761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:44.826245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:44.833858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:44.857477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:44.867393 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2881c88c-b8fb-496c-af9f-dedd86fa69c2 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1468 microversion: 2.1 time: 0.737811 Oct 16 01:09:44.882940 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1016/2186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:44 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1468 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:44.885613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-10842850-b37b-4d1e-a837-7cb49a3d37d1 req-b70cc1e1-f741-4308-b1b2-eaeb2de9f58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2132a3-c6eb-4fe2-96ce-725f4efba607", "tag": "b91eb4e3-f8a9-4013-a52a-4ea301c52468"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:44.941227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-10842850-b37b-4d1e-a837-7cb49a3d37d1 req-b70cc1e1-f741-4308-b1b2-eaeb2de9f58e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:44.943127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-10842850-b37b-4d1e-a837-7cb49a3d37d1 req-b70cc1e1-f741-4308-b1b2-eaeb2de9f58e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:44.943127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-10842850-b37b-4d1e-a837-7cb49a3d37d1 req-b70cc1e1-f741-4308-b1b2-eaeb2de9f58e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:44.994994 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-10842850-b37b-4d1e-a837-7cb49a3d37d1 req-b70cc1e1-f741-4308-b1b2-eaeb2de9f58e service nova] Creating event network-changed:b91eb4e3-f8a9-4013-a52a-4ea301c52468 for instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 on n-h1-master-1 Oct 16 01:09:45.006611 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-10842850-b37b-4d1e-a837-7cb49a3d37d1 req-b70cc1e1-f741-4308-b1b2-eaeb2de9f58e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133031 Oct 16 01:09:45.007267 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1017/2187] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:45.017138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:45.017854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:45.070496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.071204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.071712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.074473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.077571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.078355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.240506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:45.253881 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:45.258709 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30620796-dded-4130-b4db-d7d5c581d23c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1269 microversion: 2.1 time: 0.490401 Oct 16 01:09:45.271563 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1171/2188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:44 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1269 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:45.291503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:45.305134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:45.337298 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:45.340465 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:45.347765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.351244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.356584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.360460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.362580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.366092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.636050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:45.648809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:45.650291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:45.665263 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cbd59c3-2c68-4c14-8ac5-3aefedd2ed3e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.390116 Oct 16 01:09:45.665891 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1172/2189] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:45 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:45.708679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:45.717623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f6d29867-9905-4f26-aac6-95712057ec8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 0.705042 Oct 16 01:09:45.735431 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1018/2190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:45 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:45.761473 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:45.761913 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:45.768834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.769330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.769774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.770486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.786681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.787400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.896762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:45.898100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:45.907353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.911631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.912334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:45.913262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:45.914002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:45.918809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.017751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:46.026308 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b66e3168-e53f-41ac-a72a-c3f3700b7098 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1505 microversion: 2.1 time: 0.268813 Oct 16 01:09:46.043738 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1173/2191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:45 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:46.303661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:46.304982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:46.352302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:46.354180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:46.355228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.356529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:46.361971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:46.363222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.503757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:46.516717 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7784e9ae-015f-4dc7-be9a-858307a69498 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1468 microversion: 2.1 time: 0.623795 Oct 16 01:09:46.519801 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1019/2192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:45 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1468 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:46.562323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:46.573926 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec7579b8-0db0-4863-8452-c88fdbe181ba tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1275 microversion: 2.1 time: 0.283088 Oct 16 01:09:46.589259 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1174/2193] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:46 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:46.699206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:46.700165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:46.718179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:46.726139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:46.726876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.730074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:46.735792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:46.737251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.751659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:46.753431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:46.770889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:46.772207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:46.772857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.788011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:46.790735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:46.791941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:46.839624 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:47.011649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:47.021411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:47.022863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:47.024635 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a04fb54a-1e4c-4885-821b-f1d781dd03b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.330082 Oct 16 01:09:47.042506 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1020/2194] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:46 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:47.051098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:47.051715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:47.090732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:47.091279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:47.091839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:47.092789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:47.093262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:47.093704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:47.320745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:47.331803 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e4439a46-996d-4003-a126-306a326c9503 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 0.585786 Oct 16 01:09:47.336305 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1175/2195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:46 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:47.548367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:47.549199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:47.565608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:47.566135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:47.569512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:47.575663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:47.576167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:47.583273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.015532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:48.028768 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6cc4f82c-69f7-4e50-953e-67b46dcd89f3 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1487 microversion: 2.1 time: 0.982830 Oct 16 01:09:48.030548 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1021/2196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:47 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1487 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:48.043777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:48.046992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:48.057345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.060671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.063647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.065531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.067340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.068146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.168957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:48.190142 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-98d76692-a261-41af-bfb4-b4f9371ea697 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1426 microversion: 2.1 time: 0.642275 Oct 16 01:09:48.190801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1176/2197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:47 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1426 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:48.204962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:48.205701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:48.226188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.227637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.229402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.231709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.234246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.235251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.319419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:48.502735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:48.545075 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b0f550f8-64ea-473f-92ee-3d2fdf482d9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.487405 Oct 16 01:09:48.550015 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1022/2198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:48 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:48.583447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:48.584862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:48.625880 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b23e829-2121-44f1-861a-ef114a5846a1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 204 len: 0 microversion: 2.1 time: 0.424016 Oct 16 01:09:48.626946 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1177/2199] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:48 2022] DELETE /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:48.668980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.669473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.692448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ef8537e1-0371-4f93-8c6c-67f0d937d703 req-c560bd3d-41dd-4b37-b91f-ca7954d3d127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3", "name": "network-vif-deleted", "tag": "e1b4db59-fd7f-4dd9-8a04-7af773b586ef"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:48.707403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.710380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.710380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.710380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.762041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ef8537e1-0371-4f93-8c6c-67f0d937d703 req-c560bd3d-41dd-4b37-b91f-ca7954d3d127 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.762532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ef8537e1-0371-4f93-8c6c-67f0d937d703 req-c560bd3d-41dd-4b37-b91f-ca7954d3d127 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.762988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ef8537e1-0371-4f93-8c6c-67f0d937d703 req-c560bd3d-41dd-4b37-b91f-ca7954d3d127 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.802089 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ef8537e1-0371-4f93-8c6c-67f0d937d703 req-c560bd3d-41dd-4b37-b91f-ca7954d3d127 service nova] Creating event network-vif-deleted:e1b4db59-fd7f-4dd9-8a04-7af773b586ef for instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 on n-h2-master-1 Oct 16 01:09:48.817305 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ef8537e1-0371-4f93-8c6c-67f0d937d703 req-c560bd3d-41dd-4b37-b91f-ca7954d3d127 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175519 Oct 16 01:09:48.818284 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1178/2200] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:48.823397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:48.824105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:48.835844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.836328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.837278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.838007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:48.838471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:48.838901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:48.973822 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:48.993031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:48.994785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:49.018204 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-654ceea3-1fdd-4ce8-82e0-4edd6a282b0f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.463998 Oct 16 01:09:49.027327 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1023/2201] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:48 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:49.035363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05cf4654-0b3a-4b7e-a2a2-52ef0c13fd3c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64efa5940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:49.140420 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-05cf4654-0b3a-4b7e-a2a2-52ef0c13fd3c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Image not found. Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05cf4654-0b3a-4b7e-a2a2-52ef0c13fd3c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b HTTP/1.1 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '72936d59-ee31-40ff-ae6d-fa7d5721ce1b'} Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 72936d59-ee31-40ff-ae6d-fa7d5721ce1b to delete Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 72936d59-ee31-40ff-ae6d-fa7d5721ce1b could not be found. Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:49.144898 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05cf4654-0b3a-4b7e-a2a2-52ef0c13fd3c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:49.148862 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-05cf4654-0b3a-4b7e-a2a2-52ef0c13fd3c tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b" status: 404 len: 62 microversion: 2.1 time: 0.118863 Oct 16 01:09:49.151155 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1024/2202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:49 2022] DELETE /compute/v2.1/images/72936d59-ee31-40ff-ae6d-fa7d5721ce1b => generated 62 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:49.160484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:49.161005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:49.234688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:49.235235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:49.241714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:49.242767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:49.250509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:49.251185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:49.319080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:49.333806 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:49.444722 n-d-master-1 devstack@n-api.service[120546]: INFO nova.compute.api [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Instance is already in deleting state, ignoring this request Oct 16 01:09:49.445591 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f379f9bb-f926-4b85-840b-63409b74876e tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 204 len: 0 microversion: 2.1 time: 0.289444 Oct 16 01:09:49.449263 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1025/2203] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:49 2022] DELETE /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:49.455519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:49.462584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:49.473694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:49.475105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:49.475830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:49.476750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:49.477374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:49.477966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:49.549100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:49.549607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:49.550056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:49.550516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lazy-loading 'fault' on Instance uuid f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:50.172617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:50.184462 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5c92c832-1b87-400d-ab0f-37ceb0933490 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 200 len: 1311 microversion: 2.1 time: 0.730933 Oct 16 01:09:50.196516 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1026/2204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:49 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 1311 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:50.207624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:50.213276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:50.233657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:50.234166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:50.234614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:50.235426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:50.235886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:50.236317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:50.341691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:50.352550 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-87de9098-ccd3-42e5-9175-bd9fba321c30 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 1.531885 Oct 16 01:09:50.367968 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1179/2205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:48 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:50.379445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:50.380356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:50.388190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:50.388954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:50.389627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:50.390523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:50.391178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:50.391757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:50.771882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:50.785944 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e5482f30-3c8a-40a9-9c57-249b4bbe472a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1493 microversion: 2.1 time: 0.588010 Oct 16 01:09:50.787357 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1027/2206] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:50 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1493 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:50.798377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:50.800842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:50.820210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:50.821769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:50.824362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:50.825319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:50.827064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:50.827820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:50.869049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:50.880964 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-830b9f2f-79b5-4918-b717-985fa75a109e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.510073 Oct 16 01:09:50.883534 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1180/2207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:50 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:51.002697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:51.012605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:51.014712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:51.024851 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e77daaa2-3c0e-4444-bdf9-e8ac2f003df4 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.236177 Oct 16 01:09:51.035326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1028/2208] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:50 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:51.065839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1264ffd1-3ea2-4f51-b7c0-682a0968943a req-842ca743-45a5-4fdc-bd22-2218e7a72af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a39815-7a81-4ff5-b776-80edde695b13", "tag": "7a208383-81e1-4049-bdf6-3ca0742b9296"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:51.085805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1264ffd1-3ea2-4f51-b7c0-682a0968943a req-842ca743-45a5-4fdc-bd22-2218e7a72af2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.088691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1264ffd1-3ea2-4f51-b7c0-682a0968943a req-842ca743-45a5-4fdc-bd22-2218e7a72af2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.093683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1264ffd1-3ea2-4f51-b7c0-682a0968943a req-842ca743-45a5-4fdc-bd22-2218e7a72af2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.126240 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1264ffd1-3ea2-4f51-b7c0-682a0968943a req-842ca743-45a5-4fdc-bd22-2218e7a72af2 service nova] Creating event network-changed:7a208383-81e1-4049-bdf6-3ca0742b9296 for instance c7a39815-7a81-4ff5-b776-80edde695b13 on n-h1-master-1 Oct 16 01:09:51.140475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1264ffd1-3ea2-4f51-b7c0-682a0968943a req-842ca743-45a5-4fdc-bd22-2218e7a72af2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081034 Oct 16 01:09:51.147407 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1181/2209] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:09:51.199863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6460110d-2c48-4b4f-aeb1-b13013c1dec1 req-66633122-620a-446d-9dca-64663543f0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63dd9af-be49-4135-8268-025c44ef66e1", "name": "network-vif-plugged", "status": "completed", "tag": "2b6a0984-9d7c-48fe-8708-15d2afabf1d4"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:51.223235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6460110d-2c48-4b4f-aeb1-b13013c1dec1 req-66633122-620a-446d-9dca-64663543f0e0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.225209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:51.225912 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:51.228546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6460110d-2c48-4b4f-aeb1-b13013c1dec1 req-66633122-620a-446d-9dca-64663543f0e0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.229014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6460110d-2c48-4b4f-aeb1-b13013c1dec1 req-66633122-620a-446d-9dca-64663543f0e0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.238014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.238525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.241207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.242822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.243913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.244353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.268398 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6460110d-2c48-4b4f-aeb1-b13013c1dec1 req-66633122-620a-446d-9dca-64663543f0e0 service nova] Creating event network-vif-plugged:2b6a0984-9d7c-48fe-8708-15d2afabf1d4 for instance e63dd9af-be49-4135-8268-025c44ef66e1 on n-h1-master-1 Oct 16 01:09:51.281151 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] HTTP exception thrown: Instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 could not be found. Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Request method failure captured: Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 HTTP/1.1 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1mVl8t-PJ9Eh83gtrAvuqe2s8lC13WoiqdgpEUmZZtPkQVHnxrI-9b2QxSXf5bgZdhUQjDZ2q-VRxBomljaNW28DEYRV2-H3IWNSORiUAVvtr-JhCbSy6fyXORCn17zJmkJ9N0aGkFASyj5y1TADKOfWNWbifeGYvsfTSZnBHXAzAs Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 9b63ec6e0e3c4f268e63ae8da2ffe884 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1238671399 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b63ec6e0e3c4f268e63ae8da2ffe884", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b63ec6e0e3c4f268e63ae8da2ffe884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b63ec6e0e3c4f268e63ae8da2ffe884"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b63ec6e0e3c4f268e63ae8da2ffe884"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1238671399 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 9b63ec6e0e3c4f268e63ae8da2ffe884 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1238671399 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersAdminNegativeTestJSON-1238671399-project Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d0caedd0bc41435c9426ee622b9d2113 Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1238671399-project Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: exception: Instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 could not be found. Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3'} Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 could not be found. Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 could not be found. Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:51.282896 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:51.286194 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:51.286194 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:51.286194 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:51.286194 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:51.286194 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:51.286194 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:51.286194 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 could not be found. Oct 16 01:09:51.286194 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:51.286599 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6460110d-2c48-4b4f-aeb1-b13013c1dec1 req-66633122-620a-446d-9dca-64663543f0e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089432 Oct 16 01:09:51.286669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Returning 404 to user: Instance f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:51.287393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d3a4408-0ea2-41e5-9562-896f9a1ecd1b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3" status: 404 len: 111 microversion: 2.1 time: 0.066904 Oct 16 01:09:51.290627 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1182/2210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:51 2022] GET /compute/v2.1/servers/f7b67ff5-dc8e-458b-88d8-c1e9984c8fc3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:51.293581 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1029/2211] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:51.307150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:51.308344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:51.326421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.331573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.333909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.336566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.337867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.339548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.382874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:51.383607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:51.406820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.406820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.407302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.410122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.413267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.416029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.447715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:51.689428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-54e7a45a-ca05-44ab-91e8-977be7f254ef tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "DELETE /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 204 len: 0 microversion: 2.1 time: 0.394070 Oct 16 01:09:51.690368 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1183/2212] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:51 2022] DELETE /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:09:51.698794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:51.699903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:51.718870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.719667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.720263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.721372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.722268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.722840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.739365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:51.747585 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2874c48a-ae7c-4d57-a3f1-91c4a75c2622 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 0.368907 Oct 16 01:09:51.760246 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1030/2213] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:51 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:51.814213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:51.814833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:51.823008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.823515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.823970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:51.824664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:51.825096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:51.825525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.098155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:52.110067 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b2449798-a061-4b11-9bcd-06ee0b75b00a tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1477 microversion: 2.1 time: 0.412342 Oct 16 01:09:52.110948 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1184/2214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:51 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1477 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:52.115432 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:52.145419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d2da06f4-163a-4bc6-92bb-4899a04ec2e5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1493 microversion: 2.1 time: 0.334268 Oct 16 01:09:52.145955 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1031/2215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:51 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1493 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:52.148708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:52.149342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:52.182088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:52.182718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:52.196343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.197070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.197534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.207147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.210115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.210572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.221217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.221744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.222141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.222855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.223377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.223806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.258429 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:52.441054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:52.453239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:52.454690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:52.455916 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19da0b19-0608-49b4-ab11-f173f14f0187 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.297724 Oct 16 01:09:52.456489 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1032/2216] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:52 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:52.468543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:52.481512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:52.495580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.496261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.497408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.498270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.499461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.500039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.546603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:52.558256 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34c4c096-ec2d-4291-b23a-c159e597e822 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.446118 Oct 16 01:09:52.558858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1185/2217] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:52 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:52.575526 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-fc2994e3-711a-4f99-b94b-526e872ffef6 req-0288caba-40df-4359-9aaa-20d0473b7380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63dd9af-be49-4135-8268-025c44ef66e1", "name": "network-vif-deleted", "tag": "2b6a0984-9d7c-48fe-8708-15d2afabf1d4"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:52.598690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fc2994e3-711a-4f99-b94b-526e872ffef6 req-0288caba-40df-4359-9aaa-20d0473b7380 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.599546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fc2994e3-711a-4f99-b94b-526e872ffef6 req-0288caba-40df-4359-9aaa-20d0473b7380 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.600215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fc2994e3-711a-4f99-b94b-526e872ffef6 req-0288caba-40df-4359-9aaa-20d0473b7380 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.617925 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-fc2994e3-711a-4f99-b94b-526e872ffef6 req-0288caba-40df-4359-9aaa-20d0473b7380 service nova] Creating event network-vif-deleted:2b6a0984-9d7c-48fe-8708-15d2afabf1d4 for instance e63dd9af-be49-4135-8268-025c44ef66e1 on n-h1-master-1 Oct 16 01:09:52.624709 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-fc2994e3-711a-4f99-b94b-526e872ffef6 req-0288caba-40df-4359-9aaa-20d0473b7380 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062434 Oct 16 01:09:52.627250 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1186/2218] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:52.691104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:52.704830 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-45ace8c8-3427-42c8-a38f-88651f8b2697 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.234283 Oct 16 01:09:52.705333 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1033/2219] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:52 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:52.772764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-267120108", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e837775c-af35-4cb2-89ea-5a342e83cc6f"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:52.776374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:52.777125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:52.784303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.784949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.785734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.786669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:52.787383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:52.788021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:52.837071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] validate_networks() for [('e837775c-af35-4cb2-89ea-5a342e83cc6f', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:09:53.010324 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:53.018768 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4fdcf67-6fcf-4154-a96b-ed38e9fe8b47 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 0.246622 Oct 16 01:09:53.020204 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1034/2220] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:52 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:53.137372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:53.138340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:53.141533 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=10 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:53.151685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.152196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.153572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.154066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.155616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.156501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.343144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:53.354240 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e4e4625-4387-4136-852d-26c646701018 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1477 microversion: 2.1 time: 0.222771 Oct 16 01:09:53.354854 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1035/2221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:53 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1477 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:53.367126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:53.370482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:53.382418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.383207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.383856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.384730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.385336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.385961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.426420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.427405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.428394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.428998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lazy-loading 'fault' on Instance uuid e63dd9af-be49-4135-8268-025c44ef66e1 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:53.500984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875dca9ed4914e379601ddbdba035cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880e05820ad14f60888593d56af81f70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:53.514976 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-223fccdc-f9d5-495d-9cff-54c9ca05ae63 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 200 len: 1297 microversion: 2.1 time: 0.156741 Oct 16 01:09:53.516378 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1036/2222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:53 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 1297 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:53.524619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:53.525623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:53.533216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.533968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.534612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.535708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.536871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.537464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.564565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:09:53.564978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:09:53.565348 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:09:53.565937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:09:53.566545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:09:53.587397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.588223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.588673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.589524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.589985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.590414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.613242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:09:53.619226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:09:53.632988 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:53.634231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:09:53.637742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:09:53.642760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:53.644709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:53.646584 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-14a40cf0-03a3-40ae-a053-778558473a31 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.128787 Oct 16 01:09:53.647295 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1037/2223] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:53 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:53.652163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:53.652898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:53.659702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.660692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.660814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.661611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.662443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.663134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.694601 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ab2d4e5-131d-4561-b738-1aea9e2617b4 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064909 Oct 16 01:09:53.695690 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1187/2224] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:09:53.710696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-40fceea7-ac28-4ccb-9d54-2c544d0142eb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:53.711742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-40fceea7-ac28-4ccb-9d54-2c544d0142eb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:53.795928 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-40fceea7-ac28-4ccb-9d54-2c544d0142eb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:53.816165 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-40fceea7-ac28-4ccb-9d54-2c544d0142eb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1192 microversion: 2.1 time: 0.109262 Oct 16 01:09:53.833886 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1188/2225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:53 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1192 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:53.844424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:53.845090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:53.862224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.863384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.864768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:53.865367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:53.866839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:53.870460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.090747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:54.101364 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be8969f1-dfca-4d82-a3a0-ceaf1b8995eb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.452657 Oct 16 01:09:54.101955 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1038/2226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:53 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:54.111291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:54.111291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:54.172819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.173312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.173750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.174465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.174968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.175363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.312668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:54.325670 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-50f09cea-8775-47f3-99a0-f6ed08af16c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.490577 Oct 16 01:09:54.330065 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1189/2227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:53 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:54.377267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:54.377894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:54.388519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.389151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.392719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.403159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.403909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.405339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.588483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:54.602149 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-94a1def7-add2-418a-90fe-29d736dc0ecd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 0.496064 Oct 16 01:09:54.602960 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1039/2228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:54 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:54.623757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:54.624831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: e63dd9af-be49-4135-8268-025c44ef66e1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:54.636812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.637493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.638178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.641568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.647621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.648517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.684885 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance e63dd9af-be49-4135-8268-025c44ef66e1 could not be found. Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 HTTP/1.1 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: exception: Instance e63dd9af-be49-4135-8268-025c44ef66e1 could not be found. Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'e63dd9af-be49-4135-8268-025c44ef66e1'} Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63dd9af-be49-4135-8268-025c44ef66e1 could not be found. Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63dd9af-be49-4135-8268-025c44ef66e1 could not be found. Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.691876 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.695354 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:54.695354 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:54.695354 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:54.695354 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:54.695354 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63dd9af-be49-4135-8268-025c44ef66e1 could not be found. Oct 16 01:09:54.695354 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.700056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance e63dd9af-be49-4135-8268-025c44ef66e1 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:54.709820 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d3f439b-2e6f-45cf-8779-b6ba8843bb6d tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1" status: 404 len: 111 microversion: 2.1 time: 0.097999 Oct 16 01:09:54.711227 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1040/2229] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:54 2022] GET /compute/v2.1/servers/e63dd9af-be49-4135-8268-025c44ef66e1 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:54.720440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:54.728450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:54.736166 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:54.744867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.745899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.746730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.747787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.750304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.750940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.760063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:54.773422 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f03feb7f-1c4b-4ce2-bfff-695ee18485e3 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1477 microversion: 2.1 time: 0.399849 Oct 16 01:09:54.774365 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1190/2230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:54 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:54.782499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:54.787676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:54.800815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.803465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.806091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.807056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.812069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.812765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.851923 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef HTTP/1.1 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5c669059-56d4-4e1d-a7ce-e4e0a35d78ef'} Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:54.860973 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.864738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.869947 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:54.871093 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-55d476f9-e6f8-4b38-91c6-33cfc0b8b1af tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 404 len: 111 microversion: 2.1 time: 0.095144 Oct 16 01:09:54.877649 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1191/2231] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:54 2022] DELETE /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:54.883762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:54.887420 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:54.894280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:54.896417 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:54.896705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:54.898567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:54.901253 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-166a0359-3499-4f0b-91ad-7a51d2519101 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1407 microversion: 2.54 time: 0.186965 Oct 16 01:09:54.902776 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1041/2232] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:54 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:54.907819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:54.908436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:54.914278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.918720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.919253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.919697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.921176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.921984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.922428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.922966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.926952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.928161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:54.928762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:54.929506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:54.939809 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef HTTP/1.1 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5c669059-56d4-4e1d-a7ce-e4e0a35d78ef'} Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.941924 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:54.945750 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:54.945750 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:54.945750 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:54.945750 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:54.945750 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. Oct 16 01:09:54.945750 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:54.945750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance 5c669059-56d4-4e1d-a7ce-e4e0a35d78ef could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:54.945750 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-86e7f398-03e1-4562-9bbc-229d2ad39ea5 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef" status: 404 len: 111 microversion: 2.1 time: 0.039635 Oct 16 01:09:54.947193 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1042/2233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:54 2022] GET /compute/v2.1/servers/5c669059-56d4-4e1d-a7ce-e4e0a35d78ef => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:54.955197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-864eb267-da48-4d25-ba01-ec967bdc42c1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e4a95e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.018058 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-864eb267-da48-4d25-ba01-ec967bdc42c1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Image not found. Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-864eb267-da48-4d25-ba01-ec967bdc42c1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 HTTP/1.1 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'e1bbd56e-45d2-4e47-b64c-cc3719bdbe83'} Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 to delete Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 could not be found. Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.020694 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:09:55.025582 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.028520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-864eb267-da48-4d25-ba01-ec967bdc42c1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:55.030980 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-864eb267-da48-4d25-ba01-ec967bdc42c1 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83" status: 404 len: 62 microversion: 2.1 time: 0.082466 Oct 16 01:09:55.037127 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1043/2234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:54 2022] DELETE /compute/v2.1/images/e1bbd56e-45d2-4e47-b64c-cc3719bdbe83 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:55.043929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.056965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.077823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.079390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.080030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.080933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.081590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.082166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.102114 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc HTTP/1.1 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a9503402-a817-49f4-82fa-f213c8159edc'} Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:55.105265 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.110732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.113033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:55.114427 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8714a65e-2499-4331-9a0a-03ba7e933600 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 404 len: 111 microversion: 2.1 time: 0.075680 Oct 16 01:09:55.118446 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1044/2235] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:55 2022] DELETE /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:55.127996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.128918 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: a9503402-a817-49f4-82fa-f213c8159edc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.130059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:55.136654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.137149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.137638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.138404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.138990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.139423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.145523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9918bc1f-312f-4dbc-b306-05259a40eefe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1196 microversion: 2.1 time: 0.266469 Oct 16 01:09:55.147064 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1192/2236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:54 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1196 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:55.180280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.180909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc HTTP/1.1 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a9503402-a817-49f4-82fa-f213c8159edc'} Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:55.194936 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. Oct 16 01:09:55.199258 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.200487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.200696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance a9503402-a817-49f4-82fa-f213c8159edc could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:55.200914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.200914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.200914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.200914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.200914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.201297 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f9e84d14-9a28-4fcb-bccf-7d9eea2f1a67 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc" status: 404 len: 111 microversion: 2.1 time: 0.073853 Oct 16 01:09:55.201297 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1045/2237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:55 2022] GET /compute/v2.1/servers/a9503402-a817-49f4-82fa-f213c8159edc => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:55.214250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-805f80ea-1be0-4429-ab89-1f6bd336a2ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64e1491f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.250483 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-805f80ea-1be0-4429-ab89-1f6bd336a2ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Image not found. Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-805f80ea-1be0-4429-ab89-1f6bd336a2ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 HTTP/1.1 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3b639817-8b34-4108-a5e5-8e31fe672c89'} Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3b639817-8b34-4108-a5e5-8e31fe672c89 to delete Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b639817-8b34-4108-a5e5-8e31fe672c89 could not be found. Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.252417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.256755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-805f80ea-1be0-4429-ab89-1f6bd336a2ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:55.257868 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-805f80ea-1be0-4429-ab89-1f6bd336a2ad tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89" status: 404 len: 62 microversion: 2.1 time: 0.050091 Oct 16 01:09:55.267044 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1046/2238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:55 2022] DELETE /compute/v2.1/images/3b639817-8b34-4108-a5e5-8e31fe672c89 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:55.276967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.278490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.297524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.298006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.298530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.299202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.299722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.300154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.337350 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 HTTP/1.1 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: exception: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'd6612f5c-0f92-4cc2-8fcd-083e8b2b4892'} Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:55.338999 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:55.344903 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5afd664c-bece-49b3-a652-c54797d58e12 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 404 len: 111 microversion: 2.1 time: 0.072299 Oct 16 01:09:55.345562 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1047/2239] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:55 2022] DELETE /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:55.349968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.350584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.364020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.364523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.364966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.368440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.369012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.369500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.490096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:55.493719 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:55.506648 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5022b1ab-52a1-4eb9-9714-ce6001b44f2a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.357110 Oct 16 01:09:55.510946 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1193/2240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:55 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:55.549890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.551793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: d6612f5c-0f92-4cc2-8fcd-083e8b2b4892] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.562314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.566195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.568433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.570473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.571376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.575262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.611554 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 HTTP/1.1 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: exception: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'd6612f5c-0f92-4cc2-8fcd-083e8b2b4892'} Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.614410 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.617911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.617911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.617911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:55.617911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:55.617911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. Oct 16 01:09:55.617911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.620013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:55.626492 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22e8b5e3-0dfe-47c8-88c0-201111af742f tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892" status: 404 len: 111 microversion: 2.1 time: 0.114651 Oct 16 01:09:55.628151 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1194/2241] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:55 2022] GET /compute/v2.1/servers/d6612f5c-0f92-4cc2-8fcd-083e8b2b4892 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:55.634753 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.635827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.643006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.643743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.644336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.645201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.645815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.646393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.785014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:55.805654 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fcb6418f-6373-44cf-8b56-b6a436dd0dcc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.459424 Oct 16 01:09:55.807180 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1048/2242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:55 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:55.817600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6c5ea71-8fcd-4ca1-92e5-8f9b38e69b36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd6528739d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.847293 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-a6c5ea71-8fcd-4ca1-92e5-8f9b38e69b36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Image not found. Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6c5ea71-8fcd-4ca1-92e5-8f9b38e69b36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 HTTP/1.1 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ef2d7d67-4417-4df1-99e3-2f23242206b6'} Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ef2d7d67-4417-4df1-99e3-2f23242206b6 to delete Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef2d7d67-4417-4df1-99e3-2f23242206b6 could not be found. Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.850767 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:09:55.854520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:55.860523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6c5ea71-8fcd-4ca1-92e5-8f9b38e69b36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:55.861830 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a6c5ea71-8fcd-4ca1-92e5-8f9b38e69b36 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6" status: 404 len: 62 microversion: 2.1 time: 0.053165 Oct 16 01:09:55.862999 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1049/2243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:55 2022] DELETE /compute/v2.1/images/ef2d7d67-4417-4df1-99e3-2f23242206b6 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:55.868274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:55.869196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.879018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.880336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.882502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.883837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.884640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.885310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.898008 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:55.910971 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7d3fd57-0f4c-4e85-9458-dd09d7348093 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1211 microversion: 2.1 time: 0.280307 Oct 16 01:09:55.934729 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1195/2244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:55 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1211 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:55.940608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-451620147"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:55.943448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:55.956594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.978175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.978766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:55.979586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:55.980068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:55.980496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.027724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:56.040947 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-abe911c5-db94-4945-bb3a-828439dfb63b tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1435 microversion: 2.1 time: 0.176545 Oct 16 01:09:56.041872 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1050/2245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:55 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1435 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:56.049515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.055242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.063122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.063625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.064369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.069719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.070151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.070586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.092791 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 HTTP/1.1 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90'} Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:56.094430 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2aa66da2-4aa8-49dc-bbaf-8f6081510304 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 404 len: 111 microversion: 2.1 time: 0.052423 Oct 16 01:09:56.099222 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1051/2246] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:56 2022] DELETE /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:56.120552 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.121387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.127488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.128002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.128458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.129253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.129764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.130179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.232612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:56.241842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:56.243668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:56.245102 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e3d05bb6-8bec-48f1-ba14-6e3d66e4cd6d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1413 microversion: 2.54 time: 0.147662 Oct 16 01:09:56.246235 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1052/2247] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:56 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1413 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:56.251108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1abe9e82-3891-4866-819c-b4a4a096744b req-103d1cc8-2d77-4168-a8b9-ff832a7562b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67308bb0-24fc-415d-9c20-b0f810d2501b", "name": "network-vif-deleted", "tag": "ecfdb5bb-0405-4bc9-8c0e-c11c6a237d3f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:56.260656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1abe9e82-3891-4866-819c-b4a4a096744b req-103d1cc8-2d77-4168-a8b9-ff832a7562b1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.261527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1abe9e82-3891-4866-819c-b4a4a096744b req-103d1cc8-2d77-4168-a8b9-ff832a7562b1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.262222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1abe9e82-3891-4866-819c-b4a4a096744b req-103d1cc8-2d77-4168-a8b9-ff832a7562b1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.278815 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1abe9e82-3891-4866-819c-b4a4a096744b req-103d1cc8-2d77-4168-a8b9-ff832a7562b1 service nova] Creating event network-vif-deleted:ecfdb5bb-0405-4bc9-8c0e-c11c6a237d3f for instance 67308bb0-24fc-415d-9c20-b0f810d2501b on n-h2-master-1 Oct 16 01:09:56.284702 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1abe9e82-3891-4866-819c-b4a4a096744b req-103d1cc8-2d77-4168-a8b9-ff832a7562b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036908 Oct 16 01:09:56.285981 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1053/2248] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:56.290076 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2f3d000a-c35f-48f4-938b-3accfc06e894 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.353567 Oct 16 01:09:56.291160 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1196/2249] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:09:55 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 16 01:09:56.292878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.294247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.297619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.298423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.300873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.301355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.301845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.302580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.303323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.303939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.309570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.313457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.314044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.314858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.316707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.317402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.319819 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 HTTP/1.1 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90'} Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.321791 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.325666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.325666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.325666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:56.325666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:56.325666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. Oct 16 01:09:56.325666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.328238 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance 1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:56.329315 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9352d333-9b3c-496e-9945-0e1b85648b78 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90" status: 404 len: 111 microversion: 2.1 time: 0.042080 Oct 16 01:09:56.332057 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1054/2250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:56 2022] GET /compute/v2.1/servers/1f459bf4-4e7a-4f6d-b3ac-edc8b5ca3a90 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:56.339526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a75f04a6-e074-47bf-a23f-b2d65ccf90f7 req-242dc17a-deac-46f2-8077-048f953814b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "name": "network-vif-unplugged", "status": "completed", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:56.365333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a75f04a6-e074-47bf-a23f-b2d65ccf90f7 req-242dc17a-deac-46f2-8077-048f953814b3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.366140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a75f04a6-e074-47bf-a23f-b2d65ccf90f7 req-242dc17a-deac-46f2-8077-048f953814b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.366898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a75f04a6-e074-47bf-a23f-b2d65ccf90f7 req-242dc17a-deac-46f2-8077-048f953814b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.382171 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a75f04a6-e074-47bf-a23f-b2d65ccf90f7 req-242dc17a-deac-46f2-8077-048f953814b3 service nova] Creating event network-vif-unplugged:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:09:56.387181 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a75f04a6-e074-47bf-a23f-b2d65ccf90f7 req-242dc17a-deac-46f2-8077-048f953814b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052067 Oct 16 01:09:56.387788 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1055/2251] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:56.397258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.398056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.405758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.406590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.407245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.408140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.408779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.409388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.421733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:56.432532 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-744af120-e3be-4f53-b92d-d47e92db599c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1244 microversion: 2.1 time: 0.139162 Oct 16 01:09:56.447794 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1197/2252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:56 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1244 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:56.456849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6514c07-701e-4a11-9d5b-c40de857a31a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '.version_select at 0x7fd64de22700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.492325 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-d6514c07-701e-4a11-9d5b-c40de857a31a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Image not found. Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6514c07-701e-4a11-9d5b-c40de857a31a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 HTTP/1.1 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ec6d313c-ce2f-4655-92b1-aaaf4f4af681'} Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ec6d313c-ce2f-4655-92b1-aaaf4f4af681 to delete Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ec6d313c-ce2f-4655-92b1-aaaf4f4af681 could not be found. Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.494219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6514c07-701e-4a11-9d5b-c40de857a31a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6514c07-701e-4a11-9d5b-c40de857a31a tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681" status: 404 len: 62 microversion: 2.1 time: 0.046457 Oct 16 01:09:56.502157 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1198/2253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:56 2022] DELETE /compute/v2.1/images/ec6d313c-ce2f-4655-92b1-aaaf4f4af681 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:09:56.505337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.505790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.524263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.525078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.525516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.526227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.526690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.527291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.542182 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e HTTP/1.1 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '9930a3af-2106-418e-87a8-a959ce89905e'} Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:56.544071 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:56.547504 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0c234d2-eb2f-40dd-a20e-ccdab9507dcd tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 404 len: 111 microversion: 2.1 time: 0.044513 Oct 16 01:09:56.549652 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1199/2254] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:09:56 2022] DELETE /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:09:56.554657 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.555933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.567394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.567899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.568335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.569054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.569612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.570038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.590077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:56.603703 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a13457e4-3f58-4f5c-aa8e-a28bbb6f9a31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.214210 Oct 16 01:09:56.604806 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1056/2255] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:56 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:56.609996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.610865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] [instance: 9930a3af-2106-418e-87a8-a959ce89905e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.617880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.618643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.619380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.620326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.620991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.621648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.638127 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] HTTP exception thrown: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Request method failure captured: Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e HTTP/1.1 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1hi5B5me4T60KsXDYP2yj5tk5uF5xzMbl9-66-ZsxkuzljgMZ8AdMnhXqv3yXc2GVEanj-4cdUtYgQteTSg0JajbmLoV1va_Ghke6jwMKhQn81wuH0krjJJsKJbeUzORBalR5Y6kixNRbQWrcYwA43ggdud3h7mOb3DnH2_gtUwevI Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_880e05820ad14f60888593d56af81f70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/880e05820ad14f60888593d56af81f70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/880e05820ad14f60888593d56af81f70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 880e05820ad14f60888593d56af81f70 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesTestJSON-1410178873 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 875dca9ed4914e379601ddbdba035cb2 Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesTestJSON-1410178873-project Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '9930a3af-2106-418e-87a8-a959ce89905e'} Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.640873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:09:56.648339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:09:56.648339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:09:56.648339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:09:56.648339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:09:56.648339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. Oct 16 01:09:56.648339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:09:56.650186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] Returning 404 to user: Instance 9930a3af-2106-418e-87a8-a959ce89905e could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:09:56.651716 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f052c04d-ea6a-44d6-9da1-3c39688aee24 tempest-ImagesTestJSON-1410178873 tempest-ImagesTestJSON-1410178873-project] 10.222.0.39 "GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e" status: 404 len: 111 microversion: 2.1 time: 0.045377 Oct 16 01:09:56.656676 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1057/2256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:56 2022] GET /compute/v2.1/servers/9930a3af-2106-418e-87a8-a959ce89905e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:56.752964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:56.762016 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8cbd52e6-3dc0-4823-a2bf-9d81e2a5e4de tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.211266 Oct 16 01:09:56.762599 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1200/2257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:56 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:56.935217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:56.936487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:56.943812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.944694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.946160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:56.947335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:56.948143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:56.948724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.068809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:57.070475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:57.077980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.078821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.079287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.080000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.080449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.080882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.108744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:57.117446 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a921a6fe-293e-4da7-b5f5-c4e41991439e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.186549 Oct 16 01:09:57.119021 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1058/2258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:56 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:57.140997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.141496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.141935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.142389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lazy-loading 'fault' on Instance uuid 67308bb0-24fc-415d-9c20-b0f810d2501b {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:57.187250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:57.195471 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-28349a4c-f70c-4c8a-9108-be68d38f4bb5 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1311 microversion: 2.1 time: 0.133590 Oct 16 01:09:57.196236 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1201/2259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:57 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:57.274956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:57.275711 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:57.283327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.283911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.284437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.285803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.287010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.287623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.367299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:57.380799 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:57.382623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:57.383847 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b3f45027-7f17-43b6-982c-54518f06c176 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1413 microversion: 2.54 time: 0.112875 Oct 16 01:09:57.384764 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1059/2260] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:57 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:57.463412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:57.464021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:57.470030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.470548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.471019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.471699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.472156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.472578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.535321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:57.542998 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c3f141b6-d259-440c-a500-8ed7371f49f7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1244 microversion: 2.1 time: 0.084343 Oct 16 01:09:57.543793 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1202/2261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:57 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:57.629419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:57.630026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:57.636128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.636614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.637057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.637847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.638310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.638735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.787025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:57.787733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:57.791099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:57.798857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.799401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.799840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.800577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:57.800919 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-537a5401-49c8-4674-8128-1abe8c169cc1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.175282 Oct 16 01:09:57.801019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:57.801765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:57.801868 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1060/2262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:57 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:57.970541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:57.984446 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-98357dd2-d756-4ea6-9273-49d459b7ae53 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.202405 Oct 16 01:09:57.986380 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1203/2263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:57 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:58.143209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:58.144896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:58.162292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.164850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.166618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.168276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.170524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.171278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.221035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:58.221907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:58.244659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.245418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.246032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.246766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.247270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.247706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.316639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.317516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.318163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.318625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lazy-loading 'fault' on Instance uuid 67308bb0-24fc-415d-9c20-b0f810d2501b {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:58.385190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.396632 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-925c22b3-df67-4a5a-babf-98850f863aa9 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1311 microversion: 2.1 time: 0.180105 Oct 16 01:09:58.397864 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1204/2264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:58 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:58.416738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:58.417495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:58.434680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.435746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.438688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.439231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.440515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.440515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.440918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.445852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c659ec7-d0a3-4fe3-960c-397a65c75e1d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.308134 Oct 16 01:09:58.446998 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1061/2265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:58 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:58.511478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.520231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.521692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.522896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-00ba782f-4867-4645-9388-97e3afdd74a8 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1398 microversion: 2.54 time: 0.114705 Oct 16 01:09:58.523503 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1205/2266] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:58 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1398 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:58.548841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e53002e1-ea28-4a17-8c40-ce889075ed26 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '.version_select at 0x7fd64e473310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:58.569480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:58.570512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:58.572923 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e53002e1-ea28-4a17-8c40-ce889075ed26 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-650230454" status: 204 len: 0 microversion: 2.54 time: 0.028352 Oct 16 01:09:58.579059 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1062/2267] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Oct 16 01:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-650230454 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:09:58.584978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.585666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.586275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.587229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.587849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.588541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.592099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:58.592713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:58.599564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.600266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.600872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.601750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.602404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.603008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.633269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:09:58.663259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.678046 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7c1187d-28ea-4977-a4b7-15333ad99f6e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1244 microversion: 2.1 time: 0.112490 Oct 16 01:09:58.678961 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1206/2268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:58 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:58.735785 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d8e854a-4158-4171-9eeb-617a7fd8e63e tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 204 len: 0 microversion: 2.54 time: 0.148991 Oct 16 01:09:58.736723 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1063/2269] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:09:58 2022] DELETE /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:09:58.745702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:58.745702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:58.751698 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:58.753603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.754188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.754893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.756065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.756766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.757798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.831749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:58.832788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:58.849138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.852376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.853255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.855699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.858470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:58.870827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:58.870827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:58.883053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.885228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:58.886794 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6fa9a32e-138f-416d-8974-5781fe251c7f tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1404 microversion: 2.54 time: 0.145875 Oct 16 01:09:58.888025 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1207/2270] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:58 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:09:59.009305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:59.009935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:59.019106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.019620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.020063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.023404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.023917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.024376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.240079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:59.255900 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2114111e-84be-43e6-a06e-0a15baaf726a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1689 microversion: 2.1 time: 0.431471 Oct 16 01:09:59.256537 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1064/2271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:58 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1689 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:59.261520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-703ba66d-a244-4f76-897a-104fc0de82b5 req-d3d8b4ec-370f-4635-9f97-1746089ebe1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a39815-7a81-4ff5-b776-80edde695b13", "name": "network-vif-plugged", "status": "completed", "tag": "7a208383-81e1-4049-bdf6-3ca0742b9296"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:09:59.287177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-703ba66d-a244-4f76-897a-104fc0de82b5 req-d3d8b4ec-370f-4635-9f97-1746089ebe1f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.287658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-703ba66d-a244-4f76-897a-104fc0de82b5 req-d3d8b4ec-370f-4635-9f97-1746089ebe1f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.288091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-703ba66d-a244-4f76-897a-104fc0de82b5 req-d3d8b4ec-370f-4635-9f97-1746089ebe1f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.294736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:59.304481 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2f58e7ea-b13e-47d7-821e-2fbfc98e0a9d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.299010 Oct 16 01:09:59.320100 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1208/2272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:59 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:59.322275 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-703ba66d-a244-4f76-897a-104fc0de82b5 req-d3d8b4ec-370f-4635-9f97-1746089ebe1f service nova] Creating event network-vif-plugged:7a208383-81e1-4049-bdf6-3ca0742b9296 for instance c7a39815-7a81-4ff5-b776-80edde695b13 on n-h1-master-1 Oct 16 01:09:59.328657 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-703ba66d-a244-4f76-897a-104fc0de82b5 req-d3d8b4ec-370f-4635-9f97-1746089ebe1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070671 Oct 16 01:09:59.329708 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1065/2273] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:09:59.420124 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:59.420739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:59.445898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.446879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.449384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.451127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.456755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.457667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.471905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:59.472921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:59.493065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.494000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.499588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.502854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.505608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.506202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.516414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.517460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.518413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.519272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lazy-loading 'fault' on Instance uuid 67308bb0-24fc-415d-9c20-b0f810d2501b {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:09:59.604948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0caedd0bc41435c9426ee622b9d2113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b63ec6e0e3c4f268e63ae8da2ffe884', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:59.613931 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-130338ca-2859-478a-869d-52a965554640 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 200 len: 1311 microversion: 2.1 time: 0.197782 Oct 16 01:09:59.616614 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1209/2274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:59 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:59.703563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:59.704224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:59.712960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.721602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.722412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.723463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.723931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.724359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.744904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:59.756017 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1eb2c076-daef-44c5-a751-699a6c8672fc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.289733 Oct 16 01:09:59.758812 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1066/2275] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:59 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:09:59.767442 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:59.822701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:09:59.832735 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ab156af-fc0a-4d6c-928f-469fbc9e49af tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1250 microversion: 2.1 time: 0.134753 Oct 16 01:09:59.844613 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1210/2276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:09:59 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1250 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:09:59.918859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:09:59.919876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:09:59.928080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.928649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.929245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.930123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:09:59.930580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:09:59.931039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:09:59.951401 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:00.036704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:00.048886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:00.054230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:00.057964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ea00394f-85fa-4b06-a062-d43a4504748d tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1404 microversion: 2.54 time: 0.143030 Oct 16 01:10:00.059933 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1067/2277] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:09:59 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:10:00.193127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:00.195600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:00.203846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.204684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.205529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.206405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.207428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.208049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.270531 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6431875e-0fa6-42db-9ccc-952ce1be87a6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082199 Oct 16 01:10:00.274472 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1211/2278] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:10:00 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:00.286213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:00.287100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:00.287595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:00.288246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:00.296034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.297768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.298201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.298810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.299066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.299771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.300269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.301194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.301491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.302317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.302537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.303693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.481071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lazy-loading 'services' on Instance uuid b371b2df-c758-4e6c-87fd-1bb8bebac0c7 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:10:00.505004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:00.514650 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d3c0bcbd-08bd-4fd7-9030-e1d2704450a1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1689 microversion: 2.1 time: 0.232452 Oct 16 01:10:00.515351 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1212/2279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:00 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:00.520502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:00.521193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:00.527593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.528357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.528999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.530049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.530964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.531603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.666943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-513b7ae6-2aff-47a1-8cb7-2eb659c42097 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments/08642fe1-eb1d-4e50-af2a-bdae5015a858" status: 202 len: 0 microversion: 2.1 time: 0.385959 Oct 16 01:10:00.671072 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1068/2280] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:10:00 2022] DELETE /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments/08642fe1-eb1d-4e50-af2a-bdae5015a858 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:10:00.712568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:00.713875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] [instance: 67308bb0-24fc-415d-9c20-b0f810d2501b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:00.747728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.749969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.751539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.759622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.760146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.760599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.778667 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] HTTP exception thrown: Instance 67308bb0-24fc-415d-9c20-b0f810d2501b could not be found. Oct 16 01:10:00.779479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Request method failure captured: Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b HTTP/1.1 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1mVl8t-PJ9Eh83gtrAvuqe2s8lC13WoiqdgpEUmZZtPkQVHnxrI-9b2QxSXf5bgZdhUQjDZ2q-VRxBomljaNW28DEYRV2-H3IWNSORiUAVvtr-JhCbSy6fyXORCn17zJmkJ9N0aGkFASyj5y1TADKOfWNWbifeGYvsfTSZnBHXAzAs Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 9b63ec6e0e3c4f268e63ae8da2ffe884 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1238671399 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b63ec6e0e3c4f268e63ae8da2ffe884", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b63ec6e0e3c4f268e63ae8da2ffe884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b63ec6e0e3c4f268e63ae8da2ffe884"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b63ec6e0e3c4f268e63ae8da2ffe884"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1238671399 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 9b63ec6e0e3c4f268e63ae8da2ffe884 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1238671399 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersAdminNegativeTestJSON-1238671399-project Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d0caedd0bc41435c9426ee622b9d2113 Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1238671399-project Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 67308bb0-24fc-415d-9c20-b0f810d2501b could not be found. Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '67308bb0-24fc-415d-9c20-b0f810d2501b'} Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67308bb0-24fc-415d-9c20-b0f810d2501b could not be found. Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67308bb0-24fc-415d-9c20-b0f810d2501b could not be found. Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:00.780425 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:00.784558 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:00.784558 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:00.784558 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:00.784558 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:00.784558 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:00.784558 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:00.784558 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67308bb0-24fc-415d-9c20-b0f810d2501b could not be found. Oct 16 01:10:00.784558 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:00.786830 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] Returning 404 to user: Instance 67308bb0-24fc-415d-9c20-b0f810d2501b could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:00.787963 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e80afe1-6e8b-49c9-8990-793756bd9af7 tempest-ServersAdminNegativeTestJSON-1238671399 tempest-ServersAdminNegativeTestJSON-1238671399-project] 10.222.0.39 "GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b" status: 404 len: 111 microversion: 2.1 time: 0.104726 Oct 16 01:10:00.789058 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1069/2281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:00 2022] GET /compute/v2.1/servers/67308bb0-24fc-415d-9c20-b0f810d2501b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:00.794633 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bbe18efc-5443-44a2-94bd-7f93f89481fc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1317 microversion: 2.1 time: 0.272009 Oct 16 01:10:00.796124 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1213/2282] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:00 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:00.809716 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:00.811530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:00.828827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.829597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.830204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.831164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.831754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.832503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.862487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:00.863371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:00.876624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.877187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.877728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:00.882423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:00.883119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:00.883741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:01.105940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:01.145415 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34987d3b-437c-4426-a9d7-147cfbb7f01c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1250 microversion: 2.1 time: 0.289042 Oct 16 01:10:01.145646 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1214/2283] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:00 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1250 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:10:01.183242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:01.183242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:01.193786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:01.194299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:01.194740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:01.195496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:01.196383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:01.196383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:01.210682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:01.235143 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-66eb34bf-6aac-4e9c-b151-c88741460168 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.444228 Oct 16 01:10:01.254827 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1070/2284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:00 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:01.336794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:01.346627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:01.348394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:01.349726 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e01aa0dd-9740-43cd-9c66-a8cb02ad34d3 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1404 microversion: 2.54 time: 0.182087 Oct 16 01:10:01.350612 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1215/2285] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:10:01 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1404 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:10:01.539050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:01.539667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:01.553606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:01.554455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:01.555123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:01.556629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:01.556970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:01.557697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:01.751999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:01.760710 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6e1c8c84-7c6d-4b43-a9ff-0eb1b46acc5c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1689 microversion: 2.1 time: 0.225238 Oct 16 01:10:01.761842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1071/2286] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:01 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:01.828090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:01.833079 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:01.843754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:01.844251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:01.844689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:01.845398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:01.845856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:01.846290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.175363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:02.175970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:02.184782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.192375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.193088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.197175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.202111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.202744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.216026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:02.237985 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0a5915d-f267-4b53-9fdd-ae073badf100 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1467 microversion: 2.1 time: 0.420531 Oct 16 01:10:02.274950 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1216/2287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:01 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1467 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:02.274950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:02.274950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:02.298663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.299760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.300614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.301684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.302562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.303475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.661356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:02.671341 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1920b3b-064d-45e1-bc87-0caadcb02e7f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1292 microversion: 2.1 time: 0.501343 Oct 16 01:10:02.676169 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1072/2288] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:02 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1292 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:02.681338 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:02.700254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:02.719121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.720306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.721078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.722010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.722696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.723342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.839803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:02.853024 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1b2e770a-66e3-44ec-9904-e51d4db263dd tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.588764 Oct 16 01:10:02.853642 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1217/2289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:02 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:02.877880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:02.878802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:02.888765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.889674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.890331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.892472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.893934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.895233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.944503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:02.945462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:02.946867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:02.947618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lazy-loading 'fault' on Instance uuid 9b8b9989-5a6a-4465-88cd-ae8303b17e9d {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:10:03.083293 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d906ae37-05da-48e9-a696-7ec1997ec5a6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1618 microversion: 2.1 time: 0.405503 Oct 16 01:10:03.083664 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1073/2290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:02 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1618 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:03.104912 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ff579ae5-fc19-41be-a4cc-f40cfa044b01 req-a39a218c-6462-4fcd-9c81-48d8ca7acf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "name": "network-vif-plugged", "status": "completed", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:03.145863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:03.160628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff579ae5-fc19-41be-a4cc-f40cfa044b01 req-a39a218c-6462-4fcd-9c81-48d8ca7acf74 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:03.164786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:03.167739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc122b9d7abf459fa506adcdbc0e4c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021b1335de664adea720f7b92f00cff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:03.172700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff579ae5-fc19-41be-a4cc-f40cfa044b01 req-a39a218c-6462-4fcd-9c81-48d8ca7acf74 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:03.173194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff579ae5-fc19-41be-a4cc-f40cfa044b01 req-a39a218c-6462-4fcd-9c81-48d8ca7acf74 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:03.173972 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf1d10e8-2e36-4b18-8ed7-267453945d3b tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 200 len: 1409 microversion: 2.54 time: 0.312838 Oct 16 01:10:03.187099 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1218/2291] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:10:02 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 1409 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:10:03.223135 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:03.224174 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:03.229346 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ff579ae5-fc19-41be-a4cc-f40cfa044b01 req-a39a218c-6462-4fcd-9c81-48d8ca7acf74 service nova] Creating event network-vif-plugged:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:10:03.240446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:03.244850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:03.247546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:03.251491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:03.252095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:03.252688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:03.261953 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ff579ae5-fc19-41be-a4cc-f40cfa044b01 req-a39a218c-6462-4fcd-9c81-48d8ca7acf74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171306 Oct 16 01:10:03.264236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1074/2292] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:03.385264 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-7c73c19b-d027-4ac4-9f0f-e34933c3fd27 req-92274257-471f-4619-8dac-8c21d739652d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c37e3c-d741-4bc5-bbbc-6a77da9d3650", "tag": "2706a2c3-a765-4ac9-8158-56085ed044a8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:03.416021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7c73c19b-d027-4ac4-9f0f-e34933c3fd27 req-92274257-471f-4619-8dac-8c21d739652d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:03.416572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7c73c19b-d027-4ac4-9f0f-e34933c3fd27 req-92274257-471f-4619-8dac-8c21d739652d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:03.417048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7c73c19b-d027-4ac4-9f0f-e34933c3fd27 req-92274257-471f-4619-8dac-8c21d739652d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:03.444257 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-7c73c19b-d027-4ac4-9f0f-e34933c3fd27 req-92274257-471f-4619-8dac-8c21d739652d service nova] Creating event network-changed:2706a2c3-a765-4ac9-8158-56085ed044a8 for instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 on n-h2-master-1 Oct 16 01:10:03.468813 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-7c73c19b-d027-4ac4-9f0f-e34933c3fd27 req-92274257-471f-4619-8dac-8c21d739652d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084437 Oct 16 01:10:03.469676 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1075/2293] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:03.476437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-523416763", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e39cd63e-32b5-496f-aeb2-fc6855585aa5"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:03.589154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:10:03.601253 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:03.719338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:03.729919 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-27d243f6-6e78-4ba6-b18a-a7402b118020 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.540323 Oct 16 01:10:03.730516 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1219/2294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:03 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:03.761519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:03.763484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:03.776505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:03.779979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:03.782364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:03.784098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:03.785148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:03.785742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:03.814471 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:04.403494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:10:04.404511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:10:04.404803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:10:04.405463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:10:04.406095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:10:04.427907 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:04.428642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:04.429329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:04.431592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:04.432318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:04.434271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:04.452570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:04.469540 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a749e358-07a4-4e50-b184-88088f37ac9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1292 microversion: 2.1 time: 0.716116 Oct 16 01:10:04.471501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:10:04.472348 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1220/2295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:03 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1292 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:04.481680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Getting quotas for user 2d7df9a6845440bbad5bd7c0a192171b and project abaf72f7fc7248a388dbfbd2b646dc56. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:10:04.484036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:04.484886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:04.514018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:04.515249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:04.517691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:04.519163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:04.521183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:04.522691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:04.534740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:10:04.537686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:10:04.649862 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-79ce24d3-4198-4464-a190-c748310d6a9c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178882 Oct 16 01:10:04.650905 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1076/2296] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:10:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:10:04.661147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:04.662033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] [instance: 9b8b9989-5a6a-4465-88cd-ae8303b17e9d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:04.672529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:04.674582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:04.675257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:04.677175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:04.678074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:04.678782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:04.708223 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] HTTP exception thrown: Instance 9b8b9989-5a6a-4465-88cd-ae8303b17e9d could not be found. Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Request method failure captured: Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d HTTP/1.1 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1mz8-jd_bZehRVWWQ2IC9g1FtfvgOMxIgBPzRZH5-Rm0Es6Or7ff3gpdNK5aPE9VjyD4w50DosbNxNrRZQJN4s75JO2SCHot4dVz4ZHEhhwt1DsioCVNYYttn1M_rT69YgZEqlex0h8UFV4SvR3QLsofA3rPnJbWszajaNxkCQyQz8 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.54 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 021b1335de664adea720f7b92f00cff5 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerShowV254Test-138820887 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_021b1335de664adea720f7b92f00cff5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/021b1335de664adea720f7b92f00cff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/021b1335de664adea720f7b92f00cff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/021b1335de664adea720f7b92f00cff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerShowV254Test-138820887 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 021b1335de664adea720f7b92f00cff5 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerShowV254Test-138820887 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerShowV254Test-138820887-project Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: bc122b9d7abf459fa506adcdbc0e4c50 Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerShowV254Test-138820887-project Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 9b8b9989-5a6a-4465-88cd-ae8303b17e9d could not be found. Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '9b8b9989-5a6a-4465-88cd-ae8303b17e9d'} Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8b9989-5a6a-4465-88cd-ae8303b17e9d could not be found. Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8b9989-5a6a-4465-88cd-ae8303b17e9d could not be found. Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:04.721090 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:04.726064 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:04.726064 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:04.726064 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:04.726064 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:04.726064 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:04.726064 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8b9989-5a6a-4465-88cd-ae8303b17e9d could not be found. Oct 16 01:10:04.726064 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:04.730105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] Returning 404 to user: Instance 9b8b9989-5a6a-4465-88cd-ae8303b17e9d could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:04.732054 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd42e72f-bfdf-4edd-8eb4-e5e05313c9b5 tempest-ServerShowV254Test-138820887 tempest-ServerShowV254Test-138820887-project] 10.222.0.39 "GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d" status: 404 len: 111 microversion: 2.54 time: 0.079797 Oct 16 01:10:04.734629 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1077/2297] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:10:04 2022] GET /compute/v2.1/servers/9b8b9989-5a6a-4465-88cd-ae8303b17e9d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:10:04.743571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-153aa6ea-7f19-47cf-a3c2-f5efc0f59b10 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:04.746576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-153aa6ea-7f19-47cf-a3c2-f5efc0f59b10 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:05.115195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:05.131408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-153aa6ea-7f19-47cf-a3c2-f5efc0f59b10 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:05.148591 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-682a60f1-2dfb-4312-a76b-7b0fa287c8bf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.674909 Oct 16 01:10:05.152661 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-153aa6ea-7f19-47cf-a3c2-f5efc0f59b10 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1216 microversion: 2.1 time: 0.416800 Oct 16 01:10:05.182962 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1221/2298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:04 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:05.183180 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1078/2299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:04 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1216 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:05.183303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:05.184443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:05.200111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:05.203427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:05.204360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:05.206816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:05.207880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:05.209174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:05.498887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:05.500550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:05.521690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:05.522471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:05.523475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:05.525068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:05.527282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:05.527951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:05.684567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:05.695463 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b9254ecb-8bf6-4875-9fca-651b3a39a2f6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.522756 Oct 16 01:10:05.696055 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1222/2300] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:05 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:06.068400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:06.094352 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-71b588cf-c600-44cf-886d-0a33cb3e5c62 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1292 microversion: 2.1 time: 0.588356 Oct 16 01:10:06.111055 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1079/2301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:05 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1292 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:10:06.181595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:06.182320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:06.201422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:06.207634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:06.208206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:06.208966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:06.209456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:06.209940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:06.761932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:06.773706 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3f9b592d-dae3-4999-9448-2158bac15f7f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.596679 Oct 16 01:10:06.783028 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1223/2302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:06 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:06.800117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:06.801254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:06.823397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:06.824088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:06.827654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:06.832134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:06.833021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:06.836154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:07.134504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:07.155935 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a6c917ce-dc2c-4e61-9602-391de4b9c516 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1268 microversion: 2.1 time: 0.360555 Oct 16 01:10:07.156698 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1224/2303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:06 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1268 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:07.206478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:07.213177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:07.239750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:07.241350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:07.243605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:07.246455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:07.249162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:07.250288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:07.367143 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6e50b725-2b13-4c5f-9ac7-42e23b7cfe08 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] 10.222.0.39 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 1.176158 Oct 16 01:10:07.369334 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1080/2304] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Oct 16 01:10:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 1179 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 16 01:10:07.377145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:07.378529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:07.412270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:07.419634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:07.420336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:07.421326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:07.422098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:07.422687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:07.758107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:07.766244 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f294fcf4-c0d7-400a-9b44-82723b142800 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.598050 Oct 16 01:10:07.772980 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1225/2305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:07 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:07.924647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:07.934366 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-13e86b0e-30bc-4a9c-b581-19b92399c840 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1292 microversion: 2.1 time: 0.562077 Oct 16 01:10:07.935620 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1081/2306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:07 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1292 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:07.941428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-594facbb-f597-4ac5-becd-07b4bf33aef7 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Calling method '.version_select at 0x7fd64e34b8b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:07.969962 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-594facbb-f597-4ac5-becd-07b4bf33aef7 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] HTTP exception thrown: Image not found. Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-594facbb-f597-4ac5-becd-07b4bf33aef7 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Request method failure captured: Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ntBJUipg2w-VwvvIdy7aWxC5m0yd5sTdDJdUl5lSBkk36vM-65o1GPOk8FHFgS0juyib1K9psVGQyn7_5PgG-szw5BJiRONoARpLcpFfGq_CackRDn3G_vGuwYcZiViMe1nVBFpGXVsZkWhqeXLfEM54SiaYCgVFShw2DITCeMsec Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_380d48805a1544d19327c51762bb4ac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b81ffd4e8de04c69a577e41d685d04e3 Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '-1'} Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:07.973850 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:10:07.977992 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:07.983506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-594facbb-f597-4ac5-becd-07b4bf33aef7 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:07.985721 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-594facbb-f597-4ac5-becd-07b4bf33aef7 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] 10.222.0.39 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.048740 Oct 16 01:10:07.987202 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1082/2307] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Oct 16 01:10:07 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:10:07.994564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:07.996877 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:08.007789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.008793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.009481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:08.010736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.011435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.012081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:08.089534 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-629371da-2c95-4b89-9be9-abaa4b39900f tempest-TenantUsagesNegativeTestJSON-614410855 tempest-TenantUsagesNegativeTestJSON-614410855-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-15T01%3A10%3A07.345183&end=2022-10-17T01%3A10%3A07.345183" status: 404 len: 112 microversion: - time: 0.315256 Oct 16 01:10:08.090355 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1226/2308] 10.222.0.39 () {58 vars in 1316 bytes} [Sun Oct 16 01:10:07 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-15T01%3A10%3A07.345183&end=2022-10-17T01%3A10%3A07.345183 => generated 112 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 16 01:10:08.096282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-734a2352-7146-405a-8500-d9141ea10c84 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Calling method '.version_select at 0x7fd64e080280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.144731 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-734a2352-7146-405a-8500-d9141ea10c84 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] HTTP exception thrown: Image not found. Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-734a2352-7146-405a-8500-d9141ea10c84 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Request method failure captured: Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/images/93ba7812-7281-4b50-b90f-755d7ac48aej HTTP/1.1 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ntBJUipg2w-VwvvIdy7aWxC5m0yd5sTdDJdUl5lSBkk36vM-65o1GPOk8FHFgS0juyib1K9psVGQyn7_5PgG-szw5BJiRONoARpLcpFfGq_CackRDn3G_vGuwYcZiViMe1nVBFpGXVsZkWhqeXLfEM54SiaYCgVFShw2DITCeMsec Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_380d48805a1544d19327c51762bb4ac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b81ffd4e8de04c69a577e41d685d04e3 Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '93ba7812-7281-4b50-b90f-755d7ac48aej'} Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 93ba7812-7281-4b50-b90f-755d7ac48aej to delete Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 93ba7812-7281-4b50-b90f-755d7ac48aej could not be found. Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.146487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-734a2352-7146-405a-8500-d9141ea10c84 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-734a2352-7146-405a-8500-d9141ea10c84 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] 10.222.0.39 "DELETE /compute/v2.1/images/93ba7812-7281-4b50-b90f-755d7ac48aej" status: 404 len: 62 microversion: 2.1 time: 0.056415 Oct 16 01:10:08.150090 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1227/2309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:08 2022] DELETE /compute/v2.1/images/93ba7812-7281-4b50-b90f-755d7ac48aej => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:10:08.169800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac7713ba-e2b1-4bfb-b3d5-8469eabf025f tempest-TenantUsagesNegativeTestJSON-614410855 tempest-TenantUsagesNegativeTestJSON-614410855-project-admin] Calling method '.version_select at 0x7fd64e080550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.212995 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:08.214490 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ac7713ba-e2b1-4bfb-b3d5-8469eabf025f tempest-TenantUsagesNegativeTestJSON-614410855 tempest-TenantUsagesNegativeTestJSON-614410855-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac7713ba-e2b1-4bfb-b3d5-8469eabf025f tempest-TenantUsagesNegativeTestJSON-614410855 tempest-TenantUsagesNegativeTestJSON-614410855-project-admin] Request method failure captured: Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-simple-tenant-usage/8dfcf1d8ad1d4fa9bfc92b9112306793?start=2022-10-17T01%3A10%3A07.345183&end=2022-10-15T01%3A10%3A07.345183 HTTP/1.1 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1nvB317l7xBGakbdkvmYGiyD1bkwuIgDhwNAGPC9NJ1nAM1Fkej5oTPa-sC0tnzJjlm6Jqivn-F7OSkVuqbDYXxFe1iQgwF0LGXQkFHej3YlCRgoLd7KqFt0j2zKSPCHrPPgUE3vCdVuoWfa9k78STdSoQv6LMn5Tf-JZBagtV1qZ0 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 94d80ca9deb240349103dee5843ff740 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-614410855 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_94d80ca9deb240349103dee5843ff740", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/94d80ca9deb240349103dee5843ff740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/94d80ca9deb240349103dee5843ff740"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/94d80ca9deb240349103dee5843ff740"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-614410855 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 94d80ca9deb240349103dee5843ff740 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-614410855 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TenantUsagesNegativeTestJSON-614410855-project-admin Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 98711c7997fd47beb19f8357d6dd1e76 Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-614410855-project-admin Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid start time. The start time cannot occur after the end time. Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8dfcf1d8ad1d4fa9bfc92b9112306793'} Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 16 01:10:08.222188 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.225659 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b5d4c713-5b06-42a0-b8f4-654d01ef7ed4 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.234657 Oct 16 01:10:08.229439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac7713ba-e2b1-4bfb-b3d5-8469eabf025f tempest-TenantUsagesNegativeTestJSON-614410855 tempest-TenantUsagesNegativeTestJSON-614410855-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:08.233496 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac7713ba-e2b1-4bfb-b3d5-8469eabf025f tempest-TenantUsagesNegativeTestJSON-614410855 tempest-TenantUsagesNegativeTestJSON-614410855-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/8dfcf1d8ad1d4fa9bfc92b9112306793?start=2022-10-17T01%3A10%3A07.345183&end=2022-10-15T01%3A10%3A07.345183" status: 400 len: 111 microversion: 2.1 time: 0.083622 Oct 16 01:10:08.235716 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1083/2310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:07 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:08.241494 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1228/2311] 10.222.0.39 () {58 vars in 1412 bytes} [Sun Oct 16 01:10:08 2022] GET /compute/v2.1/os-simple-tenant-usage/8dfcf1d8ad1d4fa9bfc92b9112306793?start=2022-10-17T01%3A10%3A07.345183&end=2022-10-15T01%3A10%3A07.345183 => generated 111 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:10:08.248828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c68b309c-d244-4f24-ac2b-0a4d12429285 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Calling method '.version_select at 0x7fd64e49a1f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.260601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.265177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:08.269230 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c68b309c-d244-4f24-ac2b-0a4d12429285 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] HTTP exception thrown: Image not found. Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c68b309c-d244-4f24-ac2b-0a4d12429285 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Request method failure captured: Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/9bb35fde-7138-4ac2-b70a-e82ff7dba8301 HTTP/1.1 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ntBJUipg2w-VwvvIdy7aWxC5m0yd5sTdDJdUl5lSBkk36vM-65o1GPOk8FHFgS0juyib1K9psVGQyn7_5PgG-szw5BJiRONoARpLcpFfGq_CackRDn3G_vGuwYcZiViMe1nVBFpGXVsZkWhqeXLfEM54SiaYCgVFShw2DITCeMsec Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_380d48805a1544d19327c51762bb4ac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b81ffd4e8de04c69a577e41d685d04e3 Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '9bb35fde-7138-4ac2-b70a-e82ff7dba8301'} Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9bb35fde-7138-4ac2-b70a-e82ff7dba8301 to delete Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9bb35fde-7138-4ac2-b70a-e82ff7dba8301 could not be found. Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.271311 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:10:08.274681 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.277651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c68b309c-d244-4f24-ac2b-0a4d12429285 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:08.278792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c68b309c-d244-4f24-ac2b-0a4d12429285 tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] 10.222.0.39 "DELETE /compute/v2.1/images/9bb35fde-7138-4ac2-b70a-e82ff7dba8301" status: 404 len: 62 microversion: 2.1 time: 0.042045 Oct 16 01:10:08.280639 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1084/2312] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:08 2022] DELETE /compute/v2.1/images/9bb35fde-7138-4ac2-b70a-e82ff7dba8301 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:10:08.293801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.297153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.300014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:08.301047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.304275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.307147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:08.487207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:08.491243 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:08.496178 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6ec3839-770a-44c2-ac6d-71dc6f358d49 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1274 microversion: 2.1 time: 0.250919 Oct 16 01:10:08.504383 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1229/2313] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:08 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:08.516833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c67518d-9391-44d8-8f72-3bb8d5e0f9dc tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Calling method '.version_select at 0x7fd64e08f310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.584791 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-8c67518d-9391-44d8-8f72-3bb8d5e0f9dc tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] HTTP exception thrown: Image not found. Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c67518d-9391-44d8-8f72-3bb8d5e0f9dc tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Request method failure captured: Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/images/tempest-invalid-1360887842 HTTP/1.1 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ntBJUipg2w-VwvvIdy7aWxC5m0yd5sTdDJdUl5lSBkk36vM-65o1GPOk8FHFgS0juyib1K9psVGQyn7_5PgG-szw5BJiRONoARpLcpFfGq_CackRDn3G_vGuwYcZiViMe1nVBFpGXVsZkWhqeXLfEM54SiaYCgVFShw2DITCeMsec Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_380d48805a1544d19327c51762bb4ac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b81ffd4e8de04c69a577e41d685d04e3 Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'tempest-invalid-1360887842'} Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1360887842 to delete Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1360887842 could not be found. Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.586777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:10:08.591233 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.593696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c67518d-9391-44d8-8f72-3bb8d5e0f9dc tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:08.595039 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8c67518d-9391-44d8-8f72-3bb8d5e0f9dc tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] 10.222.0.39 "DELETE /compute/v2.1/images/tempest-invalid-1360887842" status: 404 len: 62 microversion: 2.1 time: 0.086295 Oct 16 01:10:08.596225 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1230/2314] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Oct 16 01:10:08 2022] DELETE /compute/v2.1/images/tempest-invalid-1360887842 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:10:08.601160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a93c5bde-a2b3-4e61-b17e-10fa907242d5 req-393924ab-12c4-4cd9-95cd-d99b65189382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2132a3-c6eb-4fe2-96ce-725f4efba607", "name": "network-vif-plugged", "status": "completed", "tag": "b91eb4e3-f8a9-4013-a52a-4ea301c52468"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:08.680679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a93c5bde-a2b3-4e61-b17e-10fa907242d5 req-393924ab-12c4-4cd9-95cd-d99b65189382 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.681739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a93c5bde-a2b3-4e61-b17e-10fa907242d5 req-393924ab-12c4-4cd9-95cd-d99b65189382 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.682880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a93c5bde-a2b3-4e61-b17e-10fa907242d5 req-393924ab-12c4-4cd9-95cd-d99b65189382 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:08.705762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c800c6a-67f8-4f27-9c8a-0b1cecc92358 tempest-TenantUsagesNegativeTestJSON-2081885054 tempest-TenantUsagesNegativeTestJSON-2081885054-project] Calling method '.version_select at 0x7fd64e1ba9d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.711174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c800c6a-67f8-4f27-9c8a-0b1cecc92358 tempest-TenantUsagesNegativeTestJSON-2081885054 tempest-TenantUsagesNegativeTestJSON-2081885054-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e0650f2323bb460494dcab303fffc62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfcf1d8ad1d4fa9bfc92b9112306793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c800c6a-67f8-4f27-9c8a-0b1cecc92358 tempest-TenantUsagesNegativeTestJSON-2081885054 tempest-TenantUsagesNegativeTestJSON-2081885054-project] Request method failure captured: Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-15T01%3A10%3A07.345183&end=2022-10-17T01%3A10%3A07.345183&detailed=1 HTTP/1.1 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ntYadvcvCcnRQTtOYLa_rAGFAoXE_dS3u5jKx_hP58JR8Ja1gcDIpOIBr9-0Y0dtrvyszLSciJCvb4v5bZP0qS0g4h1NfWYHuD7QELTAVfOQGjDDTXpnMK0lsWvqma1g3ZIw6LM8mYS08v8TMbVuBrnIvlGAs6T_fq5X_XETri8TY Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 8dfcf1d8ad1d4fa9bfc92b9112306793 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2081885054 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8dfcf1d8ad1d4fa9bfc92b9112306793", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8dfcf1d8ad1d4fa9bfc92b9112306793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8dfcf1d8ad1d4fa9bfc92b9112306793"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8dfcf1d8ad1d4fa9bfc92b9112306793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2081885054 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 8dfcf1d8ad1d4fa9bfc92b9112306793 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2081885054 Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TenantUsagesNegativeTestJSON-2081885054-project Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e0650f2323bb460494dcab303fffc62d Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2081885054-project Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:10:08.713195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 16 01:10:08.717714 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.725632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c800c6a-67f8-4f27-9c8a-0b1cecc92358 tempest-TenantUsagesNegativeTestJSON-2081885054 tempest-TenantUsagesNegativeTestJSON-2081885054-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:08.726074 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a93c5bde-a2b3-4e61-b17e-10fa907242d5 req-393924ab-12c4-4cd9-95cd-d99b65189382 service nova] Creating event network-vif-plugged:b91eb4e3-f8a9-4013-a52a-4ea301c52468 for instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 on n-h1-master-1 Oct 16 01:10:08.726836 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c800c6a-67f8-4f27-9c8a-0b1cecc92358 tempest-TenantUsagesNegativeTestJSON-2081885054 tempest-TenantUsagesNegativeTestJSON-2081885054-project] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-15T01%3A10%3A07.345183&end=2022-10-17T01%3A10%3A07.345183&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.444993 Oct 16 01:10:08.727671 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1085/2315] 10.222.0.39 () {58 vars in 1335 bytes} [Sun Oct 16 01:10:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-15T01%3A10%3A07.345183&end=2022-10-17T01%3A10%3A07.345183&detailed=1 => generated 123 bytes in 446 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:08.746499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4f969b6a-749e-4bee-87ca-64807c3f65bd tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Calling method '.version_select at 0x7fd64e4a94c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.746709 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a93c5bde-a2b3-4e61-b17e-10fa907242d5 req-393924ab-12c4-4cd9-95cd-d99b65189382 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148748 Oct 16 01:10:08.753610 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1231/2316] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:08.792514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.795945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:08.816759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.822303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.825639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:08.826958 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-4f969b6a-749e-4bee-87ca-64807c3f65bd tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] HTTP exception thrown: Image not found. Oct 16 01:10:08.828684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.829121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4f969b6a-749e-4bee-87ca-64807c3f65bd tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Request method failure captured: Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/70ad71b8-e52f-45ec-bb65-7ace213277ca HTTP/1.1 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ntBJUipg2w-VwvvIdy7aWxC5m0yd5sTdDJdUl5lSBkk36vM-65o1GPOk8FHFgS0juyib1K9psVGQyn7_5PgG-szw5BJiRONoARpLcpFfGq_CackRDn3G_vGuwYcZiViMe1nVBFpGXVsZkWhqeXLfEM54SiaYCgVFShw2DITCeMsec Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_380d48805a1544d19327c51762bb4ac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380d48805a1544d19327c51762bb4ac9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 380d48805a1544d19327c51762bb4ac9 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b81ffd4e8de04c69a577e41d685d04e3 Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041603196-project Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '70ad71b8-e52f-45ec-bb65-7ace213277ca'} Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 70ad71b8-e52f-45ec-bb65-7ace213277ca to delete Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70ad71b8-e52f-45ec-bb65-7ace213277ca could not be found. Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.829371 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:10:08.834011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:08.835731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:08.835913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4f969b6a-749e-4bee-87ca-64807c3f65bd tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:08.836234 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4f969b6a-749e-4bee-87ca-64807c3f65bd tempest-ImagesDeleteNegativeTestJSON-2041603196 tempest-ImagesDeleteNegativeTestJSON-2041603196-project] 10.222.0.39 "DELETE /compute/v2.1/images/70ad71b8-e52f-45ec-bb65-7ace213277ca" status: 404 len: 62 microversion: 2.1 time: 0.106584 Oct 16 01:10:08.837044 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1086/2317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:08 2022] DELETE /compute/v2.1/images/70ad71b8-e52f-45ec-bb65-7ace213277ca => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:10:08.960485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:08.961499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:08.973795 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:08.978721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.979613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.981134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:08.983204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:08.985750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:08.987379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:09.716181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:09.730125 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f8a8b1d-cb8f-4738-b8af-15f13263077f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.942061 Oct 16 01:10:09.731611 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1232/2318] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:08 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:10:09.755428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:09.760512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:09.780793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:09.805314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:09.809050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:09.815784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:09.816497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:09.817015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:09.957566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:09.970906 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-915f1dfd-a48c-4d13-8c93-7de53bfbcd0c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1292 microversion: 2.1 time: 1.015046 Oct 16 01:10:09.993077 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1087/2319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:08 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1292 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:10.002609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:10.003514 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:10.010357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:10.011152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:10.018073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:10.023705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:10.025101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:10.025768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:10.199521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:10.216880 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0eb4dcdb-9a91-4fec-836e-e3ef8590eae6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1199 microversion: 2.1 time: 0.481585 Oct 16 01:10:10.219102 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1233/2320] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:09 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1199 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:10.688332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22975b9b-a25d-4d13-963e-df702437ce99 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Action: 'create', calling method: .version_select at 0x7fd64e080e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-586272393", "metadata": {"Type": "work"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:11.493366 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22975b9b-a25d-4d13-963e-df702437ce99 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.147784 Oct 16 01:10:11.494457 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1234/2321] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:10:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1149 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 16 01:10:11.504809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:11.510019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:11.541403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:11.546569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:11.547352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:11.548274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:11.551067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:11.553027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:11.771017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:11.784803 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-de35bc4e-d5c3-453f-becc-eeb445e1e4f1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1316 microversion: 2.1 time: 1.790273 Oct 16 01:10:11.785667 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1088/2322] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:09 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1316 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:11.809659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-27457e51-7ec7-4b7c-b3e7-b0709c9f9364 req-99c9dfa8-b548-416f-a2bc-9e58a4896580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c37e3c-d741-4bc5-bbbc-6a77da9d3650", "name": "network-vif-plugged", "status": "completed", "tag": "2706a2c3-a765-4ac9-8158-56085ed044a8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:11.832992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-27457e51-7ec7-4b7c-b3e7-b0709c9f9364 req-99c9dfa8-b548-416f-a2bc-9e58a4896580 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:11.834336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-27457e51-7ec7-4b7c-b3e7-b0709c9f9364 req-99c9dfa8-b548-416f-a2bc-9e58a4896580 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:11.835093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-27457e51-7ec7-4b7c-b3e7-b0709c9f9364 req-99c9dfa8-b548-416f-a2bc-9e58a4896580 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:11.853887 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-27457e51-7ec7-4b7c-b3e7-b0709c9f9364 req-99c9dfa8-b548-416f-a2bc-9e58a4896580 service nova] Creating event network-vif-plugged:2706a2c3-a765-4ac9-8158-56085ed044a8 for instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 on n-h2-master-1 Oct 16 01:10:11.860057 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-27457e51-7ec7-4b7c-b3e7-b0709c9f9364 req-99c9dfa8-b548-416f-a2bc-9e58a4896580 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053995 Oct 16 01:10:11.861275 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1089/2323] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:11.867717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:11.868654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:11.875398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:11.876158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:11.876778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:11.877712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:11.878358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:11.879010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:12.359875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:12.382956 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dedbb8cd-c7e2-43fd-b888-fdaa40b94f27 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.881844 Oct 16 01:10:12.383693 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1235/2324] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:11 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:12.407605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:12.408122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:12.433466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:12.438710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:12.439622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:12.440836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:12.444879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:12.445946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:12.932783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:12.958786 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a1345c0d-5f92-4b9b-97e4-f8431de4eb81 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1292 microversion: 2.1 time: 1.089459 Oct 16 01:10:12.961318 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1090/2325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:11 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1292 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:12.989575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-90b06bf4-99d1-4c12-8309-43f9fa5027a3 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Calling method '.version_select at 0x7fd64e1c25e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:13.088549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:13.102632 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-316b94a1-2def-4f45-aacf-8119eaaa934d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1382 microversion: 2.1 time: 0.705463 Oct 16 01:10:13.107711 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1236/2326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:12 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1382 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:13.113047 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-90b06bf4-99d1-4c12-8309-43f9fa5027a3 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6" status: 200 len: 353 microversion: 2.1 time: 0.148235 Oct 16 01:10:13.113818 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1091/2327] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:10:12 2022] GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6 => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:13.124614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:13.128301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:13.131090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-599ac820-aa69-4366-99bc-06114175703c req-98baff73-5333-47ac-a63e-1d99ea7efbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea38e41-8762-453e-8a0b-93065f608007", "tag": "467b48e5-2975-4f30-bd1e-04f93d1ca939"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:13.143609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.144284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.145228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.146174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.146738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.147423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.148102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-599ac820-aa69-4366-99bc-06114175703c req-98baff73-5333-47ac-a63e-1d99ea7efbaa service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.148688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-599ac820-aa69-4366-99bc-06114175703c req-98baff73-5333-47ac-a63e-1d99ea7efbaa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.149214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-599ac820-aa69-4366-99bc-06114175703c req-98baff73-5333-47ac-a63e-1d99ea7efbaa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.163070 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-599ac820-aa69-4366-99bc-06114175703c req-98baff73-5333-47ac-a63e-1d99ea7efbaa service nova] Creating event network-changed:467b48e5-2975-4f30-bd1e-04f93d1ca939 for instance 0ea38e41-8762-453e-8a0b-93065f608007 on n-h2-master-1 Oct 16 01:10:13.168161 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-599ac820-aa69-4366-99bc-06114175703c req-98baff73-5333-47ac-a63e-1d99ea7efbaa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058873 Oct 16 01:10:13.169326 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1237/2328] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:13.178031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:13.179351 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:13.189941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.190790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.191506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.193483 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dddc9834-7571-47a8-be27-f0f39ea5f1f8 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078298 Oct 16 01:10:13.194255 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1092/2329] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:10:13 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:10:13.203259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.205444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.214642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f1ee843c-f78b-40e0-81ba-87ca32c0f9e9 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Calling method '.version_select at 0x7fd64e125e50>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:13.219236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.347334 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f1ee843c-f78b-40e0-81ba-87ca32c0f9e9 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6" status: 200 len: 353 microversion: 2.1 time: 0.151441 Oct 16 01:10:13.347926 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1093/2330] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:10:13 2022] GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:13.473388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:13.488101 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d53a6604-78f3-41d4-900a-d784d3db36cb tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1316 microversion: 2.1 time: 0.316020 Oct 16 01:10:13.492507 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1238/2331] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:13 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:13.498751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:13.507311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:13.521987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.524479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.525478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.526816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.527260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.527937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.600713 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf3d5ee8-812e-47df-bcbc-3af8303c371e tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106597 Oct 16 01:10:13.601284 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1239/2332] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:10:13 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:10:13.615712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ce6bdeec-bd9b-4b73-83fa-43d64929e136 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Calling method '.version_select at 0x7fd64e08f310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:13.728075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:13.729524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:13.749269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.750160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.750597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.754772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ce6bdeec-bd9b-4b73-83fa-43d64929e136 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6" status: 202 len: 0 microversion: 2.1 time: 0.148239 Oct 16 01:10:13.755801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1240/2333] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:10:13 2022] DELETE /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:10:13.764021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:13.765223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:13.768906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.769632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.775388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.785345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.788708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.790284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:13.791483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:13.796596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:13.797591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:14.264276 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c070c464-02dc-4d6b-a292-db06dbb81379 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1533 microversion: 2.1 time: 0.912531 Oct 16 01:10:14.269831 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1094/2334] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:13 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1533 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:14.287583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e94b7b07-26a8-4b92-9f9c-914a0761213b tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Calling method '.version_select at 0x7fd64e18e5e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:14.371176 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e94b7b07-26a8-4b92-9f9c-914a0761213b tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6" status: 200 len: 352 microversion: 2.1 time: 0.099386 Oct 16 01:10:14.372194 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1095/2335] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:10:14 2022] GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:14.379346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:14.380874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:14.388814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:14.389531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:14.395682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:14.399756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:14.400550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:14.401146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:14.418949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:14.430220 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-544f0c0c-450e-47fb-b32d-ffd86d07eb74 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.673063 Oct 16 01:10:14.431818 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1241/2336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:13 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:14.438614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:14.439647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:14.447740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:14.449067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:14.449724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:14.451847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:14.452574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:14.453252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:14.457395 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:14.468389 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:14.489533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:14.684643 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73e53c80-962f-4339-870d-a50d51695e68 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 204 len: 0 microversion: 2.1 time: 0.310049 Oct 16 01:10:14.688884 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1096/2337] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:14 2022] DELETE /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:14.702092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:14.703574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:14.713836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:14.714548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:14.715923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:14.719246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:14.719904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:14.720377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:14.723770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:14.732483 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bed45146-23bd-4187-ba79-489741f3eab9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1473 microversion: 2.1 time: 0.297532 Oct 16 01:10:14.733898 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1242/2338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:14 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1473 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:14.760926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:14.763429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:14.783521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:14.785457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:14.786644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:14.787605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:14.789020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:14.790124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:15.139782 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:15.176323 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-99018087-11a7-48fc-b4ae-b9723075a37a tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1533 microversion: 2.1 time: 0.485937 Oct 16 01:10:15.176907 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1097/2339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:14 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1533 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:15.209487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:15.212014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:15.235228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:15.236998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:15.239893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:15.240628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:15.241941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:15.244294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:15.245374 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e469fd2-d1a2-404d-87d8-1690e1f77690 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1316 microversion: 2.1 time: 0.508438 Oct 16 01:10:15.245958 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1243/2340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:14 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:15.246537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:15.255185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1218187969", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:15.368546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] validate_networks() for [('e837775c-af35-4cb2-89ea-5a342e83cc6f', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:10:15.795038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:15.811580 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3d2b41b6-6e86-483a-933b-4997a4886e34 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1680 microversion: 2.1 time: 0.614196 Oct 16 01:10:15.812073 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1098/2341] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:15 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1680 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:15.817391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-303144a2-c9b2-40ee-b534-03dfbdfdaac7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:15.828733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-303144a2-c9b2-40ee-b534-03dfbdfdaac7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:15.835257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-303144a2-c9b2-40ee-b534-03dfbdfdaac7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:15.835876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-303144a2-c9b2-40ee-b534-03dfbdfdaac7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:15.836803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-303144a2-c9b2-40ee-b534-03dfbdfdaac7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:15.837386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-303144a2-c9b2-40ee-b534-03dfbdfdaac7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:15.837935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-303144a2-c9b2-40ee-b534-03dfbdfdaac7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:15.870489 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-303144a2-c9b2-40ee-b534-03dfbdfdaac7 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056994 Oct 16 01:10:15.871990 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1099/2342] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:10:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:15.908232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5a66fdd-2e1c-432c-b69d-a1252d56e72d tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Calling method '.version_select at 0x7fd64e49a1f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:16.013827 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5a66fdd-2e1c-432c-b69d-a1252d56e72d tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6" status: 200 len: 352 microversion: 2.1 time: 0.139728 Oct 16 01:10:16.014514 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1100/2343] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:10:15 2022] GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:16.019394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:16.020280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:16.038486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:16.042426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:16.043163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:16.045805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:16.057327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:16.058149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:16.957365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:10:16.957941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:10:16.958233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:10:16.958863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:10:16.959661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:10:16.976199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:16.979608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:16.980296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:16.984576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:16.985541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:16.986231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:17.042991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:10:17.058421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:10:17.072482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:17.086640 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4956f1a-9a5c-4e0f-bcb5-5235f1e3a00b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 1.070754 Oct 16 01:10:17.086902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:10:17.089443 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1101/2344] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:16 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:17.091596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 88d4a756-77ff-44de-baf2-d67b6721283e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:10:17.103777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:17.106512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:17.127546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:17.128750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:17.129376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:17.130259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:17.130992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:17.131569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:17.164634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lazy-loading 'flavor' on Instance uuid aa2132a3-c6eb-4fe2-96ce-725f4efba607 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:10:17.184453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Going to try to live migrate instance to n-h2-master-1 {{(pid=120546) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:10:17.196711 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-96c7b17c-897c-4efa-8345-6e248f25efe5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.945446 Oct 16 01:10:17.207697 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1244/2345] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:10:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:10:17.234144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:17.234764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:17.257628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:17.258181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:17.261565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:17.264274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:17.264756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:17.265187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:17.904537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:17.917534 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-260fbb3a-6672-4fb7-bf34-3c75097113bd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1316 microversion: 2.1 time: 0.703597 Oct 16 01:10:17.921268 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1245/2346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:17 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1316 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:17.939363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:17.940156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:17.968573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:17.970304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:17.972110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:17.976523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:17.977611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:17.983642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:18.943559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:18.983397 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-57333434-3094-4c05-a05d-216e7919fb0a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1680 microversion: 2.1 time: 1.057804 Oct 16 01:10:18.988521 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1246/2347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:17 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1680 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:19.024570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-01bb72d5-8858-421a-9647-7d2127e6fa55 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Calling method '.version_select at 0x7fd64e0cbee0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:19.111323 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-01bb72d5-8858-421a-9647-7d2127e6fa55 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] HTTP exception thrown: Volume 4f944512-ce72-45cd-a6bb-57b6067c64a6 could not be found. Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-01bb72d5-8858-421a-9647-7d2127e6fa55 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Request method failure captured: Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6 HTTP/1.1 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ny2ox_Qrc-tALAn_c3xaUc19tz0QIOrSr5-zUL5z-8w_L7YhSUeC-QDojGnUoV4vss57oiXJcV8iRB_Z0RVT4CdzvUjH7qmS1CPSb-M5sEv1f0UEXF3gJOCnIiANv8oZpu_mPEh9jCvwDntOc826hdtrIVajZWB83_n0NkFC-8EOk Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 6c515ba81d4541abaf3b88e3786e6f61 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesGetTestJSON-1236826520 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6c515ba81d4541abaf3b88e3786e6f61", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6c515ba81d4541abaf3b88e3786e6f61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6c515ba81d4541abaf3b88e3786e6f61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6c515ba81d4541abaf3b88e3786e6f61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesGetTestJSON-1236826520 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 6c515ba81d4541abaf3b88e3786e6f61 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesGetTestJSON-1236826520 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesGetTestJSON-1236826520-project Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 35b70431e8c442b29659394bed48ec71 Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesGetTestJSON-1236826520-project Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: exception: Volume 4f944512-ce72-45cd-a6bb-57b6067c64a6 could not be found. Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '4f944512-ce72-45cd-a6bb-57b6067c64a6'} Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f944512-ce72-45cd-a6bb-57b6067c64a6 could not be found. (HTTP 404) (Request-ID: req-b4e77e5f-c4b1-47e5-93cf-8ab9213f5d16) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:10:19.114589 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f944512-ce72-45cd-a6bb-57b6067c64a6 could not be found. Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f944512-ce72-45cd-a6bb-57b6067c64a6 could not be found. Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f944512-ce72-45cd-a6bb-57b6067c64a6 could not be found. Oct 16 01:10:19.118858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:19.125394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-01bb72d5-8858-421a-9647-7d2127e6fa55 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] Returning 404 to user: Volume 4f944512-ce72-45cd-a6bb-57b6067c64a6 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:19.126449 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-01bb72d5-8858-421a-9647-7d2127e6fa55 tempest-VolumesGetTestJSON-1236826520 tempest-VolumesGetTestJSON-1236826520-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6" status: 404 len: 109 microversion: 2.1 time: 0.133567 Oct 16 01:10:19.127583 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1247/2348] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:10:18 2022] GET /compute/v2.1/os-volumes/4f944512-ce72-45cd-a6bb-57b6067c64a6 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:19.137966 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:19.139301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 88d4a756-77ff-44de-baf2-d67b6721283e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:19.154579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:19.159897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:19.160576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:19.161541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:19.162209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:19.162857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:19.222847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 88d4a756-77ff-44de-baf2-d67b6721283e] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:19.384843 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6ec1d7a-b511-4906-b4d8-eabce710c889 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e" status: 204 len: 0 microversion: 2.1 time: 0.255813 Oct 16 01:10:19.385826 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1248/2349] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:19 2022] DELETE /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:19.400876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:19.406765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:19.432725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:19.433576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:19.434224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:19.437910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:19.438603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:19.439294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:20.606287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:20.620732 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de265f11-0b7f-4a25-b37c-66a4d464ee38 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 1.233523 Oct 16 01:10:20.635996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1249/2350] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:19 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:20.661512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:20.662431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:20.696997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:20.697947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:20.698642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:20.699639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:20.700331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:20.700974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:21.023607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:21.032882 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:21.036892 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6322094-1ee8-4747-9673-f7999d1b305c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1316 microversion: 2.1 time: 0.399568 Oct 16 01:10:21.039291 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1250/2351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:20 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:21.056936 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:21.059138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 88d4a756-77ff-44de-baf2-d67b6721283e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:21.074306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:21.078565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:21.079366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:21.080358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:21.081034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:21.082385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:21.290319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:21.303815 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e679898-397e-4f95-88b0-4c032bc9e0ec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e" status: 200 len: 1211 microversion: 2.1 time: 0.262699 Oct 16 01:10:21.312780 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1251/2352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:21 2022] GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e => generated 1211 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:21.330107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:21.332412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:21.353084 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:21.358201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:21.358722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:21.359220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:21.364452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:21.364923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:21.365363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:21.455401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:21.455723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:21.456431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:21.457158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lazy-loading 'fault' on Instance uuid b371b2df-c758-4e6c-87fd-1bb8bebac0c7 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:10:21.682800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a745e8bb56574606b709907e661b9cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622fb0e0967148838b71b51b4d572d38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:21.692120 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22d83415-a454-45ee-9945-ada9540f6778 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 200 len: 1331 microversion: 2.1 time: 0.378231 Oct 16 01:10:21.695719 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1252/2353] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:21 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 1331 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:21.708172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-87af8e25-efe4-4860-ac9e-077b2aeac056 req-adb75377-e8f9-490c-bfd5-0ddc23bb8bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b371b2df-c758-4e6c-87fd-1bb8bebac0c7", "name": "network-vif-deleted", "tag": "d0054275-f5b2-4635-b2b2-577ae8658e69"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:21.732656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-87af8e25-efe4-4860-ac9e-077b2aeac056 req-adb75377-e8f9-490c-bfd5-0ddc23bb8bdf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:21.734490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-87af8e25-efe4-4860-ac9e-077b2aeac056 req-adb75377-e8f9-490c-bfd5-0ddc23bb8bdf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:21.739630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-87af8e25-efe4-4860-ac9e-077b2aeac056 req-adb75377-e8f9-490c-bfd5-0ddc23bb8bdf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:21.790441 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-87af8e25-efe4-4860-ac9e-077b2aeac056 req-adb75377-e8f9-490c-bfd5-0ddc23bb8bdf service nova] Creating event network-vif-deleted:d0054275-f5b2-4635-b2b2-577ae8658e69 for instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 on n-h1-master-1 Oct 16 01:10:21.805386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-87af8e25-efe4-4860-ac9e-077b2aeac056 req-adb75377-e8f9-490c-bfd5-0ddc23bb8bdf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105353 Oct 16 01:10:21.805999 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1253/2354] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:21.824655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f3880567-5d37-4be3-8df5-991dcb70c1ba req-a0b7e75a-0eb0-408b-aa62-bb1b23127693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea38e41-8762-453e-8a0b-93065f608007", "name": "network-vif-plugged", "status": "completed", "tag": "467b48e5-2975-4f30-bd1e-04f93d1ca939"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:21.908417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f3880567-5d37-4be3-8df5-991dcb70c1ba req-a0b7e75a-0eb0-408b-aa62-bb1b23127693 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:21.908951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f3880567-5d37-4be3-8df5-991dcb70c1ba req-a0b7e75a-0eb0-408b-aa62-bb1b23127693 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:21.909404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f3880567-5d37-4be3-8df5-991dcb70c1ba req-a0b7e75a-0eb0-408b-aa62-bb1b23127693 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:21.972469 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f3880567-5d37-4be3-8df5-991dcb70c1ba req-a0b7e75a-0eb0-408b-aa62-bb1b23127693 service nova] Creating event network-vif-plugged:467b48e5-2975-4f30-bd1e-04f93d1ca939 for instance 0ea38e41-8762-453e-8a0b-93065f608007 on n-h2-master-1 Oct 16 01:10:21.980628 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f3880567-5d37-4be3-8df5-991dcb70c1ba req-a0b7e75a-0eb0-408b-aa62-bb1b23127693 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160038 Oct 16 01:10:21.982524 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1254/2355] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:21.990852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:22.006778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:22.022444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:22.023628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:22.025708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:22.026676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:22.028219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:22.042544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:22.628316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:22.652455 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85b93ad2-d345-4b88-a6e9-e2c60fb306b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.663259 Oct 16 01:10:22.682695 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1255/2356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:21 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:22.721724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:22.723048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:22.730388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:22.731196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:22.732534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:22.750030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:22.750528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:22.770522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:23.159320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:23.181713 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-449f8850-6362-4178-989e-547d1e868358 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1316 microversion: 2.1 time: 0.497710 Oct 16 01:10:23.212698 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1256/2357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:22 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:23.229251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:23.230564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 88d4a756-77ff-44de-baf2-d67b6721283e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:23.242204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:23.243172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:23.243606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:23.248042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:23.248762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:23.250493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:23.594430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:23.610959 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a3908f13-d624-4d90-b6b6-93f7f9963fc7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e" status: 200 len: 1213 microversion: 2.1 time: 0.393524 Oct 16 01:10:23.612289 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1257/2358] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:23 2022] GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e => generated 1213 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:23.617092 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:23.620865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:23.635064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:23.642605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:23.643752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:23.649155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:23.649802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:23.650459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:23.685650 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] HTTP exception thrown: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Request method failure captured: Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 HTTP/1.1 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1kr_bK_yPLbl5kY3jdu3nB0k9g6cZbQW12W0OVSocTzujcmUiyJkpSmilto0hY3QLgRniQR0Yo67wni-qJ52SGz7g_2DxKto7fM1OTY37K8TEmp6ReAZ8328_S6GUXHH5VRFgk-PIZrq5XQ9rub5O3NOQM6FQjDWr5o-Ck6MoMqudc Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 622fb0e0967148838b71b51b4d572d38 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_622fb0e0967148838b71b51b4d572d38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 622fb0e0967148838b71b51b4d572d38 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachSCSIVolumeTestJSON-1109318114-project Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a745e8bb56574606b709907e661b9cd8 Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1109318114-project Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: exception: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'b371b2df-c758-4e6c-87fd-1bb8bebac0c7'} Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:23.688097 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Returning 404 to user: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:23.692464 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7c804d9a-0aa6-42a6-9f6d-0adc0a2448c0 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 404 len: 111 microversion: 2.1 time: 0.076099 Oct 16 01:10:23.693765 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1258/2359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:23 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:23.704382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:23.705016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:23.720793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:23.721306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:23.721747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:23.722458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:23.724836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:23.725428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:24.016991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:24.027743 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42c2d2ad-0fb2-43f3-92de-2dc3a13a1a5e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.332141 Oct 16 01:10:24.029942 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1259/2360] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:23 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:24.046407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-880d94cd-3e81-4bab-9021-5d3e35dc0854 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '.version_select at 0x7fd64ddbc430>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:24.084447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-880d94cd-3e81-4bab-9021-5d3e35dc0854 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245168964" status: 202 len: 0 microversion: 2.1 time: 0.051806 Oct 16 01:10:24.086114 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1260/2361] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:10:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245168964 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:10:24.093238 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f22833ca-61ba-4313-af52-32c56790f5c6 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607/action" status: 202 len: 0 microversion: 2.1 time: 7.000757 Oct 16 01:10:24.094253 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1102/2362] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:10:17 2022] POST /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607/action => generated 0 bytes in 7004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:10:24.108803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:24.113809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:24.140508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:24.144907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:24.145460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:24.149768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:24.155611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:24.156229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:24.210075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:24.210794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:24.236417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:24.241699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:24.242434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:24.243374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:24.243997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:24.244577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:25.379879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:25.393633 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eb6bd211-be49-4078-bb8a-486c357d43ac tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 1.294145 Oct 16 01:10:25.394786 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1261/2363] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:24 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:25.404455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:25.405427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 88d4a756-77ff-44de-baf2-d67b6721283e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:25.422766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:25.424693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:25.425768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:25.427928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:25.430634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:25.431303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:25.465243 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e HTTP/1.1 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '88d4a756-77ff-44de-baf2-d67b6721283e'} Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:25.469590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:25.473938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:25.473938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:25.473938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:25.473938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:25.473938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:10:25.473938 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:10:25.475279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:25.477459 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-460727ac-8b4b-4181-944a-dd2e713cd398 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e" status: 404 len: 111 microversion: 2.1 time: 0.079976 Oct 16 01:10:25.482089 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1262/2364] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:25 2022] GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:25.493557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:25.494955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:25.505402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:25.510022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:25.510721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:25.511381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:25.514594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:25.517701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:25.518354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:25.578720 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-948192c2-12bc-4f85-88db-2c414ad3a6cd tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1316 microversion: 2.1 time: 1.372822 Oct 16 01:10:25.583481 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1103/2365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:24 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1316 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:10:25.829328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2121791170", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e837775c-af35-4cb2-89ea-5a342e83cc6f"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:25.855150 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:25.975872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] validate_networks() for [('e837775c-af35-4cb2-89ea-5a342e83cc6f', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:10:26.165209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:26.179551 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c055bb8b-11c6-4b3e-a390-8036392501ce tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.696100 Oct 16 01:10:26.180433 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1263/2366] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:25 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:26.426499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:26.428183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:26.447136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:26.447928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:26.448523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:26.449402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:26.450025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:26.450656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:27.015733 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:27.048840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:10:27.051289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:10:27.053709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:10:27.054426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:10:27.055301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:10:27.061693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:27.072558 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97f20785-f268-41ab-b4cd-3d55e477eaec tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.650789 Oct 16 01:10:27.073341 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1264/2367] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:26 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:10:27.075632 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:27.091403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:27.096220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:27.097175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:27.098730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:27.099785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:27.102078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:27.102658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:27.105901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:27.129609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:27.131990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:27.133003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:27.134305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:27.144520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:27.145474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:27.159545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:10:27.172993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:10:27.205408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:10:27.218977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:10:27.349537 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3dbf04d2-faa3-48e8-bed8-3e089f1d6572 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532400 Oct 16 01:10:27.351556 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1104/2368] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:10:27.362249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:27.366676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:27.382185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:27.382691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:27.383138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:27.383868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:27.387429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:27.391009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:28.161509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:28.177689 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fece1360-8423-43c1-bd1b-f25193e3d493 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.819483 Oct 16 01:10:28.187981 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1105/2369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:27 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:28.207658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a0ce544-71b8-4880-a95c-dc9cad6daee3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:28.208532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a0ce544-71b8-4880-a95c-dc9cad6daee3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:28.303825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:28.329184 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac5f488a-1c67-4100-8994-e1caa3b1dc57 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1466 microversion: 2.1 time: 1.254479 Oct 16 01:10:28.330598 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1265/2370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:27 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1466 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:28.352204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:28.360630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:28.385138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:28.394528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:28.395263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:28.401904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:28.404080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:28.406288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:29.452249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a0ce544-71b8-4880-a95c-dc9cad6daee3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:29.476908 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a0ce544-71b8-4880-a95c-dc9cad6daee3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1221 microversion: 2.1 time: 1.286444 Oct 16 01:10:29.497427 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1106/2371] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:28 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1221 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:29.507731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:29.508908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:29.525711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:29.526374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:29.527184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:29.528214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:29.528897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:29.529644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:29.816839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:29.829638 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-98aa4b18-cf0c-44b6-b5ca-8f2a375ce40b tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 1.497084 Oct 16 01:10:29.830231 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1266/2372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:28 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:29.850154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:29.870326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:29.899551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:29.900875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:29.901657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:29.902389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:29.902847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:29.915295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:30.661146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6271b62-aea4-4fa5-8853-b26becf119b6 tempest-ServersOnMultiNodesTest-463081352 tempest-ServersOnMultiNodesTest-463081352-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1617 microversion: 2.1 time: 1.156048 Oct 16 01:10:30.664744 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1107/2373] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:29 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1617 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:30.687558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:30.690582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:30.715140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:30.724504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:30.728395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:30.729255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:30.732643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:30.735924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:30.987066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:30.997329 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b4da1bb-578f-4a38-8901-9c10396f6dc5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1279 microversion: 2.1 time: 0.327459 Oct 16 01:10:31.019968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1108/2374] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:30 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1279 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:31.038753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:31.045037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:31.070606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:31.072482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:31.078817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:31.089419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:31.090398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:31.092780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:31.160810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:31.403638 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ded996bf-1dad-4728-b95f-36ecc22a368a tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 204 len: 0 microversion: 2.1 time: 0.378085 Oct 16 01:10:31.405189 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1109/2375] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:31 2022] DELETE /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:31.413256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:31.421004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:31.437903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:31.441334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:31.442589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:31.447836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:31.448533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:31.450231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:31.468285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:31.483648 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d3d81d6-3201-4876-85b8-822040605f99 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 1.643342 Oct 16 01:10:31.484503 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1267/2376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:29 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:31.505350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:31.508456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:31.518678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:31.535769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:31.536122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:31.537024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:31.537640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:31.538241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:32.594595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:32.607579 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4b6797d-a514-449c-8fe6-bc7e2ac21ee3 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 1.200054 Oct 16 01:10:32.608374 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1110/2377] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:31 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:32.624471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:32.630990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:32.652365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-47ee368a-3be4-41f5-86ae-bb1e3b6debec tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1472 microversion: 2.1 time: 1.164150 Oct 16 01:10:32.653870 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1268/2378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:31 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1472 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:32.655818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:32.682070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:32.683112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:32.697860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:32.698649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:32.699305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:32.702329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:32.703527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:32.707342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:32.708083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:32.714524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:32.715088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:32.715894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:32.716493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:32.716974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:32.724405 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:33.078420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:33.096598 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c607bb37-d498-459b-bacf-7131e4f94a3a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1279 microversion: 2.1 time: 0.479845 Oct 16 01:10:33.108017 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1111/2379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:32 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1279 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:33.666513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:33.667390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:33.695653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:33.696302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:33.696756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:33.698693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:33.698693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:33.705684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:33.836925 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:33.858850 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1781efd3-19c1-412d-ac29-8417cdd00876 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 1.203527 Oct 16 01:10:33.870114 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1269/2380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:32 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:33.889408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:33.896603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:33.940808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:33.941733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:33.943707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:33.947897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:33.949537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:33.950660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:34.365185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:34.377344 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-652de8f3-7285-4622-b0bb-663b6f546da8 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.715357 Oct 16 01:10:34.381073 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1112/2381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:33 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:34.407103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:34.411387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:34.431316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:34.437772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:34.438455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:34.445140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:34.445976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:34.446587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:34.520212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:34.526700 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:34.531935 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc76f48c-d2e2-4f67-a59b-6014cb74f75f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1472 microversion: 2.1 time: 0.660686 Oct 16 01:10:34.550944 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1270/2382] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:33 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1472 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:34.622714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:34.636360 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2830dea0-75be-40e9-ad8c-8ab48726bc28 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1279 microversion: 2.1 time: 0.239763 Oct 16 01:10:34.636966 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1113/2383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:34 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1279 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:34.687519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2be0d2ac-7b55-4ee8-adfe-6c5407520a50 req-cdb70eb3-f345-4ad4-9745-91cfc98dbfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea38e41-8762-453e-8a0b-93065f608007", "name": "network-vif-deleted", "tag": "467b48e5-2975-4f30-bd1e-04f93d1ca939"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:34.726788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2be0d2ac-7b55-4ee8-adfe-6c5407520a50 req-cdb70eb3-f345-4ad4-9745-91cfc98dbfdf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:34.734298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2be0d2ac-7b55-4ee8-adfe-6c5407520a50 req-cdb70eb3-f345-4ad4-9745-91cfc98dbfdf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:34.735344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2be0d2ac-7b55-4ee8-adfe-6c5407520a50 req-cdb70eb3-f345-4ad4-9745-91cfc98dbfdf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:34.800330 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2be0d2ac-7b55-4ee8-adfe-6c5407520a50 req-cdb70eb3-f345-4ad4-9745-91cfc98dbfdf service nova] Creating event network-vif-deleted:467b48e5-2975-4f30-bd1e-04f93d1ca939 for instance 0ea38e41-8762-453e-8a0b-93065f608007 on n-h2-master-1 Oct 16 01:10:34.843509 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2be0d2ac-7b55-4ee8-adfe-6c5407520a50 req-cdb70eb3-f345-4ad4-9745-91cfc98dbfdf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145291 Oct 16 01:10:34.845890 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1271/2384] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:34.889450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:34.890234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:34.902725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:34.911274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:34.912492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:34.926794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:34.928647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:34.929202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:35.409701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:35.410565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:35.432807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:35.433947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:35.435432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:35.436638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:35.439183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:35.439913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:35.836157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:35.851796 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5dafc17c-9f09-4867-8f96-c4f1780c0f52 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1684 microversion: 2.1 time: 0.966460 Oct 16 01:10:35.856700 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1114/2385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:34 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1684 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:35.870285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:35.870970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:35.889925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:35.891943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:35.909687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:35.916027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:35.919597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:35.924823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:36.073212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:36.073968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:36.074447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:36.083165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lazy-loading 'fault' on Instance uuid 0ea38e41-8762-453e-8a0b-93065f608007 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:10:36.385737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:36.424741 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-437d9b61-5f9e-4bef-9811-f140b24ddd1f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 200 len: 1306 microversion: 2.1 time: 0.537267 Oct 16 01:10:36.449010 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1115/2386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:35 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 1306 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:36.470537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:36.474959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:36.485940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:36.505223 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b89e7ba7-81ed-4faa-b244-fc7089a84192 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 1.098940 Oct 16 01:10:36.509376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1272/2387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:35 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:10:36.536927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:36.540400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:36.541507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:36.565114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:36.566797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:36.571802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:36.852634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-35fc037c-503f-48e7-9f8c-b2abb79d142b tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Action: 'create', calling method: .version_select at 0x7fd64e1391f0>, body: {"pool": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:37.136381 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:38.362314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:38.382560 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ed5f47f-4ebb-4f0e-b9be-ced864243e9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1321 microversion: 2.1 time: 1.929384 Oct 16 01:10:38.383566 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1116/2388] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:36 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1321 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:38.893582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2060249776", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "d8483f43-34d4-4a15-8d4a-0ba2593407d1"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:38.971632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] validate_networks() for [('d8483f43-34d4-4a15-8d4a-0ba2593407d1', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:10:39.457614 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:40.223849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:10:40.224706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:10:40.225341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:10:40.226093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:10:40.226683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:10:40.232238 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:40.255773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:40.256586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:40.261030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:40.263565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:40.264372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:40.270753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:40.340975 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Getting quotas for project f9416837a51e484094dba1a296c4d096. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:10:40.360287 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Getting quotas for user 0a7ca896a35447f8a828817a8620d308 and project f9416837a51e484094dba1a296c4d096. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:10:40.393431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:10:40.397924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:10:40.488538 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16c25c1e-0e08-4ba8-92cf-54f81cf72704 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.097559 Oct 16 01:10:40.490627 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1117/2389] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:10:40.504244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:40.505760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:40.524043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:40.528832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:40.531045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:40.532525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:40.532996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:40.533438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:40.815989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:40.829729 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eddb9881-1cbd-4697-9763-05412748fe3a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.335524 Oct 16 01:10:40.831625 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1118/2390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:40 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:40.843727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:40.847635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 0ea38e41-8762-453e-8a0b-93065f608007] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:40.861215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:40.863567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:40.867774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:40.868760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:40.869445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:40.870087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:40.936832 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] HTTP exception thrown: Instance 0ea38e41-8762-453e-8a0b-93065f608007 could not be found. Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Request method failure captured: Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 HTTP/1.1 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1lhEyS1Hwn1n0leEshVjT0U2-CzwagXicsXvcbdRIayHOqWWeyxkr0_-kHE1cWex0RelbNvuEfmrUnq50geamnfcho4tNpNqAGt996veNcOXT2EXJNtM5gGUvIhiHnk98U2w0iyEW1CbG80_VoxrDTu7anOve47DgIOhqXwWi96MLM Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_abaf72f7fc7248a388dbfbd2b646dc56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2d7df9a6845440bbad5bd7c0a192171b Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 0ea38e41-8762-453e-8a0b-93065f608007 could not be found. Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '0ea38e41-8762-453e-8a0b-93065f608007'} Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea38e41-8762-453e-8a0b-93065f608007 could not be found. Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea38e41-8762-453e-8a0b-93065f608007 could not be found. Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:40.942851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:40.948464 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:40.948464 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:40.948464 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:40.948464 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:40.948464 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:40.948464 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea38e41-8762-453e-8a0b-93065f608007 could not be found. Oct 16 01:10:40.948464 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:40.952753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Returning 404 to user: Instance 0ea38e41-8762-453e-8a0b-93065f608007 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:40.958257 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab811ef6-b1d1-444c-a074-2e1eb8e9d83e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007" status: 404 len: 111 microversion: 2.1 time: 0.120453 Oct 16 01:10:40.963720 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1119/2391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:40 2022] GET /compute/v2.1/servers/0ea38e41-8762-453e-8a0b-93065f608007 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:40.971077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:40.972229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:40.979295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:40.979958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:40.980541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:40.982082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:40.985799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:40.985799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:41.735463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:41.781767 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-115b49c2-4451-4da1-9a99-d108c5e426b1 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.816503 Oct 16 01:10:41.782773 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1120/2392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:40 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:41.791507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1f14f6e8-a70a-403f-af93-416ec585226b req-f67beb84-c407-48ae-b282-52826c6c5ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "name": "network-vif-unplugged", "status": "completed", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:41.836603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1f14f6e8-a70a-403f-af93-416ec585226b req-f67beb84-c407-48ae-b282-52826c6c5ee2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:41.837315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1f14f6e8-a70a-403f-af93-416ec585226b req-f67beb84-c407-48ae-b282-52826c6c5ee2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:41.841850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1f14f6e8-a70a-403f-af93-416ec585226b req-f67beb84-c407-48ae-b282-52826c6c5ee2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:41.890843 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1f14f6e8-a70a-403f-af93-416ec585226b req-f67beb84-c407-48ae-b282-52826c6c5ee2 service nova] Creating event network-vif-unplugged:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:10:41.909060 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1f14f6e8-a70a-403f-af93-416ec585226b req-f67beb84-c407-48ae-b282-52826c6c5ee2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124187 Oct 16 01:10:41.912130 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1121/2393] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:41.931227 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:41.932223 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:41.957365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:41.959047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:41.960502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:41.965128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:41.969751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:41.971686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:42.429593 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:42.448021 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5946a5bb-d28d-4802-953d-69439956929c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1321 microversion: 2.1 time: 0.531095 Oct 16 01:10:42.449158 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1122/2394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:41 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:42.468683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:42.469498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:42.496633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:42.498439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:42.500166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:42.502860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:42.504096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:42.505729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:43.102748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:43.114420 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1cbad43d-5a35-4703-bcc9-08646cb8aae4 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1268 microversion: 2.1 time: 0.660553 Oct 16 01:10:43.117074 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1123/2395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:42 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1268 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:43.202536 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-35fc037c-503f-48e7-9f8c-b2abb79d142b tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.690906 Oct 16 01:10:43.203377 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1273/2396] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:10:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:43.208740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:43.209527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:43.236867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:43.239317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:43.239928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:43.241591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:43.247606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:43.248389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:43.310204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:43.493681 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5136e434-a4b9-46a2-b93d-02c2042a324c tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 204 len: 0 microversion: 2.1 time: 0.288829 Oct 16 01:10:43.494567 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1274/2397] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:43 2022] DELETE /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:43.503626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:43.511579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:43.518598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:43.519451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:43.523685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:43.524829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:43.525499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:43.526155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:43.623486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a7ea4667-4840-4a64-854a-b3e13c41f187 req-d77fd853-f511-4565-b0b1-688c358b0c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66900da4-f78f-44d8-91f4-d65e73d5fd43", "tag": "60d62453-4907-4f30-bb88-068c021d3f38"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:43.659924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a7ea4667-4840-4a64-854a-b3e13c41f187 req-d77fd853-f511-4565-b0b1-688c358b0c80 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:43.660462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a7ea4667-4840-4a64-854a-b3e13c41f187 req-d77fd853-f511-4565-b0b1-688c358b0c80 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:43.660897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a7ea4667-4840-4a64-854a-b3e13c41f187 req-d77fd853-f511-4565-b0b1-688c358b0c80 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:43.702096 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a7ea4667-4840-4a64-854a-b3e13c41f187 req-d77fd853-f511-4565-b0b1-688c358b0c80 service nova] Creating event network-changed:60d62453-4907-4f30-bb88-068c021d3f38 for instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 on n-h1-master-1 Oct 16 01:10:43.720519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a7ea4667-4840-4a64-854a-b3e13c41f187 req-d77fd853-f511-4565-b0b1-688c358b0c80 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.590959 Oct 16 01:10:43.721069 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1124/2398] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:43.728334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:43.729055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:43.748099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:43.749293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:43.750054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:43.754871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:43.756140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:43.756971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:43.976643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:43.996009 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-14c6667b-aefb-4d5b-add0-8acd934ecf90 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.499775 Oct 16 01:10:44.000055 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1275/2399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:43 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:44.012966 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6279e059-bc6c-4bb8-afab-8d1719c7b5d3 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Action: 'create', calling method: .version_select at 0x7fd64e1fb5e0>, body: {"pool": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:44.047437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:44.064273 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d168351-8a0c-4cd6-84ac-fdb25fec2845 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.341975 Oct 16 01:10:44.065544 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1125/2400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:43 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:44.071411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:44.079502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:44.105205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:44.106335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:44.113228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:44.114051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:44.119685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:44.120310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:44.634020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:44.644257 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8e2ee34-c0af-418d-b999-8f0d6495de91 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1321 microversion: 2.1 time: 0.577389 Oct 16 01:10:44.651362 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1126/2401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:44 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:44.671574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:44.672034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:44.701751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:44.705799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:44.706469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:44.707427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:44.708052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:44.708654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:45.233389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:45.242492 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-18e73257-fc9d-4e60-b7a4-929c21c30067 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1473 microversion: 2.1 time: 0.574855 Oct 16 01:10:45.255496 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1127/2402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:44 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1473 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:45.277131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:45.283942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:45.302042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:45.303145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:45.305243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:45.308048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:45.310098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:45.311046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:45.773849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:45.783528 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2e7a2b11-159a-4add-badf-fccf08213554 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1316 microversion: 2.1 time: 0.526089 Oct 16 01:10:45.793038 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1128/2403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:45 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:45.798386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:45.798973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:45.816421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:45.816925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:45.817370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:45.818106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:45.818565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:45.819083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:46.386695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:46.399955 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e8ebec4f-c4f1-4954-a01d-c28f78825cb7 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.605591 Oct 16 01:10:46.401960 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1129/2404] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:45 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:46.420242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:46.420766 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:46.429979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:46.430516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:46.431035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:46.432494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:46.433167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:46.434549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:46.464018 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:46.470470 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] HTTP exception thrown: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Request method failure captured: Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 HTTP/1.1 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1kr_bK_yPLbl5kY3jdu3nB0k9g6cZbQW12W0OVSocTzujcmUiyJkpSmilto0hY3QLgRniQR0Yo67wni-qJ52SGz7g_2DxKto7fM1OTY37K8TEmp6ReAZ8328_S6GUXHH5VRFgk-PIZrq5XQ9rub5O3NOQM6FQjDWr5o-Ck6MoMqudc Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 622fb0e0967148838b71b51b4d572d38 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_622fb0e0967148838b71b51b4d572d38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 622fb0e0967148838b71b51b4d572d38 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachSCSIVolumeTestJSON-1109318114-project Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a745e8bb56574606b709907e661b9cd8 Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1109318114-project Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: exception: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'b371b2df-c758-4e6c-87fd-1bb8bebac0c7'} Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:46.474890 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Returning 404 to user: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:46.479397 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7ba4a1d-a9b8-426a-bb20-6fd7e15b193a tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 404 len: 111 microversion: 2.1 time: 0.072323 Oct 16 01:10:46.481973 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1130/2405] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:46 2022] DELETE /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:46.489755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:46.490945 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:46.517966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:46.518749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:46.519361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:46.521189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:46.522243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:46.524476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:47.037488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:47.051252 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c6a97aa-2107-497d-8b1c-f079d074afc6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1321 microversion: 2.1 time: 0.567191 Oct 16 01:10:47.052768 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1131/2406] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:46 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:47.058377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:47.060115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:47.066807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:47.067360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:47.067844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:47.068755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:47.069785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:47.070730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:47.317416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:47.346510 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-90efa6e2-87be-43ae-8025-6350a5e085ad tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 200 len: 1473 microversion: 2.1 time: 0.274763 Oct 16 01:10:47.351540 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1132/2407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:47 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:47.367564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:47.375017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] [instance: b371b2df-c758-4e6c-87fd-1bb8bebac0c7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:47.401645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:47.403618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:47.405164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:47.408295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:47.409220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:47.411059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:47.463177 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] HTTP exception thrown: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Request method failure captured: Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 HTTP/1.1 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1kr_bK_yPLbl5kY3jdu3nB0k9g6cZbQW12W0OVSocTzujcmUiyJkpSmilto0hY3QLgRniQR0Yo67wni-qJ52SGz7g_2DxKto7fM1OTY37K8TEmp6ReAZ8328_S6GUXHH5VRFgk-PIZrq5XQ9rub5O3NOQM6FQjDWr5o-Ck6MoMqudc Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 622fb0e0967148838b71b51b4d572d38 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_622fb0e0967148838b71b51b4d572d38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622fb0e0967148838b71b51b4d572d38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 622fb0e0967148838b71b51b4d572d38 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1109318114 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachSCSIVolumeTestJSON-1109318114-project Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a745e8bb56574606b709907e661b9cd8 Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1109318114-project Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: exception: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'b371b2df-c758-4e6c-87fd-1bb8bebac0c7'} Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:47.469386 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] Returning 404 to user: Instance b371b2df-c758-4e6c-87fd-1bb8bebac0c7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-363144a5-ca64-48c6-9c40-259bea6455c6 tempest-AttachSCSIVolumeTestJSON-1109318114 tempest-AttachSCSIVolumeTestJSON-1109318114-project] 10.222.0.39 "GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7" status: 404 len: 111 microversion: 2.1 time: 0.119934 Oct 16 01:10:47.473985 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1133/2408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:47 2022] GET /compute/v2.1/servers/b371b2df-c758-4e6c-87fd-1bb8bebac0c7 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:47.479612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:47.480242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:47.488368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:47.488920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:47.489637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:47.490428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:47.491352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:47.491882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:48.344191 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6279e059-bc6c-4bb8-afab-8d1719c7b5d3 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.342939 Oct 16 01:10:48.346505 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1276/2409] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:10:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:48.351333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:48.352234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:48.379986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:48.380816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:48.381803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:48.384124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:48.387636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:48.391075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:48.391548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:48.408358 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f87fcad-053f-4fec-bf39-593ac824815c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1316 microversion: 2.1 time: 0.933407 Oct 16 01:10:48.412683 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1134/2410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:47 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1316 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:48.425124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:48.427077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:48.442303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:48.443252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:48.444037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:48.444983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:48.446177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:48.446853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:48.769815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:48.785715 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6cd54d6-556f-45fe-b193-b096fea97858 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.437763 Oct 16 01:10:48.796544 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1277/2411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:48 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:48.811433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:48.814262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-15d9e7d6-b1de-4252-91a9-eeda18e4eaef req-0294a2c7-9cfa-4d56-b722-6247d7e1f5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a39815-7a81-4ff5-b776-80edde695b13", "name": "network-vif-deleted", "tag": "7a208383-81e1-4049-bdf6-3ca0742b9296"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:48.828929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-15d9e7d6-b1de-4252-91a9-eeda18e4eaef req-0294a2c7-9cfa-4d56-b722-6247d7e1f5d4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:48.829414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-15d9e7d6-b1de-4252-91a9-eeda18e4eaef req-0294a2c7-9cfa-4d56-b722-6247d7e1f5d4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:48.829636 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0ed4a272-d1f0-4117-ac9a-df1576ae930c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.414943 Oct 16 01:10:48.830342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-15d9e7d6-b1de-4252-91a9-eeda18e4eaef req-0294a2c7-9cfa-4d56-b722-6247d7e1f5d4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:48.831340 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1135/2412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:48 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:48.846181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:48.847221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:48.863514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:48.864239 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-15d9e7d6-b1de-4252-91a9-eeda18e4eaef req-0294a2c7-9cfa-4d56-b722-6247d7e1f5d4 service nova] Creating event network-vif-deleted:7a208383-81e1-4049-bdf6-3ca0742b9296 for instance c7a39815-7a81-4ff5-b776-80edde695b13 on n-h1-master-1 Oct 16 01:10:48.865041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:48.865788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:48.866558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:48.867067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:48.867489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:48.870365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-15d9e7d6-b1de-4252-91a9-eeda18e4eaef req-0294a2c7-9cfa-4d56-b722-6247d7e1f5d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066567 Oct 16 01:10:48.871267 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1278/2413] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:48.878808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2be7ec27-908d-48fd-bd31-abdff1f6d8d9 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Action: 'create', calling method: .version_select at 0x7fd64e1fb8b0>, body: {"pool": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:49.231706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:49.248578 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03bd0ef4-4c6a-4d9d-9ba7-79ad62f70e8b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1321 microversion: 2.1 time: 0.413946 Oct 16 01:10:49.263876 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1136/2414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:48 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:49.274728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:49.278962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: c7a39815-7a81-4ff5-b776-80edde695b13] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:49.290829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:49.291677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:49.292381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:49.294039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:49.294710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:49.295392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:49.314214 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] HTTP exception thrown: Instance c7a39815-7a81-4ff5-b776-80edde695b13 could not be found. Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Request method failure captured: Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 HTTP/1.1 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1lhEyS1Hwn1n0leEshVjT0U2-CzwagXicsXvcbdRIayHOqWWeyxkr0_-kHE1cWex0RelbNvuEfmrUnq50geamnfcho4tNpNqAGt996veNcOXT2EXJNtM5gGUvIhiHnk98U2w0iyEW1CbG80_VoxrDTu7anOve47DgIOhqXwWi96MLM Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_abaf72f7fc7248a388dbfbd2b646dc56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2d7df9a6845440bbad5bd7c0a192171b Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: exception: Instance c7a39815-7a81-4ff5-b776-80edde695b13 could not be found. Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'c7a39815-7a81-4ff5-b776-80edde695b13'} Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a39815-7a81-4ff5-b776-80edde695b13 could not be found. Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a39815-7a81-4ff5-b776-80edde695b13 could not be found. Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:49.316193 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a39815-7a81-4ff5-b776-80edde695b13 could not be found. Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Returning 404 to user: Instance c7a39815-7a81-4ff5-b776-80edde695b13 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4eb92e3-02ff-4fa3-8074-2a5d4b9336e7 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13" status: 404 len: 111 microversion: 2.1 time: 0.052516 Oct 16 01:10:49.319912 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1137/2415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:49 2022] GET /compute/v2.1/servers/c7a39815-7a81-4ff5-b776-80edde695b13 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:49.323653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:49.324429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:49.331152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:49.331863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:49.332266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:49.333031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:49.333548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:49.334095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:49.676286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:49.684965 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b96943f1-07b6-482a-9fb6-9e534dc01e41 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.365662 Oct 16 01:10:49.688446 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1138/2416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:49 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:49.693283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:49.693997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:49.704750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:49.704750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:49.704750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:49.707196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:49.707802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:49.708277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:49.742298 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:49.849215 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a33a8546-68d4-4d4c-9cfd-524e51952b37 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 204 len: 0 microversion: 2.1 time: 0.161543 Oct 16 01:10:49.849905 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1139/2417] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:49 2022] DELETE /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:49.858214 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:49.863401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:49.870083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:49.871475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:49.872032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:49.872905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:49.873454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:49.873914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:50.169443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:50.177391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-abf3239e-f2f0-4f2d-a6d8-ab8a84728b45 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1316 microversion: 2.1 time: 0.325904 Oct 16 01:10:50.177956 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1140/2418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:49 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:50.182538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:50.183187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:50.191570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:50.192985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:50.193723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:50.194939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:50.195537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:50.196036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:50.323009 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:50.381625 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:50.577362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:50.586702 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bc0c82b3-4e4a-4866-866b-389b534335fe tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.407569 Oct 16 01:10:50.603219 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1141/2419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:50 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:50.619004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:50.622749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:50.633823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:50.634321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:50.634786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:50.635943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:50.636343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:50.637428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:51.416126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:51.440024 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-46549cb1-ed82-405e-b4e8-f3ed0929b3cc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.825796 Oct 16 01:10:51.440766 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1142/2420] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:50 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:51.450437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:51.451209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:51.468958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:51.469800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:51.470469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:51.471497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:51.472118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:51.472706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:51.971851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:51.981764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-913b732c-c6d5-449c-92f9-071178ee7313 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1473 microversion: 2.1 time: 0.538001 Oct 16 01:10:51.986432 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1143/2421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:51 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1473 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:51.999436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:52.000409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:52.023249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:52.024011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:52.024614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:52.027131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:52.030178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:52.030831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:52.119628 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2be7ec27-908d-48fd-bd31-abdff1f6d8d9 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.246838 Oct 16 01:10:52.125839 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1279/2422] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:10:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:52.145785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:52.149508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:52.176187 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:52.179213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:52.180193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:52.182645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:52.184200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:52.185026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:52.185688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:52.412799 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0b0dc577-b393-4bdb-b23b-7dce46ddbedf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.276318 Oct 16 01:10:52.413827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1280/2423] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:10:52 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:10:52.425963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-663a0619-54e5-4e96-b39c-a160e5640974 req-46d77cea-9f88-4022-99f6-448a65b4972a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8b1ddf6-9ad6-47af-b916-801cdc94741d", "tag": "7219957f-6491-4fec-b60e-ee746f814816"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:52.453432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-663a0619-54e5-4e96-b39c-a160e5640974 req-46d77cea-9f88-4022-99f6-448a65b4972a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:52.453920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-663a0619-54e5-4e96-b39c-a160e5640974 req-46d77cea-9f88-4022-99f6-448a65b4972a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:52.454352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-663a0619-54e5-4e96-b39c-a160e5640974 req-46d77cea-9f88-4022-99f6-448a65b4972a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:52.485475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-663a0619-54e5-4e96-b39c-a160e5640974 req-46d77cea-9f88-4022-99f6-448a65b4972a service nova] Creating event network-changed:7219957f-6491-4fec-b60e-ee746f814816 for instance b8b1ddf6-9ad6-47af-b916-801cdc94741d on n-h2-master-1 Oct 16 01:10:52.493765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:52.500256 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-663a0619-54e5-4e96-b39c-a160e5640974 req-46d77cea-9f88-4022-99f6-448a65b4972a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084949 Oct 16 01:10:52.501710 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1281/2424] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:52.513539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:52.514522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:52.515656 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4b93c940-639d-4f8d-95f9-7a73d11fb3c5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1321 microversion: 2.1 time: 0.524752 Oct 16 01:10:52.517588 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1144/2425] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:51 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:52.538199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:52.538906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:52.539490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:52.540108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:52.544956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:52.546236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:52.935000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-30cd2427-bf61-4426-aec3-69b037a0bfc2 req-2e29fce3-0372-4ae3-be65-2c7a334304ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66900da4-f78f-44d8-91f4-d65e73d5fd43", "name": "network-vif-plugged", "status": "completed", "tag": "60d62453-4907-4f30-bb88-068c021d3f38"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:52.982038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-30cd2427-bf61-4426-aec3-69b037a0bfc2 req-2e29fce3-0372-4ae3-be65-2c7a334304ff service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:52.983007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-30cd2427-bf61-4426-aec3-69b037a0bfc2 req-2e29fce3-0372-4ae3-be65-2c7a334304ff service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:52.984349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-30cd2427-bf61-4426-aec3-69b037a0bfc2 req-2e29fce3-0372-4ae3-be65-2c7a334304ff service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:53.008659 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-30cd2427-bf61-4426-aec3-69b037a0bfc2 req-2e29fce3-0372-4ae3-be65-2c7a334304ff service nova] Creating event network-vif-plugged:60d62453-4907-4f30-bb88-068c021d3f38 for instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 on n-h1-master-1 Oct 16 01:10:53.019520 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-30cd2427-bf61-4426-aec3-69b037a0bfc2 req-2e29fce3-0372-4ae3-be65-2c7a334304ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.500086 Oct 16 01:10:53.020194 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1145/2426] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:53.029070 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c2e185f-7f89-4f45-a88e-dcf0b1eb67bc tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Action: 'create', calling method: .version_select at 0x7fd6527a7e50>, body: {"pool": null} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:53.297858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:53.307998 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7e3cc1a-3985-4f10-a090-cff69c1aa24a tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1316 microversion: 2.1 time: 0.804739 Oct 16 01:10:53.311123 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1282/2427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:52 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1316 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:53.332746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:53.333922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:53.348226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:53.350937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:53.351633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:53.354415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:53.355162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:53.355935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:54.137615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:54.150878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58f5b584-969e-4e87-aca9-5a400094a56f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1673 microversion: 2.1 time: 0.836084 Oct 16 01:10:54.151575 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1283/2428] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:53 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1673 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:54.166583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:54.167926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:54.184750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:54.186852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:54.197182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:54.198114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:54.198729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:54.199964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:54.601219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:54.610690 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5999a3e7-149a-4f66-b8d5-ad342f0f9a88 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.457241 Oct 16 01:10:54.611609 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1284/2429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:54 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:54.616926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:54.617774 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:54.624435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:54.624946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:54.625407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:54.626327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:54.626975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:54.627410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:54.662667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:54.663174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:54.663811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:54.664264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lazy-loading 'fault' on Instance uuid 72afa838-e929-438a-82be-f5339d86e9ee {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:10:54.755972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:54.764898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe9d055c-5066-4928-bac2-cd6fe6e3b0ef tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 200 len: 1307 microversion: 2.1 time: 0.152107 Oct 16 01:10:54.765482 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1285/2430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:54 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:54.771022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:54.771828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:54.792214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:54.793346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:54.796265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:54.798001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:54.798723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:54.799371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:55.166639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:55.181588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b49259f1-cbf9-48c6-8385-0ee05f05e96a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1321 microversion: 2.1 time: 0.414678 Oct 16 01:10:55.199866 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1286/2431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:54 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:55.199866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:55.199866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:55.220293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:55.220794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:55.221240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:55.221961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:55.222489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:55.222845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:55.819688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:55.828253 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-007cf4fc-8a08-46dc-9414-365b4f19c7a5 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1316 microversion: 2.1 time: 0.634887 Oct 16 01:10:55.828832 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1287/2432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:55 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:55.839238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e341d442-d902-4249-84e0-1ce5ab864152 req-d77d7429-89c1-464a-83d6-c19d70c5dbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2132a3-c6eb-4fe2-96ce-725f4efba607", "name": "network-vif-unplugged", "status": "completed", "tag": "b91eb4e3-f8a9-4013-a52a-4ea301c52468"}, {"name": "network-changed", "server_uuid": "aa2132a3-c6eb-4fe2-96ce-725f4efba607", "tag": "b91eb4e3-f8a9-4013-a52a-4ea301c52468"}, {"server_uuid": "72afa838-e929-438a-82be-f5339d86e9ee", "name": "network-vif-deleted", "tag": "9ce725aa-ef63-4602-82a1-ece3baf27771"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:55.861575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e341d442-d902-4249-84e0-1ce5ab864152 req-d77d7429-89c1-464a-83d6-c19d70c5dbe4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:55.862219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e341d442-d902-4249-84e0-1ce5ab864152 req-d77d7429-89c1-464a-83d6-c19d70c5dbe4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:55.862819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e341d442-d902-4249-84e0-1ce5ab864152 req-d77d7429-89c1-464a-83d6-c19d70c5dbe4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:55.879385 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e341d442-d902-4249-84e0-1ce5ab864152 req-d77d7429-89c1-464a-83d6-c19d70c5dbe4 service nova] Creating event network-vif-unplugged:b91eb4e3-f8a9-4013-a52a-4ea301c52468 for instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 on n-h1-master-1 Oct 16 01:10:55.879894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e341d442-d902-4249-84e0-1ce5ab864152 req-d77d7429-89c1-464a-83d6-c19d70c5dbe4 service nova] Creating event network-changed:b91eb4e3-f8a9-4013-a52a-4ea301c52468 for instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 on n-h1-master-1 Oct 16 01:10:55.880393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e341d442-d902-4249-84e0-1ce5ab864152 req-d77d7429-89c1-464a-83d6-c19d70c5dbe4 service nova] Creating event network-vif-deleted:9ce725aa-ef63-4602-82a1-ece3baf27771 for instance 72afa838-e929-438a-82be-f5339d86e9ee on n-h1-master-1 Oct 16 01:10:55.889011 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e341d442-d902-4249-84e0-1ce5ab864152 req-d77d7429-89c1-464a-83d6-c19d70c5dbe4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.053042 Oct 16 01:10:55.890271 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1288/2433] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:55.914698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b5894c68-2b70-4931-9a70-5c8b6f62f864 req-6520ea4b-98f8-42ae-a2f5-dc4cb92ead31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b1ddf6-9ad6-47af-b916-801cdc94741d", "name": "network-vif-plugged", "status": "completed", "tag": "7219957f-6491-4fec-b60e-ee746f814816"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:55.937816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b5894c68-2b70-4931-9a70-5c8b6f62f864 req-6520ea4b-98f8-42ae-a2f5-dc4cb92ead31 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:55.942262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b5894c68-2b70-4931-9a70-5c8b6f62f864 req-6520ea4b-98f8-42ae-a2f5-dc4cb92ead31 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:55.942652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b5894c68-2b70-4931-9a70-5c8b6f62f864 req-6520ea4b-98f8-42ae-a2f5-dc4cb92ead31 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:55.967219 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b5894c68-2b70-4931-9a70-5c8b6f62f864 req-6520ea4b-98f8-42ae-a2f5-dc4cb92ead31 service nova] Creating event network-vif-plugged:7219957f-6491-4fec-b60e-ee746f814816 for instance b8b1ddf6-9ad6-47af-b916-801cdc94741d on n-h2-master-1 Oct 16 01:10:55.976045 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b5894c68-2b70-4931-9a70-5c8b6f62f864 req-6520ea4b-98f8-42ae-a2f5-dc4cb92ead31 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084152 Oct 16 01:10:55.977722 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1289/2434] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:55.985146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:55.985859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:56.002248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.002457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.002900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.003642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.004108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.004538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.311508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:56.324798 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:56.336193 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e4d5481-9162-4440-98e8-fdcf4ce78505 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.355861 Oct 16 01:10:56.337293 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1290/2435] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:55 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:56.345828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:56.346988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:56.357871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.358785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.359969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.361243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.361983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.362616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.567958 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c2e185f-7f89-4f45-a88e-dcf0b1eb67bc tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.544729 Oct 16 01:10:56.581182 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1146/2436] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:10:53 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:56.588706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:56.589629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 72afa838-e929-438a-82be-f5339d86e9ee] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:56.599156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.599931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.601059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.602125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.603488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.604191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.624234 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] HTTP exception thrown: Instance 72afa838-e929-438a-82be-f5339d86e9ee could not be found. Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Request method failure captured: Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee HTTP/1.1 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1lhEyS1Hwn1n0leEshVjT0U2-CzwagXicsXvcbdRIayHOqWWeyxkr0_-kHE1cWex0RelbNvuEfmrUnq50geamnfcho4tNpNqAGt996veNcOXT2EXJNtM5gGUvIhiHnk98U2w0iyEW1CbG80_VoxrDTu7anOve47DgIOhqXwWi96MLM Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_abaf72f7fc7248a388dbfbd2b646dc56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2d7df9a6845440bbad5bd7c0a192171b Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 72afa838-e929-438a-82be-f5339d86e9ee could not be found. Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '72afa838-e929-438a-82be-f5339d86e9ee'} Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72afa838-e929-438a-82be-f5339d86e9ee could not be found. Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72afa838-e929-438a-82be-f5339d86e9ee could not be found. Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:10:56.626743 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:56.632363 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:10:56.632363 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:10:56.632363 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:10:56.632363 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:10:56.632363 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:10:56.632363 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72afa838-e929-438a-82be-f5339d86e9ee could not be found. Oct 16 01:10:56.632363 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:10:56.635248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Returning 404 to user: Instance 72afa838-e929-438a-82be-f5339d86e9ee could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:10:56.639356 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ee0b105-f25d-45df-9fd5-703b1e627dde tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee" status: 404 len: 111 microversion: 2.1 time: 0.054969 Oct 16 01:10:56.639964 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1147/2437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:56 2022] GET /compute/v2.1/servers/72afa838-e929-438a-82be-f5339d86e9ee => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:10:56.650146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:56.666066 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c958f6b1-9767-4c33-a846-507f68aa6b4d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.323729 Oct 16 01:10:56.666647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:56.668523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:56.681256 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1291/2438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:56 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:56.692455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.693148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.693766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.694329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:10:56.695102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.695716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.696298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.703820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:56.733027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.733027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.733027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.733027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:56.733027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:56.733027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:56.893178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:56.905481 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cc20d8e4-8f9d-441c-bfb1-6e96831df2a2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1502 microversion: 2.1 time: 0.260131 Oct 16 01:10:56.915033 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1148/2439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:56 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:56.925354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-935e9dd8-3cfe-4797-b172-3ec4de2ed885 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Calling method '.version_select at 0x7fd6527471f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:57.023450 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-09a79692-0b85-4683-9c52-8426f1c81a46 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 200 len: 322 microversion: 2.1 time: 0.339938 Oct 16 01:10:57.026355 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1292/2440] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:10:56 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:57.034204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:57.035366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 59168582-a758-488c-81af-e65d94c8e4c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:57.060395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:57.061177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:57.063775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:57.064720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:57.068042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:57.070134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:57.148159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 59168582-a758-488c-81af-e65d94c8e4c2] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:57.287895 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-935e9dd8-3cfe-4797-b172-3ec4de2ed885 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/e3226a79-08ae-45fc-b951-6633c7795dea" status: 200 len: 140 microversion: 2.1 time: 0.370746 Oct 16 01:10:57.288525 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1149/2441] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:10:56 2022] GET /compute/v2.1/os-floating-ips/e3226a79-08ae-45fc-b951-6633c7795dea => generated 140 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:10:57.296460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:57.297155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:57.313562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:57.314146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:57.314653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:57.315901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:57.321595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:57.322688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:57.368660 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05b13dd3-8b96-4eb0-aebc-c433c11d3054 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2" status: 204 len: 0 microversion: 2.1 time: 0.340166 Oct 16 01:10:57.370288 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1293/2442] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:57 2022] DELETE /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:57.379960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:57.380936 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:57.386291 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:57.395794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:57.396916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:57.397666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:57.398627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:57.399465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:57.400132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:57.655343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:57.668517 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f895ba1c-b3f5-42df-9ef9-a75c1c96178b tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1316 microversion: 2.1 time: 0.375722 Oct 16 01:10:57.671736 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1150/2443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:57 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:57.677878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:57.678667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:57.686311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:57.687135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:57.687866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:57.688776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:57.689377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:57.689984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:57.731690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:57.743221 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49db0b3b-0266-4ca9-9e8d-2b2a9a205848 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1502 microversion: 2.1 time: 0.367991 Oct 16 01:10:57.743831 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1294/2444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:57 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:57.767059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7bcfd829-4672-4dae-915a-5a0ef1083704 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Calling method '.version_select at 0x7fd64e0bbca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:58.078511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:58.099297 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a71f5e9-1481-419e-b6dd-05eae517468d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.424177 Oct 16 01:10:58.100624 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1151/2445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:57 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:58.109837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:58.113834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:58.134611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.135761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.136520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.138505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.139239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.140069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.190660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:58.337561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e2648c1c-6182-4245-82a6-3d28e80e3276 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 204 len: 0 microversion: 2.1 time: 0.234207 Oct 16 01:10:58.339153 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1152/2446] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:58 2022] DELETE /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:58.349228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:58.350216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:58.357572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.358384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.359091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.360276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.361034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.361841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.621672 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:58.630151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4274665f-2bfb-4d07-bea7-fd818a717ae5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.288146 Oct 16 01:10:58.631091 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1153/2447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:58 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:58.652674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:58.653336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:58.659728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.660882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.660882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.661423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.661878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.662305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.693642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:58.786563 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:58.802372 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb693a26-d146-4b16-913d-2abbe6aabd92 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 204 len: 0 microversion: 2.1 time: 0.156773 Oct 16 01:10:58.803272 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1154/2448] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:58 2022] DELETE /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:58.811928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:58.813125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:58.820450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.821038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.821480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.822608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.823264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.824451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.969306 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7bcfd829-4672-4dae-915a-5a0ef1083704 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/e3226a79-08ae-45fc-b951-6633c7795dea" status: 202 len: 0 microversion: 2.1 time: 1.209629 Oct 16 01:10:58.969967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1295/2449] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:10:57 2022] DELETE /compute/v2.1/os-floating-ips/e3226a79-08ae-45fc-b951-6633c7795dea => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:10:58.974754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:58.975413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 59168582-a758-488c-81af-e65d94c8e4c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:58.985564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.986139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.986499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:58.987239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:58.987708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:58.988129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.015955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:59.025393 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-247baf0f-6c39-4f81-87e1-e9264bd5beef tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.220156 Oct 16 01:10:59.039575 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1155/2450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:58 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:59.049459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:59.050174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:59.062844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.064731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.064731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.067099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.070399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.072121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.163476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:59.174313 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3bfc5d3c-5766-42e9-9d9b-31fb9e57cd22 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2" status: 200 len: 1475 microversion: 2.1 time: 0.203291 Oct 16 01:10:59.190558 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1296/2451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:58 2022] GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2 => generated 1475 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:59.202211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:59.203218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:59.210683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.211284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.211744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.212476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.212945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.213385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.282148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:59.291135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fcf79f31-998a-46ef-a7c7-9f9be445b04c tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1505 microversion: 2.1 time: 0.250328 Oct 16 01:10:59.300379 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1156/2452] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:59 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:59.311492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fdd0332-fcd8-4d61-a1b9-f6cc3193a479 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Calling method '.version_select at 0x7fd64e1254c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:59.573375 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:59.583560 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fdd0332-fcd8-4d61-a1b9-f6cc3193a479 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.290760 Oct 16 01:10:59.584515 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1157/2453] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Oct 16 01:10:59 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:10:59.587485 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ed829834-08c6-45ae-9b0e-5d94910f0a04 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1508 microversion: 2.1 time: 0.394908 Oct 16 01:10:59.598740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:59.599419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:59.603729 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1297/2454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:59 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1508 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:59.606323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.606814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.607471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.609166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.609166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.610024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.613780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:59.614558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:59.621162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.621858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.622422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.623453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.624169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.624696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.655772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:10:59.771733 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-27dc94ce-9a51-4f24-a991-f0c5946d0652 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 204 len: 0 microversion: 2.1 time: 0.163599 Oct 16 01:10:59.776775 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1298/2455] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:10:59 2022] DELETE /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:10:59.784547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f7472e89-ff71-4ba7-80f3-487a6de3d663 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Calling method '.version_select at 0x7fd64ddbc160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:59.942085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:10:59.951016 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6ea8eaf2-fde6-4026-bd3c-f72d7996cbdb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.357349 Oct 16 01:10:59.969521 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1158/2456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:59 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:10:59.969521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:10:59.969521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:10:59.982672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.983312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.983754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:10:59.984478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:10:59.984941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:10:59.985370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:00.225018 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f7472e89-ff71-4ba7-80f3-487a6de3d663 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.446534 Oct 16 01:11:00.226556 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1299/2457] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:10:59 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:00.232569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:00.233304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:00.246140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:00.248655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:00.250020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:00.252187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:00.253472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:00.254698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:00.371714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:00.384397 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb7af2ab-1a9c-4857-b132-96311be848c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.423978 Oct 16 01:11:00.385277 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1159/2458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:10:59 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:00.407116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:00.408040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:00.414941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:00.415648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:00.416271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:00.417143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:00.418316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:00.419019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:00.634721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:00.663474 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89ae1f42-9302-435c-94ce-7c954874c5d6 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1511 microversion: 2.1 time: 0.435426 Oct 16 01:11:00.664283 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1300/2459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:00 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:00.669649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:00.670484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 59168582-a758-488c-81af-e65d94c8e4c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:00.677856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:00.678606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:00.679228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:00.680125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:00.680935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:00.681530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:00.685252 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:00.709685 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-33a46027-2b3a-4a89-89de-3b4f5a9313d6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.313028 Oct 16 01:11:00.710472 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1160/2460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:00 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:00.722652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-933b6400-15cd-4a52-b60f-ed725c260a10 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Calling method '.version_select at 0x7fd64e1c2310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:01.429794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:01.460670 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf9245a5-e6a5-45cb-8dcc-e9673f4dab35 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2" status: 200 len: 1475 microversion: 2.1 time: 0.795035 Oct 16 01:11:01.461641 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1301/2461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:00 2022] GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2 => generated 1475 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:01.469456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:01.470076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:01.476872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:01.477937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:01.479201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:01.480183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:01.481069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:01.481297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:01.880968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:01.895906 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d885b76c-d1a3-4ebf-8e63-ac111f536344 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 200 len: 1508 microversion: 2.1 time: 0.432558 Oct 16 01:11:01.914429 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1302/2462] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:01 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 1508 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:01.925551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-523011156", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "dd811960-e386-493f-95bb-934b5e94fe90"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:02.051267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] validate_networks() for [('dd811960-e386-493f-95bb-934b5e94fe90', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:11:02.832397 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-933b6400-15cd-4a52-b60f-ed725c260a10 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/e315c547-35a6-42f7-af79-147b90722d2c" status: 202 len: 0 microversion: 2.1 time: 2.120574 Oct 16 01:11:02.832968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1161/2463] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:11:00 2022] DELETE /compute/v2.1/os-floating-ips/e315c547-35a6-42f7-af79-147b90722d2c => generated 0 bytes in 2122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:02.842208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:02.843099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:02.856880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:02.857613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:02.858200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:02.859232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:02.859851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:02.860274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.009584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:11:03.010062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:11:03.010461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:11:03.010863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:11:03.012888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:11:03.035906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.036634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.038005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.038768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.039476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.039872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.041210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:03.056887 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01fc0932-8bb0-494e-ae25-f4aac7cc0d9e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.219736 Oct 16 01:11:03.058484 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1162/2464] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:02 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:03.064329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:03.065219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:03.082087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:03.082599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.083327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.084720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.085790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.086802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.088634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.098818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for user 0c8da9a32cb54d0a87d914234b1e9f40 and project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:03.129055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:11:03.131822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:11:03.225390 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d0757aa-4862-456a-9e2e-210d8744e6d7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308071 Oct 16 01:11:03.226832 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1303/2465] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:11:03.234116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-70db65d8-2955-41c4-8f02-9a4461c91ffe req-3709238d-14c4-47e9-9588-fd06713215cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59168582-a758-488c-81af-e65d94c8e4c2", "name": "network-vif-deleted", "tag": "3b0cedc3-c6e9-438a-974d-6cb5af88f656"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:03.247918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-70db65d8-2955-41c4-8f02-9a4461c91ffe req-3709238d-14c4-47e9-9588-fd06713215cc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.248584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-70db65d8-2955-41c4-8f02-9a4461c91ffe req-3709238d-14c4-47e9-9588-fd06713215cc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.249239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-70db65d8-2955-41c4-8f02-9a4461c91ffe req-3709238d-14c4-47e9-9588-fd06713215cc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.273095 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-70db65d8-2955-41c4-8f02-9a4461c91ffe req-3709238d-14c4-47e9-9588-fd06713215cc service nova] Creating event network-vif-deleted:3b0cedc3-c6e9-438a-974d-6cb5af88f656 for instance 59168582-a758-488c-81af-e65d94c8e4c2 on n-h1-master-1 Oct 16 01:11:03.284972 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-70db65d8-2955-41c4-8f02-9a4461c91ffe req-3709238d-14c4-47e9-9588-fd06713215cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056370 Oct 16 01:11:03.286221 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1304/2466] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:03.295701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:03.318741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 59168582-a758-488c-81af-e65d94c8e4c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:03.340685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.343723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.344388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.345687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.346836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.347683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.381160 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] HTTP exception thrown: Instance 59168582-a758-488c-81af-e65d94c8e4c2 could not be found. Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Request method failure captured: Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2 HTTP/1.1 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lhEyS1Hwn1n0leEshVjT0U2-CzwagXicsXvcbdRIayHOqWWeyxkr0_-kHE1cWex0RelbNvuEfmrUnq50geamnfcho4tNpNqAGt996veNcOXT2EXJNtM5gGUvIhiHnk98U2w0iyEW1CbG80_VoxrDTu7anOve47DgIOhqXwWi96MLM Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_abaf72f7fc7248a388dbfbd2b646dc56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2d7df9a6845440bbad5bd7c0a192171b Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 59168582-a758-488c-81af-e65d94c8e4c2 could not be found. Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '59168582-a758-488c-81af-e65d94c8e4c2'} Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59168582-a758-488c-81af-e65d94c8e4c2 could not be found. Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59168582-a758-488c-81af-e65d94c8e4c2 could not be found. Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:03.400531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.406780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:03.406780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:03.406780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:03.406780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:03.406780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:03.406780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59168582-a758-488c-81af-e65d94c8e4c2 could not be found. Oct 16 01:11:03.406780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.410466 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Returning 404 to user: Instance 59168582-a758-488c-81af-e65d94c8e4c2 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:03.411585 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ae6fb253-3989-4c07-9ad7-82cb7f4edf63 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2" status: 404 len: 111 microversion: 2.1 time: 0.123748 Oct 16 01:11:03.412706 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1305/2467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:03 2022] GET /compute/v2.1/servers/59168582-a758-488c-81af-e65d94c8e4c2 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:03.480245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:03.491221 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b7b13fad-9eb0-4d2e-ae52-fe65ca6e6793 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1511 microversion: 2.1 time: 0.431230 Oct 16 01:11:03.508131 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1163/2468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:03 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:03.524946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5deaa165-d6c6-4cb0-b51e-cc93f04110e9 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Calling method '.version_select at 0x7fd64e1c2280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:03.648052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-362187c4-1908-4001-9b41-6db6ec25a11d req-90a00720-7881-4142-8d7e-6777c3691a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66900da4-f78f-44d8-91f4-d65e73d5fd43", "name": "network-vif-deleted", "tag": "60d62453-4907-4f30-bb88-068c021d3f38"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:03.665292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-362187c4-1908-4001-9b41-6db6ec25a11d req-90a00720-7881-4142-8d7e-6777c3691a1f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.666464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-362187c4-1908-4001-9b41-6db6ec25a11d req-90a00720-7881-4142-8d7e-6777c3691a1f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.669684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-362187c4-1908-4001-9b41-6db6ec25a11d req-90a00720-7881-4142-8d7e-6777c3691a1f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.686276 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-362187c4-1908-4001-9b41-6db6ec25a11d req-90a00720-7881-4142-8d7e-6777c3691a1f service nova] Creating event network-vif-deleted:60d62453-4907-4f30-bb88-068c021d3f38 for instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 on n-h1-master-1 Oct 16 01:11:03.696382 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-362187c4-1908-4001-9b41-6db6ec25a11d req-90a00720-7881-4142-8d7e-6777c3691a1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282025 Oct 16 01:11:03.698055 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1306/2469] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:03.705002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:03.706061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:03.714567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.718554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.719338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.721758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.723736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.726655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.764853 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 HTTP/1.1 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '66900da4-f78f-44d8-91f4-d65e73d5fd43'} Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.770311 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e3fda18-0c13-445a-888c-03a068783bb2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 404 len: 111 microversion: 2.1 time: 0.072127 Oct 16 01:11:03.774570 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1307/2470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:03 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:03.785531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9605c482-1fd4-405e-8552-09321f64a26e req-eee1609e-2a8d-4710-925d-56561c746d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b1ddf6-9ad6-47af-b916-801cdc94741d", "name": "network-vif-unplugged", "status": "completed", "tag": "7219957f-6491-4fec-b60e-ee746f814816"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:03.806814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9605c482-1fd4-405e-8552-09321f64a26e req-eee1609e-2a8d-4710-925d-56561c746d02 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:03.806814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9605c482-1fd4-405e-8552-09321f64a26e req-eee1609e-2a8d-4710-925d-56561c746d02 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:03.808916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9605c482-1fd4-405e-8552-09321f64a26e req-eee1609e-2a8d-4710-925d-56561c746d02 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:03.834988 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9605c482-1fd4-405e-8552-09321f64a26e req-eee1609e-2a8d-4710-925d-56561c746d02 service nova] Creating event network-vif-unplugged:7219957f-6491-4fec-b60e-ee746f814816 for instance b8b1ddf6-9ad6-47af-b916-801cdc94741d on n-h2-master-1 Oct 16 01:11:03.846391 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9605c482-1fd4-405e-8552-09321f64a26e req-eee1609e-2a8d-4710-925d-56561c746d02 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070698 Oct 16 01:11:03.849179 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1308/2471] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:03.859766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-785bf509-19b7-4feb-a3cd-48ceda914d78 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:03.860497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-785bf509-19b7-4feb-a3cd-48ceda914d78 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:04.039414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-785bf509-19b7-4feb-a3cd-48ceda914d78 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:04.055072 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-785bf509-19b7-4feb-a3cd-48ceda914d78 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1214 microversion: 2.1 time: 0.204520 Oct 16 01:11:04.056074 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1309/2472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:03 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:04.066612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:04.069498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:04.086686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:04.087409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:04.091669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:04.092436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:04.092904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:04.095990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:04.421626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:04.438785 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-29537c27-452a-4068-a97c-6fd598e81348 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1433 microversion: 2.1 time: 0.380734 Oct 16 01:11:04.439840 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1310/2473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:04 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1433 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:04.452979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65a08b15-8c07-4a00-be12-604367cf8ece tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: .version_select at 0x7fd64df5cf70>, body: {"keypair": {"name": "tempest-key-1396952414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUA1u2lv5EWCpjWL2yIWCDaxoIKG889/OH31ix7R9Vexvyw7VLg8ih+eAa066ol99SOpbeU3z93YUPY7e4008IVqDCMeSjyY59/HaSCNsRK8sYWqvcqob+9ASJ4dq8BSQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:04.495143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-65a08b15-8c07-4a00-be12-604367cf8ece tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:04.527662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-65a08b15-8c07-4a00-be12-604367cf8ece tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:04.597099 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65a08b15-8c07-4a00-be12-604367cf8ece tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.151714 Oct 16 01:11:04.598517 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1311/2474] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:11:04 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:04.614070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:04.614737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:04.618793 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:04.629662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:04.632502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:04.633653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:04.635453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:04.637094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:04.637823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:04.674376 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:04.973111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:04.983325 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68952d59-e96c-4462-9b9e-46b2d0e65761 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1392 microversion: 2.1 time: 0.379195 Oct 16 01:11:04.984409 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1312/2475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:04 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1392 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:04.989326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:04.990487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:05.011745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:05.012353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:05.012872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:05.013753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:05.014342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:05.014842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:05.108629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:05.109208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:05.110360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:05.110360 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lazy-loading 'fault' on Instance uuid b8b1ddf6-9ad6-47af-b916-801cdc94741d {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:05.220969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a7ca896a35447f8a828817a8620d308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9416837a51e484094dba1a296c4d096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:05.229555 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc381797-1fe5-4bb2-8104-fc527dc954ed tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 200 len: 1306 microversion: 2.1 time: 0.243969 Oct 16 01:11:05.230961 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1313/2476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:04 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 1306 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:05.248380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22ea0d19-d5bb-4df6-b83f-476ba9fa6633 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '.version_select at 0x7fd64e3db550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:05.256040 n-d-master-1 devstack@n-api.service[120545]: WARNING oslo_db.sqlalchemy.utils [None req-22ea0d19-d5bb-4df6-b83f-476ba9fa6633 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 16 01:11:05.267672 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22ea0d19-d5bb-4df6-b83f-476ba9fa6633 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.035599 Oct 16 01:11:05.270135 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1314/2477] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:11:05 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:05.283303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:05.284122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:05.300301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:05.300804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:05.301245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:05.302206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:05.302673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:05.303131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:05.453004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:05.465991 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a734e44e-b37a-412e-a82b-fe0211f345b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1266 microversion: 2.1 time: 0.193885 Oct 16 01:11:05.484132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1315/2478] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:05 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:05.495233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:05.496367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:05.503024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:05.503712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:05.504441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:05.505293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:05.505900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:05.506468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:05.549451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:05.549994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:05.550563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:05.551223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lazy-loading 'fault' on Instance uuid 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:05.768322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:05.785221 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0a445d5-3e66-441e-ac14-971bb9621848 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 200 len: 1309 microversion: 2.1 time: 0.296807 Oct 16 01:11:05.786198 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1316/2479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:05 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:05.799683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1615300018", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-key-1396952414", "networks": [{"uuid": "e837775c-af35-4cb2-89ea-5a342e83cc6f"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:05.923787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] validate_networks() for [('e837775c-af35-4cb2-89ea-5a342e83cc6f', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:11:06.629097 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5deaa165-d6c6-4cb0-b51e-cc93f04110e9 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/b7782c3c-4e7f-4b54-b15b-74f68541992f" status: 202 len: 0 microversion: 2.1 time: 3.110540 Oct 16 01:11:06.631171 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1164/2480] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:11:03 2022] DELETE /compute/v2.1/os-floating-ips/b7782c3c-4e7f-4b54-b15b-74f68541992f => generated 0 bytes in 3122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:06.652375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-48d2b5e5-98db-40b7-a4b0-e7edc139f67f req-6e28a3db-66b2-4842-8398-5c61caa8aacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8b1ddf6-9ad6-47af-b916-801cdc94741d", "name": "network-vif-deleted", "tag": "7219957f-6491-4fec-b60e-ee746f814816"}, {"server_uuid": "1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf", "name": "network-vif-deleted", "tag": "b7103a28-390b-42d9-8fb4-2f560f9b35d3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:06.674658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-48d2b5e5-98db-40b7-a4b0-e7edc139f67f req-6e28a3db-66b2-4842-8398-5c61caa8aacd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:06.675245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-48d2b5e5-98db-40b7-a4b0-e7edc139f67f req-6e28a3db-66b2-4842-8398-5c61caa8aacd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:06.675800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-48d2b5e5-98db-40b7-a4b0-e7edc139f67f req-6e28a3db-66b2-4842-8398-5c61caa8aacd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:06.691688 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-48d2b5e5-98db-40b7-a4b0-e7edc139f67f req-6e28a3db-66b2-4842-8398-5c61caa8aacd service nova] Creating event network-vif-deleted:7219957f-6491-4fec-b60e-ee746f814816 for instance b8b1ddf6-9ad6-47af-b916-801cdc94741d on n-h2-master-1 Oct 16 01:11:06.692359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-48d2b5e5-98db-40b7-a4b0-e7edc139f67f req-6e28a3db-66b2-4842-8398-5c61caa8aacd service nova] Creating event network-vif-deleted:b7103a28-390b-42d9-8fb4-2f560f9b35d3 for instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf on n-h2-master-1 Oct 16 01:11:06.701124 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-48d2b5e5-98db-40b7-a4b0-e7edc139f67f req-6e28a3db-66b2-4842-8398-5c61caa8aacd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067860 Oct 16 01:11:06.702891 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1165/2481] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:06.709265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:06.710667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:06.719538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:06.720651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:06.721321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:06.722274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:06.723184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:06.723851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:07.255622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:07.284822 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57905aa6-9c16-4028-bc17-56a8cde94b65 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1382 microversion: 2.1 time: 0.580348 Oct 16 01:11:07.286117 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1166/2482] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:06 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1382 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:07.296845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:07.297873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:07.339763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:07.340627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:07.341231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:07.342281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:07.343080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:07.343661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:07.367930 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] HTTP exception thrown: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Request method failure captured: Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d HTTP/1.1 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1oLfNM6Co0n6L5KnbBWAFo0r-AUtGjs_rntxb6T0lEjd3b0gXiXRZveLjKk-lEyCHPl2WF-yfJbt4ALMnpHgD5xxbruzW9nqMN7a2r5AjsguaNGIXu1TqG2ckvHJWc0CPOgTOknFIxXkyhobtZkIwiuWkiaQ9H56NSvtsp_fZ_9Ppk Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f9416837a51e484094dba1a296c4d096", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f9416837a51e484094dba1a296c4d096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 0a7ca896a35447f8a828817a8620d308 Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: exception: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'b8b1ddf6-9ad6-47af-b916-801cdc94741d'} Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:07.373057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:07.377484 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:07.377484 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:07.377484 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:07.377484 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:07.377484 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:07.377484 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:07.377484 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:07.382279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Returning 404 to user: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:07.384356 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0869ff57-72d3-4821-a1be-b6f438af0675 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 404 len: 111 microversion: 2.1 time: 0.097050 Oct 16 01:11:07.385854 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1167/2483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:07 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:07.393196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:07.394363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:07.403700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:07.405048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:07.405650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:07.406575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:07.407254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:07.407838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:07.414081 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:07.752646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:07.761883 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dce0a30e-ea00-49de-afb2-4f2b0a4fb961 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1314 microversion: 2.1 time: 0.373266 Oct 16 01:11:07.780045 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1168/2484] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:07 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:07.787084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0f4355d5-8040-43d6-a410-077ec02f0ef3 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] Calling method '.version_select at 0x7fd64db03940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:07.795493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:11:07.795949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:11:07.796376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:11:07.796783 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:11:07.797192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:11:07.815875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:07.816357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:07.816882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:07.817505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:07.824422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:07.827931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:07.881550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:07.893028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:07.934141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:11:07.941424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:11:08.021523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f4899d8-5aaa-41bd-bd9f-c1cfdc0d84c0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.231612 Oct 16 01:11:08.022424 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1317/2485] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:11:08.031483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:08.032496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:08.042270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:08.043788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:08.044751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:08.045889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:08.046592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:08.047269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:08.081407 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] HTTP exception thrown: Instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf could not be found. Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Request method failure captured: Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf HTTP/1.1 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lhEyS1Hwn1n0leEshVjT0U2-CzwagXicsXvcbdRIayHOqWWeyxkr0_-kHE1cWex0RelbNvuEfmrUnq50geamnfcho4tNpNqAGt996veNcOXT2EXJNtM5gGUvIhiHnk98U2w0iyEW1CbG80_VoxrDTu7anOve47DgIOhqXwWi96MLM Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_abaf72f7fc7248a388dbfbd2b646dc56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2d7df9a6845440bbad5bd7c0a192171b Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf could not be found. Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf'} Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf could not be found. Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf could not be found. Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:08.085149 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.088701 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:08.088701 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:08.088701 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:08.088701 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:08.088701 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:08.088701 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf could not be found. Oct 16 01:11:08.088701 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.094182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Returning 404 to user: Instance 1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:08.095708 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d53774b-73a8-4955-9407-c6a1d2c60b9e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf" status: 404 len: 111 microversion: 2.1 time: 0.071597 Oct 16 01:11:08.100570 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1318/2486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:08 2022] GET /compute/v2.1/servers/1fdfa8e8-412c-4f84-a2f9-f38b84a8cdaf => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:08.107228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8a568b1-ca1e-4e43-a5c4-ddf0bd5a2077 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '.version_select at 0x7fd64e080940>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:08.111748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8a568b1-ca1e-4e43-a5c4-ddf0bd5a2077 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:08.112481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8a568b1-ca1e-4e43-a5c4-ddf0bd5a2077 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:08.113602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8a568b1-ca1e-4e43-a5c4-ddf0bd5a2077 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:08.124279 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8a568b1-ca1e-4e43-a5c4-ddf0bd5a2077 tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.022210 Oct 16 01:11:08.126736 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1319/2487] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:11:08 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:08.147231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1925103391", "metadata": {"image_type": "test"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:08.150017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:08.160424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:08.161686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:08.162338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:08.163318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:08.164220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:08.165531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:08.184872 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] HTTP exception thrown: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Request method failure captured: Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d/action HTTP/1.1 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 112 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1oLfNM6Co0n6L5KnbBWAFo0r-AUtGjs_rntxb6T0lEjd3b0gXiXRZveLjKk-lEyCHPl2WF-yfJbt4ALMnpHgD5xxbruzW9nqMN7a2r5AjsguaNGIXu1TqG2ckvHJWc0CPOgTOknFIxXkyhobtZkIwiuWkiaQ9H56NSvtsp_fZ_9Ppk Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f9416837a51e484094dba1a296c4d096", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f9416837a51e484094dba1a296c4d096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0a7ca896a35447f8a828817a8620d308 Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1925103391", "metadata": {"image_type": "test"}}} Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: exception: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'b8b1ddf6-9ad6-47af-b916-801cdc94741d', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1925103391', 'metadata': {'image_type': 'test'}}}} Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 16 01:11:08.186771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:08.190126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:08.195459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Returning 404 to user: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:08.196635 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d872c89c-c463-4e2b-8df5-674c34e9362e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "POST /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d/action" status: 404 len: 111 microversion: 2.1 time: 0.054436 Oct 16 01:11:08.197450 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1320/2488] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Oct 16 01:11:08 2022] POST /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:08.205985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62920ef3-b9aa-4953-ab2c-31bb8197dafd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:08.206971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-62920ef3-b9aa-4953-ab2c-31bb8197dafd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:08.397547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62920ef3-b9aa-4953-ab2c-31bb8197dafd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:08.408787 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-62920ef3-b9aa-4953-ab2c-31bb8197dafd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1229 microversion: 2.1 time: 0.209834 Oct 16 01:11:08.422537 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1321/2489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:08 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1229 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:08.453902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2019d79c-d382-4235-90ae-cdde2a44ad3e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:08.552641 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2019d79c-d382-4235-90ae-cdde2a44ad3e tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/a1658ad2-522e-42c2-b3e7-c97ba50c69d1" status: 204 len: 0 microversion: 2.1 time: 0.123682 Oct 16 01:11:08.560897 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1322/2490] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:11:08 2022] DELETE /compute/v2.1/os-server-groups/a1658ad2-522e-42c2-b3e7-c97ba50c69d1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:08.584379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:08.585013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:08.598225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:08.598436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:08.598734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:08.599521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:08.600040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:08.601394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:09.196824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ef94f7a4-f3c5-4ca1-a9bf-700bdf6287cc tempest-LiveMigrationTest-1499507079 tempest-LiveMigrationTest-1499507079-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1533 microversion: 2.1 time: 0.633375 Oct 16 01:11:09.198290 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1323/2491] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:08 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1533 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:09.204189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6d8f526-b0c9-463b-8aed-920af75fde3f tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-502867294", "metadata": {"image_type": "test"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:09.212340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f6d8f526-b0c9-463b-8aed-920af75fde3f tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Failed to fetch instance by id tempest-invalid-1904994408 {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 16 01:11:09.215604 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f6d8f526-b0c9-463b-8aed-920af75fde3f tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] HTTP exception thrown: Instance tempest-invalid-1904994408 could not be found. Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6d8f526-b0c9-463b-8aed-920af75fde3f tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Request method failure captured: Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/tempest-invalid-1904994408/action HTTP/1.1 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 111 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1oLfNM6Co0n6L5KnbBWAFo0r-AUtGjs_rntxb6T0lEjd3b0gXiXRZveLjKk-lEyCHPl2WF-yfJbt4ALMnpHgD5xxbruzW9nqMN7a2r5AjsguaNGIXu1TqG2ckvHJWc0CPOgTOknFIxXkyhobtZkIwiuWkiaQ9H56NSvtsp_fZ_9Ppk Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f9416837a51e484094dba1a296c4d096", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f9416837a51e484094dba1a296c4d096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0a7ca896a35447f8a828817a8620d308 Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-502867294", "metadata": {"image_type": "test"}}} Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: exception: Instance tempest-invalid-1904994408 could not be found. Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'tempest-invalid-1904994408', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-502867294', 'metadata': {'image_type': 'test'}}}} Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1904994408 could not be found. Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:09.217478 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1904994408 could not be found. Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1904994408 could not be found. Oct 16 01:11:09.221251 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:09.242185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6d8f526-b0c9-463b-8aed-920af75fde3f tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Returning 404 to user: Instance tempest-invalid-1904994408 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:09.251151 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f6d8f526-b0c9-463b-8aed-920af75fde3f tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "POST /compute/v2.1/servers/tempest-invalid-1904994408/action" status: 404 len: 101 microversion: 2.1 time: 0.050724 Oct 16 01:11:09.251849 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1324/2492] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Oct 16 01:11:09 2022] POST /compute/v2.1/servers/tempest-invalid-1904994408/action => generated 101 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:09.261947 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:09.265183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:09.280631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:09.281142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:09.281584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:09.287323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:09.288053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:09.288850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:09.359978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:11:09.500688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ad02d24-5b99-4994-9b2f-1393af097efc tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd" status: 204 len: 0 microversion: 2.1 time: 0.242809 Oct 16 01:11:09.501551 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1325/2493] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:09 2022] DELETE /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:09.521412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f081dd2d-7655-4722-b84b-adce0d637205 req-062125ed-88e8-4ecf-b123-6be162d309ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f199d0-c8ac-4b34-900f-d76d13a71c79", "tag": "76e5aea7-bf51-495a-8ec2-5bf79b6c00fc"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:09.542105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f081dd2d-7655-4722-b84b-adce0d637205 req-062125ed-88e8-4ecf-b123-6be162d309ed service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:09.542547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f081dd2d-7655-4722-b84b-adce0d637205 req-062125ed-88e8-4ecf-b123-6be162d309ed service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:09.543406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f081dd2d-7655-4722-b84b-adce0d637205 req-062125ed-88e8-4ecf-b123-6be162d309ed service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:09.569175 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f081dd2d-7655-4722-b84b-adce0d637205 req-062125ed-88e8-4ecf-b123-6be162d309ed service nova] Creating event network-changed:76e5aea7-bf51-495a-8ec2-5bf79b6c00fc for instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 on n-h1-master-1 Oct 16 01:11:09.589424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f081dd2d-7655-4722-b84b-adce0d637205 req-062125ed-88e8-4ecf-b123-6be162d309ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086026 Oct 16 01:11:09.594506 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1326/2494] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:09.601611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:09.602683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:09.610538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:09.611790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:09.612738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:09.614545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:09.615223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:09.615798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.097533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:10.107493 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c537c480-6997-47ef-8c5b-1e802e5f42f7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1314 microversion: 2.1 time: 0.511568 Oct 16 01:11:10.108189 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1327/2495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:09 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:10.113876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:10.114474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:10.122882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.123484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.123994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.124964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.125490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.125989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.153025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:11:10.255715 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-649efbf2-c90b-4fb1-ad92-3713780ced8d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 204 len: 0 microversion: 2.1 time: 0.145217 Oct 16 01:11:10.259820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1328/2496] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:10 2022] DELETE /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:10.267210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a3b01ec-a51f-4d5c-af15-7f06cd111e0e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1595141822"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:10.269959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a3b01ec-a51f-4d5c-af15-7f06cd111e0e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 16 01:11:10.270682 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-6a3b01ec-a51f-4d5c-af15-7f06cd111e0e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a3b01ec-a51f-4d5c-af15-7f06cd111e0e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Request method failure captured: Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 57 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1oLfNM6Co0n6L5KnbBWAFo0r-AUtGjs_rntxb6T0lEjd3b0gXiXRZveLjKk-lEyCHPl2WF-yfJbt4ALMnpHgD5xxbruzW9nqMN7a2r5AjsguaNGIXu1TqG2ckvHJWc0CPOgTOknFIxXkyhobtZkIwiuWkiaQ9H56NSvtsp_fZ_9Ppk Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f9416837a51e484094dba1a296c4d096", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f9416837a51e484094dba1a296c4d096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0a7ca896a35447f8a828817a8620d308 Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: {"createImage": {"name": "tempest-test-snap-1595141822"}} Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1595141822'}}} Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.272792 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.277734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.279815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a3b01ec-a51f-4d5c-af15-7f06cd111e0e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:10.281039 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a3b01ec-a51f-4d5c-af15-7f06cd111e0e tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.019678 Oct 16 01:11:10.282306 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1329/2497] 10.222.0.39 () {60 vars in 1275 bytes} [Sun Oct 16 01:11:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:10.290830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:10.293094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:10.303071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.303853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.304522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.305437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.306777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.307420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.421469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:10.429551 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb7742b1-3c39-4d76-bbe4-887d4c30777c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1299 microversion: 2.1 time: 0.146000 Oct 16 01:11:10.430124 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1330/2498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:10 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:10.446887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:10.447434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:10.453893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.454369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.454797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.455540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.455990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.456406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.483127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:11:10.508763 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0f4355d5-8040-43d6-a410-077ec02f0ef3 tempest-FloatingIPDetailsTestJSON-1173354529 tempest-FloatingIPDetailsTestJSON-1173354529-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/8f2be54b-2ad5-4345-816e-931a1b15b9db" status: 202 len: 0 microversion: 2.1 time: 2.726220 Oct 16 01:11:10.517002 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1169/2499] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:11:07 2022] DELETE /compute/v2.1/os-floating-ips/8f2be54b-2ad5-4345-816e-931a1b15b9db => generated 0 bytes in 2736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:10.543200 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:10.579918 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f0d984e-c6bb-4819-8332-19c363c68675 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 204 len: 0 microversion: 2.1 time: 0.148546 Oct 16 01:11:10.581186 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1331/2500] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:10 2022] DELETE /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:10.587799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:10.588591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:10.599537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.600263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.600893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.601812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.602638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.603297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.743267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-07c2e1f4-9f05-4232-94c7-5d19387f7b0d tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Action: 'create', calling method: .version_select at 0x7fd64d816160>, body: {"keypair": {"name": "tempest-keypair-951174705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVC07dHGJUeF79HET4g3rF97aqfPLNjhMZZXizsNbPQLyCChfTH+1s1HlACA+26ZuIJTRr7Tzo2nqW7l+PcFDKCMXA4InRbl0npSx+NVPwOiBfHRv3fX8GO+qxwa/TI8g=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:10.767644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-07c2e1f4-9f05-4232-94c7-5d19387f7b0d tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:10.773913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-07c2e1f4-9f05-4232-94c7-5d19387f7b0d tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:10.804646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-07c2e1f4-9f05-4232-94c7-5d19387f7b0d tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.286347 Oct 16 01:11:10.812461 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1170/2501] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Oct 16 01:11:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 288 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 16 01:11:10.812461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57c96839-23e1-43be-989c-0eb1bf177cc8 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1481981325"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:10.813440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-57c96839-23e1-43be-989c-0eb1bf177cc8 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 16 01:11:10.814170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-57c96839-23e1-43be-989c-0eb1bf177cc8 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57c96839-23e1-43be-989c-0eb1bf177cc8 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Request method failure captured: Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 57 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1oLfNM6Co0n6L5KnbBWAFo0r-AUtGjs_rntxb6T0lEjd3b0gXiXRZveLjKk-lEyCHPl2WF-yfJbt4ALMnpHgD5xxbruzW9nqMN7a2r5AjsguaNGIXu1TqG2ckvHJWc0CPOgTOknFIxXkyhobtZkIwiuWkiaQ9H56NSvtsp_fZ_9Ppk Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f9416837a51e484094dba1a296c4d096", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f9416837a51e484094dba1a296c4d096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 0a7ca896a35447f8a828817a8620d308 Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: {"createImage": {"name": "tempest-test-snap-1481981325"}} Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1481981325'}}} Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.815748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57c96839-23e1-43be-989c-0eb1bf177cc8 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57c96839-23e1-43be-989c-0eb1bf177cc8 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010694 Oct 16 01:11:10.819874 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1171/2502] 10.222.0.39 () {60 vars in 1281 bytes} [Sun Oct 16 01:11:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:10.824828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:10.826036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:10.833814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.834133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.834577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.835298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:10.835932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:10.836504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:10.948122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:10.960332 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f77ea40-1296-44b6-a46e-b6f011ddf14c tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1388 microversion: 2.1 time: 0.376777 Oct 16 01:11:10.975382 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1332/2503] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:10 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1388 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:10.980875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-93bc18bd-65ed-4556-95c9-62434a8db6de tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e419ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:10.989552 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-93bc18bd-65ed-4556-95c9-62434a8db6de tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-951174705" status: 200 len: 512 microversion: 2.2 time: 0.012942 Oct 16 01:11:10.990290 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1333/2504] 10.222.0.39 () {60 vars in 1255 bytes} [Sun Oct 16 01:11:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-951174705 => generated 512 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:11.003318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.003962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:11.011597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.013196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.013401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:11.014242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.014852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.015490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:11.031196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] HTTP exception thrown: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Request method failure captured: Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d HTTP/1.1 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1oLfNM6Co0n6L5KnbBWAFo0r-AUtGjs_rntxb6T0lEjd3b0gXiXRZveLjKk-lEyCHPl2WF-yfJbt4ALMnpHgD5xxbruzW9nqMN7a2r5AjsguaNGIXu1TqG2ckvHJWc0CPOgTOknFIxXkyhobtZkIwiuWkiaQ9H56NSvtsp_fZ_9Ppk Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f9416837a51e484094dba1a296c4d096", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f9416837a51e484094dba1a296c4d096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0a7ca896a35447f8a828817a8620d308 Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: exception: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'b8b1ddf6-9ad6-47af-b916-801cdc94741d'} Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:11.032913 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Returning 404 to user: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:11.036356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-27f98dfc-b150-420d-a4f4-3a8e8511e370 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 404 len: 111 microversion: 2.1 time: 0.036404 Oct 16 01:11:11.039145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1334/2505] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:10 2022] DELETE /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:11.045130 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6412651-38af-40fc-b549-ae2bb169b1e5 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e464790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.078489 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f6412651-38af-40fc-b549-ae2bb169b1e5 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-951174705" status: 204 len: 0 microversion: 2.2 time: 0.038242 Oct 16 01:11:11.081841 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1335/2506] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Oct 16 01:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-951174705 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:11.086927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.087605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] [instance: b8b1ddf6-9ad6-47af-b916-801cdc94741d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:11.095311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.096446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.096889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:11.097595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.098051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.098477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:11.113924 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] HTTP exception thrown: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Request method failure captured: Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d HTTP/1.1 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1oLfNM6Co0n6L5KnbBWAFo0r-AUtGjs_rntxb6T0lEjd3b0gXiXRZveLjKk-lEyCHPl2WF-yfJbt4ALMnpHgD5xxbruzW9nqMN7a2r5AjsguaNGIXu1TqG2ckvHJWc0CPOgTOknFIxXkyhobtZkIwiuWkiaQ9H56NSvtsp_fZ_9Ppk Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f9416837a51e484094dba1a296c4d096", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f9416837a51e484094dba1a296c4d096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f9416837a51e484094dba1a296c4d096"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f9416837a51e484094dba1a296c4d096 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1484962271 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0a7ca896a35447f8a828817a8620d308 Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesNegativeTestJSON-1484962271-project Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: exception: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'b8b1ddf6-9ad6-47af-b916-801cdc94741d'} Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:11.115799 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] Returning 404 to user: Instance b8b1ddf6-9ad6-47af-b916-801cdc94741d could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e66ba33-5295-40c6-bfb8-3d19c81e6e18 tempest-ImagesNegativeTestJSON-1484962271 tempest-ImagesNegativeTestJSON-1484962271-project] 10.222.0.39 "GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d" status: 404 len: 111 microversion: 2.1 time: 0.037108 Oct 16 01:11:11.121016 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1336/2507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:11 2022] GET /compute/v2.1/servers/b8b1ddf6-9ad6-47af-b916-801cdc94741d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:11.126610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca05c3f8-c8b3-4c95-98e4-d79d86a4c7f0 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Action: 'create', calling method: .version_select at 0x7fd64e206280>, body: {"keypair": {"name": "tempest-keypair-302980443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmganEk6IFDkglgOcZLwJIRRGSA2ng7rsvdBBFET0pv5GO09Knf0EHIZulwAEosGpy04kA2aWBYBcxk7XXwBE9PABgdFVW8R/UXLeja2MgbuUPaF4yuZ/K/v5zsyY6v1Q=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:11.126967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:11.136740 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-376beaeb-7e4b-496e-94bc-511a092b6015 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd" status: 200 len: 1474 microversion: 2.1 time: 0.317108 Oct 16 01:11:11.143619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ca05c3f8-c8b3-4c95-98e4-d79d86a4c7f0 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:11.149434 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1172/2508] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:10 2022] GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:11.152036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ca05c3f8-c8b3-4c95-98e4-d79d86a4c7f0 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:11.156265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.157233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:11.167219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.167891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.168334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:11.169039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.169775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.170543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:11.171275 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=4,nova_api:UPDATE=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:11.207175 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca05c3f8-c8b3-4c95-98e4-d79d86a4c7f0 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.087715 Oct 16 01:11:11.213541 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1337/2509] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Oct 16 01:11:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 16 01:11:11.220486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-591ef307-8932-48fc-8689-0833fff5f050 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e464e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.246483 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-591ef307-8932-48fc-8689-0833fff5f050 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302980443" status: 204 len: 0 microversion: 2.2 time: 0.029551 Oct 16 01:11:11.247158 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1338/2510] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Oct 16 01:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302980443 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:11.256293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b676802-57a2-42a8-ba99-d664360c3c08 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Action: 'create', calling method: .version_select at 0x7fd64e7e6e50>, body: {"keypair": {"name": "tempest-keypair-204048835", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:11.272344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8b676802-57a2-42a8-ba99-d664360c3c08 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:11.278874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8b676802-57a2-42a8-ba99-d664360c3c08 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:11.310257 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b676802-57a2-42a8-ba99-d664360c3c08 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.057146 Oct 16 01:11:11.311787 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1339/2511] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Oct 16 01:11:11 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 16 01:11:11.325113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ba6a369-3f2c-40a4-83ce-a3726ede34c9 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e3d7550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.349465 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ba6a369-3f2c-40a4-83ce-a3726ede34c9 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204048835" status: 204 len: 0 microversion: 2.2 time: 0.030126 Oct 16 01:11:11.351002 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1340/2512] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Oct 16 01:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204048835 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:11.365694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3740659d-1f56-446d-8fcc-00a976d0e7ef tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Action: 'create', calling method: .version_select at 0x7fd64e21ec10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-320164341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT4WAgXtXlFbC1/+RMknrOHCw0lrERlZ9a/W5GLZFSNTkam/QACxhixaMVFR8m1WjcbjE1pdeWuUbums+qR2d1vl2+p7mkbFnfSpf0bYiFny7Rd/3sJJjQR+p5S7nTGKQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:11.389373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3740659d-1f56-446d-8fcc-00a976d0e7ef tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:11.395849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3740659d-1f56-446d-8fcc-00a976d0e7ef tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:11.428370 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3740659d-1f56-446d-8fcc-00a976d0e7ef tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.066643 Oct 16 01:11:11.428370 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1341/2513] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Oct 16 01:11:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 16 01:11:11.443079 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc40d647-ac94-4cc2-8b2d-60bca4555ae8 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Action: 'create', calling method: .version_select at 0x7fd64e0bb8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-182636354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxtIcBc9IIMf3dOv7eNsZ8pkbG3CMvJOf0q7vNgofbpmqFYdl7sgZdMtcU1NLf+L7O5ttDniS0RcjU2ZOaMY01IIGj4IoKaMp6Sy1+NCdxr4bGFmYU/KnCXB9PtUPGNdg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:11.463660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-fc40d647-ac94-4cc2-8b2d-60bca4555ae8 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:11.472559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-fc40d647-ac94-4cc2-8b2d-60bca4555ae8 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:11.501655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc40d647-ac94-4cc2-8b2d-60bca4555ae8 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.063315 Oct 16 01:11:11.502968 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1342/2514] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Oct 16 01:11:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 16 01:11:11.516516 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.517291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:11.527309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.527309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.527309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:11.528179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.528991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.529973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:11.584367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:11.593328 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b011ed06-b865-49bd-9940-e63469903314 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1314 microversion: 2.1 time: 0.442259 Oct 16 01:11:11.600918 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1173/2515] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:11 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:11.606519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-479707bd-1023-4aa3-97a7-8681f9dfd0c3 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Action: 'create', calling method: .version_select at 0x7fd64e14b8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1284635272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpib0ris9YJdXfWA39/pz9uDxb/u+E5nEt5E5De/buX7+J4jbKV3D2XCIkaHtqvkwi6zt+hIpZlds6E5dWZSpLbPBKcUYIWBhOE4nJMrDMwKUV+oFGSlNvbnN1jGV4y5Q=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:11.626741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:11.632708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-479707bd-1023-4aa3-97a7-8681f9dfd0c3 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:11.637371 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bcc34e76-b3e2-40af-8d2f-94916c8afabc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1287 microversion: 2.1 time: 0.133381 Oct 16 01:11:11.638450 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1343/2516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:11 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:11.640187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-479707bd-1023-4aa3-97a7-8681f9dfd0c3 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:11.675847 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-479707bd-1023-4aa3-97a7-8681f9dfd0c3 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.075527 Oct 16 01:11:11.676784 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1174/2517] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Oct 16 01:11:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 16 01:11:11.688725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea609bed-44d2-4399-8425-552073ce3d01 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e890160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.693034 n-d-master-1 devstack@n-api.service[120545]: WARNING oslo_db.sqlalchemy.utils [None req-ea609bed-44d2-4399-8425-552073ce3d01 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 16 01:11:11.699621 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea609bed-44d2-4399-8425-552073ce3d01 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.014930 Oct 16 01:11:11.700813 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1344/2518] 10.222.0.39 () {60 vars in 1177 bytes} [Sun Oct 16 01:11:11 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:11.711539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-12b3137f-d343-4d97-84d0-ffdf145965b4 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64daaa5e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.731373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-12b3137f-d343-4d97-84d0-ffdf145965b4 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1284635272" status: 204 len: 0 microversion: 2.2 time: 0.023396 Oct 16 01:11:11.731966 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1175/2519] 10.222.0.39 () {60 vars in 1321 bytes} [Sun Oct 16 01:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1284635272 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:11.742470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-28322448-40d2-4580-b057-c702bbebcfbe tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e1fba60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.765617 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-28322448-40d2-4580-b057-c702bbebcfbe tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-182636354" status: 204 len: 0 microversion: 2.2 time: 0.028723 Oct 16 01:11:11.766341 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1345/2520] 10.222.0.39 () {60 vars in 1318 bytes} [Sun Oct 16 01:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-182636354 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:11.776765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd4b4b0f-7739-4b49-99c9-b0fae4564408 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64d7a40d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.802430 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd4b4b0f-7739-4b49-99c9-b0fae4564408 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-320164341" status: 204 len: 0 microversion: 2.2 time: 0.030003 Oct 16 01:11:11.811057 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1176/2521] 10.222.0.39 () {60 vars in 1318 bytes} [Sun Oct 16 01:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-320164341 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:11.817021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e5cc7ab-0a7d-4750-9694-992b28674203 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Action: 'create', calling method: .version_select at 0x7fd64e0bb8b0>, body: {"keypair": {"name": "tempest-keypair-1951956653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAZ/YbBJUwLbyecFDMHpccLuPageWq4D690N1btygjOUH+NFS1UWhmK1F2bEpZQj2rtyl2K2tZgUNOb7bgxmuq42hjLP+pQgt31I26jN0cEgnMQQsG3IOgzoNloCKzaJw=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:11.834784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9e5cc7ab-0a7d-4750-9694-992b28674203 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:11.840524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9e5cc7ab-0a7d-4750-9694-992b28674203 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:11.866981 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e5cc7ab-0a7d-4750-9694-992b28674203 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.054071 Oct 16 01:11:11.867852 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1346/2522] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Oct 16 01:11:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 16 01:11:11.880786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-394409fd-1f0d-43fc-98df-27e96357cdd3 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64d7b14c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.890657 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-394409fd-1f0d-43fc-98df-27e96357cdd3 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1951956653" status: 200 len: 513 microversion: 2.2 time: 0.014806 Oct 16 01:11:11.892143 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1177/2523] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Oct 16 01:11:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1951956653 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:11.904842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d89a3e89-b7c7-4742-98b5-cc5db874621b tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e0803a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.908989 n-d-master-1 devstack@n-api.service[120545]: WARNING oslo_db.sqlalchemy.utils [None req-d89a3e89-b7c7-4742-98b5-cc5db874621b tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 16 01:11:11.915132 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d89a3e89-b7c7-4742-98b5-cc5db874621b tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.014776 Oct 16 01:11:11.919288 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1347/2524] 10.222.0.39 () {60 vars in 1177 bytes} [Sun Oct 16 01:11:11 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:11.928936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64732b9d-9f02-4bd8-886b-3c73f73482e2 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e34b700>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.949835 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64732b9d-9f02-4bd8-886b-3c73f73482e2 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951956653" status: 204 len: 0 microversion: 2.2 time: 0.025951 Oct 16 01:11:11.950907 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1178/2525] 10.222.0.39 () {60 vars in 1261 bytes} [Sun Oct 16 01:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951956653 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:11.960401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Action: 'create', calling method: .version_select at 0x7fd64e3d7430>, body: {"keypair": {"name": "tempest-keypair-121777411", "type": "x509"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:11.976959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:11.987137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:11.988862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:11.989647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:11.998144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:11.999060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:11.999968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:12.001162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:12.001955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:12.002607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:12.030905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.processutils [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpanwwmysc/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpanwwmysc/temp.key -subj /CN=dcddb65efbf14eee9f1af5839919c12c -extensions v3_req_client {{(pid=120545) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 16 01:11:12.359769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.processutils [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpanwwmysc/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpanwwmysc/temp.key -subj /CN=dcddb65efbf14eee9f1af5839919c12c -extensions v3_req_client" returned: 0 in 0.328s {{(pid=120545) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 16 01:11:12.361957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.processutils [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpanwwmysc/temp.key -password pass: {{(pid=120545) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 16 01:11:12.405125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.processutils [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpanwwmysc/temp.key -password pass:" returned: 0 in 0.042s {{(pid=120545) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 16 01:11:12.488962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:12.497812 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ecb02323-efa1-4dd7-9380-0eab4d172f12 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1346 microversion: 2.1 time: 0.514808 Oct 16 01:11:12.507293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:12.507684 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1179/2526] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:11 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1346 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:12.522317 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:12.524000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:12.533205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:12.533700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:12.534142 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:12.538464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Getting quotas for user dcddb65efbf14eee9f1af5839919c12c and project 5fa23478036a4bcdafbac2b61d7b970b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:12.538889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:12.539469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:12.539914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:12.583676 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9297cbe5-b370-4449-b2fd-af3ee16a2a63 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.627105 Oct 16 01:11:12.590046 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1348/2527] 10.222.0.39 () {62 vars in 1198 bytes} [Sun Oct 16 01:11:11 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 629 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:11:12.598466 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-21b2b660-f2d9-41d3-869f-2176f22b53b7 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e422ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:12.618128 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-21b2b660-f2d9-41d3-869f-2176f22b53b7 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-121777411" status: 200 len: 1533 microversion: 2.2 time: 0.018650 Oct 16 01:11:12.618128 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1349/2528] 10.222.0.39 () {60 vars in 1255 bytes} [Sun Oct 16 01:11:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-121777411 => generated 1533 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:12.624833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:12.624833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:12.631951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:12.632480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:12.632923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:12.633678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:12.634123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:12.634569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:13.076255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:13.085982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:13.089928 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-056bceb5-1500-486a-bb45-f29695c8d530 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1314 microversion: 2.1 time: 0.476909 Oct 16 01:11:13.091136 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1350/2529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:12 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:13.112262 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f379db96-9205-468c-b765-dc691fc4c69d tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd" status: 200 len: 1474 microversion: 2.1 time: 0.603140 Oct 16 01:11:13.113184 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1180/2530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:12 2022] GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd => generated 1474 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:13.117800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e809f06f-991e-49c0-aa32-96c0ef9cf8fe tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64e422ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:13.118936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:13.119661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:13.127577 n-d-master-1 devstack@n-api.service[120545]: WARNING oslo_db.sqlalchemy.utils [None req-e809f06f-991e-49c0-aa32-96c0ef9cf8fe tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 16 01:11:13.134190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:13.146651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:13.149006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:13.151134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:13.152029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:13.152143 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e809f06f-991e-49c0-aa32-96c0ef9cf8fe tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.045346 Oct 16 01:11:13.152939 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1351/2531] 10.222.0.39 () {60 vars in 1177 bytes} [Sun Oct 16 01:11:13 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:13.153610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:13.165126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-af72872a-fbca-46ff-84fb-7d226ba4abf3 req-2157038b-3a59-44c6-925f-edc4e7bceff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2132a3-c6eb-4fe2-96ce-725f4efba607", "name": "network-vif-deleted", "tag": "b91eb4e3-f8a9-4013-a52a-4ea301c52468"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:13.177232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-af72872a-fbca-46ff-84fb-7d226ba4abf3 req-2157038b-3a59-44c6-925f-edc4e7bceff7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:13.177965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-af72872a-fbca-46ff-84fb-7d226ba4abf3 req-2157038b-3a59-44c6-925f-edc4e7bceff7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:13.178554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-af72872a-fbca-46ff-84fb-7d226ba4abf3 req-2157038b-3a59-44c6-925f-edc4e7bceff7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:13.193356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-af72872a-fbca-46ff-84fb-7d226ba4abf3 req-2157038b-3a59-44c6-925f-edc4e7bceff7 service nova] Creating event network-vif-deleted:b91eb4e3-f8a9-4013-a52a-4ea301c52468 for instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 on n-h2-master-1 Oct 16 01:11:13.203700 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-af72872a-fbca-46ff-84fb-7d226ba4abf3 req-2157038b-3a59-44c6-925f-edc4e7bceff7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043849 Oct 16 01:11:13.204941 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1352/2532] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:13.210428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5de389eb-a184-4481-a34e-aa52273d29a7 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] Calling method '.version_select at 0x7fd64eb68550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:13.221581 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:13.234643 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5de389eb-a184-4481-a34e-aa52273d29a7 tempest-KeyPairsV22TestJSON-548994780 tempest-KeyPairsV22TestJSON-548994780-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-121777411" status: 204 len: 0 microversion: 2.2 time: 0.028190 Oct 16 01:11:13.235739 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1353/2533] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Oct 16 01:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-121777411 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:13.546290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:13.554349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:13.573143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:13.578548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:13.579225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:13.580134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:13.584001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:13.586061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:13.742495 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:13.751943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9a033b76-fec0-4003-9818-98f52b04b021 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 0.637488 Oct 16 01:11:13.752757 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1181/2534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:13 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:13.974910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:13.988411 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f94ed66-0232-4636-a8bc-c03d2ac446bc tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1184 microversion: 2.1 time: 0.455790 Oct 16 01:11:14.023195 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1354/2535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:13 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1184 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:14.117237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:14.120051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:14.130365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:14.135510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:14.137361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:14.138212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:14.140059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:14.140693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:14.141078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:14.141331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:14.159776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:14.161771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:14.163541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:14.167413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:14.170508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:14.173604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:14.729709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:14.746015 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1fd4db2e-4e35-4a44-bd95-bd99ea3c19c1 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd" status: 200 len: 1432 microversion: 2.1 time: 0.607234 Oct 16 01:11:14.747535 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1355/2536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:14 2022] GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd => generated 1432 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:14.781056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:14.781992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:14.789271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:14.790244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:14.790838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:14.794632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:14.795411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:14.796025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:15.348924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:15.363005 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1a51501-87ef-4f04-a340-b9db8ab57d04 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1314 microversion: 2.1 time: 1.248656 Oct 16 01:11:15.368168 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1182/2537] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:14 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1314 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:15.381044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:15.381906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:15.400603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:15.402011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:15.405345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:15.406677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:15.408493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:15.411238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:15.478155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:15.491023 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ca7477c-ee35-4363-8320-03d20e7ebe00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 0.716231 Oct 16 01:11:15.491858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1356/2538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:14 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:15.520671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-fe07def1-fe56-48ab-975b-6f64d954f49e req-7c756a93-155b-48b3-a746-a9bc89200b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd", "name": "network-vif-deleted", "tag": "d8fc1c0d-6620-41e0-b82f-05674b90f342"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:15.567047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fe07def1-fe56-48ab-975b-6f64d954f49e req-7c756a93-155b-48b3-a746-a9bc89200b6e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:15.569355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fe07def1-fe56-48ab-975b-6f64d954f49e req-7c756a93-155b-48b3-a746-a9bc89200b6e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:15.570160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fe07def1-fe56-48ab-975b-6f64d954f49e req-7c756a93-155b-48b3-a746-a9bc89200b6e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:15.599921 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-fe07def1-fe56-48ab-975b-6f64d954f49e req-7c756a93-155b-48b3-a746-a9bc89200b6e service nova] Creating event network-vif-deleted:d8fc1c0d-6620-41e0-b82f-05674b90f342 for instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd on n-h1-master-1 Oct 16 01:11:15.614471 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-fe07def1-fe56-48ab-975b-6f64d954f49e req-7c756a93-155b-48b3-a746-a9bc89200b6e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099972 Oct 16 01:11:15.617373 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1357/2539] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:15.631787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a89e6287-b1c2-461a-9b22-75014a771060 req-5da64efb-c46a-4d01-a1cd-090f99cf6c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32be475-1191-40ba-a6d8-eec04d0c2cb9", "name": "network-vif-deleted", "tag": "9de0040b-fdd5-4e2d-8263-86982613cbef"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:15.654826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a89e6287-b1c2-461a-9b22-75014a771060 req-5da64efb-c46a-4d01-a1cd-090f99cf6c88 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:15.655582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a89e6287-b1c2-461a-9b22-75014a771060 req-5da64efb-c46a-4d01-a1cd-090f99cf6c88 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:15.656681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a89e6287-b1c2-461a-9b22-75014a771060 req-5da64efb-c46a-4d01-a1cd-090f99cf6c88 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:15.670850 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a89e6287-b1c2-461a-9b22-75014a771060 req-5da64efb-c46a-4d01-a1cd-090f99cf6c88 service nova] Creating event network-vif-deleted:9de0040b-fdd5-4e2d-8263-86982613cbef for instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 on n-h1-master-1 Oct 16 01:11:15.675866 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a89e6287-b1c2-461a-9b22-75014a771060 req-5da64efb-c46a-4d01-a1cd-090f99cf6c88 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057021 Oct 16 01:11:15.677361 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1358/2540] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:15.704265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:15.717969 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0fd42d8f-95b2-4535-87bc-25e1727f17e6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1184 microversion: 2.1 time: 0.348382 Oct 16 01:11:15.723202 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1183/2541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:15 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1184 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:15.776448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:15.777915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:15.789722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:15.792334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:15.793068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:15.793990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:15.794706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:15.795340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:15.894714 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] HTTP exception thrown: Instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd could not be found. Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Request method failure captured: Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd HTTP/1.1 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lhEyS1Hwn1n0leEshVjT0U2-CzwagXicsXvcbdRIayHOqWWeyxkr0_-kHE1cWex0RelbNvuEfmrUnq50geamnfcho4tNpNqAGt996veNcOXT2EXJNtM5gGUvIhiHnk98U2w0iyEW1CbG80_VoxrDTu7anOve47DgIOhqXwWi96MLM Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_abaf72f7fc7248a388dbfbd2b646dc56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2d7df9a6845440bbad5bd7c0a192171b Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd could not be found. Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd'} Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd could not be found. Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd could not be found. Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:15.900237 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd could not be found. Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Returning 404 to user: Instance 1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:15.904960 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-251b7f16-613e-4699-8dce-12085897d566 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd" status: 404 len: 111 microversion: 2.1 time: 0.131809 Oct 16 01:11:15.912747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:15.913651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:15.920816 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1359/2542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:15 2022] GET /compute/v2.1/servers/1ad72b16-8ecf-4dfd-a03b-33a3ae60f8dd => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:15.925607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:15.926802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:15.928989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:15.930704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:15.950214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:15.962904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:16.059485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:16.059985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:16.060750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:16.061370 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lazy-loading 'fault' on Instance uuid e32be475-1191-40ba-a6d8-eec04d0c2cb9 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:16.394836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:16.397156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:16.418198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:16.420044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:16.422231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:16.425546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:16.428842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:16.429524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:16.797340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:16.807986 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-62fbbcd8-aea9-4cc6-ad73-e0d43ebfea67 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 200 len: 1308 microversion: 2.1 time: 0.898673 Oct 16 01:11:16.818969 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1184/2543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:15 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 1308 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:16.818969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9dde3a8c-1c2f-404a-8ac8-c6dde4f765e0 req-35dcf767-6648-442d-9251-a99ed77d65db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f199d0-c8ac-4b34-900f-d76d13a71c79", "name": "network-vif-plugged", "status": "completed", "tag": "76e5aea7-bf51-495a-8ec2-5bf79b6c00fc"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:16.838019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9dde3a8c-1c2f-404a-8ac8-c6dde4f765e0 req-35dcf767-6648-442d-9251-a99ed77d65db service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:16.838506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9dde3a8c-1c2f-404a-8ac8-c6dde4f765e0 req-35dcf767-6648-442d-9251-a99ed77d65db service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:16.841576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9dde3a8c-1c2f-404a-8ac8-c6dde4f765e0 req-35dcf767-6648-442d-9251-a99ed77d65db service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:16.868077 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9dde3a8c-1c2f-404a-8ac8-c6dde4f765e0 req-35dcf767-6648-442d-9251-a99ed77d65db service nova] Creating event network-vif-plugged:76e5aea7-bf51-495a-8ec2-5bf79b6c00fc for instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 on n-h1-master-1 Oct 16 01:11:16.894657 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9dde3a8c-1c2f-404a-8ac8-c6dde4f765e0 req-35dcf767-6648-442d-9251-a99ed77d65db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082802 Oct 16 01:11:16.897879 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1185/2544] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:16.912346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:16.916263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:16.938855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:16.940819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:16.941283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:16.946757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:16.951371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:16.959056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:17.265838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:17.276372 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8540cc5f-01d3-436f-95d9-ef50d6d398a3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1314 microversion: 2.1 time: 0.888570 Oct 16 01:11:17.276996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1360/2545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:16 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:17.288186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:17.288857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:17.302745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:17.303293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:17.305131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:17.308635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:17.309377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:17.310610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:17.512695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:17.522861 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba87161d-dd0e-4741-83dc-0e5f38d65bfe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 0.623559 Oct 16 01:11:17.528154 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1186/2546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:16 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:17.537866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:17.559390 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1cea6fd3-8893-4e08-8391-d103d3ffed8a tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1184 microversion: 2.1 time: 0.269003 Oct 16 01:11:17.572226 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1361/2547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:17 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1184 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:17.812752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-11b9e676-a1b3-4c8d-9689-ae4fa59456a2 req-d2da8e5b-ea97-4ca2-8b52-afc4e507364c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96f9006-082a-45f2-bfef-5ba9d429bcf1", "tag": "86679e3b-c764-48b2-9567-9ea849250bc5"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:17.833531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:17.834145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e32be475-1191-40ba-a6d8-eec04d0c2cb9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:17.852753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-11b9e676-a1b3-4c8d-9689-ae4fa59456a2 req-d2da8e5b-ea97-4ca2-8b52-afc4e507364c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:17.853233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-11b9e676-a1b3-4c8d-9689-ae4fa59456a2 req-d2da8e5b-ea97-4ca2-8b52-afc4e507364c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:17.853663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-11b9e676-a1b3-4c8d-9689-ae4fa59456a2 req-d2da8e5b-ea97-4ca2-8b52-afc4e507364c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:17.859574 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:17.861954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:17.862491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:17.862941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:17.864300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:17.864763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:17.874962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:17.909438 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-11b9e676-a1b3-4c8d-9689-ae4fa59456a2 req-d2da8e5b-ea97-4ca2-8b52-afc4e507364c service nova] Creating event network-changed:86679e3b-c764-48b2-9567-9ea849250bc5 for instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 on n-h2-master-1 Oct 16 01:11:17.938808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-11b9e676-a1b3-4c8d-9689-ae4fa59456a2 req-d2da8e5b-ea97-4ca2-8b52-afc4e507364c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129554 Oct 16 01:11:17.943477 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1187/2548] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:17.945716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] HTTP exception thrown: Instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 could not be found. Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Request method failure captured: Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 HTTP/1.1 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lhEyS1Hwn1n0leEshVjT0U2-CzwagXicsXvcbdRIayHOqWWeyxkr0_-kHE1cWex0RelbNvuEfmrUnq50geamnfcho4tNpNqAGt996veNcOXT2EXJNtM5gGUvIhiHnk98U2w0iyEW1CbG80_VoxrDTu7anOve47DgIOhqXwWi96MLM Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_abaf72f7fc7248a388dbfbd2b646dc56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2d7df9a6845440bbad5bd7c0a192171b Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 could not be found. Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e32be475-1191-40ba-a6d8-eec04d0c2cb9'} Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 could not be found. Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 could not be found. Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:17.953289 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 could not be found. Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Returning 404 to user: Instance e32be475-1191-40ba-a6d8-eec04d0c2cb9 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:17.958003 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2c3814c3-9fc0-42f0-8507-4ab2847f1632 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9" status: 404 len: 111 microversion: 2.1 time: 0.125396 Oct 16 01:11:17.965599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a9bf60dc-5eff-46f5-b075-2c2484049e6f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:17.967766 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1362/2549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:17 2022] GET /compute/v2.1/servers/e32be475-1191-40ba-a6d8-eec04d0c2cb9 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:11:18.021960 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a9bf60dc-5eff-46f5-b075-2c2484049e6f tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/de8f9fa1-2ab7-423b-899b-2571a5bf4d68" status: 204 len: 0 microversion: 2.1 time: 0.062022 Oct 16 01:11:18.022594 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1188/2550] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:11:17 2022] DELETE /compute/v2.1/os-server-groups/de8f9fa1-2ab7-423b-899b-2571a5bf4d68 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:11:18.032205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:18.033015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:18.040587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:18.045462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:18.046183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:18.049818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:18.050522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:18.051197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:18.116790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:11:18.294826 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45bd27e4-a264-4522-bff1-1cebbaffd584 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 204 len: 0 microversion: 2.1 time: 0.266590 Oct 16 01:11:18.304499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:18.305641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:18.312742 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1363/2551] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:18 2022] DELETE /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:18.328094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:18.332396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:18.332931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:18.334696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:18.335432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:18.335522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:18.335925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:18.336803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:18.347282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:18.350784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:18.352774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:18.355594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:18.356939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:18.359535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:18.696477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:18.712588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0fa7589e-637c-4643-aecd-593b7446f500 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1472 microversion: 2.1 time: 0.397931 Oct 16 01:11:18.714790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1364/2552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:18 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:18.723184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:18.728603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:18.748583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:18.751096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:18.752245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:18.753970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:18.754665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:18.755387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:19.234870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:19.248319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5621c44b-2bd9-4557-af66-3e4e375c401c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1314 microversion: 2.1 time: 0.947788 Oct 16 01:11:19.263545 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1189/2553] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:18 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:19.270322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:19.271309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:19.278612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:19.287979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:19.294811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:19.295760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:19.296495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:19.297069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:19.403998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:19.413083 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e5b8dea-51c1-4e36-810d-f4a79b3fa76e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 0.693687 Oct 16 01:11:19.432610 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1365/2554] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:18 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:19.531810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:19.572227 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b342b8f0-85fd-4cb6-95e1-362f4f48dafb tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1184 microversion: 2.1 time: 0.306890 Oct 16 01:11:19.574607 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1190/2555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:19 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1184 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:19.742456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:19.743154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:19.757444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:19.757947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:19.758384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:19.759161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:19.762013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:19.762681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:20.275340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:20.275960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:20.288917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:20.289874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:20.290809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:20.291984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:20.292629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:20.293512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:20.315264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:20.326885 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d32d00f4-d2cb-4fcd-9e70-da09e8db4726 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1472 microversion: 2.1 time: 0.590227 Oct 16 01:11:20.327505 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1366/2556] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:19 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1472 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:20.444298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:20.444929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:20.451054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:20.451546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:20.451987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:20.452688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:20.453161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:20.453582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:20.492214 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:21.248686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:21.258507 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d97790db-9ac2-4456-8a45-0155435bc251 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1501 microversion: 2.1 time: 0.988606 Oct 16 01:11:21.259550 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1191/2557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:20 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1501 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:21.264895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:21.265525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:21.267442 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:DELETE=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:21.272224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.272715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.273458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:21.273814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.275069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.275661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:21.435503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:21.444019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:21.451755 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-894698f8-9b94-4bd3-ae37-428ca6cc18c6 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1184 microversion: 2.1 time: 0.188262 Oct 16 01:11:21.470949 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1192/2558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:21 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1184 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:21.476160 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4387656c-da18-4f9b-aef4-03dcfcdbee18 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 1.035120 Oct 16 01:11:21.477805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-777a493f-42dc-44a3-9fa0-13b6e2f417a4 req-f95ae191-0128-4339-aec5-35488f111ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39cd63e-32b5-496f-aeb2-fc6855585aa5", "name": "network-vif-deleted", "tag": "69180027-9adb-46d9-ad22-857bbfe67cdb"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:21.482150 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1367/2559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:20 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:21.490848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-777a493f-42dc-44a3-9fa0-13b6e2f417a4 req-f95ae191-0128-4339-aec5-35488f111ade service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.491760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-777a493f-42dc-44a3-9fa0-13b6e2f417a4 req-f95ae191-0128-4339-aec5-35488f111ade service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.492514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-777a493f-42dc-44a3-9fa0-13b6e2f417a4 req-f95ae191-0128-4339-aec5-35488f111ade service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:21.507861 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-777a493f-42dc-44a3-9fa0-13b6e2f417a4 req-f95ae191-0128-4339-aec5-35488f111ade service nova] Creating event network-vif-deleted:69180027-9adb-46d9-ad22-857bbfe67cdb for instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 on n-h2-master-1 Oct 16 01:11:21.514137 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-777a493f-42dc-44a3-9fa0-13b6e2f417a4 req-f95ae191-0128-4339-aec5-35488f111ade service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041146 Oct 16 01:11:21.515247 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1193/2560] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:21.517423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67cea1f9-a9ff-4bc2-9f07-d3825bf64da0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:21.522805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:21.523737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:21.532202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.533054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.533802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:21.534765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.535680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.536593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:21.548633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cea1f9-a9ff-4bc2-9f07-d3825bf64da0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.553831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cea1f9-a9ff-4bc2-9f07-d3825bf64da0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.556890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cea1f9-a9ff-4bc2-9f07-d3825bf64da0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:21.596333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.597022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.597468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:21.598050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lazy-loading 'fault' on Instance uuid e39cd63e-32b5-496f-aeb2-fc6855585aa5 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:21.656512 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:21.681600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67cea1f9-a9ff-4bc2-9f07-d3825bf64da0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Going to try to stop instance {{(pid=120545) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:11:21.749500 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67cea1f9-a9ff-4bc2-9f07-d3825bf64da0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79/action" status: 202 len: 0 microversion: 2.1 time: 0.263737 Oct 16 01:11:21.756593 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:21.760338 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1368/2561] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:11:21 2022] POST /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:21.771746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:21.772901 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df948291-212b-4c79-a0df-00488018ff94 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1306 microversion: 2.1 time: 0.255791 Oct 16 01:11:21.773670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:21.774810 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1194/2562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:21 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:21.802798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.803694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.804346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:21.805346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:21.811415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:21.812421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:22.478632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:22.479924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:22.492355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:22.492858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:22.493297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:22.494029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:22.494509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:22.506581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:22.516910 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:22.564028 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=48 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:22.597611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:22.598307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:22.600397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:22.601116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lazy-loading 'fault' on Instance uuid aa2132a3-c6eb-4fe2-96ce-725f4efba607 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:22.806383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:22.824785 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fefb22a0-6e66-43d7-b2ab-a30cb1874749 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 1.058046 Oct 16 01:11:22.830111 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1369/2563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:21 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:22.837949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:22.840669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:22.850177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:22.856280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:22.857975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:22.859580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:22.861988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:22.862703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:22.863065 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c0801b66-9c89-4ab7-bcd5-da6119e89fde tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 200 len: 1143 microversion: 2.1 time: 0.389227 Oct 16 01:11:22.863651 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1195/2564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:22 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 1143 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:22.865370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:22.920779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:22.923203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:22.944744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:22.945251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:22.945759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:22.958511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:22.959027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:22.959637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:23.048783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:23.050106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:23.050735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:23.051393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lazy-loading 'fault' on Instance uuid e39cd63e-32b5-496f-aeb2-fc6855585aa5 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:23.242745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7df9a6845440bbad5bd7c0a192171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abaf72f7fc7248a388dbfbd2b646dc56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:23.251288 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d57f0f1-098f-4225-9753-7db04b3a7917 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 200 len: 1306 microversion: 2.1 time: 0.386531 Oct 16 01:11:23.254721 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1196/2565] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:22 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 1306 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:23.317516 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:23.326844 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4360b26e-7c12-4641-a273-d4acf69933d9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 0.495239 Oct 16 01:11:23.330948 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1370/2566] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:22 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:23.855650 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:23.857070 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:23.873740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:23.895763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:23.896375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:23.897256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:23.897593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:23.898088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:23.898497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:23.899852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: aa2132a3-c6eb-4fe2-96ce-725f4efba607] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:23.914889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:23.917172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:23.920616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:23.921590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:23.922231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:23.922826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:23.950108 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] HTTP exception thrown: Instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 could not be found. Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Request method failure captured: Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 HTTP/1.1 Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1h67J3MYX9GiKLyyJv-dQR7Rrq-zaOycwajGYCQ_cztWOjWcLK4JxyyiaU8ilNR8wDcwQMLiCmkdzFG9WQTnFv59ii-a5MGSuf89KGJpIboucpvXVVkYvTBpEzqFiOg3y2yEilLsR9YH-VUYOngosd9ZA7wKEYoePYsApB5lVd6-1w Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 05a68224ef104af2963c881faa8383de Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05a68224ef104af2963c881faa8383de", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05a68224ef104af2963c881faa8383de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05a68224ef104af2963c881faa8383de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05a68224ef104af2963c881faa8383de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 05a68224ef104af2963c881faa8383de Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-LiveMigrationTest-1301795125-project Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 3c33afd9ae144eb185203c30baa70351 Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-LiveMigrationTest-1301795125-project Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: exception: Instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 could not be found. Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'aa2132a3-c6eb-4fe2-96ce-725f4efba607'} Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 could not be found. Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 could not be found. Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:23.956572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:23.962557 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:23.962557 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:23.962557 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:23.962557 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:23.962557 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:23.962557 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 could not be found. Oct 16 01:11:23.962557 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:23.965967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Returning 404 to user: Instance aa2132a3-c6eb-4fe2-96ce-725f4efba607 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:23.967107 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92e988f7-b5a5-4cf8-8541-f4db8bb9f47e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607" status: 404 len: 111 microversion: 2.1 time: 0.078993 Oct 16 01:11:23.969895 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1371/2567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:23 2022] GET /compute/v2.1/servers/aa2132a3-c6eb-4fe2-96ce-725f4efba607 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:24.279790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:24.280718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] [instance: e39cd63e-32b5-496f-aeb2-fc6855585aa5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:24.300409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:24.306064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:24.306859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:24.308119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:24.317900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:24.318763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:24.368265 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] HTTP exception thrown: Instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 could not be found. Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Request method failure captured: Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 HTTP/1.1 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lhEyS1Hwn1n0leEshVjT0U2-CzwagXicsXvcbdRIayHOqWWeyxkr0_-kHE1cWex0RelbNvuEfmrUnq50geamnfcho4tNpNqAGt996veNcOXT2EXJNtM5gGUvIhiHnk98U2w0iyEW1CbG80_VoxrDTu7anOve47DgIOhqXwWi96MLM Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_abaf72f7fc7248a388dbfbd2b646dc56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/abaf72f7fc7248a388dbfbd2b646dc56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: abaf72f7fc7248a388dbfbd2b646dc56 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-112974721 Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2d7df9a6845440bbad5bd7c0a192171b Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersOnMultiNodesTest-112974721-project Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 could not be found. Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e39cd63e-32b5-496f-aeb2-fc6855585aa5'} Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 could not be found. Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 could not be found. Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:24.374571 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:24.379572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:24.379572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:24.379572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:24.379572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:24.379572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:24.379572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 could not be found. Oct 16 01:11:24.379572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:24.391627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] Returning 404 to user: Instance e39cd63e-32b5-496f-aeb2-fc6855585aa5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:24.399455 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d84f5563-a8cf-4732-9960-adeb18bd31a6 tempest-ServersOnMultiNodesTest-112974721 tempest-ServersOnMultiNodesTest-112974721-project] 10.222.0.39 "GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5" status: 404 len: 111 microversion: 2.1 time: 0.121339 Oct 16 01:11:24.405877 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1372/2568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:24 2022] GET /compute/v2.1/servers/e39cd63e-32b5-496f-aeb2-fc6855585aa5 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:11:24.422780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:24.423447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:24.440083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:24.447941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:24.451670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:24.453457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:24.456549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:24.460336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:24.626708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:24.637072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-afe74bb8-a7ba-43c3-97fd-f53369db6542 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.786398 Oct 16 01:11:24.637938 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1197/2569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:23 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:25.663094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:25.663734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:25.673717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:25.674207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:25.674639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:25.687767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:25.688519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:25.689118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:25.863856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:25.875996 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-063a2cb1-48d4-43fc-b0ca-66bd4ebab951 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 1.468738 Oct 16 01:11:25.879863 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1373/2570] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:24 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:26.361284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:26.371389 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6a1740e-2932-4c4e-8b0e-8d0c53d84e56 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.710520 Oct 16 01:11:26.373566 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1198/2571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:25 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:26.906400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:26.907617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:26.941641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:26.942340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:26.943071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:26.943942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:26.944545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:26.945116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:27.399042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:27.401490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:27.435202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:27.438426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:27.440743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:27.444539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:27.445765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:27.446366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:28.270431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:28.320948 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c42fdddd-a2d3-4b30-85d2-945357c9909a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.922941 Oct 16 01:11:28.323546 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1199/2572] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:27 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:28.330968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a39712db-ffcf-4f10-9b84-904f3ad8b018 req-00e213eb-7855-4362-80ac-7b3c399567d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96f9006-082a-45f2-bfef-5ba9d429bcf1", "name": "network-vif-plugged", "status": "completed", "tag": "86679e3b-c764-48b2-9567-9ea849250bc5"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:28.368107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a39712db-ffcf-4f10-9b84-904f3ad8b018 req-00e213eb-7855-4362-80ac-7b3c399567d1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:28.372364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a39712db-ffcf-4f10-9b84-904f3ad8b018 req-00e213eb-7855-4362-80ac-7b3c399567d1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:28.373304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a39712db-ffcf-4f10-9b84-904f3ad8b018 req-00e213eb-7855-4362-80ac-7b3c399567d1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:28.428856 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a39712db-ffcf-4f10-9b84-904f3ad8b018 req-00e213eb-7855-4362-80ac-7b3c399567d1 service nova] Creating event network-vif-plugged:86679e3b-c764-48b2-9567-9ea849250bc5 for instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 on n-h2-master-1 Oct 16 01:11:28.444180 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a39712db-ffcf-4f10-9b84-904f3ad8b018 req-00e213eb-7855-4362-80ac-7b3c399567d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115427 Oct 16 01:11:28.445206 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1200/2573] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:28.521408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:28.531762 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a960bb41-9df5-4332-b7f9-5384d4bc30d5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 1.629936 Oct 16 01:11:28.538797 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1374/2574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:26 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:29.350958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:29.351676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:29.372650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:29.373162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:29.373604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:29.374324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:29.377277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:29.377731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:29.558429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:29.559938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:29.576276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:29.577983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:29.579888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:29.580844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:29.582397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:29.583107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:30.316773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:30.326502 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cf8cf93d-40de-4790-99f4-56525282936b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.979524 Oct 16 01:11:30.327779 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1201/2575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:29 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:30.332852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f879cd18-356e-4b62-acb1-7709dcc69d02 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Calling method '.version_select at 0x7fd64d7b1790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:30.389406 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f879cd18-356e-4b62-acb1-7709dcc69d02 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a" status: 200 len: 636 microversion: 2.1 time: 0.060055 Oct 16 01:11:30.390672 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1202/2576] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:30 2022] GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a => generated 636 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:30.407561 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aaa26c83-93b7-4a6d-9209-eeac4b126953 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'update_all', calling method: .version_select at 0x7fd64d816670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:30.491365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-aaa26c83-93b7-4a6d-9209-eeac4b126953 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:30.508010 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-aaa26c83-93b7-4a6d-9209-eeac4b126953 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:30.525309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:30.537278 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78ec1f4e-ad38-4d15-b059-d26cedce3dde tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1329 microversion: 2.1 time: 0.983328 Oct 16 01:11:30.540833 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1375/2577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:29 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1329 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:31.131453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-519341492", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": "none"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:31.142400 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aaa26c83-93b7-4a6d-9209-eeac4b126953 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.739871 Oct 16 01:11:31.147249 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1203/2578] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:11:30 2022] PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 61 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:11:31.148337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:31.148845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:31.165467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:31.165981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:31.167193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:31.168053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:31.168518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:31.168951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:31.237387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:11:31.238087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:11:31.238726 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:11:31.239318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:11:31.240776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:11:31.244860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:11:31.269234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:31.269974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:31.270599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:31.275517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:31.278409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:31.279530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:31.304723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Getting quotas for project b8fc396554c84269805db99beff5e471. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:31.314620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Getting quotas for user cdbd559440454d2f82801ee6bbe280c0 and project b8fc396554c84269805db99beff5e471. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:31.334568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:11:31.339766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:11:31.415986 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-429bf6f7-87c7-415a-bf46-04298ebdf4e5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.754658 Oct 16 01:11:31.417311 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1376/2579] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:11:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 16 01:11:31.451880 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d660418e-9a1c-4fbe-a25d-45394aa7f335 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 204 len: 0 microversion: 2.1 time: 0.306813 Oct 16 01:11:31.454259 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1204/2580] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:31 2022] DELETE /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:31.470123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce3bd540-fd21-44d7-814b-e7c282e5cb53 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Calling method '.version_select at 0x7fd64d8164c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:31.554811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-84c92969-bd53-463c-86a9-ce0abd8a477a tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Action: 'create', calling method: .version_select at 0x7fd64e27a0d0>, body: {"keypair": {"name": "tempest-keypair-1153297181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTB80TatUG6e7BQJp13N+MA62s8AWNfSTlDqfQjR3rIv1d00hu6XiiJJz5adcei40fyp4BBfriHzfgKyQAp3yMEWezkdLFJbasyCQ0b7siKgqjG0T03Bd3owpez0iNpsQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:31.601949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-84c92969-bd53-463c-86a9-ce0abd8a477a tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:31.620737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-84c92969-bd53-463c-86a9-ce0abd8a477a tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for user e9f13f7cba4342aba47cd3e5f4b19e2a and project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:31.710047 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-84c92969-bd53-463c-86a9-ce0abd8a477a tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.291344 Oct 16 01:11:31.711051 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1377/2581] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:11:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:31.724104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:31.726057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:31.734254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:31.735024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:31.735626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:31.736532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:31.737154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:31.737747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:31.915973 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce3bd540-fd21-44d7-814b-e7c282e5cb53 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "DELETE /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.458658 Oct 16 01:11:31.916869 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1205/2582] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Oct 16 01:11:31 2022] DELETE /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata/os_version => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:31.923394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-07732041-7516-430a-adda-3c981b5fb8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:31.924409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-07732041-7516-430a-adda-3c981b5fb8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:32.056531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-07732041-7516-430a-adda-3c981b5fb8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:32.066251 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-07732041-7516-430a-adda-3c981b5fb8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:32.073269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-07732041-7516-430a-adda-3c981b5fb8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:32.088702 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-07732041-7516-430a-adda-3c981b5fb8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1452 microversion: 2.91 time: 0.170382 Oct 16 01:11:32.089572 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1206/2583] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:31 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:32.094352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:32.101979 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:32.114891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:32.123737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:32.124354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:32.125416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:32.125996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:32.126534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:32.222126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:32.231079 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f5c6132-4a46-442a-9b20-547a47c8350f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.511706 Oct 16 01:11:32.235557 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1378/2584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:31 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:32.250258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:32.251020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:32.266371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:32.267049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:32.267582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:32.268521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:32.269192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:32.269832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:32.558421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:32.568758 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bf9d1fd7-48f1-471f-a5d8-f9197174e599 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1667 microversion: 2.1 time: 0.477829 Oct 16 01:11:32.569332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1207/2585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:32 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1667 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:32.578485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5eafeb00-7c40-42dd-a14c-caf58ffa018a tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Calling method '.version_select at 0x7fd64dab13a0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:32.602317 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5eafeb00-7c40-42dd-a14c-caf58ffa018a tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1153297181" status: 200 len: 498 microversion: 2.1 time: 0.031924 Oct 16 01:11:32.603002 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1208/2586] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:11:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1153297181 => generated 498 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:32.616616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe4d5813-ee4a-4175-befe-35f35cca995c tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Calling method '.version_select at 0x7fd64d7de430>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:32.693486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fe4d5813-ee4a-4175-befe-35f35cca995c tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 37 microversion: 2.1 time: 0.088050 Oct 16 01:11:32.695151 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1209/2587] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:11:32 2022] GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 37 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:32.708747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a50a4c2a-8d38-4f58-bdde-0bdf226888cd tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Calling method '.version_select at 0x7fd64d7a4c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:32.754157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:32.755952 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a50a4c2a-8d38-4f58-bdde-0bdf226888cd tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153297181" status: 202 len: 0 microversion: 2.1 time: 0.056480 Oct 16 01:11:32.757495 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1210/2588] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:11:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153297181 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:32.771342 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6ffdaff0-bff5-46eb-ad77-185acf3a2c74 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1510 microversion: 2.1 time: 0.534410 Oct 16 01:11:32.775892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d6602aa0-af51-41ef-82a3-cd09368b5daa tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'update_all', calling method: .version_select at 0x7fd64daaa670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:32.792735 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1379/2589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:32 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:32.797636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42248851-4e7f-41ba-80a3-668f536cc2c7 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Action: 'create', calling method: .version_select at 0x7fd64e13c700>, body: {"keypair": {"name": "tempest-keypair-1766967570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaPLCSo+aA158Tc0IyeT85PZlKpdMPqFwxBXZQMCydKLJCpzcirr/8CV47QnCaAA5Vnar0Nqmp3N+3lq/M8meDM5iaaz8gBcqw1kdqyqYWlEXIg4SK1/ot88ukOTjrfwQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:32.852994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-42248851-4e7f-41ba-80a3-668f536cc2c7 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:32.865228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-42248851-4e7f-41ba-80a3-668f536cc2c7 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for user e9f13f7cba4342aba47cd3e5f4b19e2a and project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:32.866190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-d6602aa0-af51-41ef-82a3-cd09368b5daa tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:32.875402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-d6602aa0-af51-41ef-82a3-cd09368b5daa tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:32.933106 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42248851-4e7f-41ba-80a3-668f536cc2c7 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138369 Oct 16 01:11:32.933739 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1380/2590] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:11:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:32.945438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:32.946050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:32.953946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:32.954682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:32.955319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:32.956214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:32.956846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:32.957469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.284574 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d6602aa0-af51-41ef-82a3-cd09368b5daa tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.524707 Oct 16 01:11:33.288456 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1211/2591] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:11:32 2022] PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 61 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:33.302514 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02ef516b-cf9d-4dbf-9019-dd8126e98772 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Calling method '.version_select at 0x7fd6526ed310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:33.328912 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-02ef516b-cf9d-4dbf-9019-dd8126e98772 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766967570" status: 202 len: 0 microversion: 2.1 time: 0.038888 Oct 16 01:11:33.330267 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1212/2592] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:11:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766967570 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:33.339307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:33.340342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:33.345411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:33.351135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:33.351715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:33.352509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.353371 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65dc7153-dea0-447c-95cd-13f2692adac6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1510 microversion: 2.1 time: 0.412531 Oct 16 01:11:33.354533 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1381/2593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:32 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:33.367098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:33.367098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:33.367098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.391486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:33.392148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:33.394094 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:33.408009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:33.408509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:33.408981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.412591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:33.413093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:33.413514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.524554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:33.533603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:33.535303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:33.542600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32d73bad-c68a-48cb-8053-f08390cbf73a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1504 microversion: 2.91 time: 0.209309 Oct 16 01:11:33.543812 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1213/2594] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:33 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:33.560288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5279b0ad-4b8a-4c54-8fbc-d2a65f990088 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Calling method '.version_select at 0x7fd64d816af0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:33.625905 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5279b0ad-4b8a-4c54-8fbc-d2a65f990088 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.080682 Oct 16 01:11:33.626814 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1214/2595] 10.222.0.39 () {58 vars in 1290 bytes} [Sun Oct 16 01:11:33 2022] GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata/os_distro => generated 33 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:33.633258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4cead2a4-8e87-42d3-b2e4-85de29a685e5 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Action: 'create', calling method: .version_select at 0x7fd64d7a4430>, body: {"keypair": {"name": "tempest-keypair-514131406", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:33.681946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4cead2a4-8e87-42d3-b2e4-85de29a685e5 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:33.691696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4cead2a4-8e87-42d3-b2e4-85de29a685e5 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for user e9f13f7cba4342aba47cd3e5f4b19e2a and project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:33.730659 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4cead2a4-8e87-42d3-b2e4-85de29a685e5 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.102143 Oct 16 01:11:33.731656 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1215/2596] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:11:33 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:33.743528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:33.748386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:33.759204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:33.761144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:33.761951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.762949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:33.763593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:33.764627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.806689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:11:33.881292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:33.897823 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-912cec30-f38f-4e51-b824-bc12157d82be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.511298 Oct 16 01:11:33.898528 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1382/2597] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:33 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:33.904292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:33.904911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:33.928826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:33.929320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:33.929955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.930824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:33.931548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:33.932182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:33.937413 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9a9adbd-3d85-4334-9534-ed286b5bbc01 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 204 len: 0 microversion: 2.1 time: 0.203743 Oct 16 01:11:33.939327 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1216/2598] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:33 2022] DELETE /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:33.947330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab59e7e7-d9c8-4a31-a88d-c7b7a0ced1e0 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'update_all', calling method: .version_select at 0x7fd64daaaa60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:34.097616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ab59e7e7-d9c8-4a31-a88d-c7b7a0ced1e0 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:34.105704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ab59e7e7-d9c8-4a31-a88d-c7b7a0ced1e0 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:34.189693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:34.202267 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6fb138d-f44f-41bb-830c-5da84645cd3e tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1599 microversion: 2.1 time: 0.302572 Oct 16 01:11:34.206045 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1383/2599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:33 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1599 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:34.220192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c662e8e4-416d-4c3e-a1a0-647864c124f0 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Calling method '.version_select at 0x7fd64de1ca60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:34.258152 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c662e8e4-416d-4c3e-a1a0-647864c124f0 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514131406" status: 202 len: 0 microversion: 2.1 time: 0.049540 Oct 16 01:11:34.259261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1384/2600] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:11:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514131406 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:34.277787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:34.280319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:34.299699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:34.300472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:34.301131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:34.302833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:34.303520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:34.304118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:34.419220 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab59e7e7-d9c8-4a31-a88d-c7b7a0ced1e0 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.476944 Oct 16 01:11:34.419851 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1217/2601] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:11:33 2022] PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 61 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:34.430891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b58214d3-162a-44f4-b34a-357aeacaa99c tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Action: 'create', calling method: .version_select at 0x7fd6527479d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-705261756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5vD29lZePLuGKlxJ/WHkkiAhRkP279T5zOzhxs1ZH/FKmb6J0wlGsiNXRrHyc5sFjQePor2l+tqA6avmU0E7kJAIehH6WfCUHGB27Qk4VFmBy/qCq+kx6bF4bApozhbw=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:34.443158 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:34.488466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b58214d3-162a-44f4-b34a-357aeacaa99c tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:34.501203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b58214d3-162a-44f4-b34a-357aeacaa99c tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for user e9f13f7cba4342aba47cd3e5f4b19e2a and project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:34.569952 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b58214d3-162a-44f4-b34a-357aeacaa99c tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.143735 Oct 16 01:11:34.572011 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1218/2602] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:11:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:34.584289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2b2f4667-78dd-4b23-a6a3-8bda37896f84 req-b9d6bf32-7fa9-4140-b837-4ad6f340903e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfbc75a-8d3f-4561-b380-95d95f9c23fe", "name": "network-vif-deleted", "tag": "24e4f451-8cff-409b-8a75-99b4af5dbfd3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:34.605840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b2f4667-78dd-4b23-a6a3-8bda37896f84 req-b9d6bf32-7fa9-4140-b837-4ad6f340903e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:34.607651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b2f4667-78dd-4b23-a6a3-8bda37896f84 req-b9d6bf32-7fa9-4140-b837-4ad6f340903e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:34.608252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b2f4667-78dd-4b23-a6a3-8bda37896f84 req-b9d6bf32-7fa9-4140-b837-4ad6f340903e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:34.614990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:34.626328 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f61ff218-4c7d-40ad-81da-d028ddae3169 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1516 microversion: 2.1 time: 0.365150 Oct 16 01:11:34.627085 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1385/2603] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:34 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1516 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:34.632287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff1aaa21-8db7-4246-9b50-9f8849c54dc4 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Calling method '.version_select at 0x7fd64e387280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:34.650130 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2b2f4667-78dd-4b23-a6a3-8bda37896f84 req-b9d6bf32-7fa9-4140-b837-4ad6f340903e service nova] Creating event network-vif-deleted:24e4f451-8cff-409b-8a75-99b4af5dbfd3 for instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe on n-h2-master-1 Oct 16 01:11:34.671184 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2b2f4667-78dd-4b23-a6a3-8bda37896f84 req-b9d6bf32-7fa9-4140-b837-4ad6f340903e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096286 Oct 16 01:11:34.672454 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1219/2604] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:34.683218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:34.684185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:34.697160 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff1aaa21-8db7-4246-9b50-9f8849c54dc4 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.068617 Oct 16 01:11:34.698034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:34.698502 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1386/2605] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:11:34 2022] GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 61 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:34.705499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c08efd9e-17a5-4065-9a73-c1b5a02dbd24 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Action: 'create', calling method: .version_select at 0x7fd64de1c820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1561880900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4HmjdV6+hM+cYl/XERbttJrF8kj4VYNO51nfIb93uDphMfq4SWh8c7fEGzRg3C7szALZKoYXser+L1U35K1/XXjktXfKcEiSEbLW+RYuIsppzipaW4uPAXI8QITlV77A=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:34.710221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:34.715075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:34.716463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:34.717056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:34.717557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:34.743441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c08efd9e-17a5-4065-9a73-c1b5a02dbd24 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:34.750857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c08efd9e-17a5-4065-9a73-c1b5a02dbd24 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for user e9f13f7cba4342aba47cd3e5f4b19e2a and project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:34.785595 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c08efd9e-17a5-4065-9a73-c1b5a02dbd24 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.085692 Oct 16 01:11:34.786525 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1387/2606] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:11:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:34.799147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f157e266-d948-4a82-aa39-a64931415ac0 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'update_all', calling method: .version_select at 0x7fd64ddfd700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:34.817991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:34.834183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:34.839353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:34.859057 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c7c3a1f-2c63-4a2e-b16e-697367f90a21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1510 microversion: 2.91 time: 0.182434 Oct 16 01:11:34.859671 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1220/2607] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:34 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:34.900375 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-f157e266-d948-4a82-aa39-a64931415ac0 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:34.908059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-f157e266-d948-4a82-aa39-a64931415ac0 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:34.989502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b328b112-b047-4027-94ab-db872171826b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd64d816310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-773671553", "description": "tempest-description-1432091538"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:35.241260 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b328b112-b047-4027-94ab-db872171826b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.380118 Oct 16 01:11:35.241963 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1221/2608] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:11:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:35.256876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b3a6cfee-ca7d-4349-be89-8b8a5ae077eb tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Action: 'create', calling method: .version_select at 0x7fd64d816dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1158432611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRIjE3omUXr+Hupw3CfzGA9tKFqDRNjGwM36AsAihSJ0G6avAHu0lt2UhpvTmaxUKoQSNL1zRn3P1vt7B5DveUPi7vHacVkv3NLhUrIcUAJlIeToVFZHe6f2QGPMsOhBg=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:35.286035 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f157e266-d948-4a82-aa39-a64931415ac0 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.498108 Oct 16 01:11:35.286791 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1388/2609] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:11:34 2022] PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 61 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:35.303143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b3a6cfee-ca7d-4349-be89-8b8a5ae077eb tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:35.318170 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:35.322026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:35.324035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b3a6cfee-ca7d-4349-be89-8b8a5ae077eb tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Getting quotas for user e9f13f7cba4342aba47cd3e5f4b19e2a and project 54913c9d843e43c4b0d5b1c4a78a0e70. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:35.336128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:35.337918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:35.339397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:35.340308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:35.340987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:35.341639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:35.422095 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b3a6cfee-ca7d-4349-be89-8b8a5ae077eb tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.178335 Oct 16 01:11:35.422964 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1222/2610] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:11:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:35.437742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:35.438515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:35.456355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:35.458652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:35.460770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:35.463945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:35.469662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:35.472655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:35.607091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:35.615977 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba6c6eb3-d843-4eab-ba11-417e23f900ba tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.316875 Oct 16 01:11:35.630955 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1389/2611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:35 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:35.630955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f8e870f5-e697-4a97-9e09-b9e70c355b3b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd64e3535e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1031198694", "description": "tempest-description-1496806876"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:35.639537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:35.660320 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-383643c2-7454-45c3-800b-ed8a563ea412 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 200 len: 1319 microversion: 2.1 time: 0.230525 Oct 16 01:11:35.661910 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1223/2612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:35 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:35.669299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87d36879-13c2-4e30-ad93-d48e5568adcd tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'update_all', calling method: .version_select at 0x7fd64d7b1ca0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:35.769699 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-87d36879-13c2-4e30-ad93-d48e5568adcd tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:35.781355 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-87d36879-13c2-4e30-ad93-d48e5568adcd tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:35.844219 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f8e870f5-e697-4a97-9e09-b9e70c355b3b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.225253 Oct 16 01:11:35.845019 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1390/2613] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:11:35 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:35.870583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-94f24e0b-2c4f-4b42-a600-7f6a81846358 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Calling method '.version_select at 0x7fd64de1c5e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:35.891630 n-d-master-1 devstack@n-api.service[120545]: WARNING oslo_db.sqlalchemy.utils [None req-94f24e0b-2c4f-4b42-a600-7f6a81846358 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 16 01:11:35.971593 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-94f24e0b-2c4f-4b42-a600-7f6a81846358 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.125220 Oct 16 01:11:35.976742 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1391/2614] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:11:35 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:35.989295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:35.994123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:36.017867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:36.021270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:36.021975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:36.022954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:36.027986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:36.028751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:36.265499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:36.274452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1a1f0c0b-912a-48db-a4db-68ad364b9162 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 200 len: 1516 microversion: 2.1 time: 0.296419 Oct 16 01:11:36.276590 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1392/2615] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:35 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 1516 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:36.303513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:36.304403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:36.313159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:36.314050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:36.314684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:36.316027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:36.316696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:36.317337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:36.324921 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-87d36879-13c2-4e30-ad93-d48e5568adcd tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.661085 Oct 16 01:11:36.329378 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1224/2616] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:11:35 2022] PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 64 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:36.340385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4f948eda-96d3-46f6-b860-da530def0fc8 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Calling method '.version_select at 0x7fd64d7ce4c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:36.346776 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:36.373773 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4f948eda-96d3-46f6-b860-da530def0fc8 tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1158432611" status: 202 len: 0 microversion: 2.1 time: 0.042993 Oct 16 01:11:36.375139 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1225/2617] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Oct 16 01:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1158432611 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:36.386545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-326277526", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "78815c45-b439-4415-a27c-20b59792b91b"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:36.407277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:36.419564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:36.422253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:36.429054 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d0fb2cca-c927-4328-afaf-f49cb59b7bdf tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1531 microversion: 2.91 time: 0.131472 Oct 16 01:11:36.430340 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1393/2618] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:36 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1531 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:36.437142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55eb8fe6-4186-480c-863f-0efad290df06 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Calling method '.version_select at 0x7fd64e20c160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:36.502435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-55eb8fe6-4186-480c-863f-0efad290df06 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 64 microversion: 2.1 time: 0.070494 Oct 16 01:11:36.503712 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1394/2619] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:11:36 2022] GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 64 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:36.512434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f01e4e10-d2ee-428e-89c3-2467c73d625e tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Calling method '.version_select at 0x7fd64e387160>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:36.527148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] validate_networks() for [('78815c45-b439-4415-a27c-20b59792b91b', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:11:36.537114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f01e4e10-d2ee-428e-89c3-2467c73d625e tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1561880900" status: 202 len: 0 microversion: 2.1 time: 0.031886 Oct 16 01:11:36.538982 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1395/2620] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Oct 16 01:11:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1561880900 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:36.868008 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:36.869973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:36.892700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:36.893916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:36.894371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:36.895783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:36.896256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:36.896689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.119095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lazy-loading 'services' on Instance uuid 4405ee0b-a476-446d-a5b2-e5c6bf483b0e {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:37.156435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-667168b3-2980-464e-8437-8804e56b166e tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1936 microversion: 2.91 time: 0.615741 Oct 16 01:11:37.168097 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1396/2621] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:36 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1936 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:37.176012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57b4040a-96fb-415b-84e1-7cc04c487b97 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'update_all', calling method: .version_select at 0x7fd64e7e6c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:37.271782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-57b4040a-96fb-415b-84e1-7cc04c487b97 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:37.281384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-57b4040a-96fb-415b-84e1-7cc04c487b97 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:37.580296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:11:37.580858 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:11:37.581181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:11:37.581592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:11:37.582009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:11:37.598881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.600420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.601151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.602088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.602780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.604348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.616596 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:37.646449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Getting quotas for project 3986cde5f07a4eeead588c344187a0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:37.653492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Getting quotas for user 17f95d77e66946ce9ac525cc34c61d7c and project 3986cde5f07a4eeead588c344187a0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:37.668421 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-57b4040a-96fb-415b-84e1-7cc04c487b97 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.498488 Oct 16 01:11:37.673060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:11:37.675015 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1397/2622] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:11:37 2022] PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 61 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:37.677395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:11:37.680935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f28ae81-4cea-4ebf-988d-bbdd56d67f4a tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] Calling method '.version_select at 0x7fd64e387940>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:37.715774 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f28ae81-4cea-4ebf-988d-bbdd56d67f4a tempest-KeyPairsV2TestJSON-1581365002 tempest-KeyPairsV2TestJSON-1581365002-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-705261756" status: 202 len: 0 microversion: 2.1 time: 0.036740 Oct 16 01:11:37.717007 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1398/2623] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-705261756 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:37.725948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:37.727551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:37.740370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.741273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.742024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.742903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.743637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.747275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.771545 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-54b66fa2-bc02-43c5-93a5-1fb6d1aaf6c4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392600 Oct 16 01:11:37.772225 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1226/2624] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:11:37.785191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:37.785724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: ebfbc75a-8d3f-4561-b380-95d95f9c23fe] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:37.808411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.809009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.809449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.810244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.810693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.812266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.839919 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] HTTP exception thrown: Instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe could not be found. Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Request method failure captured: Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe HTTP/1.1 Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1h67J3MYX9GiKLyyJv-dQR7Rrq-zaOycwajGYCQ_cztWOjWcLK4JxyyiaU8ilNR8wDcwQMLiCmkdzFG9WQTnFv59ii-a5MGSuf89KGJpIboucpvXVVkYvTBpEzqFiOg3y2yEilLsR9YH-VUYOngosd9ZA7wKEYoePYsApB5lVd6-1w Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 05a68224ef104af2963c881faa8383de Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05a68224ef104af2963c881faa8383de", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05a68224ef104af2963c881faa8383de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05a68224ef104af2963c881faa8383de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05a68224ef104af2963c881faa8383de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 05a68224ef104af2963c881faa8383de Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-LiveMigrationTest-1301795125-project Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 3c33afd9ae144eb185203c30baa70351 Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-LiveMigrationTest-1301795125-project Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe could not be found. Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ebfbc75a-8d3f-4561-b380-95d95f9c23fe'} Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe could not be found. Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe could not be found. Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:37.841922 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe could not be found. Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Returning 404 to user: Instance ebfbc75a-8d3f-4561-b380-95d95f9c23fe could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d5b2b2cd-081d-43eb-b24e-642e857141d0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe" status: 404 len: 111 microversion: 2.1 time: 0.070166 Oct 16 01:11:37.846006 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1227/2625] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:37 2022] GET /compute/v2.1/servers/ebfbc75a-8d3f-4561-b380-95d95f9c23fe => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:37.851525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f06f75a0-a777-43db-a0c0-92e2634e590c req-7807f33a-4891-40b0-ab62-ae30a1b99ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96f9006-082a-45f2-bfef-5ba9d429bcf1", "name": "network-vif-deleted", "tag": "86679e3b-c764-48b2-9567-9ea849250bc5"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:37.880066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f06f75a0-a777-43db-a0c0-92e2634e590c req-7807f33a-4891-40b0-ab62-ae30a1b99ea0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.882427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f06f75a0-a777-43db-a0c0-92e2634e590c req-7807f33a-4891-40b0-ab62-ae30a1b99ea0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.884342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f06f75a0-a777-43db-a0c0-92e2634e590c req-7807f33a-4891-40b0-ab62-ae30a1b99ea0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.919351 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f06f75a0-a777-43db-a0c0-92e2634e590c req-7807f33a-4891-40b0-ab62-ae30a1b99ea0 service nova] Creating event network-vif-deleted:86679e3b-c764-48b2-9567-9ea849250bc5 for instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 on n-h2-master-1 Oct 16 01:11:37.929737 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f06f75a0-a777-43db-a0c0-92e2634e590c req-7807f33a-4891-40b0-ab62-ae30a1b99ea0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082105 Oct 16 01:11:37.933887 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1228/2626] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:37.966652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:37.970766 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:37.982372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.983422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.984060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:37.985359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:37.986165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:37.987345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:38.171323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lazy-loading 'services' on Instance uuid 4405ee0b-a476-446d-a5b2-e5c6bf483b0e {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:38.180958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:38.192923 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-14b2fde7-ac28-40ab-8eb1-8c4e6b031976 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.474595 Oct 16 01:11:38.194887 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1399/2627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:37 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:38.201385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:38.202285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:38.210539 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58b9e72c-ec18-439f-859c-5a665c58cb09 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1936 microversion: 2.91 time: 0.269245 Oct 16 01:11:38.211407 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1229/2628] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:37 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1936 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:38.217937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:38.218735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:38.219484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:38.220260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:38.220811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:38.221285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:38.227581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-010c19ab-1708-4dfc-ab3d-7e2b54489b0d tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'update', calling method: .version_select at 0x7fd64daaaca0>, body: {"meta": {"os_version": "alt"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:38.253096 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 HTTP/1.1 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: exception: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'a96f9006-082a-45f2-bfef-5ba9d429bcf1'} Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:38.260179 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:38.265502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:38.265502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:38.265502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:38.265502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:38.265502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:11:38.265502 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:38.265502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:38.265502 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f9f24b42-5b2f-4ed4-8aea-fa65efe5bf7e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 404 len: 111 microversion: 2.1 time: 0.067707 Oct 16 01:11:38.270744 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1400/2629] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:38 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:38.279165 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcf17a64-2ee4-46f1-a4b4-a39e6767bcd6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:38.281433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fcf17a64-2ee4-46f1-a4b4-a39e6767bcd6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:38.327081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-010c19ab-1708-4dfc-ab3d-7e2b54489b0d tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:38.343567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-010c19ab-1708-4dfc-ab3d-7e2b54489b0d tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:38.349969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fcf17a64-2ee4-46f1-a4b4-a39e6767bcd6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:38.358664 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcf17a64-2ee4-46f1-a4b4-a39e6767bcd6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1215 microversion: 2.1 time: 0.086655 Oct 16 01:11:38.359302 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1401/2630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:38 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:38.374379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-050f12ac-63dc-4457-ae9c-aeb9582221e0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '.version_select at 0x7fd64df5cdc0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:38.414559 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-050f12ac-63dc-4457-ae9c-aeb9582221e0 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021869812" status: 202 len: 0 microversion: 2.1 time: 0.052796 Oct 16 01:11:38.415516 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1402/2631] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:11:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021869812 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:38.442405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13d39222-66a0-426c-b5aa-66fda47ee7fb tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:38.450592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d39222-66a0-426c-b5aa-66fda47ee7fb tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:38.453409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d39222-66a0-426c-b5aa-66fda47ee7fb tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:38.453869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d39222-66a0-426c-b5aa-66fda47ee7fb tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:38.455693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d39222-66a0-426c-b5aa-66fda47ee7fb tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:38.457846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d39222-66a0-426c-b5aa-66fda47ee7fb tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:38.458457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d39222-66a0-426c-b5aa-66fda47ee7fb tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:38.534074 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13d39222-66a0-426c-b5aa-66fda47ee7fb tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.100218 Oct 16 01:11:38.544116 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1403/2632] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Oct 16 01:11:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:11:38.549568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83c3db34-0bae-415d-a44c-8fb0d7e198b5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '.version_select at 0x7fd64fe3c310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:38.577848 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83c3db34-0bae-415d-a44c-8fb0d7e198b5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-key-1396952414" status: 202 len: 0 microversion: 2.1 time: 0.031581 Oct 16 01:11:38.578990 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1404/2633] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Oct 16 01:11:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1396952414 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:11:38.613049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:38.613838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:38.627220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:38.630378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:38.630933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:38.632439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:38.632916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:38.633349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:38.705704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lazy-loading 'flavor' on Instance uuid 4405ee0b-a476-446d-a5b2-e5c6bf483b0e {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:11:38.776253 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-010c19ab-1708-4dfc-ab3d-7e2b54489b0d tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.562980 Oct 16 01:11:38.777744 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1230/2634] 10.222.0.39 () {60 vars in 1313 bytes} [Sun Oct 16 01:11:38 2022] PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata/os_version => generated 31 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:38.787762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1878264390", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e837775c-af35-4cb2-89ea-5a342e83cc6f"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:38.875956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] validate_networks() for [('e837775c-af35-4cb2-89ea-5a342e83cc6f', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:11:39.167668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13d71c8d-196a-46ad-8705-51d20522956e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "POST /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e/action" status: 202 len: 0 microversion: 2.91 time: 0.577828 Oct 16 01:11:39.168251 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1405/2635] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:11:38 2022] POST /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:39.188577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a9ec4bd0-efc7-45b8-9dfb-e112a7bde08e tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Calling method '.version_select at 0x7fd64e0e5700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:39.262284 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a9ec4bd0-efc7-45b8-9dfb-e112a7bde08e tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 58 microversion: 2.1 time: 0.088089 Oct 16 01:11:39.263654 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1406/2636] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:11:39 2022] GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 58 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:39.284898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:39.286466 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:39.297461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:39.298243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:39.298929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:39.300021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:39.301371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:39.302293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:39.791511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:39.800648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:39.803102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:39.818217 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c8f7a6a2-cd79-4735-9857-f92c51a43890 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.552948 Oct 16 01:11:39.819819 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1407/2637] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:39 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:39.826191 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:39.831338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:39.840906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:39.841776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:39.842613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:39.843605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:39.847936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:39.861512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.306901 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:11:40.307590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:11:40.307958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:11:40.308370 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:11:40.309352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:11:40.329872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.330202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.330948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.331709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.332302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.332732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.366344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:40.368823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:40.374410 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e2e572db-1bee-4667-ba5a-2cd91a8b767b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.553277 Oct 16 01:11:40.376729 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:40.377848 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1408/2638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:39 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:40.386614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e3d0a1b-6de7-4b73-816b-167af807b606 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'update_all', calling method: .version_select at 0x7fd64e0cb820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:40.409928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:11:40.412293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:11:40.501329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5e3d0a1b-6de7-4b73-816b-167af807b606 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:40.513496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5e3d0a1b-6de7-4b73-816b-167af807b606 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:40.581931 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-901c40b8-0765-4816-aaed-d2c5d9f76ea3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.798854 Oct 16 01:11:40.583019 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1231/2639] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:11:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:11:40.612189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:40.613950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:40.626607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.627973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.629764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.631405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.633880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.634579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.782329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:40.794515 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b767f64a-5f0a-43e4-845c-a769a5e7bf9d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1273 microversion: 2.1 time: 0.210044 Oct 16 01:11:40.795338 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1232/2640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:40 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:40.811049 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d919ff38-c201-4457-b008-61d956d7ac78 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:40.816446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d919ff38-c201-4457-b008-61d956d7ac78 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:40.940126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d919ff38-c201-4457-b008-61d956d7ac78 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:40.952814 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d919ff38-c201-4457-b008-61d956d7ac78 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1209 microversion: 2.1 time: 0.156148 Oct 16 01:11:40.956650 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1233/2641] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:40 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1209 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:40.975860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:40.976465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:40.987249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.988319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.988774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:40.990424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:40.992158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:40.992604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.028137 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e3d0a1b-6de7-4b73-816b-167af807b606 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 61 microversion: 2.1 time: 0.648983 Oct 16 01:11:41.028745 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1409/2642] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:11:40 2022] PUT /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 61 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:41.034273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:41.034885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:41.047940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:41.048446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:41.048873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.053908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:41.056288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:41.056792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.076182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:11:41.213865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:41.233075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:41.237946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:41.258818 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:41.264147 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3be33825-688d-4411-9200-3b57d9bf3a8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.233066 Oct 16 01:11:41.292857 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1410/2643] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:41 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:41.297693 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce4ed987-5fac-4141-9995-7cb071fdf1cf tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "DELETE /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 204 len: 0 microversion: 2.1 time: 0.339579 Oct 16 01:11:41.298554 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1234/2644] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:40 2022] DELETE /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:41.310855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-db677081-5aca-4c6c-ad10-e5f23dcbb216 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Action: 'create', calling method: .version_select at 0x7fd652825940>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:41.314295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:41.323203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:41.353080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:41.353612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:41.354788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.359524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:41.362512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:41.363396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.401241 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=5,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:41.433693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-db677081-5aca-4c6c-ad10-e5f23dcbb216 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:41.470181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-db677081-5aca-4c6c-ad10-e5f23dcbb216 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Getting quotas for user ac5b287a0e084b4d8e0480cd177e1eaa and project 61f3c40ffaff4643896b3dfbedada1a7. Resources: dict_keys(['metadata_items']) {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:41.707489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:41.724073 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-95e9d54a-fcdb-4ce3-9bb1-34e61e33fc52 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1485 microversion: 2.1 time: 0.415042 Oct 16 01:11:41.725053 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1235/2645] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:41 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1485 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:41.730073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:41.730683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:41.743095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:41.743595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:41.744973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.759085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:41.760603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:41.761420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.972489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:41.982031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d430e99-eaa8-40f4-abff-c3a207d143ee tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.255912 Oct 16 01:11:41.991373 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1236/2646] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:41 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:41.991373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:41.991373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:41.995667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:41.996390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:41.996924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:41.997739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:41.998296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:41.998839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.056715 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-db677081-5aca-4c6c-ad10-e5f23dcbb216 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "POST /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.771484 Oct 16 01:11:42.058570 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1411/2647] 10.222.0.39 () {60 vars in 1281 bytes} [Sun Oct 16 01:11:41 2022] POST /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 85 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:42.066896 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:42.068287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:42.081550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:42.082065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:42.085012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.087169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:42.088468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:42.088919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.180622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:42.195162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:42.195570 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a0dfce04-1b3a-4ff1-8ad1-3aeb00bf638f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1261 microversion: 2.1 time: 0.135425 Oct 16 01:11:42.204254 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1da7ae47-89bd-48e3-99e3-2624b96a8351 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.220193 Oct 16 01:11:42.204905 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1237/2648] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:41 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:42.206435 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1412/2649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:42 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:42.210425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b27a0fdd-8ca8-47d3-a57e-386404346b71 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] Calling method '.version_select at 0x7fd64d7b1550>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:42.268691 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b27a0fdd-8ca8-47d3-a57e-386404346b71 tempest-ImagesMetadataTestJSON-79352876 tempest-ImagesMetadataTestJSON-79352876-project] 10.222.0.39 "GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata" status: 200 len: 85 microversion: 2.1 time: 0.062559 Oct 16 01:11:42.269526 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1238/2650] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:11:42 2022] GET /compute/v2.1/images/d1bb4d89-26a6-4167-83d7-f583c4c24c4a/metadata => generated 85 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:11:42.301207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:42.302226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:42.310102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:42.310845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:42.311510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.312585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:42.313275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:42.313903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.417130 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:42.426468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:42.428443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:42.435034 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3ef75901-51e7-48b0-9112-a899f46f5039 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.138150 Oct 16 01:11:42.436226 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1413/2651] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:42 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:42.748327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:42.749114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:42.755785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:42.756475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:42.757068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.757966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:42.758387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:42.759456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:42.949048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:42.958534 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ed110cb-620a-4e90-bdc4-38007fee2543 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1485 microversion: 2.1 time: 0.214471 Oct 16 01:11:42.959406 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1239/2652] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:42 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1485 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:43.005038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:43.006494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:43.016835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.017640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.018535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.019778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.027641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.028422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.232754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:43.233517 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:43.240718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.243424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.244605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.250461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.250967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.251443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.289540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:43.302450 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4921b8a8-392e-488c-8e66-01bd96530234 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.300793 Oct 16 01:11:43.304191 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1414/2653] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:42 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:43.310369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:43.311325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:43.320639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.321426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.322194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.323899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.324518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.325114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.383818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:43.396544 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8cf42a4f-69f0-4ad5-9923-0fc2cdd04a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1267 microversion: 2.1 time: 0.166701 Oct 16 01:11:43.397651 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1240/2654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:43 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:43.466825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:43.467643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:43.475417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.476028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.476518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.477313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.477895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.478651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.553842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:43.566357 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1161ebae-73e4-48ed-b53e-cd65206eb71b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.260566 Oct 16 01:11:43.567097 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1415/2655] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:43 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:43.585488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:43.599249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:43.600978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:43.610566 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e5811bce-f1ec-46e5-918d-91024e4d933c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.148218 Oct 16 01:11:43.625229 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1241/2656] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:43 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:11:43.984447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:43.985407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:43.992567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.993448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.995249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:43.996372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:43.996937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:43.997756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.038932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a87af231-aeac-4d70-9bf0-162e5408eaf7 req-fc72cc52-b156-42e6-9302-c66a0e24f632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410ba63a-9ba1-4c3b-89fb-51e8f05ebec5", "name": "network-vif-deleted", "tag": "47665bb6-8bdf-48f8-941d-f051a5c2dfc5"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:44.060763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a87af231-aeac-4d70-9bf0-162e5408eaf7 req-fc72cc52-b156-42e6-9302-c66a0e24f632 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.061590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a87af231-aeac-4d70-9bf0-162e5408eaf7 req-fc72cc52-b156-42e6-9302-c66a0e24f632 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.062172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a87af231-aeac-4d70-9bf0-162e5408eaf7 req-fc72cc52-b156-42e6-9302-c66a0e24f632 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.077014 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a87af231-aeac-4d70-9bf0-162e5408eaf7 req-fc72cc52-b156-42e6-9302-c66a0e24f632 service nova] Creating event network-vif-deleted:47665bb6-8bdf-48f8-941d-f051a5c2dfc5 for instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 on n-h2-master-1 Oct 16 01:11:44.083274 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a87af231-aeac-4d70-9bf0-162e5408eaf7 req-fc72cc52-b156-42e6-9302-c66a0e24f632 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052844 Oct 16 01:11:44.084412 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1242/2657] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:44.163504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:44.178898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1da20c1-0cf0-469e-bebe-48bec0c325a5 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 200 len: 1443 microversion: 2.1 time: 0.196030 Oct 16 01:11:44.179553 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1416/2658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:43 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 1443 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:44.338521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:44.339139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:44.349044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.350398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.357013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.360072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.361661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.363644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.425429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:44.425964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:44.434299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.434786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.435416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.437080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.437709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.438420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.559898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:44.576451 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7493f6ec-9d80-42ce-ae1c-a791f6df5055 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1267 microversion: 2.1 time: 0.153468 Oct 16 01:11:44.578512 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1417/2659] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:44 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:44.599070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:44.599792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:44.610818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.611377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.613485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.615385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.616876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.617502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.679852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:44.690618 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5fc1a5b3-8883-4500-8903-c0896a08fa53 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.362035 Oct 16 01:11:44.699348 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1243/2660] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:44 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:44.708041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:44.709155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:44.731860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.732409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.732863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.733580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:44.737888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:44.738398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:44.874643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:44.878697 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:44.888728 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be98d027-3992-446f-97d3-84da85c86752 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.295822 Oct 16 01:11:44.889719 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1418/2661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:44 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:44.922125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:44.933353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:44.938007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:44.957025 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64058ee0-9f31-4cd4-95bc-bb620c8d4264 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.253143 Oct 16 01:11:44.957631 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1244/2662] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:44 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:45.212802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.214431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:45.228927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d9f82f1-2e18-4922-84c8-2e9c42e08b3e tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Calling method '.version_select at 0x7fd64e0e50d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.236859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.237491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.237859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.238949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.239674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.240173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.257884 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] HTTP exception thrown: Instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 could not be found. Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Request method failure captured: Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 HTTP/1.1 Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1h67J3MYX9GiKLyyJv-dQR7Rrq-zaOycwajGYCQ_cztWOjWcLK4JxyyiaU8ilNR8wDcwQMLiCmkdzFG9WQTnFv59ii-a5MGSuf89KGJpIboucpvXVVkYvTBpEzqFiOg3y2yEilLsR9YH-VUYOngosd9ZA7wKEYoePYsApB5lVd6-1w Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 05a68224ef104af2963c881faa8383de Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05a68224ef104af2963c881faa8383de", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05a68224ef104af2963c881faa8383de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05a68224ef104af2963c881faa8383de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05a68224ef104af2963c881faa8383de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 05a68224ef104af2963c881faa8383de Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-LiveMigrationTest-1301795125-project Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 3c33afd9ae144eb185203c30baa70351 Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-LiveMigrationTest-1301795125-project Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 could not be found. Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '410ba63a-9ba1-4c3b-89fb-51e8f05ebec5'} Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 could not be found. Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 could not be found. Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.260792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 could not be found. Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Returning 404 to user: Instance 410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e035e1b8-4940-41d4-b4d0-8578f5e94963 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5" status: 404 len: 111 microversion: 2.1 time: 0.057393 Oct 16 01:11:45.268433 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1245/2663] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:45 2022] GET /compute/v2.1/servers/410ba63a-9ba1-4c3b-89fb-51e8f05ebec5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:45.272624 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1d9f82f1-2e18-4922-84c8-2e9c42e08b3e tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] HTTP exception thrown: Image not found. Oct 16 01:11:45.273231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.273730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:45.280622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.281321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.281936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.283048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.283963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.284547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d9f82f1-2e18-4922-84c8-2e9c42e08b3e tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Request method failure captured: Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/images/1cc7e133-cc60-4f01-ac1c-b160369a0c0e/metadata/os_distro HTTP/1.1 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pQ-8v-Qji-jw6mdY9mgVhxcwW0Plx9vMhzn8kmtSSuSOVs9HaYO4824MufqxqiEhsFIrbs0b4Uh3d75xuggtzl8C1-3Mg33drEFW5kEwOX51uayltcKHLCCKc7NOTCCkrOVidTA_LYRZy_F2AdFte5tE1mFlv6iZNEHPx6BMXGbms Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02b9058861b64d68b7c87ed1b1516a25", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a112d6d4601d4bd4a3ffe3a65cd59fe9 Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: action_args: {'image_id': '1cc7e133-cc60-4f01-ac1c-b160369a0c0e', 'id': 'os_distro'} Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1cc7e133-cc60-4f01-ac1c-b160369a0c0e Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:11:45.290693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1cc7e133-cc60-4f01-ac1c-b160369a0c0e could not be found. Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.295082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d9f82f1-2e18-4922-84c8-2e9c42e08b3e tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:45.304059 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d9f82f1-2e18-4922-84c8-2e9c42e08b3e tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] 10.222.0.39 "DELETE /compute/v2.1/images/1cc7e133-cc60-4f01-ac1c-b160369a0c0e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.225508 Oct 16 01:11:45.304892 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1419/2664] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:11:45 2022] DELETE /compute/v2.1/images/1cc7e133-cc60-4f01-ac1c-b160369a0c0e/metadata/os_distro => generated 62 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:11:45.332819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:11:45.355762 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8178a101-05b1-420f-8345-0c59c9ffe875 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Calling method '.version_select at 0x7fd64e20c9d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.381293 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:45.388998 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-8178a101-05b1-420f-8345-0c59c9ffe875 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] HTTP exception thrown: Image not found. Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8178a101-05b1-420f-8345-0c59c9ffe875 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Request method failure captured: Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/images/776635ff-1546-4c7c-8d71-7be15af81d79/metadata/os_version HTTP/1.1 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pQ-8v-Qji-jw6mdY9mgVhxcwW0Plx9vMhzn8kmtSSuSOVs9HaYO4824MufqxqiEhsFIrbs0b4Uh3d75xuggtzl8C1-3Mg33drEFW5kEwOX51uayltcKHLCCKc7NOTCCkrOVidTA_LYRZy_F2AdFte5tE1mFlv6iZNEHPx6BMXGbms Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02b9058861b64d68b7c87ed1b1516a25", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a112d6d4601d4bd4a3ffe3a65cd59fe9 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: action_args: {'image_id': '776635ff-1546-4c7c-8d71-7be15af81d79', 'id': 'os_version'} Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 776635ff-1546-4c7c-8d71-7be15af81d79 Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:11:45.391742 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 776635ff-1546-4c7c-8d71-7be15af81d79 could not be found. Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8178a101-05b1-420f-8345-0c59c9ffe875 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:45.395941 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8178a101-05b1-420f-8345-0c59c9ffe875 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] 10.222.0.39 "GET /compute/v2.1/images/776635ff-1546-4c7c-8d71-7be15af81d79/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.077821 Oct 16 01:11:45.403895 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1420/2665] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:11:45 2022] GET /compute/v2.1/images/776635ff-1546-4c7c-8d71-7be15af81d79/metadata/os_version => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:11:45.409060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d372e02-e603-4485-979e-25fc5306316d tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Calling method '.version_select at 0x7fd64e353f70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.437948 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9d372e02-e603-4485-979e-25fc5306316d tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] HTTP exception thrown: Image not found. Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d372e02-e603-4485-979e-25fc5306316d tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Request method failure captured: Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/images/a86174a1-9b0e-4ae5-ae2f-2a20a8c12be7/metadata HTTP/1.1 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pQ-8v-Qji-jw6mdY9mgVhxcwW0Plx9vMhzn8kmtSSuSOVs9HaYO4824MufqxqiEhsFIrbs0b4Uh3d75xuggtzl8C1-3Mg33drEFW5kEwOX51uayltcKHLCCKc7NOTCCkrOVidTA_LYRZy_F2AdFte5tE1mFlv6iZNEHPx6BMXGbms Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02b9058861b64d68b7c87ed1b1516a25", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a112d6d4601d4bd4a3ffe3a65cd59fe9 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: action_args: {'image_id': 'a86174a1-9b0e-4ae5-ae2f-2a20a8c12be7'} Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a86174a1-9b0e-4ae5-ae2f-2a20a8c12be7 Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:11:45.449708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a86174a1-9b0e-4ae5-ae2f-2a20a8c12be7 could not be found. Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.454780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d372e02-e603-4485-979e-25fc5306316d tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:45.470772 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fb7fae0-97db-4862-b490-e2484d16a66d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 204 len: 0 microversion: 2.1 time: 0.185015 Oct 16 01:11:45.470772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1246/2666] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:11:45 2022] DELETE /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:11:45.471896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d372e02-e603-4485-979e-25fc5306316d tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] 10.222.0.39 "GET /compute/v2.1/images/a86174a1-9b0e-4ae5-ae2f-2a20a8c12be7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048186 Oct 16 01:11:45.471896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1421/2667] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Oct 16 01:11:45 2022] GET /compute/v2.1/images/a86174a1-9b0e-4ae5-ae2f-2a20a8c12be7/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:11:45.475280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.475488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1c61089-8e75-444c-b31d-30cfd72de3aa tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Action: 'update_all', calling method: .version_select at 0x7fd64ddfd670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:45.475700 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:45.484228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.484632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.485060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.485910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.486517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.487039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.501614 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b1c61089-8e75-444c-b31d-30cfd72de3aa tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] HTTP exception thrown: Image not found. Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1c61089-8e75-444c-b31d-30cfd72de3aa tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Request method failure captured: Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/images/fdec3553-a1c1-493f-9457-337b8b5b5528/metadata HTTP/1.1 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 57 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pQ-8v-Qji-jw6mdY9mgVhxcwW0Plx9vMhzn8kmtSSuSOVs9HaYO4824MufqxqiEhsFIrbs0b4Uh3d75xuggtzl8C1-3Mg33drEFW5kEwOX51uayltcKHLCCKc7NOTCCkrOVidTA_LYRZy_F2AdFte5tE1mFlv6iZNEHPx6BMXGbms Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02b9058861b64d68b7c87ed1b1516a25", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a112d6d4601d4bd4a3ffe3a65cd59fe9 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: action_args: {'image_id': 'fdec3553-a1c1-493f-9457-337b8b5b5528', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fdec3553-a1c1-493f-9457-337b8b5b5528 Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:11:45.503984 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fdec3553-a1c1-493f-9457-337b8b5b5528 could not be found. Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:11:45.507667 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.514783 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1c61089-8e75-444c-b31d-30cfd72de3aa tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:45.514783 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1c61089-8e75-444c-b31d-30cfd72de3aa tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] 10.222.0.39 "PUT /compute/v2.1/images/fdec3553-a1c1-493f-9457-337b8b5b5528/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043534 Oct 16 01:11:45.514783 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1422/2668] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:11:45 2022] PUT /compute/v2.1/images/fdec3553-a1c1-493f-9457-337b8b5b5528/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:11:45.523953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91425e03-3b28-42cb-8c65-93db5328cb89 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Action: 'update', calling method: .version_select at 0x7fd6528309d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:45.566903 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-91425e03-3b28-42cb-8c65-93db5328cb89 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] HTTP exception thrown: Image not found. Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91425e03-3b28-42cb-8c65-93db5328cb89 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Request method failure captured: Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/images/68913e16-601c-4085-9e60-102fbe814f1f/metadata/os_distro HTTP/1.1 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 30 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pQ-8v-Qji-jw6mdY9mgVhxcwW0Plx9vMhzn8kmtSSuSOVs9HaYO4824MufqxqiEhsFIrbs0b4Uh3d75xuggtzl8C1-3Mg33drEFW5kEwOX51uayltcKHLCCKc7NOTCCkrOVidTA_LYRZy_F2AdFte5tE1mFlv6iZNEHPx6BMXGbms Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02b9058861b64d68b7c87ed1b1516a25", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a112d6d4601d4bd4a3ffe3a65cd59fe9 Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: {"meta": {"os_distro": "alt"}} Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: action_args: {'image_id': '68913e16-601c-4085-9e60-102fbe814f1f', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 68913e16-601c-4085-9e60-102fbe814f1f Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:11:45.575453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 68913e16-601c-4085-9e60-102fbe814f1f could not be found. Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91425e03-3b28-42cb-8c65-93db5328cb89 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91425e03-3b28-42cb-8c65-93db5328cb89 tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] 10.222.0.39 "PUT /compute/v2.1/images/68913e16-601c-4085-9e60-102fbe814f1f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.057229 Oct 16 01:11:45.581447 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1423/2669] 10.222.0.39 () {60 vars in 1310 bytes} [Sun Oct 16 01:11:45 2022] PUT /compute/v2.1/images/68913e16-601c-4085-9e60-102fbe814f1f/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:11:45.594533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-864b2508-8742-4a64-8083-2c27f9c5bedd tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Action: 'create', calling method: .version_select at 0x7fd652830af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:45.626235 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-864b2508-8742-4a64-8083-2c27f9c5bedd tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] HTTP exception thrown: Image not found. Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-864b2508-8742-4a64-8083-2c27f9c5bedd tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Request method failure captured: Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/images/c12bfde0-4d5d-46d1-ae6d-a0fe64c6002a/metadata HTTP/1.1 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 57 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pQ-8v-Qji-jw6mdY9mgVhxcwW0Plx9vMhzn8kmtSSuSOVs9HaYO4824MufqxqiEhsFIrbs0b4Uh3d75xuggtzl8C1-3Mg33drEFW5kEwOX51uayltcKHLCCKc7NOTCCkrOVidTA_LYRZy_F2AdFte5tE1mFlv6iZNEHPx6BMXGbms Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_02b9058861b64d68b7c87ed1b1516a25", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/02b9058861b64d68b7c87ed1b1516a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 02b9058861b64d68b7c87ed1b1516a25 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a112d6d4601d4bd4a3ffe3a65cd59fe9 Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1151900422-project Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: action_args: {'image_id': 'c12bfde0-4d5d-46d1-ae6d-a0fe64c6002a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c12bfde0-4d5d-46d1-ae6d-a0fe64c6002a Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:11:45.630720 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c12bfde0-4d5d-46d1-ae6d-a0fe64c6002a could not be found. Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-864b2508-8742-4a64-8083-2c27f9c5bedd tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:45.634501 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-864b2508-8742-4a64-8083-2c27f9c5bedd tempest-ImagesMetadataNegativeTestJSON-1151900422 tempest-ImagesMetadataNegativeTestJSON-1151900422-project] 10.222.0.39 "POST /compute/v2.1/images/c12bfde0-4d5d-46d1-ae6d-a0fe64c6002a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049613 Oct 16 01:11:45.637694 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1424/2670] 10.222.0.39 () {60 vars in 1281 bytes} [Sun Oct 16 01:11:45 2022] POST /compute/v2.1/images/c12bfde0-4d5d-46d1-ae6d-a0fe64c6002a/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:11:45.644290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.645173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:45.655991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.657230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.659846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.660795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.662754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.689996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.735978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:45.747466 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74dd7a89-dcaa-4d9b-bec0-5888fe82b024 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1501 microversion: 2.1 time: 0.282670 Oct 16 01:11:45.755818 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1247/2671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:45 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:45.793090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.794331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:45.798812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:45.822540 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a20fdea0-c300-4472-9a04-1b0f6c658991 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1267 microversion: 2.1 time: 0.183449 Oct 16 01:11:45.826707 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1425/2672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:45 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:45.838093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.839124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.841098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.844208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.845919 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.846571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.913288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:45.914288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:45.926032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.928292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.928808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:45.929561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:45.931840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:45.932310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:46.296909 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:46.307513 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-75d01bd0-049c-4699-81fe-0e7f2f82a74d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1511 microversion: 2.1 time: 0.543071 Oct 16 01:11:46.321199 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1248/2673] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:45 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:46.332304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:46.332923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:46.340079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.341395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.342000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:46.342896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.343523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.344100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:46.365899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:46.389168 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60211970-d941-4f5e-9ed4-471f127c209f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.478669 Oct 16 01:11:46.395321 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1426/2674] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:45 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:46.466571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:46.476334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:46.477922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:46.486344 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-669045d1-2efe-457b-89d9-4e0f7ef78bfb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.158638 Oct 16 01:11:46.487311 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1249/2675] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:46 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:46.774667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:46.776054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:46.777728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-871b1771-977e-44d4-887e-d85b2ffd9e61 req-b7c98909-194d-4d6f-91d9-6304eee6ac8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f7388b-c77c-4971-8df5-f5bb064c65ed", "tag": "40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:46.790512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.791878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.793498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:46.795114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.797191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.798004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:46.809636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-871b1771-977e-44d4-887e-d85b2ffd9e61 req-b7c98909-194d-4d6f-91d9-6304eee6ac8e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.810119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-871b1771-977e-44d4-887e-d85b2ffd9e61 req-b7c98909-194d-4d6f-91d9-6304eee6ac8e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.810549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-871b1771-977e-44d4-887e-d85b2ffd9e61 req-b7c98909-194d-4d6f-91d9-6304eee6ac8e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:46.841520 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-871b1771-977e-44d4-887e-d85b2ffd9e61 req-b7c98909-194d-4d6f-91d9-6304eee6ac8e service nova] Creating event network-changed:40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d for instance 35f7388b-c77c-4971-8df5-f5bb064c65ed on n-h2-master-1 Oct 16 01:11:46.851754 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-871b1771-977e-44d4-887e-d85b2ffd9e61 req-b7c98909-194d-4d6f-91d9-6304eee6ac8e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077275 Oct 16 01:11:46.853533 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1250/2676] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:11:46.861583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:46.863646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:46.876682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.877505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.878182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:46.880244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:46.881076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:46.881864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.296828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:47.315090 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ee080946-4af4-40f6-b461-a0bdda3b3c60 tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1501 microversion: 2.1 time: 0.540247 Oct 16 01:11:47.317380 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1427/2677] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:46 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1501 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:47.330584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:47.356697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f4d6f8fa-7fd2-4122-984d-39a1fee9cc82 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 0.500605 Oct 16 01:11:47.358389 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1251/2678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:46 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:47.361264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:47.362196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:47.373337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:47.373846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:47.374277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.375019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:47.376573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:47.379768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.422193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:47.423315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:47.430420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:47.431212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:47.432509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.433446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:47.434163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:47.434861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.812634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:47.821487 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e23eea89-541b-4b79-b5ca-982ff689fa35 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1488 microversion: 2.1 time: 0.472975 Oct 16 01:11:47.843909 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1428/2679] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:47 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1488 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:47.849443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:47.850054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:47.871378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:47.871917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:47.872367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.873098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:47.873557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:47.873978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.904339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:47.912266 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b806e5e-3b7e-40ae-bfd3-b56aae42e084 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.494448 Oct 16 01:11:47.936203 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1252/2680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:47 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:47.957695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:47.960153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:47.967461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:47.969560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:47.969560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:47.969560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:47.970197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:47.970794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.056396 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8253e9af-f954-4ac0-a15e-0d8c9542f55c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 200 len: 132 microversion: 2.1 time: 0.118497 Oct 16 01:11:48.060418 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1253/2681] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:11:47 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 132 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:48.071177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:48.072142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:48.090158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.090945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.091545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.094178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.094652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.099021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.108159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:48.131610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:48.139698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:48.152008 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9edd23b2-1dd0-46fd-bedb-568a0cbf2395 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.306773 Oct 16 01:11:48.152962 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1429/2682] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:47 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:48.343220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:48.343779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:48.363981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.366020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.367028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.371893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.373026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.373783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.423800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:48.448375 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-738ad42d-6d1b-4e47-b862-8725f6994e80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.369887 Oct 16 01:11:48.448375 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1254/2683] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:48 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:48.448375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:48.448375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:48.475624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.476438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.482387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.483702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.484553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.486377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.489436 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:48.760922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:48.780918 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7bcd6674-bf4b-40ff-9082-47e5ec1cdc5d tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1501 microversion: 2.1 time: 0.441530 Oct 16 01:11:48.801054 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1430/2684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:48 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1501 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:48.850957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:48.862994 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a539cb9a-5782-4774-99e2-00ebfa156e53 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 0.425019 Oct 16 01:11:48.863781 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1255/2685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:48 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:48.903333 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:48.904648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:48.922148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.925017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.925810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:48.927566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:48.928630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:48.929701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.025881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2a0dd2e-b181-4962-a924-16c0e61da79d tempest-ListImagesTestJSON-411157947 tempest-ListImagesTestJSON-411157947-project] Calling method '.version_select at 0x7fd64e20ce50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:49.151133 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2a0dd2e-b181-4962-a924-16c0e61da79d tempest-ListImagesTestJSON-411157947 tempest-ListImagesTestJSON-411157947-project] 10.222.0.39 "GET /compute/v2.1/images/a103d6a4-5636-40e5-8e77-0179ae547423" status: 200 len: 784 microversion: 2.1 time: 0.350174 Oct 16 01:11:49.152083 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1431/2686] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:11:48 2022] GET /compute/v2.1/images/a103d6a4-5636-40e5-8e77-0179ae547423 => generated 784 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:49.157932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-7576fe70-776a-42af-87aa-d40400518f09 req-67073fe4-440b-4add-9130-6cc0ce358d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae19d1c-0d21-4eb0-8323-93679f2c60c8", "name": "network-vif-deleted", "tag": "a63778d8-206e-4f12-97a1-d377df5ddbe8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:49.173339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7576fe70-776a-42af-87aa-d40400518f09 req-67073fe4-440b-4add-9130-6cc0ce358d5d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.174170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7576fe70-776a-42af-87aa-d40400518f09 req-67073fe4-440b-4add-9130-6cc0ce358d5d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.175069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7576fe70-776a-42af-87aa-d40400518f09 req-67073fe4-440b-4add-9130-6cc0ce358d5d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.189112 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-7576fe70-776a-42af-87aa-d40400518f09 req-67073fe4-440b-4add-9130-6cc0ce358d5d service nova] Creating event network-vif-deleted:a63778d8-206e-4f12-97a1-d377df5ddbe8 for instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 on n-h2-master-1 Oct 16 01:11:49.194649 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-7576fe70-776a-42af-87aa-d40400518f09 req-67073fe4-440b-4add-9130-6cc0ce358d5d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041044 Oct 16 01:11:49.195906 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1432/2687] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:49.205528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:49.206527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:49.215251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.216132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.216888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.218193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.218874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.219721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.317009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:49.326104 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa7ca8c2-e51c-4ca6-9c35-e12d92aab073 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.432160 Oct 16 01:11:49.326711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1256/2688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:48 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:49.339128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7ffcd926-3390-4bfd-9599-dfc5883f68a7 tempest-ListImagesTestJSON-411157947 tempest-ListImagesTestJSON-411157947-project] Calling method '.version_select at 0x7fd6526ed310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:49.408998 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7ffcd926-3390-4bfd-9599-dfc5883f68a7 tempest-ListImagesTestJSON-411157947 tempest-ListImagesTestJSON-411157947-project] 10.222.0.39 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.081177 Oct 16 01:11:49.409810 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1257/2689] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Oct 16 01:11:49 2022] GET /compute/v2.1/images => generated 445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:49.414756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:49.430602 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:49.440460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.441208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.442452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.443432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.444085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.445034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.491808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:49.505309 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d064529-9c9d-49cd-ba62-502799f0a37c tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.306994 Oct 16 01:11:49.506213 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1433/2690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:49 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:49.511949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:49.512557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:49.535306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.536242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.536705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.537427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.537908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.538358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.670372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:49.685809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:49.692065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:49.707749 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b924bc43-97e5-4bc2-83e6-1366ecb22fd1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.296560 Oct 16 01:11:49.711748 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1258/2691] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:49 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:49.719845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d6ea6ff-d655-4e4a-b9e9-920e36cd753e tempest-ListImagesTestJSON-411157947 tempest-ListImagesTestJSON-411157947-project] Calling method '.version_select at 0x7fd64d723040>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:49.841610 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d6ea6ff-d655-4e4a-b9e9-920e36cd753e tempest-ListImagesTestJSON-411157947 tempest-ListImagesTestJSON-411157947-project] 10.222.0.39 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.128058 Oct 16 01:11:49.852477 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1259/2692] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:11:49 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:49.852477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:49.852477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:49.856492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.857216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.857956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:49.858848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:49.859451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:49.860128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.296348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c33afd9ae144eb185203c30baa70351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05a68224ef104af2963c881faa8383de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:50.308904 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6182090d-3a7d-493f-ba53-e716be87503f tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 200 len: 1296 microversion: 2.1 time: 0.464951 Oct 16 01:11:50.330185 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1260/2693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:49 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 1296 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:50.336659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:50.339983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:50.346665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:50.347439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:50.348048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.360558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:50.362787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:50.363461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.364648 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:50.452209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:50.463692 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fabf0462-c644-4a8f-8c0d-9e29d8fbab57 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.956341 Oct 16 01:11:50.464802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1434/2694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:49 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:50.500454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:50.501975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:50.512792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:50.513687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:50.514408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.515370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:50.516061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:50.516883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.895882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:50.907390 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f4e80cd5-5045-4413-a7cd-23fcc0b6132d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 0.575395 Oct 16 01:11:50.911016 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1261/2695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:50 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:50.927942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:50.928802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:50.944970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:50.945811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:50.946486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.948005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:50.948707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:50.949987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:50.950677 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=48 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:51.158095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:51.194252 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2418b76d-2dae-4618-9644-625ceb65f19e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.699795 Oct 16 01:11:51.207215 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1435/2696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:50 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:51.213615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:51.215741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:51.238485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.239083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.244514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:51.247000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.250891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.252072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:51.354992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:51.367186 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4dd60e07-d962-46e5-9394-280a40950af4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.453330 Oct 16 01:11:51.371242 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1262/2697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:50 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:51.383429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-890a39df-219c-4c1c-b7f4-2f112514595d req-62d6a512-15ed-4eac-adee-c802e4b1ddb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cd5566-b29c-4a2b-8b91-26dd91bf207e", "tag": "5d3e3e8e-9926-4aba-88c1-f362cb41d97c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:51.417516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-890a39df-219c-4c1c-b7f4-2f112514595d req-62d6a512-15ed-4eac-adee-c802e4b1ddb3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.418384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-890a39df-219c-4c1c-b7f4-2f112514595d req-62d6a512-15ed-4eac-adee-c802e4b1ddb3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.419097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-890a39df-219c-4c1c-b7f4-2f112514595d req-62d6a512-15ed-4eac-adee-c802e4b1ddb3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:51.451980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:51.459265 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-890a39df-219c-4c1c-b7f4-2f112514595d req-62d6a512-15ed-4eac-adee-c802e4b1ddb3 service nova] Creating event network-changed:5d3e3e8e-9926-4aba-88c1-f362cb41d97c for instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e on n-h2-master-1 Oct 16 01:11:51.461100 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-890a39df-219c-4c1c-b7f4-2f112514595d req-62d6a512-15ed-4eac-adee-c802e4b1ddb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087448 Oct 16 01:11:51.462084 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1263/2698] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:51.471172 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:51.472200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] [instance: 4ae19d1c-0d21-4eb0-8323-93679f2c60c8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:51.472936 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:51.478451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:51.482343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.483261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.485292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:51.489818 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9dcdffc0-3879-4e86-a8ec-9726221935fc tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.281221 Oct 16 01:11:51.490884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.491270 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1436/2699] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:51 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:51.491614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.492168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:51.497883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1781793471", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "dd811960-e386-493f-95bb-934b5e94fe90"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:51.520376 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=36 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:51.528679 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] HTTP exception thrown: Instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 could not be found. Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Request method failure captured: Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 HTTP/1.1 Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1h67J3MYX9GiKLyyJv-dQR7Rrq-zaOycwajGYCQ_cztWOjWcLK4JxyyiaU8ilNR8wDcwQMLiCmkdzFG9WQTnFv59ii-a5MGSuf89KGJpIboucpvXVVkYvTBpEzqFiOg3y2yEilLsR9YH-VUYOngosd9ZA7wKEYoePYsApB5lVd6-1w Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 05a68224ef104af2963c881faa8383de Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_05a68224ef104af2963c881faa8383de", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/05a68224ef104af2963c881faa8383de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05a68224ef104af2963c881faa8383de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/05a68224ef104af2963c881faa8383de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 05a68224ef104af2963c881faa8383de Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-LiveMigrationTest-1301795125 Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-LiveMigrationTest-1301795125-project Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 3c33afd9ae144eb185203c30baa70351 Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-LiveMigrationTest-1301795125-project Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 could not be found. Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4ae19d1c-0d21-4eb0-8323-93679f2c60c8'} Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 could not be found. Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 could not be found. Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:11:51.530444 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:51.535487 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:11:51.535487 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:11:51.535487 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:11:51.535487 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:11:51.535487 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:11:51.535487 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 could not be found. Oct 16 01:11:51.535487 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:11:51.535487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] Returning 404 to user: Instance 4ae19d1c-0d21-4eb0-8323-93679f2c60c8 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:11:51.537846 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab55b418-409b-4a32-ab83-1180b30cc9ab tempest-LiveMigrationTest-1301795125 tempest-LiveMigrationTest-1301795125-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8" status: 404 len: 111 microversion: 2.1 time: 0.073176 Oct 16 01:11:51.538543 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1264/2700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:51 2022] GET /compute/v2.1/servers/4ae19d1c-0d21-4eb0-8323-93679f2c60c8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:11:51.574811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] validate_networks() for [('dd811960-e386-493f-95bb-934b5e94fe90', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:11:51.938848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:51.939597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:51.946288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.951733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.952526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:51.955446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:51.956134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:51.958077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:52.656652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:52.666291 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ac2cbb5-2330-40df-842b-ca2e3f1d39da tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 0.730661 Oct 16 01:11:52.680307 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1265/2701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:51 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:52.692953 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:52.693747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:52.705448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:52.706199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:52.709366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:52.710319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:52.713533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:52.714178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:52.792240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:11:52.792240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:11:52.793360 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:11:52.793976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:11:52.794796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:11:52.810042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:52.811994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:52.812507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:52.813329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:52.813866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:52.814361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:52.871026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:52.885799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for user 0c8da9a32cb54d0a87d914234b1e9f40 and project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:52.916835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:11:52.919826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:11:53.013970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:53.027228 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59066c59-0fe5-4efb-bf81-2c3595db3cc2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.345511 Oct 16 01:11:53.035602 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1266/2702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:52 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:53.050422 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6776db6-2bd7-4a5f-bea8-2070550f8002 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.557128 Oct 16 01:11:53.055266 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1437/2703] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:11:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:11:53.063366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:53.069746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4240db7-1764-4dfb-8643-897d7a66d810 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:53.071383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4240db7-1764-4dfb-8643-897d7a66d810 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:53.073803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:53.116352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:53.116868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:53.121710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:53.122794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:53.124343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:53.124929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:53.145963 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:53.401487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:53.408110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4240db7-1764-4dfb-8643-897d7a66d810 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:53.421269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:53.424232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:53.433926 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3593f101-0d60-47f7-a824-ec1583402e8d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.396098 Oct 16 01:11:53.438283 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4240db7-1764-4dfb-8643-897d7a66d810 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1215 microversion: 2.1 time: 0.376439 Oct 16 01:11:53.439931 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1438/2704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:53 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1215 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:53.445832 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1267/2705] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:53 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:53.657634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-49a9c661-1311-4498-aad4-619195b1a122 req-3970bd25-6405-43c0-a307-bb99eb6e81dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f7388b-c77c-4971-8df5-f5bb064c65ed", "name": "network-vif-plugged", "status": "completed", "tag": "40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:53.702163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-49a9c661-1311-4498-aad4-619195b1a122 req-3970bd25-6405-43c0-a307-bb99eb6e81dd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:53.706151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-49a9c661-1311-4498-aad4-619195b1a122 req-3970bd25-6405-43c0-a307-bb99eb6e81dd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:53.706349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:53.707627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:53.724438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:53.725526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:53.726456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:53.727857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:53.729698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-49a9c661-1311-4498-aad4-619195b1a122 req-3970bd25-6405-43c0-a307-bb99eb6e81dd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:53.729936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:53.730961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:53.777841 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-49a9c661-1311-4498-aad4-619195b1a122 req-3970bd25-6405-43c0-a307-bb99eb6e81dd service nova] Creating event network-vif-plugged:40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d for instance 35f7388b-c77c-4971-8df5-f5bb064c65ed on n-h2-master-1 Oct 16 01:11:53.800275 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-49a9c661-1311-4498-aad4-619195b1a122 req-3970bd25-6405-43c0-a307-bb99eb6e81dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146466 Oct 16 01:11:53.802967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1439/2706] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:54.062832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:54.063889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:54.073212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.074005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.077290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.078271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.078963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.079535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.110440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:54.120869 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53d3f75a-f52e-4ef0-8e40-e5cb5735ecc8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 0.429233 Oct 16 01:11:54.125423 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1268/2707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:53 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:54.301472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:54.314537 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7486c1c3-7ee5-441d-9389-cd6310caf056 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.257427 Oct 16 01:11:54.315217 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1440/2708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:54 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:54.472164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:54.472883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:54.473651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:54.474385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:54.483340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.484628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.485573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.486471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.490856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.491632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.507301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.507934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.509735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.512002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:54.512640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:54.514900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:54.667161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:54.693122 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0dd02ea2-0f47-4991-a224-b26095bcf3df tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1267 microversion: 2.1 time: 0.234313 Oct 16 01:11:54.694252 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1269/2709] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:54 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:54.717121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:54.727440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:54.729302 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:54.736462 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c4cfbb71-0896-465a-8379-9f7d6f0ae76c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.272498 Oct 16 01:11:54.738049 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1441/2710] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:54 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:55.148690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:55.151132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:55.171918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.172658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:55.173334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:55.174541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.175702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:55.176340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:55.342602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:55.343264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:55.362081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.362591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:55.363059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:55.363771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.364467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:55.365052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:55.928008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:55.943359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f5e45172-02eb-41c0-9f00-142605a163d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 0.797736 Oct 16 01:11:55.946022 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1270/2711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:55 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:55.956127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:55.957266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:55.993519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.994100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:55.995785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:55.996965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:55.998156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:56.004255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:56.027642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:56.039088 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6fa63c0f-99fb-486b-9b8c-937afb716ce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1315 microversion: 2.1 time: 0.702807 Oct 16 01:11:56.042350 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1442/2712] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:55 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:56.047613 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:56.053586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:56.067937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:56.068468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:56.068917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:56.069661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:56.070086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:56.070518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:56.203605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:56.213762 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-417a52e9-7550-4981-a5c0-c2af226e7c80 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1273 microversion: 2.1 time: 0.264911 Oct 16 01:11:56.223126 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1271/2713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:55 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:56.299406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:56.318351 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:56.319869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:56.335578 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd154b3b-8ad9-4127-9c83-b6e81537d43f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.285117 Oct 16 01:11:56.336269 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1443/2714] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:56 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:56.742127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4df43900-cc06-4c2a-9ea3-86ebe096cd5f tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Action: 'create', calling method: .version_select at 0x7fd64d750c10>, body: {"keypair": {"name": "tempest-keypair-282968383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwmj8ekRqI1oN6aEsLxWW04/kYVjdCly8lP7SysxdGZ2UIFsFr9HfNeXreTMONWd/qj8fiLiuo3mtPwTbD/ejVTqYXhy9rp5A1p2Ai8nHxo+HdE0kdAsNkMr51591RSjg=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:56.816114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4df43900-cc06-4c2a-9ea3-86ebe096cd5f tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Getting quotas for project d688e31f04ce4d14bbc9c4d2635d3e2a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:11:56.829458 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4df43900-cc06-4c2a-9ea3-86ebe096cd5f tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Getting quotas for user befcf8a010bb48d3a174a52ea94d012e and project d688e31f04ce4d14bbc9c4d2635d3e2a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:11:56.854783 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:56.865787 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4df43900-cc06-4c2a-9ea3-86ebe096cd5f tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.370495 Oct 16 01:11:56.867871 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1272/2715] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:11:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:11:56.968586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:56.969207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:56.982616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:56.983177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:56.983620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:56.984334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:56.984795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:56.985225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:57.067990 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:57.068839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:57.076006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:57.076738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:57.077359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:57.078454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:57.079267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:57.079855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:57.932177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:57.941121 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-749c60b1-5eb3-476f-870e-696101ad1bb1 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1502 microversion: 2.1 time: 0.877227 Oct 16 01:11:57.949983 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1273/2716] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:57 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1502 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:11:57.955453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:57.957434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:57.973662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:57.974297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:57.975226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:57.977007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:57.977731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:57.983596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:58.047748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:58.065087 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d372935d-c53f-4a24-a9cf-1da663294ccc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 1.100842 Oct 16 01:11:58.067500 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1444/2717] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:56 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:58.085317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:58.086236 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:58.100463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:58.100962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:58.107444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:58.108558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:58.109330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:58.109937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:58.157369 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:58.298909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:58.315651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:58.319615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:58.332363 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2fc18e1-a2d1-409a-abc6-42361be512a8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.262986 Oct 16 01:11:58.335261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1445/2718] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:11:58 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:11:58.345770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-773671553"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:11:58.348532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:58.362196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:58.363116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:58.363790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:58.364709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:58.365380 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:58.366035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:58.439804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:11:58.450800 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22539e1f-b368-4e45-ba5e-45b237ac621f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1315 microversion: 2.1 time: 0.499351 Oct 16 01:11:58.459238 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1274/2719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:57 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:11:59.076932 n-d-master-1 devstack@n-api.service[120545]: INFO nova.network.security_group_api [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Adding security group fbfb3356-c13f-4dbb-bb50-f73b7cab7277 to port 40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d Oct 16 01:11:59.096502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:11:59.097116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:11:59.110661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:59.132044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:59.137153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:11:59.140200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:11:59.144807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:11:59.156155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.141873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:00.179224 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0fbe75f4-9f44-4f59-a0b2-fa674dbd6c6b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 1.086593 Oct 16 01:12:00.180009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1275/2720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:11:59 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:00.195075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0bca9f7f-53df-4287-8008-0d6c75114f48 req-437906f9-72c2-4ae3-bb46-faca5334dd5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa13b8e4-6d6e-45b0-994b-6eeac448e348", "tag": "4431a515-533b-494c-a17a-390a7820b435"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:00.225033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0bca9f7f-53df-4287-8008-0d6c75114f48 req-437906f9-72c2-4ae3-bb46-faca5334dd5f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.227292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0bca9f7f-53df-4287-8008-0d6c75114f48 req-437906f9-72c2-4ae3-bb46-faca5334dd5f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.228578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0bca9f7f-53df-4287-8008-0d6c75114f48 req-437906f9-72c2-4ae3-bb46-faca5334dd5f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.297001 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0bca9f7f-53df-4287-8008-0d6c75114f48 req-437906f9-72c2-4ae3-bb46-faca5334dd5f service nova] Creating event network-changed:4431a515-533b-494c-a17a-390a7820b435 for instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 on n-h1-master-1 Oct 16 01:12:00.323067 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0bca9f7f-53df-4287-8008-0d6c75114f48 req-437906f9-72c2-4ae3-bb46-faca5334dd5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138810 Oct 16 01:12:00.327983 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1276/2721] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:00.336508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:00.338014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:00.348875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.349379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.353644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.354561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.355109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.355852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.373270 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbdbed61-419b-4b4b-b6b7-8326a6c5d61f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed/action" status: 202 len: 0 microversion: 2.1 time: 2.036695 Oct 16 01:12:00.375012 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1446/2722] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:11:58 2022] POST /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed/action => generated 0 bytes in 2039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:00.381729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:00.383867 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:00.398264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.399324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.400504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.402429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.405291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.406053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.686668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:00.703193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:00.707013 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:00.728631 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e52ed2c2-2704-4615-9186-c640b57da155 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.397463 Oct 16 01:12:00.736159 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1277/2723] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:00 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:00.764705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-38768b13-d610-466a-ac91-e2b385f7e440 req-8cfc2c8e-3678-4921-af3f-4397e6b5470b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cd5566-b29c-4a2b-8b91-26dd91bf207e", "name": "network-vif-plugged", "status": "completed", "tag": "5d3e3e8e-9926-4aba-88c1-f362cb41d97c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:00.786303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-38768b13-d610-466a-ac91-e2b385f7e440 req-8cfc2c8e-3678-4921-af3f-4397e6b5470b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.790095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-38768b13-d610-466a-ac91-e2b385f7e440 req-8cfc2c8e-3678-4921-af3f-4397e6b5470b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.793479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-38768b13-d610-466a-ac91-e2b385f7e440 req-8cfc2c8e-3678-4921-af3f-4397e6b5470b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.839855 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-38768b13-d610-466a-ac91-e2b385f7e440 req-8cfc2c8e-3678-4921-af3f-4397e6b5470b service nova] Creating event network-vif-plugged:5d3e3e8e-9926-4aba-88c1-f362cb41d97c for instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e on n-h2-master-1 Oct 16 01:12:00.875659 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-38768b13-d610-466a-ac91-e2b385f7e440 req-8cfc2c8e-3678-4921-af3f-4397e6b5470b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130812 Oct 16 01:12:00.876513 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1278/2724] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:00.892833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1031198694"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:00.897942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:00.912489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.913231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.913828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:00.914686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:00.917494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:00.918153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:01.570489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:01.601277 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-96d2bd6b-ed80-4905-9afd-9279c7ff7b08 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1315 microversion: 2.1 time: 1.222220 Oct 16 01:12:01.604967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1447/2725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:00 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1315 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:01.617396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c483aa5b-7c86-44a5-ad22-e65501a1ff87 req-a67a2714-e8c4-47e0-a081-4489fd76074b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f7388b-c77c-4971-8df5-f5bb064c65ed", "tag": "40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:01.636761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c483aa5b-7c86-44a5-ad22-e65501a1ff87 req-a67a2714-e8c4-47e0-a081-4489fd76074b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:01.645369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c483aa5b-7c86-44a5-ad22-e65501a1ff87 req-a67a2714-e8c4-47e0-a081-4489fd76074b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:01.646121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c483aa5b-7c86-44a5-ad22-e65501a1ff87 req-a67a2714-e8c4-47e0-a081-4489fd76074b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:01.675313 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c483aa5b-7c86-44a5-ad22-e65501a1ff87 req-a67a2714-e8c4-47e0-a081-4489fd76074b service nova] Creating event network-changed:40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d for instance 35f7388b-c77c-4971-8df5-f5bb064c65ed on n-h2-master-1 Oct 16 01:12:01.694674 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c483aa5b-7c86-44a5-ad22-e65501a1ff87 req-a67a2714-e8c4-47e0-a081-4489fd76074b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088255 Oct 16 01:12:01.696184 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1448/2726] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:01.711747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:01.714649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:01.732325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:01.734194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:01.736182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:01.736956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:01.737435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:01.739725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:01.920304 n-d-master-1 devstack@n-api.service[120546]: INFO nova.network.security_group_api [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Adding security group 0732da25-7193-46bd-b245-255f277f06a3 to port 40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d Oct 16 01:12:02.284161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:02.294223 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa28e4d8-ef0f-44ec-b695-77234d91a56a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 0.595846 Oct 16 01:12:02.294825 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1449/2727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:01 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:02.308396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:02.308964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:02.331605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:02.334274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:02.334732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:02.335664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:02.336162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:02.336616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:02.500751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:02.512567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:02.514440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:02.517745 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:02.521306 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f4acc31-e646-4636-b245-3c5a7dbd3944 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.217073 Oct 16 01:12:02.535952 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1450/2728] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:02 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:02.634074 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:02.636847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:02.648983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:02.650817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:02.651844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:02.652802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:02.653826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:02.654655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:02.831565 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:03.253299 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bc5f389-a14a-4e44-b6a0-c76555dd6b79 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed/action" status: 202 len: 0 microversion: 2.1 time: 2.372530 Oct 16 01:12:03.262083 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1279/2729] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:00 2022] POST /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed/action => generated 0 bytes in 2385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:03.266972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:03.267463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:03.276901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:03.277304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:03.277956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:03.278845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:03.278990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:03.279600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:03.280184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:03.289835 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b80a5bde-55a2-4ec1-ba69-bb7530dae0e7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1315 microversion: 2.1 time: 0.664444 Oct 16 01:12:03.290562 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1451/2730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:02 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:03.317749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:03.318621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:03.336787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:03.337529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:03.337979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:03.338713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:03.339198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:03.339631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:03.436856 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:03.766970 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e470c031-d74d-47b0-b8ae-135ba4500299 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.503631 Oct 16 01:12:03.767925 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1280/2731] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:12:03 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed/os-security-groups => generated 1158 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:03.783571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e5e84944-aaa7-4132-a70f-c66458535467"}], "security_groups": [{"name": "tempest-securitygroup--891318517"}], "key_name": "tempest-keypair-282968383", "user_data": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:03.864540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:03.883156 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ed7a482b-b516-4047-8ea1-e733f26da38e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1309 microversion: 2.1 time: 0.567401 Oct 16 01:12:03.886246 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1452/2732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:03 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1309 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:03.925448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:03.927387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:03.940307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:03.944120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:03.945453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:03.947811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:03.948341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:03.948811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:04.519398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] validate_networks() for [('e5e84944-aaa7-4132-a70f-c66458535467', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:12:04.522549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:04.532530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:04.534389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:04.541789 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-53ae61c5-ec30-4008-9ae5-41b9d0ad9069 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.653371 Oct 16 01:12:04.542741 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1453/2733] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:03 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:04.547915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-903ae0fb-66b9-48f6-b41c-c30f3f1c4c49 req-bbbd3650-1ca8-43fb-a6cb-5feeb505b984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f7388b-c77c-4971-8df5-f5bb064c65ed", "tag": "40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:04.561649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-903ae0fb-66b9-48f6-b41c-c30f3f1c4c49 req-bbbd3650-1ca8-43fb-a6cb-5feeb505b984 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:04.562502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-903ae0fb-66b9-48f6-b41c-c30f3f1c4c49 req-bbbd3650-1ca8-43fb-a6cb-5feeb505b984 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:04.563659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-903ae0fb-66b9-48f6-b41c-c30f3f1c4c49 req-bbbd3650-1ca8-43fb-a6cb-5feeb505b984 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:04.584959 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-903ae0fb-66b9-48f6-b41c-c30f3f1c4c49 req-bbbd3650-1ca8-43fb-a6cb-5feeb505b984 service nova] Creating event network-changed:40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d for instance 35f7388b-c77c-4971-8df5-f5bb064c65ed on n-h2-master-1 Oct 16 01:12:04.591109 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-903ae0fb-66b9-48f6-b41c-c30f3f1c4c49 req-bbbd3650-1ca8-43fb-a6cb-5feeb505b984 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046829 Oct 16 01:12:04.592016 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1454/2734] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:04.597684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8cf9d557-96da-489b-a656-8f72bb7238a5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd6527d80d0>, body: {"security_group": {"name": " tempest-securitygroup -1698769613 ", "description": "tempest-description-2039860000"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:05.194038 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8cf9d557-96da-489b-a656-8f72bb7238a5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.600611 Oct 16 01:12:05.202896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1455/2735] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:04 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:05.216062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:05.216905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:05.238466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:05.239356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:05.240870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:05.241812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:05.242725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:05.244334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:05.546320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:12:05.546769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:12:05.547444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:12:05.547918 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:12:05.548407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:12:05.560011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:05.560817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:05.561439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:05.562367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:05.563036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:05.563663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:05.595751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Getting quotas for project d688e31f04ce4d14bbc9c4d2635d3e2a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:12:05.601556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Getting quotas for user befcf8a010bb48d3a174a52ea94d012e and project d688e31f04ce4d14bbc9c4d2635d3e2a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:12:05.620097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:12:05.622841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:12:05.634411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:05.646810 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-81c6621a-0f4e-4c86-bf14-85eacde5f1a4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1315 microversion: 2.1 time: 0.441099 Oct 16 01:12:05.650764 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1456/2736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:05 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:05.661091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:05.661972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:05.673714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:05.687677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:05.688305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:05.689065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:05.689544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:05.692486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:05.694942 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56dde69c-d9bb-4d48-9761-b4050b16eb8b tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.924044 Oct 16 01:12:05.695883 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1281/2737] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:12:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:12:05.701187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-67184e6c-2d4e-4653-be64-4fbdf176621d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64d7b1790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:05.962295 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-67184e6c-2d4e-4653-be64-4fbdf176621d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f" status: 200 len: 224 microversion: 2.1 time: 0.264050 Oct 16 01:12:05.963553 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1282/2738] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:12:05 2022] GET /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f => generated 224 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:05.982776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:05.992898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:06.013103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:06.014567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:06.015380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:06.016514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:06.017137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:06.017727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:06.259367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:06.277395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:06.283164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:06.289902 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7aedd49f-7edb-454f-ad04-c2772687350b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1558 microversion: 2.91 time: 0.314531 Oct 16 01:12:06.295426 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1283/2739] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:05 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1558 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:06.306891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b32c2509-94df-44df-a77a-57b0b5f54b53 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:06.311569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b32c2509-94df-44df-a77a-57b0b5f54b53 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:06.393063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:06.408909 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-38d6d5be-932b-429e-b675-0649c35d5b00 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1490 microversion: 2.1 time: 0.756208 Oct 16 01:12:06.432712 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1457/2740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:05 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1490 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:06.448764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60c91701-a97f-48c9-a215-8dc5cba46024 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd65278dc10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:06.582152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b32c2509-94df-44df-a77a-57b0b5f54b53 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:06.597638 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b32c2509-94df-44df-a77a-57b0b5f54b53 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1225 microversion: 2.1 time: 0.300422 Oct 16 01:12:06.601113 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1284/2741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:06 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1225 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:06.676120 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:06.677845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:06.688742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:06.689728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:06.690385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:06.691372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:06.691992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:06.692581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:07.257426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:07.266593 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c29ea923-5a26-4766-ba9c-4239efe980c4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1315 microversion: 2.1 time: 0.597887 Oct 16 01:12:07.289638 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1285/2742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:06 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:07.305448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1878264390", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e837775c-af35-4cb2-89ea-5a342e83cc6f"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:07.472363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] validate_networks() for [('e837775c-af35-4cb2-89ea-5a342e83cc6f', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:12:08.642320 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60c91701-a97f-48c9-a215-8dc5cba46024 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f" status: 202 len: 0 microversion: 2.1 time: 2.208426 Oct 16 01:12:08.644250 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1458/2743] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:06 2022] DELETE /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f => generated 0 bytes in 2211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:08.657592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:08.660617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:08.687527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:08.688116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:08.688798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:08.691097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:08.691810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:08.693662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:09.043445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:09.051003 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:09.063374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:09.072311 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8db4c21d-d92e-4d18-bba1-b0e8852f7d36 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.426642 Oct 16 01:12:09.076560 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1459/2744] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:08 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:09.081873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:09.082716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:09.089861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:09.090671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:09.091434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:09.092464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:09.093146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:09.093807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:09.333615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:09.349752 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ddd1f297-aec2-430e-9d73-ba465bd7bf22 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1283 microversion: 2.1 time: 0.271660 Oct 16 01:12:09.355725 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1460/2745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:09 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1283 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:09.366076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:09.366905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:09.379998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:09.380768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:09.381385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:09.382084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:09.383043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:09.390292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:09.916836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:12:09.920541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:12:09.921080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:12:09.921504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:12:09.922080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:12:09.947551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:09.949966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:09.950450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:09.951311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:09.952028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:09.952465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:09.989781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:12:10.030060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:12:10.054891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:12:10.057696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:10.058178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:12:10.065932 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e85480ec-8a6c-4207-8636-f89e0b119bd0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1315 microversion: 2.1 time: 0.708816 Oct 16 01:12:10.072801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1461/2746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:09 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:10.083215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d40b2fe-ceb9-4684-86b6-f92dc2300d20 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd6527f11f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:10.125681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b42ad42c-0d94-4523-90c8-787ebec02e72 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.830868 Oct 16 01:12:10.127734 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1286/2747] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:12:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:12:10.142645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-cfb0da9f-c1dd-4940-97c7-d93efe209992 req-6fc0ba9d-82ca-41b2-a64d-05ddbbbc7784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa13b8e4-6d6e-45b0-994b-6eeac448e348", "name": "network-vif-plugged", "status": "completed", "tag": "4431a515-533b-494c-a17a-390a7820b435"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:10.145786 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-4d40b2fe-ceb9-4684-86b6-f92dc2300d20 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:10.146405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-4d40b2fe-ceb9-4684-86b6-f92dc2300d20 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group 5518aed3-2777-4854-95a7-14a44ea7a12f not found {{(pid=120545) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:12:10.146986 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4d40b2fe-ceb9-4684-86b6-f92dc2300d20 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:12:10.146986 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-722d1a7a-7981-4120-b074-7cb471677622'] Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d40b2fe-ceb9-4684-86b6-f92dc2300d20 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f HTTP/1.1 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: exception: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-722d1a7a-7981-4120-b074-7cb471677622'] Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5518aed3-2777-4854-95a7-14a44ea7a12f'} Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:10.149077 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-722d1a7a-7981-4120-b074-7cb471677622'] Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-722d1a7a-7981-4120-b074-7cb471677622'] Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-722d1a7a-7981-4120-b074-7cb471677622'] Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-722d1a7a-7981-4120-b074-7cb471677622'] Oct 16 01:12:10.153531 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:10.157354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d40b2fe-ceb9-4684-86b6-f92dc2300d20 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:12:10.157354 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-722d1a7a-7981-4120-b074-7cb471677622'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:10.158569 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d40b2fe-ceb9-4684-86b6-f92dc2300d20 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f" status: 404 len: 194 microversion: 2.1 time: 0.084507 Oct 16 01:12:10.159644 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1462/2748] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:12:10 2022] GET /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:10.168948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:10.171104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:10.189151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cfb0da9f-c1dd-4940-97c7-d93efe209992 req-6fc0ba9d-82ca-41b2-a64d-05ddbbbc7784 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:10.189917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cfb0da9f-c1dd-4940-97c7-d93efe209992 req-6fc0ba9d-82ca-41b2-a64d-05ddbbbc7784 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:10.190354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cfb0da9f-c1dd-4940-97c7-d93efe209992 req-6fc0ba9d-82ca-41b2-a64d-05ddbbbc7784 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:10.191978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:10.194446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:10.196811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:10.199805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:10.200315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:10.200759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:10.217035 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-cfb0da9f-c1dd-4940-97c7-d93efe209992 req-6fc0ba9d-82ca-41b2-a64d-05ddbbbc7784 service nova] Creating event network-vif-plugged:4431a515-533b-494c-a17a-390a7820b435 for instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 on n-h1-master-1 Oct 16 01:12:10.229900 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-cfb0da9f-c1dd-4940-97c7-d93efe209992 req-6fc0ba9d-82ca-41b2-a64d-05ddbbbc7784 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099648 Oct 16 01:12:10.234424 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1287/2749] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:10.241373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5e6bf040-33b7-4969-8ab7-4c8b33e31c1a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:10.246180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5e6bf040-33b7-4969-8ab7-4c8b33e31c1a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:10.439922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:10.450189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:10.451733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:10.485477 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-63fa7a5e-0c91-4d1d-ba9c-141a43e02ac3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.318852 Oct 16 01:12:10.489288 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1463/2750] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:10 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:10.507675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca2fa1a3-0dc2-4166-b6bd-7a8727d31431 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd652797280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-38372094", "description": "tempest-description-206337840"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:10.513729 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5e6bf040-33b7-4969-8ab7-4c8b33e31c1a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:10.521031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5e6bf040-33b7-4969-8ab7-4c8b33e31c1a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1209 microversion: 2.1 time: 0.284892 Oct 16 01:12:10.521885 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1288/2751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:10 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1209 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:10.527266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:10.528112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:10.536801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:10.537557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:10.538481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:10.539600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:10.557355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:10.559271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:10.789692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:10.800002 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d206594-d697-4f27-aa08-e2cc540606bb tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1283 microversion: 2.1 time: 0.276567 Oct 16 01:12:10.803492 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1289/2752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:10 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1283 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:11.104282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:11.104991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:11.122657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:11.122966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:11.123473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:11.124407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:11.124934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:11.125434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:11.408076 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca2fa1a3-0dc2-4166-b6bd-7a8727d31431 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.917558 Oct 16 01:12:11.409087 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1464/2753] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:10 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:11.427148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d0265bb0-d049-4f7f-9084-5f5bd4160824 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd6527d1040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-261898556", "description": "tempest-description-602751155"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:11.866907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:11.879575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd98d4d5-dc86-44c7-821e-df4bcc5f12b4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1315 microversion: 2.1 time: 0.784901 Oct 16 01:12:11.880080 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1290/2754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:11 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:11.899520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:11.900157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:11.935035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:11.935910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:11.936592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:11.936803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:11.937173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:11.937540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:12.255737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:12.261703 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:12.289627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:12.296834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:12.320165 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8229d06-0a0d-4978-b1ab-7e53ebad0080 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.430415 Oct 16 01:12:12.325143 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1291/2755] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:11 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:12.347460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:12.348359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:12.360043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:12.360570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:12.365849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:12.370167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:12.370634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:12.375259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:12.743737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:12.765228 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ef43ed4-fe46-499d-99ce-c4143968899d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1261 microversion: 2.1 time: 0.438689 Oct 16 01:12:12.769862 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1292/2756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:12 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1261 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:12.938166 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d0265bb0-d049-4f7f-9084-5f5bd4160824 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.515974 Oct 16 01:12:12.940231 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1465/2757] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:11 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:12.947049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:12.948601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:12.967368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:12.968761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:12.969436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:12.970494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:12.971395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:12.972167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:13.038077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c4f7b97-2578-45c3-9fd5-9c7bd13e49cd tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd64d750ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-42953751", "description": "tempest-description-1173915705"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:14.056513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:14.070339 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1afa40ea-a54d-4060-8b01-72f4e23d1962 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1350 microversion: 2.1 time: 1.128505 Oct 16 01:12:14.074451 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1466/2758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:12 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1350 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:14.086277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:14.099701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:14.111512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:14.114551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:14.115044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:14.115796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:14.116281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:14.116728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:14.811368 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c4f7b97-2578-45c3-9fd5-9c7bd13e49cd tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.039632 Oct 16 01:12:14.812477 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1293/2759] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:12 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:14.817828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-70e09bdf-a548-4ac0-9fbd-ddc2ff0a412d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd64d73bca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1338859953", "description": "tempest-description-1264475853"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:14.873145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:14.908365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-35b63b13-b637-4885-ba71-7287b1ca5d6c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1502 microversion: 2.1 time: 0.832027 Oct 16 01:12:14.923483 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1467/2760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:14 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1502 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:14.939915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:14.940530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:14.958773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:14.959570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:14.960206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:14.961135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:14.965528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:14.966293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:15.141522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:15.156997 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:15.191784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:15.205054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:15.229978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d85f889e-e485-4f52-9aa4-cf8a730f26c6 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.305027 Oct 16 01:12:15.236131 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1468/2761] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:14 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:15.262739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:15.266195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:15.302402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:15.328483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:15.329004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:15.333274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:15.340799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:15.343136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:15.396386 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-70e09bdf-a548-4ac0-9fbd-ddc2ff0a412d tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.582709 Oct 16 01:12:15.397539 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1294/2762] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:15.411783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1613805e-8e9b-4e76-b53b-db1943a00dc3 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd64d6e8670>, body: {"security_group_rule": {"parent_group_id": "a4e266a0-df16-4fbd-9196-4c0e75c334be", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:16.234654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:16.248049 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7455efc1-8464-48fa-9cb9-87fcacfe7665 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1309 microversion: 2.1 time: 1.006852 Oct 16 01:12:16.249354 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1469/2763] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:15 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1309 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:16.255276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:16.258477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:16.266877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:16.268846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:16.270235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:16.271305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:16.277280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:16.277977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:16.377389 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-109312ac-5048-4054-99f6-8ad8266e6c32 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action" status: 200 len: 14 microversion: 2.1 time: 0.126402 Oct 16 01:12:16.383997 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1470/2764] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:16 2022] POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:12:16.405590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:16.407612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:16.425500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:16.427604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:16.428817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:16.432016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:16.433016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:16.435121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:16.543561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1613805e-8e9b-4e76-b53b-db1943a00dc3 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.136269 Oct 16 01:12:16.563434 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1295/2765] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:12:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:16.575024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-7065683b-a763-4906-b507-89d179cd5ce2 req-f63d2695-4a76-4683-81ee-9db100eb0570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219", "tag": "ae7e0904-3430-4daa-9aca-2e07fd0e9fe3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:16.601461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7065683b-a763-4906-b507-89d179cd5ce2 req-f63d2695-4a76-4683-81ee-9db100eb0570 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:16.602277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7065683b-a763-4906-b507-89d179cd5ce2 req-f63d2695-4a76-4683-81ee-9db100eb0570 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:16.602884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7065683b-a763-4906-b507-89d179cd5ce2 req-f63d2695-4a76-4683-81ee-9db100eb0570 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:16.629889 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-7065683b-a763-4906-b507-89d179cd5ce2 req-f63d2695-4a76-4683-81ee-9db100eb0570 service nova] Creating event network-changed:ae7e0904-3430-4daa-9aca-2e07fd0e9fe3 for instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 on n-h2-master-1 Oct 16 01:12:16.644877 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-7065683b-a763-4906-b507-89d179cd5ce2 req-f63d2695-4a76-4683-81ee-9db100eb0570 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080207 Oct 16 01:12:16.645867 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1296/2766] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:16.653125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fa99b30-b816-4f6f-a205-84b524905c5a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64d6edf70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:16.927127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:16.937841 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-210021f9-ffaa-4d63-ba70-02751c37cee8 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1350 microversion: 2.1 time: 0.551030 Oct 16 01:12:16.943261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1471/2767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:16 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1350 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:16.948795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:16.961545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:16.976868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:16.979000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:16.979715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:16.982189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:16.989210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:16.990037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:17.121148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:17.145652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:17.147802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:17.157256 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ebeff84c-435f-44fc-abf5-39ebaf9422b9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.210393 Oct 16 01:12:17.171342 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1472/2768] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:16 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:17.199412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-308c4242-d22e-41a0-b176-f0c3d57e0ff5 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd6527a2280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2012333417", "description": "tempest-description-2057956096"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:17.324135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fa99b30-b816-4f6f-a205-84b524905c5a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.676749 Oct 16 01:12:17.325416 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1297/2769] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:12:16 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:17.344183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:17.346205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:17.375868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:17.380888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:17.382751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:17.388047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:17.389733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:17.391628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:17.703377 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-308c4242-d22e-41a0-b176-f0c3d57e0ff5 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.530727 Oct 16 01:12:17.713228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1473/2770] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:17 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:17.718451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e407e5f-4f11-4ba6-9f8f-a43a58efa5a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd6527c03a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:17.924497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:17.935812 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c3fa102-d429-4ded-ba97-ae029e6ad12d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1309 microversion: 2.1 time: 0.608833 Oct 16 01:12:17.939911 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1298/2771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:17 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1309 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:17.956860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:17.962946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:17.979876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:17.980730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:17.981350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:17.983612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:17.985805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:17.987467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:18.089136 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f47b74c9-3704-4c12-a86b-25ee314a1ba0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action" status: 200 len: 14 microversion: 2.1 time: 0.147126 Oct 16 01:12:18.093135 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1299/2772] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:17 2022] POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:12:18.096253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2b936b89-3a4e-45dd-9727-e2e3e7f27f00 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd64d7c9550>, body: {"security_group_rule": {"parent_group_id": "7c5d8453-df72-4730-9707-26fe1e51ce1d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:18.468442 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e407e5f-4f11-4ba6-9f8f-a43a58efa5a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/936b05e4-163f-47ce-b806-8bbbe7479595" status: 202 len: 0 microversion: 2.1 time: 0.753229 Oct 16 01:12:18.469633 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1474/2773] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:17 2022] DELETE /compute/v2.1/os-security-groups/936b05e4-163f-47ce-b806-8bbbe7479595 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:18.476756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:18.478261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:18.492417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:18.493902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:18.494529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:18.496252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:18.497000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:18.498087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:18.768766 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2b936b89-3a4e-45dd-9727-e2e3e7f27f00 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.677325 Oct 16 01:12:18.770460 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1300/2774] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:12:18 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:18.775892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:18.777703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:18.789393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:18.793056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:18.793509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:18.794240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:18.794706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:18.795160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:18.812037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:18.822174 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de1edac5-c34f-469b-8888-b0ff280ced2d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1350 microversion: 2.1 time: 0.350407 Oct 16 01:12:18.841818 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1475/2775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:18 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1350 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:18.856793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d90c989a-a2c4-4260-b32b-1e03c4aa8952 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd6527a25e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:18.887999 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-d90c989a-a2c4-4260-b32b-1e03c4aa8952 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:18.888863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-d90c989a-a2c4-4260-b32b-1e03c4aa8952 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group 936b05e4-163f-47ce-b806-8bbbe7479595 not found {{(pid=120545) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:12:18.889565 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-d90c989a-a2c4-4260-b32b-1e03c4aa8952 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:12:18.889565 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-64d03a94-e047-47e3-b811-7da6ecf3f05c'] Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d90c989a-a2c4-4260-b32b-1e03c4aa8952 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-security-groups/936b05e4-163f-47ce-b806-8bbbe7479595 HTTP/1.1 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: exception: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-64d03a94-e047-47e3-b811-7da6ecf3f05c'] Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '936b05e4-163f-47ce-b806-8bbbe7479595'} Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:18.891968 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64d03a94-e047-47e3-b811-7da6ecf3f05c'] Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64d03a94-e047-47e3-b811-7da6ecf3f05c'] Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64d03a94-e047-47e3-b811-7da6ecf3f05c'] Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64d03a94-e047-47e3-b811-7da6ecf3f05c'] Oct 16 01:12:18.896830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:18.901635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d90c989a-a2c4-4260-b32b-1e03c4aa8952 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:12:18.901635 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-64d03a94-e047-47e3-b811-7da6ecf3f05c'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:18.905713 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d90c989a-a2c4-4260-b32b-1e03c4aa8952 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/936b05e4-163f-47ce-b806-8bbbe7479595" status: 404 len: 194 microversion: 2.1 time: 0.062488 Oct 16 01:12:18.909497 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1476/2776] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:12:18 2022] GET /compute/v2.1/os-security-groups/936b05e4-163f-47ce-b806-8bbbe7479595 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:18.976441 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:18.985229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:18.986655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:18.992255 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e7e81931-38db-46a1-a982-07d525a34981 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.220746 Oct 16 01:12:18.993670 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1301/2777] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:18 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:19.002071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fb799085-00f2-4ae3-8afa-7e45b48c85b3 req-b7bdca45-cd3f-4725-a3f3-5a76c8349e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc3574c-4ad5-4069-b6a1-86290bae32d5", "tag": "60b2d71e-2e49-4475-a6f6-52a9ebb44105"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:19.023623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fb799085-00f2-4ae3-8afa-7e45b48c85b3 req-b7bdca45-cd3f-4725-a3f3-5a76c8349e53 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:19.024217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fb799085-00f2-4ae3-8afa-7e45b48c85b3 req-b7bdca45-cd3f-4725-a3f3-5a76c8349e53 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:19.026902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fb799085-00f2-4ae3-8afa-7e45b48c85b3 req-b7bdca45-cd3f-4725-a3f3-5a76c8349e53 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:19.063848 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fb799085-00f2-4ae3-8afa-7e45b48c85b3 req-b7bdca45-cd3f-4725-a3f3-5a76c8349e53 service nova] Creating event network-changed:60b2d71e-2e49-4475-a6f6-52a9ebb44105 for instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 on n-h1-master-1 Oct 16 01:12:19.077770 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fb799085-00f2-4ae3-8afa-7e45b48c85b3 req-b7bdca45-cd3f-4725-a3f3-5a76c8349e53 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082354 Oct 16 01:12:19.090958 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1302/2778] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:19.100495 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbb12506-5948-4d24-9094-32b479ade10f tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd64d6e9ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1238226086", "description": "tempest-description-1754680483"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:19.344751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cf00c48-095e-4151-a9e2-28f9755378dc tempest-FlavorsV2NegativeTest-647191339 tempest-FlavorsV2NegativeTest-647191339-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:19.355789 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cf00c48-095e-4151-a9e2-28f9755378dc tempest-FlavorsV2NegativeTest-647191339 tempest-FlavorsV2NegativeTest-647191339-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.445191 Oct 16 01:12:19.356754 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1477/2779] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:12:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:19.362263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-388c379a-2c36-471c-a4fb-15da6c56fc58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd6527a23a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:19.437031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fbb12506-5948-4d24-9094-32b479ade10f tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.344680 Oct 16 01:12:19.437630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1303/2780] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:19 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:19.442339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:19.443356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:19.459277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:19.460095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:19.460867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:19.462504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:19.463225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:19.463870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:19.761044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:19.779568 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cb059c62-a34d-4207-b4d7-0c626b10c0bf tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1309 microversion: 2.1 time: 0.330348 Oct 16 01:12:19.780201 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1304/2781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:19 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1309 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:19.869340 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-388c379a-2c36-471c-a4fb-15da6c56fc58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/dd94890b-68b6-42a3-a85a-d24581fb186b" status: 202 len: 0 microversion: 2.1 time: 0.511302 Oct 16 01:12:19.869923 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1478/2782] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:19 2022] DELETE /compute/v2.1/os-security-groups/dd94890b-68b6-42a3-a85a-d24581fb186b => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:19.881997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d062e9ab-1a29-4cd8-828f-8b2b49e5bcc9 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd6527d8550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-520620703", "description": "tempest-description-862358525"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:19.962329 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:20.033736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:20.038190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:20.051787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:20.052141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:20.052577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:20.053269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:20.064195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:20.064801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:20.173774 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b858e0aa-d0d9-4835-8e5c-b16af440a24b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action" status: 200 len: 14 microversion: 2.1 time: 0.380117 Oct 16 01:12:20.181765 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1305/2783] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:19 2022] POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action => generated 14 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:12:20.198786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:20.201985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:20.228278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:20.228792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:20.232749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:20.234706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:20.235496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:20.237727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:20.288952 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d062e9ab-1a29-4cd8-828f-8b2b49e5bcc9 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.417618 Oct 16 01:12:20.290609 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1479/2784] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:19 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:20.303867 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-996c564a-016b-4e90-992f-226052590658 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd6527868b0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:20.498434 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-996c564a-016b-4e90-992f-226052590658 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:20.499528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-996c564a-016b-4e90-992f-226052590658 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group dd94890b-68b6-42a3-a85a-d24581fb186b not found {{(pid=120545) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:12:20.500277 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-996c564a-016b-4e90-992f-226052590658 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:12:20.500277 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-2e8155da-e624-4d5a-94ef-84d37699e7cf'] Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-996c564a-016b-4e90-992f-226052590658 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-security-groups/dd94890b-68b6-42a3-a85a-d24581fb186b HTTP/1.1 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: exception: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-2e8155da-e624-4d5a-94ef-84d37699e7cf'] Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'dd94890b-68b6-42a3-a85a-d24581fb186b'} Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:20.503372 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e8155da-e624-4d5a-94ef-84d37699e7cf'] Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e8155da-e624-4d5a-94ef-84d37699e7cf'] Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e8155da-e624-4d5a-94ef-84d37699e7cf'] Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e8155da-e624-4d5a-94ef-84d37699e7cf'] Oct 16 01:12:20.507057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:20.523456 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=20 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:20.526495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-996c564a-016b-4e90-992f-226052590658 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:12:20.526495 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-2e8155da-e624-4d5a-94ef-84d37699e7cf'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:20.528000 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-996c564a-016b-4e90-992f-226052590658 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/dd94890b-68b6-42a3-a85a-d24581fb186b" status: 404 len: 194 microversion: 2.1 time: 0.236103 Oct 16 01:12:20.529672 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1480/2785] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:12:20 2022] GET /compute/v2.1/os-security-groups/dd94890b-68b6-42a3-a85a-d24581fb186b => generated 194 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:20.536771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:20.537764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:20.546785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:20.547704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:20.548369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:20.549311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:20.549988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:20.550842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:20.570434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:20.581976 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7cd1578-f674-44a4-9353-fd30c57a7f73 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1350 microversion: 2.1 time: 0.398406 Oct 16 01:12:20.601236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1306/2786] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:20 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1350 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:20.631157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a159adee-b316-4d70-80b3-7a453e296089 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd64d75cd30>, body: {"security_group_rule": {"parent_group_id": "53ea8ca9-0332-4be1-b0ed-0ee9198f62fc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6908abf4-d8c1-4dc7-bc3a-c8103d312843"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:20.736309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:20.750256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:20.752278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:20.767061 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f4bb453-63b9-4dc3-959b-bcb3cb2ca7af tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.235164 Oct 16 01:12:20.767847 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1481/2787] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:20 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:20.793464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9bb2266-91c0-4bd8-9cdd-f021f8146564 tempest-FlavorsV2NegativeTest-647191339 tempest-FlavorsV2NegativeTest-647191339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1671478305", "imageRef": "a0de708a-2c85-41a8-8e1d-57873ac68231", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:20.895256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-f9bb2266-91c0-4bd8-9cdd-f021f8146564 tempest-FlavorsV2NegativeTest-647191339 tempest-FlavorsV2NegativeTest-647191339-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:12:21.375756 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f9bb2266-91c0-4bd8-9cdd-f021f8146564 tempest-FlavorsV2NegativeTest-647191339 tempest-FlavorsV2NegativeTest-647191339-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9bb2266-91c0-4bd8-9cdd-f021f8146564 tempest-FlavorsV2NegativeTest-647191339 tempest-FlavorsV2NegativeTest-647191339-project] Request method failure captured: Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 143 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pyRSg4-5ruhxmdBTildbsxU6AwEg2dRga5SNr-9JsCkzHOfIybXrwIuSPJf5g7XOQp8kFbuthNQuiNyXpE46VGq0J2puhuLv5o9biEKsl-YDZeTnEMjYdnrPMIEEwpBrQeG-gJoubhTpVv2tLMrUB0WalavDoghl8CzrQfnRsQcLY Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 5c325a1382a84822b02f62d51b8cd163 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-FlavorsV2NegativeTest-647191339 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5c325a1382a84822b02f62d51b8cd163", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5c325a1382a84822b02f62d51b8cd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c325a1382a84822b02f62d51b8cd163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5c325a1382a84822b02f62d51b8cd163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-FlavorsV2NegativeTest-647191339 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 5c325a1382a84822b02f62d51b8cd163 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-647191339 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-FlavorsV2NegativeTest-647191339-project Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7cbe5edbc4a040758d293b6932f52328 Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-FlavorsV2NegativeTest-647191339-project Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1671478305", "imageRef": "a0de708a-2c85-41a8-8e1d-57873ac68231", "flavorRef": "452"}} Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: exception: Flavor's memory is too small for requested image. Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1671478305', 'imageRef': 'a0de708a-2c85-41a8-8e1d-57873ac68231', 'flavorRef': '452'}}} Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:12:21.377833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9bb2266-91c0-4bd8-9cdd-f021f8146564 tempest-FlavorsV2NegativeTest-647191339 tempest-FlavorsV2NegativeTest-647191339-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f9bb2266-91c0-4bd8-9cdd-f021f8146564 tempest-FlavorsV2NegativeTest-647191339 tempest-FlavorsV2NegativeTest-647191339-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.610168 Oct 16 01:12:21.382298 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1482/2788] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:12:20 2022] POST /compute/v2.1/servers => generated 93 bytes in 611 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:21.404219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80b28869-2936-43dd-a32b-8ceb1510b655 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd6527869d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:21.554232 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a159adee-b316-4d70-80b3-7a453e296089 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.941562 Oct 16 01:12:21.564348 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1307/2789] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:12:20 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:21.569291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:21.574152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:21.583381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:21.591656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:21.592682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:21.594544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:21.595731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:21.599303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:21.831670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:21.850642 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9bfbdb01-0c6e-46e6-9c42-aa5760dc4d96 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1309 microversion: 2.1 time: 0.282105 Oct 16 01:12:21.853344 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1308/2790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:21 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:21.873702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:21.877261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:21.891546 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:21.906503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:21.908958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:21.909547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:21.911086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:21.912015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:21.915031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:21.987598 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80b28869-2936-43dd-a32b-8ceb1510b655 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e5d84b0b-9582-4b6a-b293-99df1ffc42a1" status: 202 len: 0 microversion: 2.1 time: 0.605903 Oct 16 01:12:21.992005 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1483/2791] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:21 2022] DELETE /compute/v2.1/os-security-groups/e5d84b0b-9582-4b6a-b293-99df1ffc42a1 => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:21.998387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91b28e51-c105-41db-b296-7c065738e3ee tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd6527868b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1733587382", "description": "tempest-description-827975549"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:22.038450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c859150a-e8f2-4e6b-b687-e8449dda0e0a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action" status: 200 len: 14 microversion: 2.1 time: 0.183153 Oct 16 01:12:22.042609 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1309/2792] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:21 2022] POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:12:22.070701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:22.074100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:22.112319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:22.113223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:22.115169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:22.119610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:22.120630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:22.122334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:22.398659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:22.413020 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e9734f45-5701-4b99-bfe6-e6ef96e183d7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1350 microversion: 2.1 time: 0.371583 Oct 16 01:12:22.417025 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1310/2793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:22 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1350 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:22.429901 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:22.432936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:22.455812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:22.458147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:22.460029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:22.461131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:22.464174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:22.464879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:22.524986 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91b28e51-c105-41db-b296-7c065738e3ee tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.530905 Oct 16 01:12:22.526142 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1484/2794] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:21 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:22.530795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17666c52-5952-411a-97de-3a16edf5bf6a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64de25820>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:22.580906 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-17666c52-5952-411a-97de-3a16edf5bf6a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:22.580906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-17666c52-5952-411a-97de-3a16edf5bf6a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 not found {{(pid=120545) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:12:22.580906 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-17666c52-5952-411a-97de-3a16edf5bf6a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:12:22.580906 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-0f452eba-505e-45e3-b90e-121e8067011f'] Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17666c52-5952-411a-97de-3a16edf5bf6a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-security-groups/e5d84b0b-9582-4b6a-b293-99df1ffc42a1 HTTP/1.1 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: exception: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-0f452eba-505e-45e3-b90e-121e8067011f'] Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e5d84b0b-9582-4b6a-b293-99df1ffc42a1'} Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:22.581269 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f452eba-505e-45e3-b90e-121e8067011f'] Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f452eba-505e-45e3-b90e-121e8067011f'] Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f452eba-505e-45e3-b90e-121e8067011f'] Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f452eba-505e-45e3-b90e-121e8067011f'] Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17666c52-5952-411a-97de-3a16edf5bf6a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-0f452eba-505e-45e3-b90e-121e8067011f'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-17666c52-5952-411a-97de-3a16edf5bf6a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/e5d84b0b-9582-4b6a-b293-99df1ffc42a1" status: 404 len: 194 microversion: 2.1 time: 0.055557 Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1485/2795] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:12:22 2022] GET /compute/v2.1/os-security-groups/e5d84b0b-9582-4b6a-b293-99df1ffc42a1 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:22.595333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-227cef98-83ae-49f0-bf17-6e4362ee0c6e req-bdcd8f3f-5495-4812-8101-9910b4c9a2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219", "name": "network-vif-plugged", "status": "completed", "tag": "ae7e0904-3430-4daa-9aca-2e07fd0e9fe3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:22.608824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:22.608824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:22.608824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:22.611235 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-90d57795-15ae-493e-b523-9d4503a1a8ee tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.188709 Oct 16 01:12:22.611235 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1311/2796] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:22 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:22.623938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-227cef98-83ae-49f0-bf17-6e4362ee0c6e req-bdcd8f3f-5495-4812-8101-9910b4c9a2a6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:22.624324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-227cef98-83ae-49f0-bf17-6e4362ee0c6e req-bdcd8f3f-5495-4812-8101-9910b4c9a2a6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:22.626801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-227cef98-83ae-49f0-bf17-6e4362ee0c6e req-bdcd8f3f-5495-4812-8101-9910b4c9a2a6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:22.632347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4637d81-5a22-490f-ae11-bd3e3b248c6f tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd64d7230d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1997072664", "description": "tempest-description-1868727700"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:22.647196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-227cef98-83ae-49f0-bf17-6e4362ee0c6e req-bdcd8f3f-5495-4812-8101-9910b4c9a2a6 service nova] Creating event network-vif-plugged:ae7e0904-3430-4daa-9aca-2e07fd0e9fe3 for instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 on n-h2-master-1 Oct 16 01:12:22.652828 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-227cef98-83ae-49f0-bf17-6e4362ee0c6e req-bdcd8f3f-5495-4812-8101-9910b4c9a2a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064746 Oct 16 01:12:22.654059 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1486/2797] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:22.659440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c3cea47e-bfc7-4e23-8b10-75807957feba tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64e7e6c10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:23.047228 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4637d81-5a22-490f-ae11-bd3e3b248c6f tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.431056 Oct 16 01:12:23.048290 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1312/2798] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:23.058499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:23.059433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:23.070589 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c3cea47e-bfc7-4e23-8b10-75807957feba tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.415116 Oct 16 01:12:23.072988 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1487/2799] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:12:22 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:23.076040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:23.077919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:23.080053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:23.081891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:23.085355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:23.086387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:23.087253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:23.089282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:23.095235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:23.095867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:23.096403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:23.097207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:23.097776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:23.098435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:23.183823 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6c4c8660-3525-4fc7-92cb-046f581b7e39 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action" status: 200 len: 14 microversion: 2.1 time: 0.109558 Oct 16 01:12:23.185121 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1488/2800] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:23 2022] POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:12:23.191645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6de56a5-b949-486f-a406-2c7f19e81e8e tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd6527a1670>, body: {"security_group_rule": {"parent_group_id": "91da7cc9-1ea9-4fd5-82d8-1f723fc36921", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4f1e374d-36db-42dc-8fbb-79075765dd9f"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:23.547300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:23.561636 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ce092f4-bfec-4306-a1b0-99d39255eef6 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1309 microversion: 2.1 time: 0.511919 Oct 16 01:12:23.562678 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1313/2801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:23 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1309 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:23.575937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82e5f3b5-a4dd-4fbc-a396-34d8de7b7a62 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd64d723310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1321055845", "description": "tempest-description-1376250653"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:23.980005 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6de56a5-b949-486f-a406-2c7f19e81e8e tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.793104 Oct 16 01:12:23.981205 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1489/2802] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:12:23 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:23.986464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:23.987237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:24.003449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:24.003950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:24.004388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:24.005095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:24.012423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:24.013358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:24.170092 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82e5f3b5-a4dd-4fbc-a396-34d8de7b7a62 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.605949 Oct 16 01:12:24.182411 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1314/2803] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:23 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:24.188666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:24.189519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:24.208305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:24.210439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:24.213362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:24.215885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:24.219990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:24.220750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:24.324255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:24.328771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:24.339374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:24.342227 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:24.343145 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c72a2b78-f6f1-4586-9dfa-dde11de91ad7 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1350 microversion: 2.1 time: 0.360732 Oct 16 01:12:24.343921 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1490/2804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:23 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1350 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:24.348204 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d658d9d-8338-4691-94e3-fd07020248aa tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.164149 Oct 16 01:12:24.348857 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1315/2805] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:24 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:24.353304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fd58082a-b0c8-4553-9511-6064ac28205b tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd6527a1550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:24.354851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3da49915-b0cf-491c-95e2-6441ff1cf6ca tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd64d6e8790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1436340061", "description": "tempest-description-573683142"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:24.995138 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fd58082a-b0c8-4553-9511-6064ac28205b tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/4f1e374d-36db-42dc-8fbb-79075765dd9f" status: 202 len: 0 microversion: 2.1 time: 0.647965 Oct 16 01:12:24.998655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1491/2806] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:24 2022] DELETE /compute/v2.1/os-security-groups/4f1e374d-36db-42dc-8fbb-79075765dd9f => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:25.001258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:25.011815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:25.038872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:25.039521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:25.039962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:25.041044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:25.041513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:25.041947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:25.184289 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d02a8e9-a62b-4b82-b414-9273a3dd6af6 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action" status: 200 len: 8208 microversion: 2.1 time: 0.186710 Oct 16 01:12:25.185124 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1492/2807] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:24 2022] POST /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348/action => generated 8208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:25.195310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:25.197909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:25.223454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:25.228701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:25.235560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:25.238223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:25.240242 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3da49915-b0cf-491c-95e2-6441ff1cf6ca tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.890102 Oct 16 01:12:25.240713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:25.242405 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1316/2808] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:25.246506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:25.248269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9624f6e9-4c98-47d9-99b7-6ec096ada041 req-8edd428d-b88a-46b8-9ee9-95c67ec2da7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc3574c-4ad5-4069-b6a1-86290bae32d5", "name": "network-vif-plugged", "status": "completed", "tag": "60b2d71e-2e49-4475-a6f6-52a9ebb44105"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:25.281286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9624f6e9-4c98-47d9-99b7-6ec096ada041 req-8edd428d-b88a-46b8-9ee9-95c67ec2da7d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:25.282520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9624f6e9-4c98-47d9-99b7-6ec096ada041 req-8edd428d-b88a-46b8-9ee9-95c67ec2da7d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:25.283376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9624f6e9-4c98-47d9-99b7-6ec096ada041 req-8edd428d-b88a-46b8-9ee9-95c67ec2da7d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:25.321583 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9624f6e9-4c98-47d9-99b7-6ec096ada041 req-8edd428d-b88a-46b8-9ee9-95c67ec2da7d service nova] Creating event network-vif-plugged:60b2d71e-2e49-4475-a6f6-52a9ebb44105 for instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 on n-h1-master-1 Oct 16 01:12:25.334965 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9624f6e9-4c98-47d9-99b7-6ec096ada041 req-8edd428d-b88a-46b8-9ee9-95c67ec2da7d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090307 Oct 16 01:12:25.342969 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1317/2809] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:25.350331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d349ab8a-e001-4fa3-bbb0-3ce2a9727074 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd64d6e84c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:25.860969 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d349ab8a-e001-4fa3-bbb0-3ce2a9727074 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/91da7cc9-1ea9-4fd5-82d8-1f723fc36921" status: 200 len: 247 microversion: 2.1 time: 0.516326 Oct 16 01:12:25.861483 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1318/2810] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:12:25 2022] GET /compute/v2.1/os-security-groups/91da7cc9-1ea9-4fd5-82d8-1f723fc36921 => generated 247 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:25.866665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:25.868039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:25.890051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:25.890548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:25.891017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:25.891748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:25.892207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:25.903282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:25.957248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:25.973569 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c3fa81b6-c1ee-45fa-9c16-a1a5a2b6b6a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1309 microversion: 2.1 time: 0.786954 Oct 16 01:12:25.978774 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1493/2811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:25 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1309 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:26.002166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:26.003634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:26.033365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:26.034331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:26.035666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:26.036658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:26.049216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:26.050094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:26.140367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:26.150027 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2793f63a-eb64-4744-b00f-4d63e46f5117 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.287339 Oct 16 01:12:26.154248 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1319/2812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:25 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:26.162143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:26.163722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:26.187340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:26.194043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:26.194480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:26.201608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:26.204041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:26.204899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:26.517834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:26.531488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:26.537276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:26.550663 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3d776784-70bd-4d18-8eb2-975a04fff6f5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.395088 Oct 16 01:12:26.552461 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1320/2813] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:26 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:26.558583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2089257106", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "78815c45-b439-4415-a27c-20b59792b91b"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:26.714740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] validate_networks() for [('78815c45-b439-4415-a27c-20b59792b91b', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:12:27.028810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:27.045595 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c9da0f0e-2ef7-4e0e-9b6f-5d4bcde0deda tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1540 microversion: 2.1 time: 1.065173 Oct 16 01:12:27.046555 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1494/2814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:25 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1540 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:27.051682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a21a9330-4002-4527-b6a2-6c03e929d01b tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd64e353a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-4391972", "description": "tempest-description-2102019169"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:27.844252 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a21a9330-4002-4527-b6a2-6c03e929d01b tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.795112 Oct 16 01:12:27.861675 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1495/2815] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:12:27 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:27.894873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:27.903506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:27.938322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:27.939576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:27.941117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:27.942433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:27.943208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:27.943898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:28.487281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:12:28.488369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:12:28.488912 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:12:28.489389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:12:28.490014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:12:28.511721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:28.512604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:28.517121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:28.518055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:28.518755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:28.520460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:28.593349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Getting quotas for project 3986cde5f07a4eeead588c344187a0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:12:28.599703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Getting quotas for user 17f95d77e66946ce9ac525cc34c61d7c and project 3986cde5f07a4eeead588c344187a0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:12:28.635771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:12:28.639151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:12:28.708737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:28.721637 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91ab7d29-1821-4316-b389-b23078249094 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.857790 Oct 16 01:12:28.740544 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1496/2816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:27 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:28.747508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:28.748514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:28.755743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:28.756113 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-127d512a-28c5-4367-8135-bd290d5c21a8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.197194 Oct 16 01:12:28.756848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1321/2817] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:12:28.764627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:28.765447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:28.765789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:28.766735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:28.767559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:28.768258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:28.787353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:28.808358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:28.809225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:28.809677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:28.818195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:28.818691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:28.819170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:29.103157 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d54dfb96-5cf7-4753-b742-fde208121435 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.344144 Oct 16 01:12:29.104126 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1322/2818] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:12:28 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219/os-interface => generated 284 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:29.109016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:29.109559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:29.123726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:29.124273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:29.124662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:29.125397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:29.125870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:29.126295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:29.221812 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:29.297455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:29.311625 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6114eb1b-a2ce-47a1-8041-a9e09ee45443 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1490 microversion: 2.1 time: 0.568951 Oct 16 01:12:29.312678 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1497/2819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:28 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1490 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:29.318306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-32df7fd5-19ba-4d57-b6a3-683e78bb8f7f tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd6527d1430>, body: {"security_group_rule": {"parent_group_id": "31bb8d23-3b74-4546-a007-656f078bc8c4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:29.409235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:29.421936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:29.423713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:29.440146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a57ad4c0-86b8-4631-ae57-729c1a52e30f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.335043 Oct 16 01:12:29.440954 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1323/2820] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:29 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:29.453225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:29.454149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:29.465203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:29.471286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:29.472050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:29.472986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:29.473716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:29.475058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:29.877624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:29.896974 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba7f36b4-4a10-41c4-bdfc-aacb9b84398d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.453106 Oct 16 01:12:29.911560 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1324/2821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:29 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:29.932700 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:29.935932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:29.951822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:29.952901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:29.954868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:29.956306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:29.958628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:29.959871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:30.075955 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-32df7fd5-19ba-4d57-b6a3-683e78bb8f7f tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.761330 Oct 16 01:12:30.077643 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1498/2822] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:12:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:30.083807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:30.085045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:30.093471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:30.094308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:30.095848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:30.096809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:30.097495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:30.098484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:30.223519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:30.236127 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed08d155-0980-4199-bd8e-a1377aa336e6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1220 microversion: 2.1 time: 0.319292 Oct 16 01:12:30.237136 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1325/2823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:29 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1220 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:30.254907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:30.255948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:30.264106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:30.284780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:30.286010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:30.292636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:30.297737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:30.298356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:30.590787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:30.608425 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d12457a6-2e7b-400c-a81d-00900ceb205a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1490 microversion: 2.1 time: 0.524822 Oct 16 01:12:30.613912 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1499/2824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:30 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1490 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:30.624117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ccd8ca2-7aca-4eb9-bdb9-c956331c8083 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Action: 'create', calling method: .version_select at 0x7fd64e353550>, body: {"security_group_rule": {"parent_group_id": "31bb8d23-3b74-4546-a007-656f078bc8c4", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:30.750301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:30.764914 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c2abd5d6-8ebe-4648-8ed7-b6a2955d3efa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.523188 Oct 16 01:12:30.766664 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1326/2825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:30 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:30.777437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:30.779810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:30.791719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:30.792641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:30.793308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:30.794499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:30.797375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:30.798413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:30.956786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:30.971526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:30.973964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:30.993136 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3410cd46-7d2c-4618-9c0f-01f71a42e011 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.221908 Oct 16 01:12:30.994494 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1327/2826] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:30 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:31.002308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:31.003466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:31.011106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.011917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.012859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.014033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.014708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.015392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.471379 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ccd8ca2-7aca-4eb9-bdb9-c956331c8083 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.856142 Oct 16 01:12:31.473138 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1500/2827] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Oct 16 01:12:30 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:31.487777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:31.491342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:31.492860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:31.502091 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6899277e-834b-4633-bb42-8358eb8c2149 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1490 microversion: 2.1 time: 0.505169 Oct 16 01:12:31.505692 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1328/2828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:30 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1490 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:31.512330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:31.513141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:31.520548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.523100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.525344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.526657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.527582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.528567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.529187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.529311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.529895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.535684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.536183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.536689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.652139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Locking {{(pid=120545) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 16 01:12:31.671331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:31.681670 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e496268-fef8-4e71-98f6-e9ef409f10ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1274 microversion: 2.1 time: 0.174015 Oct 16 01:12:31.691049 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1329/2829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:31 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:31.694289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1829ad6-1219-4285-8031-31cc90a2f5fb tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd64d6edd30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:31.765701 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:31.786877 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69586c8e-4d5d-4740-a81e-2075648e8591 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.310248 Oct 16 01:12:31.788799 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1501/2830] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:31 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:31.802483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:31.803395 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:31.822264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.823073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.823733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.826051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.827654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.828593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.873704 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1829ad6-1219-4285-8031-31cc90a2f5fb tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/31bb8d23-3b74-4546-a007-656f078bc8c4" status: 200 len: 662 microversion: 2.1 time: 0.188260 Oct 16 01:12:31.875405 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1330/2831] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:12:31 2022] GET /compute/v2.1/os-security-groups/31bb8d23-3b74-4546-a007-656f078bc8c4 => generated 662 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:31.879109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:12:31.882106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:31.883992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:31.895950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.898849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.902104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:31.903081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:31.904575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:31.905130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.039264 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-189db598-fe21-49ae-b814-6c83d1143269 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 204 len: 0 microversion: 2.1 time: 0.248260 Oct 16 01:12:32.040263 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1502/2832] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:12:31 2022] DELETE /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:12:32.048124 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2d72428f-aea7-4399-ab8d-f1d268cb3bad tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd6527aaa60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:32.311510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:32.322512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac81fd67-4ef4-4e76-a011-eb3ff5b027c8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.445794 Oct 16 01:12:32.326357 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1331/2833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:31 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:32.333131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:32.333887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:32.341455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.342297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.343152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.344307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.345062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.345829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.447167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:32.463710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:32.469111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:32.480160 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a788610e-5e95-4581-b0f2-8e9863df2b20 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1535 microversion: 2.91 time: 0.152515 Oct 16 01:12:32.481435 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1332/2834] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:32 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1535 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:32.485853 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2d72428f-aea7-4399-ab8d-f1d268cb3bad tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/963c41ce-796a-4bd6-8a18-cc9b840cd942" status: 202 len: 0 microversion: 2.1 time: 0.444201 Oct 16 01:12:32.487273 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1503/2835] 10.222.0.39 () {58 vars in 1287 bytes} [Sun Oct 16 01:12:32 2022] DELETE /compute/v2.1/os-security-group-rules/963c41ce-796a-4bd6-8a18-cc9b840cd942 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:32.488745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:32.490030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:32.499068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abb8896d-27e1-4407-a98b-73f2a33b6902 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:32.505613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.506019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abb8896d-27e1-4407-a98b-73f2a33b6902 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.506474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.506858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abb8896d-27e1-4407-a98b-73f2a33b6902 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.507518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abb8896d-27e1-4407-a98b-73f2a33b6902 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.508605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.511829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.512526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.513059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.535917 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-abb8896d-27e1-4407-a98b-73f2a33b6902 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] HTTP exception thrown: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 is locked Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abb8896d-27e1-4407-a98b-73f2a33b6902 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Request method failure captured: Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action HTTP/1.1 Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lCQssGoLCMTEsVMxK-f6QYxp_nX9s1U_rgMVcFCuMNSWEj-XbEz5zL0fxYzYm8bfkANKAnDQ-EKcPXRqRLjNfVJQtzFY6v1LO99t-h7BlAjJTxhH4ZuAOw2s3x8zmxyligHjIsACPLjAzGVmPXDbD8mG6VEANNtObMLP94eBVvVlc Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb799a0263a14d1a93ba6e3fd37c260a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-616665436 Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0c8da9a32cb54d0a87d914234b1e9f40 Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: {"os-stop": {}} Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: exception: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 is locked Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'c8bd887d-2505-40d6-bbbf-e3cdd79c4f90', 'body': {'os-stop': {}}} Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 is locked Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 is locked Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 is locked Oct 16 01:12:32.537752 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:32.542519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abb8896d-27e1-4407-a98b-73f2a33b6902 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Returning 409 to user: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 is locked {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:32.542519 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abb8896d-27e1-4407-a98b-73f2a33b6902 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 409 len: 107 microversion: 2.1 time: 0.052072 Oct 16 01:12:32.542519 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1504/2836] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:32 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 107 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:12:32.545548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-138abe1a-1ab8-4ce1-ba20-d8f514901fd4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd6527a4f70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:32.751850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:32.762810 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ae0be548-f78e-4bef-a3cb-62f64ec6f945 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1496 microversion: 2.1 time: 0.279994 Oct 16 01:12:32.763402 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1333/2837] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:32 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1496 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:32.777605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:32.778579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:32.785900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.786715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.787378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.788218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.788778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.789360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.860806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Unlocking {{(pid=120546) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 16 01:12:32.864187 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-138abe1a-1ab8-4ce1-ba20-d8f514901fd4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/31bb8d23-3b74-4546-a007-656f078bc8c4" status: 202 len: 0 microversion: 2.1 time: 0.322210 Oct 16 01:12:32.865139 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1505/2838] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:32 2022] DELETE /compute/v2.1/os-security-groups/31bb8d23-3b74-4546-a007-656f078bc8c4 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:32.870984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:32.872659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:32.885602 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:32.889674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.895217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.895881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.897039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:32.897710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:32.898336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:32.965194 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e3f55e04-6c4e-4df5-b556-a0e345f0d1ab tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.194284 Oct 16 01:12:32.966669 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1334/2839] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:32 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:32.974892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-174deae9-6a99-4089-952b-a5c619fad8d4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd64d6f91f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:33.002674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:33.016512 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cdfac777-afdd-4cd2-a5ec-85a029236424 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1274 microversion: 2.1 time: 0.150106 Oct 16 01:12:33.027801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1506/2840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:32 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:33.037206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-87162afb-9e58-4383-a69e-223bcca3ff62 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:33.037589 n-d-master-1 devstack@n-api.service[120546]: DEBUG neutronclient.v2_0.client [None req-174deae9-6a99-4089-952b-a5c619fad8d4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f1e374d-36db-42dc-8fbb-79075765dd9f does not exist", "detail": ""}} {{(pid=120546) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:33.038276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.security_group_api [None req-174deae9-6a99-4089-952b-a5c619fad8d4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Neutron security group 4f1e374d-36db-42dc-8fbb-79075765dd9f not found {{(pid=120546) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:12:33.038872 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-174deae9-6a99-4089-952b-a5c619fad8d4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] HTTP exception thrown: Security group 4f1e374d-36db-42dc-8fbb-79075765dd9f does not exist Oct 16 01:12:33.038872 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-df9307a2-3a65-4378-abe1-03800c8c6060'] Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-174deae9-6a99-4089-952b-a5c619fad8d4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Request method failure captured: Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/os-security-groups/4f1e374d-36db-42dc-8fbb-79075765dd9f HTTP/1.1 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1prCjCjLIqx3LkuVJk4uNVFm0hEaacIQ-Ttb3AUdIKX84qasm4DJjBiUNEVSBV9MmdFIz8_8xIDzBRvg4PGCMeiUeZrJhbRxk21yZKTBDqw3qmd27jco5VLw66n49ssh4yc_E42NxzAeXJTLQQyhR8_ScOCoWZ2k1uPDRfaiE4r2jg Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 8747e7b25c434abfbdb3e7f981ef8fc8 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-542933476 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8747e7b25c434abfbdb3e7f981ef8fc8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8747e7b25c434abfbdb3e7f981ef8fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8747e7b25c434abfbdb3e7f981ef8fc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8747e7b25c434abfbdb3e7f981ef8fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupRulesTestJSON-542933476 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 8747e7b25c434abfbdb3e7f981ef8fc8 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-542933476 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupRulesTestJSON-542933476-project Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ebca99f6818548b982e94948327522b5 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupRulesTestJSON-542933476-project Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: exception: Security group 4f1e374d-36db-42dc-8fbb-79075765dd9f does not exist Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-df9307a2-3a65-4378-abe1-03800c8c6060'] Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4f1e374d-36db-42dc-8fbb-79075765dd9f'} Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:33.042679 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4f1e374d-36db-42dc-8fbb-79075765dd9f does not exist Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df9307a2-3a65-4378-abe1-03800c8c6060'] Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4f1e374d-36db-42dc-8fbb-79075765dd9f does not exist Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df9307a2-3a65-4378-abe1-03800c8c6060'] Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4f1e374d-36db-42dc-8fbb-79075765dd9f does not exist Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df9307a2-3a65-4378-abe1-03800c8c6060'] Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4f1e374d-36db-42dc-8fbb-79075765dd9f does not exist Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df9307a2-3a65-4378-abe1-03800c8c6060'] Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-174deae9-6a99-4089-952b-a5c619fad8d4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Returning 404 to user: Security group 4f1e374d-36db-42dc-8fbb-79075765dd9f does not exist Oct 16 01:12:33.047135 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-df9307a2-3a65-4378-abe1-03800c8c6060'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:33.050609 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-174deae9-6a99-4089-952b-a5c619fad8d4 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/4f1e374d-36db-42dc-8fbb-79075765dd9f" status: 404 len: 194 microversion: 2.1 time: 0.080143 Oct 16 01:12:33.051175 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1335/2841] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:32 2022] DELETE /compute/v2.1/os-security-groups/4f1e374d-36db-42dc-8fbb-79075765dd9f => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:33.055377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87162afb-9e58-4383-a69e-223bcca3ff62 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:33.056513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87162afb-9e58-4383-a69e-223bcca3ff62 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:33.057523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-8e9a5367-e9fc-4f94-bd53-388af1abd2f1 req-c543c86c-99c0-4cb0-b93b-0d07df4964d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219", "tag": "ae7e0904-3430-4daa-9aca-2e07fd0e9fe3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:33.062132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87162afb-9e58-4383-a69e-223bcca3ff62 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:33.069152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8e9a5367-e9fc-4f94-bd53-388af1abd2f1 req-c543c86c-99c0-4cb0-b93b-0d07df4964d2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:33.069784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8e9a5367-e9fc-4f94-bd53-388af1abd2f1 req-c543c86c-99c0-4cb0-b93b-0d07df4964d2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:33.070403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8e9a5367-e9fc-4f94-bd53-388af1abd2f1 req-c543c86c-99c0-4cb0-b93b-0d07df4964d2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:33.082325 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-8e9a5367-e9fc-4f94-bd53-388af1abd2f1 req-c543c86c-99c0-4cb0-b93b-0d07df4964d2 service nova] Creating event network-changed:ae7e0904-3430-4daa-9aca-2e07fd0e9fe3 for instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 on n-h2-master-1 Oct 16 01:12:33.087840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-87162afb-9e58-4383-a69e-223bcca3ff62 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Going to try to stop instance {{(pid=120545) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:12:33.089210 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-8e9a5367-e9fc-4f94-bd53-388af1abd2f1 req-c543c86c-99c0-4cb0-b93b-0d07df4964d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036474 Oct 16 01:12:33.090058 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1336/2842] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:33.095781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-415fbd05-daed-430b-9b49-28e50626d1e1 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd64d6f9f70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:33.150655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-87162afb-9e58-4383-a69e-223bcca3ff62 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.121369 Oct 16 01:12:33.152063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1507/2843] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:33 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:33.163273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:33.167011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:33.182423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:33.183338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:33.184000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:33.185705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:33.186660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:33.188137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:33.424382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:33.433943 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d5985def-c78f-478d-8b6d-d1e9c68e4980 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.277167 Oct 16 01:12:33.435594 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1508/2844] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:33 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:33.453625 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-415fbd05-daed-430b-9b49-28e50626d1e1 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/91da7cc9-1ea9-4fd5-82d8-1f723fc36921" status: 202 len: 0 microversion: 2.1 time: 0.362055 Oct 16 01:12:33.454542 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1337/2845] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:33 2022] DELETE /compute/v2.1/os-security-groups/91da7cc9-1ea9-4fd5-82d8-1f723fc36921 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:33.465889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9340386b-ccd9-4a1f-9941-eeca2a91377c tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd6527a41f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:33.515104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:33.515888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:33.524411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:33.525247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:33.526957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:33.527863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:33.528634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:33.529231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:33.661548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:33.679609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:33.681097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:33.693144 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2a0250e4-5252-4e8a-b78d-381ebe75f84f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1535 microversion: 2.91 time: 0.182782 Oct 16 01:12:33.694176 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1338/2846] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:33 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1535 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:12:33.785913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:33.786769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:33.793724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:33.794520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:33.795216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:33.796141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:33.796797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:33.797440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:34.108873 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9340386b-ccd9-4a1f-9941-eeca2a91377c tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/6908abf4-d8c1-4dc7-bc3a-c8103d312843" status: 202 len: 0 microversion: 2.1 time: 0.648877 Oct 16 01:12:34.109349 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1509/2847] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:33 2022] DELETE /compute/v2.1/os-security-groups/6908abf4-d8c1-4dc7-bc3a-c8103d312843 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:12:34.119150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:34.120069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:34.130663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:34.131343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:34.131914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:34.133441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:34.134021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:34.134686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:34.163380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:34.174975 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-091fd770-27c2-4f55-accd-1534fbed87b7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1496 microversion: 2.1 time: 0.392982 Oct 16 01:12:34.176793 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1339/2848] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:33 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1496 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:34.184130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-690dc307-36ad-47ce-b899-87f0116599d2 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd64d750d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:34.517591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:34.526312 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-72812fc5-cbc7-49a9-82a0-462b6125df58 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 0.412207 Oct 16 01:12:34.529480 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1510/2849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:34 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:34.564325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:34.565545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:34.573296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:34.574023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:34.574629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:34.575558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:34.576171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:34.576759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:34.952697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-690dc307-36ad-47ce-b899-87f0116599d2 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/53ea8ca9-0332-4be1-b0ed-0ee9198f62fc" status: 202 len: 0 microversion: 2.1 time: 0.774797 Oct 16 01:12:34.953648 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1340/2850] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:34 2022] DELETE /compute/v2.1/os-security-groups/53ea8ca9-0332-4be1-b0ed-0ee9198f62fc => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:34.959506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:34.960118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:34.977454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:34.979708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:34.980178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:34.980916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:34.981377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:34.981799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:35.259096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:35.271187 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-90585e00-04be-47ac-87da-36e693a3cce2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.736826 Oct 16 01:12:35.271926 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1511/2851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:34 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:35.302213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-35beb51c-db4a-4e9d-8468-f4f4ebd5d05e tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd64e0bb0d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:35.577360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:35.593532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:35.600795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:35.656293 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85fff04b-2a6f-4ff1-9602-797eeb42a158 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1535 microversion: 2.91 time: 0.701211 Oct 16 01:12:35.664580 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1341/2852] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:34 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1535 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:35.673585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-cff2efb0-3461-47f2-9645-7fd0112c7a9f req-8e3a41c0-b0b8-410c-8bf4-fe96ef73fcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc3574c-4ad5-4069-b6a1-86290bae32d5", "name": "network-vif-deleted", "tag": "60b2d71e-2e49-4475-a6f6-52a9ebb44105"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:35.699050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cff2efb0-3461-47f2-9645-7fd0112c7a9f req-8e3a41c0-b0b8-410c-8bf4-fe96ef73fcbb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:35.699916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cff2efb0-3461-47f2-9645-7fd0112c7a9f req-8e3a41c0-b0b8-410c-8bf4-fe96ef73fcbb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:35.700571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cff2efb0-3461-47f2-9645-7fd0112c7a9f req-8e3a41c0-b0b8-410c-8bf4-fe96ef73fcbb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:35.726049 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-cff2efb0-3461-47f2-9645-7fd0112c7a9f req-8e3a41c0-b0b8-410c-8bf4-fe96ef73fcbb service nova] Creating event network-vif-deleted:60b2d71e-2e49-4475-a6f6-52a9ebb44105 for instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 on n-h1-master-1 Oct 16 01:12:35.747694 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-cff2efb0-3461-47f2-9645-7fd0112c7a9f req-8e3a41c0-b0b8-410c-8bf4-fe96ef73fcbb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081537 Oct 16 01:12:35.750021 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1342/2853] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:35.757668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:35.759248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:35.772312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:35.772803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:35.773241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:35.774605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:35.775100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:35.775524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:35.799771 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:35.813210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:35.813699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:35.814326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:35.814671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lazy-loading 'fault' on Instance uuid 0cc3574c-4ad5-4069-b6a1-86290bae32d5 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:12:35.911817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:35.928374 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-211193db-b226-4cc8-9dc7-9508fa3bb3f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 200 len: 1299 microversion: 2.1 time: 0.176656 Oct 16 01:12:35.929271 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1343/2854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:35 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:35.934594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:35.935229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:35.951797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:35.952297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:35.952739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:35.953450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:35.953968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:35.954316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:36.351168 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-35beb51c-db4a-4e9d-8468-f4f4ebd5d05e tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/7c5d8453-df72-4730-9707-26fe1e51ce1d" status: 202 len: 0 microversion: 2.1 time: 1.065546 Oct 16 01:12:36.355716 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1512/2855] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:35 2022] DELETE /compute/v2.1/os-security-groups/7c5d8453-df72-4730-9707-26fe1e51ce1d => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:36.360900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:36.361518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:36.376586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:36.379369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:36.382219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:36.383381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:36.384037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:36.385775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:36.971423 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:36.982230 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-248fd018-ac50-4f3e-94a9-f26433802648 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 1.050904 Oct 16 01:12:37.000269 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1344/2856] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:35 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:37.005194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85fcdd62-7e64-4b16-bcad-ea9233bf9114 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] Calling method '.version_select at 0x7fd64d6dbe50>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:37.190500 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:37.205328 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83b91dbc-8cb1-4770-bc86-968e36a17e5a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.848099 Oct 16 01:12:37.207853 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1513/2857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:36 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:37.215321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:37.216304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:37.225768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.226531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.227410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.229410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.230103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.230626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.444664 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:37.462510 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:37.468247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:37.475438 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8efa4179-b45c-449c-9be3-89e379c207bb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1478 microversion: 2.91 time: 0.265580 Oct 16 01:12:37.477056 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1514/2858] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:37 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1478 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:37.483066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:37.484178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:37.497873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.498794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.499494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.500459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.501161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.501811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.527362 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 HTTP/1.1 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '0cc3574c-4ad5-4069-b6a1-86290bae32d5'} Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:37.535861 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:37.540057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:37.540057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:37.540057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:37.540057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:37.540057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:12:37.540057 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:37.550741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:37.552452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9077632f-7fca-4577-9606-9f1ffc7e9a4b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 404 len: 111 microversion: 2.1 time: 0.073856 Oct 16 01:12:37.553716 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1515/2859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:37 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:37.560403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d9be3a8f-8bd0-4a74-a5d6-9b2dddd9c922 req-95ed27fc-37fb-4642-94f8-80f05477aab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c741ee8-74ef-4feb-bc05-d01a47195446", "tag": "2e367a32-57a9-4501-8aab-6af3c3d2d359"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:37.572964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d9be3a8f-8bd0-4a74-a5d6-9b2dddd9c922 req-95ed27fc-37fb-4642-94f8-80f05477aab3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.573825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d9be3a8f-8bd0-4a74-a5d6-9b2dddd9c922 req-95ed27fc-37fb-4642-94f8-80f05477aab3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.574711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d9be3a8f-8bd0-4a74-a5d6-9b2dddd9c922 req-95ed27fc-37fb-4642-94f8-80f05477aab3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.589421 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d9be3a8f-8bd0-4a74-a5d6-9b2dddd9c922 req-95ed27fc-37fb-4642-94f8-80f05477aab3 service nova] Creating event network-changed:2e367a32-57a9-4501-8aab-6af3c3d2d359 for instance 4c741ee8-74ef-4feb-bc05-d01a47195446 on n-h2-master-1 Oct 16 01:12:37.596121 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d9be3a8f-8bd0-4a74-a5d6-9b2dddd9c922 req-95ed27fc-37fb-4642-94f8-80f05477aab3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040362 Oct 16 01:12:37.597603 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1516/2860] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:37.603642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:37.606959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:37.615189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.616067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.623078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.624399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.625162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.625844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.668393 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85fcdd62-7e64-4b16-bcad-ea9233bf9114 tempest-SecurityGroupRulesTestJSON-542933476 tempest-SecurityGroupRulesTestJSON-542933476-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/a4e266a0-df16-4fbd-9196-4c0e75c334be" status: 202 len: 0 microversion: 2.1 time: 0.666823 Oct 16 01:12:37.668990 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1345/2861] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:37 2022] DELETE /compute/v2.1/os-security-groups/a4e266a0-df16-4fbd-9196-4c0e75c334be => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:37.674354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:37.675100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:37.688767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.689275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.689719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.690429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.690890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.691346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.735013 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:12:37.861499 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab3124c9-6feb-4d75-841c-2a93bd236f9b tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 204 len: 0 microversion: 2.1 time: 0.190769 Oct 16 01:12:37.863166 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1346/2862] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:12:37 2022] DELETE /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:12:37.872907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:37.873950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:37.881279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.881787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.891529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.893050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:37.894614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:37.895317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:37.902990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-master-1". {{(pid=120545) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 01:12:38.044863 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea1f01e4-cd15-47a4-8a2b-61b47efbbdd6 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e/action" status: 202 len: 0 microversion: 2.91 time: 0.445582 Oct 16 01:12:38.045816 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1517/2863] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:12:37 2022] POST /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:12:38.053274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:38.054063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:38.062129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:38.062837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:38.063333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:38.064194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:38.064644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:38.065265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:38.453221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:38.462180 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7efd05b0-e186-472b-9646-68c17a22f5a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1496 microversion: 2.1 time: 0.593852 Oct 16 01:12:38.462848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1347/2864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:37 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1496 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:38.468469 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:38.469248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:38.476483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:38.477153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:38.477755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:38.478616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:38.479255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:38.479875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:38.568444 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:38.617967 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:38.623145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:38.633347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:38.634244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:38.636029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:38.640158 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:38.645281 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-12dc45c4-e41d-47de-a189-d0232542bce0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 0.598230 Oct 16 01:12:38.646181 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d4364a4-1844-457f-968d-64845cf6ed3d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1486 microversion: 2.91 time: 0.181413 Oct 16 01:12:38.647353 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1348/2865] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:38 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1486 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:38.653239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:38.654148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:38.661879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:38.662712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:38.663552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:38.664525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:38.665178 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1518/2866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:38 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:38.665403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:38.665840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:39.094878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:39.104175 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f7934a17-4913-4af8-a328-6e11b7b1147c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.454687 Oct 16 01:12:39.105161 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1349/2867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:38 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:39.488040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:39.490198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:39.504050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:39.509919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:39.510731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:39.511813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:39.515788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:39.516497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:39.671247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:39.671930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:39.688632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:39.689314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:39.689823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:39.690554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:39.691046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:39.691476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:39.826264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:39.843983 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e7e7656-3ebb-48a5-9804-50aa2e69362c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1496 microversion: 2.1 time: 0.361470 Oct 16 01:12:39.845944 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1519/2868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:39 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1496 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:39.853067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:39.854040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:39.862768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:39.863673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:39.864318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:39.865590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:39.866388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:39.867955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:39.874766 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:40.298616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:40.310431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:40.312869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:40.319949 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-86566da9-6dd0-4496-bff2-9ba005b9257e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.472788 Oct 16 01:12:40.322231 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1520/2869] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:39 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:40.329724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:40.330624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:40.340124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:40.340938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:40.341699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:40.342895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:40.343766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:40.344563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:40.569294 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:40.582431 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8cf0216-4658-4601-b71a-abdfd74ccef9 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 0.915007 Oct 16 01:12:40.583043 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1350/2870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:39 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:40.673759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-28b3fc76-d0a9-4a36-be83-4b94b8a3d85e req-adec3f4a-8a85-4a82-9b15-0450cb0fa26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cd5566-b29c-4a2b-8b91-26dd91bf207e", "name": "network-vif-deleted", "tag": "5d3e3e8e-9926-4aba-88c1-f362cb41d97c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:40.686886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-28b3fc76-d0a9-4a36-be83-4b94b8a3d85e req-adec3f4a-8a85-4a82-9b15-0450cb0fa26d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:40.692564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-28b3fc76-d0a9-4a36-be83-4b94b8a3d85e req-adec3f4a-8a85-4a82-9b15-0450cb0fa26d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:40.693126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-28b3fc76-d0a9-4a36-be83-4b94b8a3d85e req-adec3f4a-8a85-4a82-9b15-0450cb0fa26d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:40.723056 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-28b3fc76-d0a9-4a36-be83-4b94b8a3d85e req-adec3f4a-8a85-4a82-9b15-0450cb0fa26d service nova] Creating event network-vif-deleted:5d3e3e8e-9926-4aba-88c1-f362cb41d97c for instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e on n-h2-master-1 Oct 16 01:12:40.731352 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-28b3fc76-d0a9-4a36-be83-4b94b8a3d85e req-adec3f4a-8a85-4a82-9b15-0450cb0fa26d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060995 Oct 16 01:12:40.731941 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1351/2871] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:12:40.800683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:40.816843 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc61006a-4f58-4ab0-b1f3-6576532c7045 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.492893 Oct 16 01:12:40.825577 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1521/2872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:40 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:40.870968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:40.872039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:40.888207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:40.889023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:40.889701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:40.890676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:40.895523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:40.896353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:41.167349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:41.185534 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4bd2a831-44a2-4b83-8210-32c88fcdda49 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 200 len: 1454 microversion: 2.1 time: 0.319492 Oct 16 01:12:41.188534 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1352/2873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:40 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 1454 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:41.352684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:41.353853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:41.385623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:41.410341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:41.414502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:41.417927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:41.422105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:41.424031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:41.485112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-032dda30-b1d9-4606-9eeb-4ad03c3be6c8 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Calling method '.version_select at 0x7fd6527a41f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:41.568005 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-032dda30-b1d9-4606-9eeb-4ad03c3be6c8 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f3e85cd0-edcb-46b9-8657-554684b4db3b does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:41.568661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-032dda30-b1d9-4606-9eeb-4ad03c3be6c8 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Neutron security group f3e85cd0-edcb-46b9-8657-554684b4db3b not found {{(pid=120545) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:12:41.569196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-032dda30-b1d9-4606-9eeb-4ad03c3be6c8 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] HTTP exception thrown: Security group f3e85cd0-edcb-46b9-8657-554684b4db3b does not exist Oct 16 01:12:41.569196 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3bfa9970-6ac0-4156-bc7c-b4c5fcb0207d'] Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-032dda30-b1d9-4606-9eeb-4ad03c3be6c8 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Request method failure captured: Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-security-groups/f3e85cd0-edcb-46b9-8657-554684b4db3b HTTP/1.1 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1qI-np6szh4G4xbnu_di4zhpVgBqj_idbuQCIDVuI_mVh9L5Etx16f8goefkPDSR2Du0tph1kr0FWPce3iKk832U0nVhIz2P0HR9JNtkT58q64CtybYe05GVkl8hZwa_yLmxoqTQedJihdJSonYUHnHn4rpYmQJXaW9tGPJVH8rzJ0 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 325693aecd4344b9a9ee136574fea515 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_325693aecd4344b9a9ee136574fea515", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/325693aecd4344b9a9ee136574fea515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/325693aecd4344b9a9ee136574fea515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/325693aecd4344b9a9ee136574fea515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 325693aecd4344b9a9ee136574fea515 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsNegativeTestJSON-613225131-project Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 61dc016688674a9991b1d89c17e37fbc Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-613225131-project Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: exception: Security group f3e85cd0-edcb-46b9-8657-554684b4db3b does not exist Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3bfa9970-6ac0-4156-bc7c-b4c5fcb0207d'] Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f3e85cd0-edcb-46b9-8657-554684b4db3b'} Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:41.574101 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f3e85cd0-edcb-46b9-8657-554684b4db3b does not exist Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bfa9970-6ac0-4156-bc7c-b4c5fcb0207d'] Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f3e85cd0-edcb-46b9-8657-554684b4db3b does not exist Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bfa9970-6ac0-4156-bc7c-b4c5fcb0207d'] Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f3e85cd0-edcb-46b9-8657-554684b4db3b does not exist Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bfa9970-6ac0-4156-bc7c-b4c5fcb0207d'] Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f3e85cd0-edcb-46b9-8657-554684b4db3b does not exist Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bfa9970-6ac0-4156-bc7c-b4c5fcb0207d'] Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-032dda30-b1d9-4606-9eeb-4ad03c3be6c8 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Returning 404 to user: Security group f3e85cd0-edcb-46b9-8657-554684b4db3b does not exist Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3bfa9970-6ac0-4156-bc7c-b4c5fcb0207d'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-032dda30-b1d9-4606-9eeb-4ad03c3be6c8 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/f3e85cd0-edcb-46b9-8657-554684b4db3b" status: 404 len: 194 microversion: 2.1 time: 0.469360 Oct 16 01:12:41.577817 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1522/2874] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:41 2022] DELETE /compute/v2.1/os-security-groups/f3e85cd0-edcb-46b9-8657-554684b4db3b => generated 194 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:41.589367 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dca814cb-945f-4abd-8c8e-2d4a355106c4 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005735 Oct 16 01:12:41.589905 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1523/2875] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Oct 16 01:12:41 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 16 01:12:41.641366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-388074cc-a8fb-4fe6-836b-7229bc1b5364 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Calling method '.version_select at 0x7fd6527a4ee0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:41.840371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:41.852764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:41.860769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:41.884055 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-002354f8-cb71-4e6e-b047-aaf2116daedb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.536810 Oct 16 01:12:41.884914 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1353/2876] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:41 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:12:41.911963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:41.912589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:41.936146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:41.936360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:41.936658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:41.937475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:41.942584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:41.943139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:42.485416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:42.495691 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-93c10938-c9d7-4596-8353-243da2d201e4 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 0.608900 Oct 16 01:12:42.513723 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1354/2877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:41 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:42.540352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:42.546945 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:42.566863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:42.571095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:42.571918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:42.574318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:42.576521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:42.579500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:42.651920 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-388074cc-a8fb-4fe6-836b-7229bc1b5364 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.031638 Oct 16 01:12:42.662143 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1524/2878] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:12:41 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:42.667525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:42.668365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:42.704600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:42.710004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:42.710765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:42.711700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:42.712329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:42.713108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:42.753525 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e HTTP/1.1 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '13cd5566-b29c-4a2b-8b91-26dd91bf207e'} Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:42.771882 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:42.776715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:42.776715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:42.776715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:42.776715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:42.776715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:12:42.776715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:42.776715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:42.776715 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f7272e4e-1c6f-451b-b023-220170632543 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 404 len: 111 microversion: 2.1 time: 0.110888 Oct 16 01:12:42.778686 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1525/2879] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:42 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:42.786433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d165635-c18c-45c7-b081-7147ff3e5111 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Calling method '.version_select at 0x7fd6527d8040>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:43.247586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:43.262979 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81be8bfb-42bd-4026-a97f-066b198ce15a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.746863 Oct 16 01:12:43.266230 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1355/2880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:42 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:43.276912 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:43.282281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:43.301999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:43.305028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:43.305702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:43.306624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:43.308533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:43.309164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:43.474579 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-4d165635-c18c-45c7-b081-7147ff3e5111 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:43.475501 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4d165635-c18c-45c7-b081-7147ff3e5111 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 16 01:12:43.475501 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-a8fa8b83-14e1-4854-9f85-3dedd100a7eb'] Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d165635-c18c-45c7-b081-7147ff3e5111 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Request method failure captured: Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-security-groups/07310d02-669e-43ad-960c-c6fd9522221d HTTP/1.1 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1qI-np6szh4G4xbnu_di4zhpVgBqj_idbuQCIDVuI_mVh9L5Etx16f8goefkPDSR2Du0tph1kr0FWPce3iKk832U0nVhIz2P0HR9JNtkT58q64CtybYe05GVkl8hZwa_yLmxoqTQedJihdJSonYUHnHn4rpYmQJXaW9tGPJVH8rzJ0 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 325693aecd4344b9a9ee136574fea515 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_325693aecd4344b9a9ee136574fea515", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/325693aecd4344b9a9ee136574fea515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/325693aecd4344b9a9ee136574fea515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/325693aecd4344b9a9ee136574fea515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 325693aecd4344b9a9ee136574fea515 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsNegativeTestJSON-613225131-project Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 61dc016688674a9991b1d89c17e37fbc Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-613225131-project Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: exception: Insufficient rights for removing default security group. Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-a8fa8b83-14e1-4854-9f85-3dedd100a7eb'] Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '07310d02-669e-43ad-960c-c6fd9522221d'} Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:43.480328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8fa8b83-14e1-4854-9f85-3dedd100a7eb'] Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8fa8b83-14e1-4854-9f85-3dedd100a7eb'] Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8fa8b83-14e1-4854-9f85-3dedd100a7eb'] Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8fa8b83-14e1-4854-9f85-3dedd100a7eb'] Oct 16 01:12:43.484825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:43.495221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d165635-c18c-45c7-b081-7147ff3e5111 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 16 01:12:43.495221 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-a8fa8b83-14e1-4854-9f85-3dedd100a7eb'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:43.496352 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d165635-c18c-45c7-b081-7147ff3e5111 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/07310d02-669e-43ad-960c-c6fd9522221d" status: 400 len: 182 microversion: 2.1 time: 0.716662 Oct 16 01:12:43.497110 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1526/2881] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:42 2022] DELETE /compute/v2.1/os-security-groups/07310d02-669e-43ad-960c-c6fd9522221d => generated 182 bytes in 718 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:12:43.517638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-241880438", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e837775c-af35-4cb2-89ea-5a342e83cc6f"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:43.572987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:43.595565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:43.603776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:43.623745 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-95b4df04-8447-40d3-bb8d-5c959e947006 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.356155 Oct 16 01:12:43.624358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1356/2882] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:43 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:43.633758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e740a036-f2b2-4059-a30f-19b4f74d521b tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Calling method '.version_select at 0x7fd64d6df670>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:43.693681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] validate_networks() for [('e837775c-af35-4cb2-89ea-5a342e83cc6f', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:12:43.982873 n-d-master-1 devstack@n-api.service[120546]: DEBUG neutronclient.v2_0.client [None req-e740a036-f2b2-4059-a30f-19b4f74d521b tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 does not exist", "detail": ""}} {{(pid=120546) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:43.984927 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.security_group_api [None req-e740a036-f2b2-4059-a30f-19b4f74d521b tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Neutron security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 not found {{(pid=120546) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:12:43.988089 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e740a036-f2b2-4059-a30f-19b4f74d521b tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] HTTP exception thrown: Security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 does not exist Oct 16 01:12:43.988089 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-bdbe5a3f-e0c7-4fb5-af08-cc96ce250746'] Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e740a036-f2b2-4059-a30f-19b4f74d521b tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Request method failure captured: Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-security-groups/967ef5b8-5124-41e9-a2e5-6aa2bfe00017 HTTP/1.1 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1qI-np6szh4G4xbnu_di4zhpVgBqj_idbuQCIDVuI_mVh9L5Etx16f8goefkPDSR2Du0tph1kr0FWPce3iKk832U0nVhIz2P0HR9JNtkT58q64CtybYe05GVkl8hZwa_yLmxoqTQedJihdJSonYUHnHn4rpYmQJXaW9tGPJVH8rzJ0 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 325693aecd4344b9a9ee136574fea515 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_325693aecd4344b9a9ee136574fea515", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/325693aecd4344b9a9ee136574fea515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/325693aecd4344b9a9ee136574fea515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/325693aecd4344b9a9ee136574fea515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 325693aecd4344b9a9ee136574fea515 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsNegativeTestJSON-613225131-project Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 61dc016688674a9991b1d89c17e37fbc Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-613225131-project Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: exception: Security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 does not exist Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-bdbe5a3f-e0c7-4fb5-af08-cc96ce250746'] Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '967ef5b8-5124-41e9-a2e5-6aa2bfe00017'} Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:43.996513 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 does not exist Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdbe5a3f-e0c7-4fb5-af08-cc96ce250746'] Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 does not exist Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdbe5a3f-e0c7-4fb5-af08-cc96ce250746'] Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 does not exist Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdbe5a3f-e0c7-4fb5-af08-cc96ce250746'] Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 does not exist Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bdbe5a3f-e0c7-4fb5-af08-cc96ce250746'] Oct 16 01:12:44.000225 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:44.008020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e740a036-f2b2-4059-a30f-19b4f74d521b tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Returning 404 to user: Security group 967ef5b8-5124-41e9-a2e5-6aa2bfe00017 does not exist Oct 16 01:12:44.008020 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-bdbe5a3f-e0c7-4fb5-af08-cc96ce250746'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:44.009163 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e740a036-f2b2-4059-a30f-19b4f74d521b tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/967ef5b8-5124-41e9-a2e5-6aa2bfe00017" status: 404 len: 194 microversion: 2.1 time: 0.381680 Oct 16 01:12:44.010777 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1357/2883] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:12:43 2022] GET /compute/v2.1/os-security-groups/967ef5b8-5124-41e9-a2e5-6aa2bfe00017 => generated 194 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:44.034515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:44.044871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:44.069618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:44.073552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:44.074067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:44.077780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:44.079375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:44.086376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:44.951511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:44.968481 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a231996a-d737-44de-9c93-16f0a8b58bda tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 0.956478 Oct 16 01:12:44.971584 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1358/2884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:44 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:44.987778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-26eb1508-b905-4109-91f1-ad9cdf6b8423 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Action: 'update', calling method: .version_select at 0x7fd64d6df0d0>, body: {"security_group": {"name": "tempest-sg-984817373", "description": "tempest-description-1543625398"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:45.120217 n-d-master-1 devstack@n-api.service[120546]: DEBUG neutronclient.v2_0.client [None req-26eb1508-b905-4109-91f1-ad9cdf6b8423 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70721d21-bc0e-4d63-94b6-d90176ee8347 does not exist", "detail": ""}} {{(pid=120546) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:45.120930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.security_group_api [None req-26eb1508-b905-4109-91f1-ad9cdf6b8423 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Neutron security group 70721d21-bc0e-4d63-94b6-d90176ee8347 not found {{(pid=120546) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:12:45.121739 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-26eb1508-b905-4109-91f1-ad9cdf6b8423 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] HTTP exception thrown: Security group 70721d21-bc0e-4d63-94b6-d90176ee8347 does not exist Oct 16 01:12:45.121739 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-f2dea015-5813-4f25-9bc2-a1a771b921e4'] Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-26eb1508-b905-4109-91f1-ad9cdf6b8423 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Request method failure captured: Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/os-security-groups/70721d21-bc0e-4d63-94b6-d90176ee8347 HTTP/1.1 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 101 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1qI-np6szh4G4xbnu_di4zhpVgBqj_idbuQCIDVuI_mVh9L5Etx16f8goefkPDSR2Du0tph1kr0FWPce3iKk832U0nVhIz2P0HR9JNtkT58q64CtybYe05GVkl8hZwa_yLmxoqTQedJihdJSonYUHnHn4rpYmQJXaW9tGPJVH8rzJ0 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 325693aecd4344b9a9ee136574fea515 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_325693aecd4344b9a9ee136574fea515", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/325693aecd4344b9a9ee136574fea515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/325693aecd4344b9a9ee136574fea515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/325693aecd4344b9a9ee136574fea515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 325693aecd4344b9a9ee136574fea515 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-613225131 Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsNegativeTestJSON-613225131-project Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 61dc016688674a9991b1d89c17e37fbc Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-613225131-project Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: {"security_group": {"name": "tempest-sg-984817373", "description": "tempest-description-1543625398"}} Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: exception: Security group 70721d21-bc0e-4d63-94b6-d90176ee8347 does not exist Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-f2dea015-5813-4f25-9bc2-a1a771b921e4'] Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '70721d21-bc0e-4d63-94b6-d90176ee8347', 'body': {'security_group': {'name': 'tempest-sg-984817373', 'description': 'tempest-description-1543625398'}}} Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:45.124113 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70721d21-bc0e-4d63-94b6-d90176ee8347 does not exist Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2dea015-5813-4f25-9bc2-a1a771b921e4'] Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70721d21-bc0e-4d63-94b6-d90176ee8347 does not exist Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2dea015-5813-4f25-9bc2-a1a771b921e4'] Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70721d21-bc0e-4d63-94b6-d90176ee8347 does not exist Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2dea015-5813-4f25-9bc2-a1a771b921e4'] Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70721d21-bc0e-4d63-94b6-d90176ee8347 does not exist Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2dea015-5813-4f25-9bc2-a1a771b921e4'] Oct 16 01:12:45.127860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:12:45.132193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-26eb1508-b905-4109-91f1-ad9cdf6b8423 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] Returning 404 to user: Security group 70721d21-bc0e-4d63-94b6-d90176ee8347 does not exist Oct 16 01:12:45.132193 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-f2dea015-5813-4f25-9bc2-a1a771b921e4'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:45.133668 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-26eb1508-b905-4109-91f1-ad9cdf6b8423 tempest-SecurityGroupsNegativeTestJSON-613225131 tempest-SecurityGroupsNegativeTestJSON-613225131-project] 10.222.0.39 "PUT /compute/v2.1/os-security-groups/70721d21-bc0e-4d63-94b6-d90176ee8347" status: 404 len: 194 microversion: 2.1 time: 0.159323 Oct 16 01:12:45.134820 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1359/2885] 10.222.0.39 () {60 vars in 1290 bytes} [Sun Oct 16 01:12:44 2022] PUT /compute/v2.1/os-security-groups/70721d21-bc0e-4d63-94b6-d90176ee8347 => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:12:45.148899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:45.152416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:45.182317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:45.184036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:45.184742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:45.193295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:45.194315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:45.195054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:45.538272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:12:45.538887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:12:45.539245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:12:45.539967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:12:45.540670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:12:45.601824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:45.602255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:45.602886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:45.609620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:45.610305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:45.611447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:45.702458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:12:45.708022 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:45.722879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:12:45.735921 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ddc5fce7-9cfc-4ac3-9e30-354ffd27989b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1658 microversion: 2.1 time: 0.599749 Oct 16 01:12:45.740920 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1360/2886] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:45 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1658 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:45.748536 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:45.763279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:12:45.765895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:12:45.769663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:45.788166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:45.791094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:45.793101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:45.795263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:45.800509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:45.801507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:45.861902 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:45.893212 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1b8e078b-4822-44c9-9024-6ebd87b405e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.391236 Oct 16 01:12:45.911910 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1527/2887] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:12:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:12:45.921114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-444cc300-5b88-4fb0-a154-907ada43b8e0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:45.964411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444cc300-5b88-4fb0-a154-907ada43b8e0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:45.964921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444cc300-5b88-4fb0-a154-907ada43b8e0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:45.968134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-444cc300-5b88-4fb0-a154-907ada43b8e0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:46.030306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-444cc300-5b88-4fb0-a154-907ada43b8e0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Going to try to start instance {{(pid=120545) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 01:12:46.057624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:46.075480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:46.077232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:46.101763 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd55cd5c-a624-4c9e-8811-02ba7d093164 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.354250 Oct 16 01:12:46.121285 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1361/2888] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:45 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:46.127982 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-444cc300-5b88-4fb0-a154-907ada43b8e0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.212647 Oct 16 01:12:46.130384 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1528/2889] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:45 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:46.141738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5892b806-a7dc-459c-ac83-37b10dd4d476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:46.144263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5892b806-a7dc-459c-ac83-37b10dd4d476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:46.146610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:46.149508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:46.170692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:46.171361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:46.174138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:46.177269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:46.177759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:46.181143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:46.491275 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5892b806-a7dc-459c-ac83-37b10dd4d476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:46.499480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5892b806-a7dc-459c-ac83-37b10dd4d476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1208 microversion: 2.1 time: 0.372287 Oct 16 01:12:46.514608 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1362/2890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:46 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1208 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:46.520036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:46.527726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:46.553224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:46.561947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:46.562943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:46.579535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:46.580294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:46.580906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:46.916192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:46.929961 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-947a859d-b0d2-4064-8d76-9ea45baf574f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 0.794554 Oct 16 01:12:46.950678 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1529/2891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:46 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:47.134554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:47.135479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:47.149487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:47.155643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:47.156334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:47.158482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:47.165952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:47.166673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:47.203411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:47.215685 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ad144e63-9754-4906-9f93-a3538a37777e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1667 microversion: 2.1 time: 0.699630 Oct 16 01:12:47.218265 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1363/2892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:46 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1667 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:47.443340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:47.457273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:47.461781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:47.473588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbc6a514-86ef-4cc3-afcb-42f5c4b5051f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.343756 Oct 16 01:12:47.484022 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1530/2893] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:47 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:47.538035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:47.539172 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:47.552442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:47.556525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:47.557138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:47.559560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:47.564200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:47.566827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:47.965927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:47.966461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:47.981646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:47.982156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:47.982604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:47.990946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:47.992324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:47.992776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:48.026217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:48.035489 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19f2a79c-10b7-419e-a006-e8cbb2124495 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1204 microversion: 2.1 time: 0.502362 Oct 16 01:12:48.040484 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1364/2894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:47 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1204 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:48.249536 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:48.251533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:48.272133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:48.275650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:48.277290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:48.279050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:48.281050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:48.282151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:48.487461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:48.502672 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-379f6017-dd7f-4312-a305-afdfbeeb1ce6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 0.541332 Oct 16 01:12:48.514310 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1531/2895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:47 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:48.543237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4d6f12d5-833d-4e9c-a5c5-851dcd0df970 req-11861865-686c-4f5d-b083-a302dd839b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c741ee8-74ef-4feb-bc05-d01a47195446", "name": "network-vif-plugged", "status": "completed", "tag": "2e367a32-57a9-4501-8aab-6af3c3d2d359"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:48.591621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4d6f12d5-833d-4e9c-a5c5-851dcd0df970 req-11861865-686c-4f5d-b083-a302dd839b8c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:48.592123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4d6f12d5-833d-4e9c-a5c5-851dcd0df970 req-11861865-686c-4f5d-b083-a302dd839b8c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:48.592558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4d6f12d5-833d-4e9c-a5c5-851dcd0df970 req-11861865-686c-4f5d-b083-a302dd839b8c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:48.625973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:48.638724 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ccb4a5d3-d775-4217-aaf6-6b6d6318fd8d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1667 microversion: 2.1 time: 0.396695 Oct 16 01:12:48.639634 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1365/2896] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:48 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1667 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:48.643125 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4d6f12d5-833d-4e9c-a5c5-851dcd0df970 req-11861865-686c-4f5d-b083-a302dd839b8c service nova] Creating event network-vif-plugged:2e367a32-57a9-4501-8aab-6af3c3d2d359 for instance 4c741ee8-74ef-4feb-bc05-d01a47195446 on n-h2-master-1 Oct 16 01:12:48.649024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:48.652528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:48.665459 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4d6f12d5-833d-4e9c-a5c5-851dcd0df970 req-11861865-686c-4f5d-b083-a302dd839b8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141998 Oct 16 01:12:48.668637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:48.670711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:48.672800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:48.673766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:48.675054 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1532/2897] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:48.675439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:48.677938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:48.834848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:48.849757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:48.856048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:48.884886 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b7a91ead-f844-4095-a613-c370f6e24078 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.228010 Oct 16 01:12:48.889888 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1366/2898] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:48 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:49.073342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:49.076231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:49.095101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:49.120667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:49.121607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:49.122656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:49.124499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:49.127521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:49.480748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:49.498393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0fa973e1-0d8f-4347-ac88-af539fea1186 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1260 microversion: 2.1 time: 0.435794 Oct 16 01:12:49.502161 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1533/2899] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:49 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1260 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:49.544825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:49.548928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:49.579900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:49.580635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:49.581362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:49.582366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:49.583556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:49.584740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:49.666098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:49.666904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:49.692008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:49.692512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:49.692960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:49.693684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:49.694154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:49.694585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:50.716095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:50.729407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:50.731287 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-709c5868-789f-4e14-83a2-720662fdcab4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 1.070016 Oct 16 01:12:50.732259 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1534/2900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:49 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:50.737017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:50.749643 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b90db62a-f3ca-4cb8-8f92-7bd956c70edb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1316 microversion: 2.1 time: 1.212615 Oct 16 01:12:50.753070 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1367/2901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:49 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1316 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:50.754648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:50.760336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:50.763956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:50.775612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:50.776327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:50.777052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:50.779887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:50.781563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:50.795837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:50.805237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:50.810790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:50.811577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:50.812714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:50.813411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:50.821822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:51.098702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:51.118216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:51.120149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:51.129582 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77a8a3d4-7ed7-4d2b-8c72-62f7625ab97d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.396196 Oct 16 01:12:51.130422 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1535/2902] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:50 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:51.138951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:51.143762 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:51.160946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:51.175073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:51.175512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:51.180911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:51.181406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:51.181849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:51.205725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:51.219961 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-abc452da-0356-459b-a0a2-41c2d1991710 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1266 microversion: 2.1 time: 0.465351 Oct 16 01:12:51.244120 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1368/2903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:50 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1266 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:51.771578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:51.779671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:51.780984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:51.787576 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-529de40d-e80e-4e4f-9c46-2781c2650144 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.655288 Oct 16 01:12:51.789281 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1536/2904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:51 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:51.813565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:51.814195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:51.814829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:51.815645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:51.827765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:51.830736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:51.830891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:51.831363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:51.831747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:51.831880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:51.832502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:51.833385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:51.834006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:51.834597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:51.938676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Unlocking {{(pid=120545) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 16 01:12:52.090145 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c51c39ba-febf-4165-933a-edff6b7c551c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.279503 Oct 16 01:12:52.092709 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1537/2905] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:51 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:12:52.104097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:52.107708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:52.120304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.121183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.121789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.122670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.123385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.123971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.528986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:52.541300 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e3f5f809-719d-4ef7-a841-fd5ffe78ffa5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1503 microversion: 2.1 time: 0.766449 Oct 16 01:12:52.562108 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1369/2906] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:51 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1503 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:52.564416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:52.574503 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cfd2d6ba-4c88-406c-a72f-87054607f8cd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.475615 Oct 16 01:12:52.575326 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1538/2907] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:52 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:52.586372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:52.592725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:52.595482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:52.595708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:52.615998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.617205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.620899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.621443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.623570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.625066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.625816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.627393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.627952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.631380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.631910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.637662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.671923 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:52.751267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:52.763452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f449d0f8-eb61-4f86-8334-2b9bd0afd241 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1266 microversion: 2.1 time: 0.182392 Oct 16 01:12:52.764049 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1539/2908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:52 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:52.769417 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1321055845"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:52.769731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:52.790351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.790999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.791492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.792316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.792859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.795564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.892808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:52.906507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:52.916153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:52.928900 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d786d631-ecb8-43ef-88fe-14d5776a052e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.364566 Oct 16 01:12:52.933962 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1370/2909] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:52 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:52.944693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:52.947889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:52.969566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.971696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.972515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:52.975645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:52.977196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:52.977974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:53.366113 n-d-master-1 devstack@n-api.service[120545]: INFO nova.network.security_group_api [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Adding security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 to port 2e367a32-57a9-4501-8aab-6af3c3d2d359 Oct 16 01:12:53.405704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:53.419635 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce608370-674b-48a6-bbdd-9a636b31754e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.483170 Oct 16 01:12:53.420540 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1371/2910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:52 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:53.446945 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:53.447660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:53.461201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:53.463607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:53.465757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:53.466796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:53.467532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:53.468140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:54.351825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:54.363852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aea29d18-f804-4086-a5ff-08798a291f3d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.921949 Oct 16 01:12:54.375065 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1372/2911] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:53 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:12:54.381030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:54.383510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:54.397566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:54.398734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:54.399454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:54.401355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:54.402027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:54.403842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:54.956144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:54.976613 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b650b79b-9878-4527-ad89-744cd426c509 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.610350 Oct 16 01:12:54.977472 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1373/2912] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:54 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:54.983088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:54.984364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:54.992726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:54.993709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:54.994477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:54.995447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:54.996107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:54.997011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:55.167815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:55.190335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:55.192875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:55.200424 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-828bfeea-fead-4f34-84b3-478471425d9e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.221377 Oct 16 01:12:55.201065 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1374/2913] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:54 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:55.206089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:55.206620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:55.218645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:55.219693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:55.220289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:55.222273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:55.222909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:55.223796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:55.332591 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-55d91cef-ea34-46a0-9ccf-290bbe908823 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.129507 Oct 16 01:12:55.333673 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1375/2914] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:55 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:55.344781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:55.345933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:55.354234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:55.355572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:55.356270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:55.357387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:55.358572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:55.359118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:55.444276 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-39bbd2be-d8c3-4bb0-b1aa-9006ba2b8363 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446/action" status: 202 len: 0 microversion: 2.1 time: 2.678411 Oct 16 01:12:55.446402 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1540/2915] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:52 2022] POST /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446/action => generated 0 bytes in 2682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:55.457459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-136d6f91-4279-44b8-8f5f-58782597c211 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd6527a1700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:55.667144 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:55.739064 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:56.070692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:56.084442 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2fa6c0c5-dac1-4f97-9a6f-57adc52de98b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1676 microversion: 2.1 time: 0.745026 Oct 16 01:12:56.085026 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1376/2916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:55 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1676 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:56.091017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c10ab83b-1a2f-4bee-b4cc-82b4eb01c7ff req-06a05c1c-79ed-4bc5-8d8b-b2b9ab41fe16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c741ee8-74ef-4feb-bc05-d01a47195446", "tag": "2e367a32-57a9-4501-8aab-6af3c3d2d359"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:56.120682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c10ab83b-1a2f-4bee-b4cc-82b4eb01c7ff req-06a05c1c-79ed-4bc5-8d8b-b2b9ab41fe16 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.121395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c10ab83b-1a2f-4bee-b4cc-82b4eb01c7ff req-06a05c1c-79ed-4bc5-8d8b-b2b9ab41fe16 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.122055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c10ab83b-1a2f-4bee-b4cc-82b4eb01c7ff req-06a05c1c-79ed-4bc5-8d8b-b2b9ab41fe16 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.148377 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c10ab83b-1a2f-4bee-b4cc-82b4eb01c7ff req-06a05c1c-79ed-4bc5-8d8b-b2b9ab41fe16 service nova] Creating event network-changed:2e367a32-57a9-4501-8aab-6af3c3d2d359 for instance 4c741ee8-74ef-4feb-bc05-d01a47195446 on n-h2-master-1 Oct 16 01:12:56.168832 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c10ab83b-1a2f-4bee-b4cc-82b4eb01c7ff req-06a05c1c-79ed-4bc5-8d8b-b2b9ab41fe16 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081097 Oct 16 01:12:56.169663 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1377/2917] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:12:56.174874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:56.175658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:56.182904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.183743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.184593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.186007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.186757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.187403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.362299 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-136d6f91-4279-44b8-8f5f-58782597c211 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f410fe4f-5e85-4e79-9eba-8e9d211936b7 in use.", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:12:56.363292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-136d6f91-4279-44b8-8f5f-58782597c211 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security Group f410fe4f-5e85-4e79-9eba-8e9d211936b7 in use. Oct 16 01:12:56.363292 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3153669d-2099-41a1-a719-3d6fc24e9a18'] Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-136d6f91-4279-44b8-8f5f-58782597c211 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-security-groups/f410fe4f-5e85-4e79-9eba-8e9d211936b7 HTTP/1.1 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: exception: Security Group f410fe4f-5e85-4e79-9eba-8e9d211936b7 in use. Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3153669d-2099-41a1-a719-3d6fc24e9a18'] Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f410fe4f-5e85-4e79-9eba-8e9d211936b7'} Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:12:56.368533 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f410fe4f-5e85-4e79-9eba-8e9d211936b7 in use. Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3153669d-2099-41a1-a719-3d6fc24e9a18'] Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f410fe4f-5e85-4e79-9eba-8e9d211936b7 in use. Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3153669d-2099-41a1-a719-3d6fc24e9a18'] Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f410fe4f-5e85-4e79-9eba-8e9d211936b7 in use. Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3153669d-2099-41a1-a719-3d6fc24e9a18'] Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f410fe4f-5e85-4e79-9eba-8e9d211936b7 in use. Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3153669d-2099-41a1-a719-3d6fc24e9a18'] Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-136d6f91-4279-44b8-8f5f-58782597c211 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 400 to user: Security Group f410fe4f-5e85-4e79-9eba-8e9d211936b7 in use. Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-3153669d-2099-41a1-a719-3d6fc24e9a18'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-136d6f91-4279-44b8-8f5f-58782597c211 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/f410fe4f-5e85-4e79-9eba-8e9d211936b7" status: 400 len: 185 microversion: 2.1 time: 0.921991 Oct 16 01:12:56.377331 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1541/2918] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:12:55 2022] DELETE /compute/v2.1/os-security-groups/f410fe4f-5e85-4e79-9eba-8e9d211936b7 => generated 185 bytes in 923 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:12:56.396809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:56.396809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:56.401850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.402360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.402809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.403565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.404030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.404465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.497065 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:56.552139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:56.573543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:56.578441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:56.595824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-afc5853f-bbdb-44bc-8e0d-5e0332f80ec5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1531 microversion: 2.91 time: 0.218565 Oct 16 01:12:56.596466 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1542/2919] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:56 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1531 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:56.612213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:56.614582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:56.628377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.628869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.629309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.630019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.630475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.630897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.641437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:56.653568 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:56.666126 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df93f0b2-3ebe-4031-82bd-20e43801f0a3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.495213 Oct 16 01:12:56.685595 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1378/2920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:56 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:56.691663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:56.693047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:56.703179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.703990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.704772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.710957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.711920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.712564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.896139 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e4af44a-925b-45e9-b114-467a7456ad12 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446/action" status: 202 len: 0 microversion: 2.1 time: 0.295174 Oct 16 01:12:56.911522 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1543/2921] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:56 2022] POST /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:56.917140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lazy-loading 'services' on Instance uuid 4405ee0b-a476-446d-a5b2-e5c6bf483b0e {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:12:56.938132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:56.944169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:56.967442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.972471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.973003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.973762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:56.978177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:56.978637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:56.987611 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-530adc9c-8a25-4db3-a9e5-74d83beb3bd2 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1936 microversion: 2.91 time: 0.300296 Oct 16 01:12:57.011389 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1379/2922] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:56 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1936 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:57.021902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:57.022461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:57.030109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:57.030627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:57.031567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:57.032861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:57.033333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:57.033761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:57.064645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lazy-loading 'flavor' on Instance uuid 4405ee0b-a476-446d-a5b2-e5c6bf483b0e {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:12:57.400275 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b0aff7f1-8a8c-448a-87a2-e24cbde5f044 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "POST /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e/action" status: 202 len: 0 microversion: 2.91 time: 0.385443 Oct 16 01:12:57.400903 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1380/2923] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:12:57 2022] POST /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:12:57.429637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:57.430412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:57.441440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:57.441981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:57.442418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:57.443152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:57.443602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:57.444200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:57.616600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:57.636383 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-214680d7-8755-4074-92bf-2b5425402c57 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1574 microversion: 2.1 time: 0.721568 Oct 16 01:12:57.637012 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1544/2924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:56 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1574 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:57.649938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:57.656912 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:57.676079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:57.676887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:57.679039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:57.679843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:57.680323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:57.684056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:57.980833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:57.999197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:58.000809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:58.016029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a6a6b1f4-13ae-4065-980e-6bb895198d4c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.374281 Oct 16 01:12:58.016632 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1545/2925] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:57 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:58.022366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:58.028167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:58.039163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:58.043726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:58.044481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:58.045604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:58.047051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:58.047707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:58.049641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:58.060545 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-066cad26-662a-4554-8380-ce40409dda02 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1656 microversion: 2.1 time: 0.653406 Oct 16 01:12:58.071910 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1381/2926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:57 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1656 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:58.097528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:58.098454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:58.106648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:58.111802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:58.112565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:58.114198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:58.115744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:58.125144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:58.253417 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7b58022e-b108-4c31-999a-ae3669358103 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.157691 Oct 16 01:12:58.255534 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1382/2927] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:12:58 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:12:58.291164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:58.305962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:58.317110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:58.318301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:58.319337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:58.323070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:58.324779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:58.327026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:59.129982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:59.140342 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c8ea5e17-6878-406c-a055-af7fa2e151a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 1.122463 Oct 16 01:12:59.151436 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1546/2928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:58 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:59.162423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:59.171089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:59.177964 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:59.181093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:59.181824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:59.182524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:59.187338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:59.188115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:59.188772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:59.468454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:59.477786 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-604c2fb2-df5f-480c-b51d-6f0cb6efc27a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1663 microversion: 2.1 time: 1.195087 Oct 16 01:12:59.478368 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1383/2929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:58 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1663 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:59.494733 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:12:59.495389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:12:59.514234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:59.514728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:59.515207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:59.515912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:59.516364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:59.519857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:59.853124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:59.862221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:59.863680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:59.877178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:12:59.885547 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc2cc5be-7dbc-4190-bab7-08d80f78659a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1574 microversion: 2.1 time: 0.732660 Oct 16 01:12:59.893665 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1547/2930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:12:59 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1574 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:12:59.897458 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-67f06595-5a9b-4f9b-b542-ee5466f293a7 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.413155 Oct 16 01:12:59.901824 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1384/2931] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:12:59 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:12:59.902897 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3836c3bf-e2c1-4c18-b324-a61eaa06a785 req-b95eaba2-278f-4024-8fef-f08f751d69ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8395135d-ce46-43bd-89d3-58c071e2c08c", "tag": "16d56f63-8f6d-4e42-82d1-53e1bc83b86a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:12:59.920400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3836c3bf-e2c1-4c18-b324-a61eaa06a785 req-b95eaba2-278f-4024-8fef-f08f751d69ca service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:12:59.923488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3836c3bf-e2c1-4c18-b324-a61eaa06a785 req-b95eaba2-278f-4024-8fef-f08f751d69ca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:12:59.924121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3836c3bf-e2c1-4c18-b324-a61eaa06a785 req-b95eaba2-278f-4024-8fef-f08f751d69ca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:12:59.953287 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3836c3bf-e2c1-4c18-b324-a61eaa06a785 req-b95eaba2-278f-4024-8fef-f08f751d69ca service nova] Creating event network-changed:16d56f63-8f6d-4e42-82d1-53e1bc83b86a for instance 8395135d-ce46-43bd-89d3-58c071e2c08c on n-h1-master-1 Oct 16 01:12:59.966331 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3836c3bf-e2c1-4c18-b324-a61eaa06a785 req-b95eaba2-278f-4024-8fef-f08f751d69ca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071346 Oct 16 01:12:59.967549 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1548/2932] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:00.173305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:00.174672 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:00.195936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:00.198321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:00.200196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:00.202530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:00.203527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:00.204213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:00.514223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:00.518397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:00.536178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:00.537129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:00.537821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:00.538615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:00.540248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:00.542574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:00.543390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:00.567734 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ff3df43-29e7-4842-ad13-8ecf43f69b36 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.400297 Oct 16 01:13:00.577711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1385/2933] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:00 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:00.930830 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:00.930830 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:00.939392 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:00.942741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:00.944706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:00.948048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:00.948988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:00.949667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:00.950362 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-094048f1-a876-404d-887b-a273978fc07c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.448833 Oct 16 01:13:00.951016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:00.961868 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1549/2934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:00 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:00.965333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:00.969910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:00.983725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:00.984822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:00.985508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:00.986430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:00.987129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:00.988674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:01.146899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:01.163789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:01.167899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:01.179769 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d36883ac-6d16-42cc-8a9d-7a5db28f8b50 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.224155 Oct 16 01:13:01.184938 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1550/2935] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:00 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:01.198536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:01.200580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:01.216689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:01.219652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:01.220269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:01.222703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:01.223453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:01.226459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:01.390509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:01.399069 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ffe0511-fb50-4513-8c34-4eb59aedbcf5 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1572 microversion: 2.1 time: 0.474614 Oct 16 01:13:01.399666 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1386/2936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:00 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1572 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:01.437923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1436340061"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:01.438461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:01.456296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:01.456788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:01.457223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:01.457925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:01.458377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:01.466244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:02.055713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:02.073380 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52ff64e0-616e-4b7f-a767-7b864401f839 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.887315 Oct 16 01:13:02.073983 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1551/2937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:01 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:02.083988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:02.084799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:02.098289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:02.099293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:02.099934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:02.102950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:02.103650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:02.104271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:02.120026 n-d-master-1 devstack@n-api.service[120546]: INFO nova.network.security_group_api [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Adding security group e033acc4-4dfa-4726-9f28-3910e74a316c to port 2e367a32-57a9-4501-8aab-6af3c3d2d359 Oct 16 01:13:02.611284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:02.619588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8df9a4ad-28ee-40f9-84ca-d5a94ca7dfbe tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.544548 Oct 16 01:13:02.620173 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1552/2938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:02 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:02.628049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:02.629160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:02.645802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:02.646752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:02.647399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:02.649105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:02.649795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:02.650411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:03.143084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:03.168768 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-082e3113-7b5b-4aee-9469-09963ebd99af tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.534791 Oct 16 01:13:03.172385 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1553/2939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:02 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:03.178386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:03.179932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:03.196734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:03.200633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:03.203804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:03.204767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:03.205428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:03.205859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:03.307576 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1b78546e-e144-4c56-9bf9-a2efcbfb1a00 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446/action" status: 202 len: 0 microversion: 2.1 time: 1.873138 Oct 16 01:13:03.314599 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1387/2940] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:13:01 2022] POST /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446/action => generated 0 bytes in 1882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:13:03.323620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:03.324341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:03.343727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:03.346553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:03.347383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:03.360347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:03.362044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:03.364621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:03.423835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:03.441718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:03.443390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:03.465566 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-af9a2887-4cfd-4214-8945-8bd19609562f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.290444 Oct 16 01:13:03.468297 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1554/2941] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:03 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:03.480818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07a26811-e45c-46b9-ae0b-43bee9bfc66f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd652786310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:03.742746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:03.759589 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b63057e6-a757-40e4-9384-ced158f4dabf tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.440478 Oct 16 01:13:03.760452 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1388/2942] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:03 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:03.768761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6ab9f430-2b4b-4321-af9e-56918f156a06 req-ec896a99-344b-4215-b54d-d4d98b0ed1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c741ee8-74ef-4feb-bc05-d01a47195446", "tag": "2e367a32-57a9-4501-8aab-6af3c3d2d359"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:03.794173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6ab9f430-2b4b-4321-af9e-56918f156a06 req-ec896a99-344b-4215-b54d-d4d98b0ed1ac service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:03.795338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6ab9f430-2b4b-4321-af9e-56918f156a06 req-ec896a99-344b-4215-b54d-d4d98b0ed1ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:03.795958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6ab9f430-2b4b-4321-af9e-56918f156a06 req-ec896a99-344b-4215-b54d-d4d98b0ed1ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:03.812770 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-07a26811-e45c-46b9-ae0b-43bee9bfc66f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e033acc4-4dfa-4726-9f28-3910e74a316c in use.", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:13:03.813693 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-07a26811-e45c-46b9-ae0b-43bee9bfc66f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security Group e033acc4-4dfa-4726-9f28-3910e74a316c in use. Oct 16 01:13:03.813693 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-c79ff519-a6e6-46db-bf2f-0897dfb6e438'] Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07a26811-e45c-46b9-ae0b-43bee9bfc66f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-security-groups/e033acc4-4dfa-4726-9f28-3910e74a316c HTTP/1.1 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: exception: Security Group e033acc4-4dfa-4726-9f28-3910e74a316c in use. Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-c79ff519-a6e6-46db-bf2f-0897dfb6e438'] Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e033acc4-4dfa-4726-9f28-3910e74a316c'} Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:13:03.815851 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e033acc4-4dfa-4726-9f28-3910e74a316c in use. Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c79ff519-a6e6-46db-bf2f-0897dfb6e438'] Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e033acc4-4dfa-4726-9f28-3910e74a316c in use. Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c79ff519-a6e6-46db-bf2f-0897dfb6e438'] Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e033acc4-4dfa-4726-9f28-3910e74a316c in use. Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c79ff519-a6e6-46db-bf2f-0897dfb6e438'] Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e033acc4-4dfa-4726-9f28-3910e74a316c in use. Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c79ff519-a6e6-46db-bf2f-0897dfb6e438'] Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07a26811-e45c-46b9-ae0b-43bee9bfc66f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 400 to user: Security Group e033acc4-4dfa-4726-9f28-3910e74a316c in use. Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-c79ff519-a6e6-46db-bf2f-0897dfb6e438'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-07a26811-e45c-46b9-ae0b-43bee9bfc66f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e033acc4-4dfa-4726-9f28-3910e74a316c" status: 400 len: 185 microversion: 2.1 time: 0.346028 Oct 16 01:13:03.821332 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1555/2943] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:03 2022] DELETE /compute/v2.1/os-security-groups/e033acc4-4dfa-4726-9f28-3910e74a316c => generated 185 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:13:03.827347 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6ab9f430-2b4b-4321-af9e-56918f156a06 req-ec896a99-344b-4215-b54d-d4d98b0ed1ac service nova] Creating event network-changed:2e367a32-57a9-4501-8aab-6af3c3d2d359 for instance 4c741ee8-74ef-4feb-bc05-d01a47195446 on n-h2-master-1 Oct 16 01:13:03.827508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:03.830577 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6ab9f430-2b4b-4321-af9e-56918f156a06 req-ec896a99-344b-4215-b54d-d4d98b0ed1ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068789 Oct 16 01:13:03.830713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:03.831275 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1389/2944] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:03.843979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:03.844638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:03.844898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:03.849533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:03.850793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:03.852492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.046778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-399a6e6d-5344-450a-99ed-4d6e4aacb20a tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Action: 'create', calling method: .version_select at 0x7fd6526ed8b0>, body: {"keypair": {"name": "tempest-keypair-366948471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9ZX3Sv61TjQx03PPWcrY2MTln74zdZHvQyrqQNnqnbOVJQzc3iZWh/461wmLNTgkP46F+0bOulx4h1Lfp8RxCkBCxTm5UMlUaiKML1kRYTZoEUni2QZ4Zey+4qKZXpUA=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:04.072755 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:04.083533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:04.086149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-399a6e6d-5344-450a-99ed-4d6e4aacb20a tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Getting quotas for project cfee6c66b8f5495a8eb29e4136ec3ed7. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:13:04.094435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-399a6e6d-5344-450a-99ed-4d6e4aacb20a tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Getting quotas for user 3714a80dffe147b5b683e6a3419d0df3 and project cfee6c66b8f5495a8eb29e4136ec3ed7. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:13:04.097143 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2051aead-332b-4cc7-8d32-d15dfe246022 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.277973 Oct 16 01:13:04.098122 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1556/2945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:03 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:04.105759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:04.107108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:04.115601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.116855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.117652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.118671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.120243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.121227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.161149 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-399a6e6d-5344-450a-99ed-4d6e4aacb20a tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.323417 Oct 16 01:13:04.168127 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1390/2946] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:13:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:04.177418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:04.178356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:04.186613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.187404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.188032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.188913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.190507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.191524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.262812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:13:04.402025 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-26a79f1f-d54d-41aa-bb85-3bd09c8040bb tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 204 len: 0 microversion: 2.1 time: 0.232078 Oct 16 01:13:04.405487 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1391/2947] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:13:04 2022] DELETE /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:13:04.412746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:04.416322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:04.417295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:04.420162 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:04.424350 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2e1a5c9b-e9a1-42c8-9215-77ebad13f298 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.324357 Oct 16 01:13:04.427742 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1557/2948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:04 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:04.451323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.452280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.452536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:04.453355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:04.455183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.457311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.458499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.459774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.474318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.476234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.477003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.477922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.478586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.479205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.509805 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:04.810667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:04.830132 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2f8423fc-f2ad-435f-b85c-e0bede8da236 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.382140 Oct 16 01:13:04.830459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:04.837561 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1558/2949] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:04 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:04.852524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:04.853916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:04.857901 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d9bc83e-f0b7-4504-b886-c19adb1837ac tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1647 microversion: 2.1 time: 0.448161 Oct 16 01:13:04.858994 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1392/2950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:04 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1647 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:04.887144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.887747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.890346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.891230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:04.893313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:04.893855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:04.975338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:04.985099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:04.986679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:04.992606 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7b9cf383-7021-4f16-895c-e246fcae233e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.152284 Oct 16 01:13:04.993327 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1559/2951] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:04 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:05.124007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:05.126327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:05.134306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:05.135128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:05.135926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:05.137062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:05.137759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:05.139346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:05.406320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:05.418612 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3665d2ef-ef57-4e49-bde6-575ae88d2aa3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.298466 Oct 16 01:13:05.419830 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1393/2952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:05 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:05.886611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:05.887430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:05.900846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:05.905974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:05.906692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:05.907569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:05.908554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:05.909222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:06.024465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:06.025135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:06.034585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:06.035429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:06.039757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:06.040515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:06.040997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:06.041434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:06.215405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:06.226155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:06.228181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:06.234794 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-da234c1a-0c7a-471d-b16d-8b15ebee21a5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.214643 Oct 16 01:13:06.264156 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1394/2953] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:06 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:13:06.454242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:06.455753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:06.468114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:06.470974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:06.471500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:06.473112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:06.473604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:06.476542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:07.045610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:07.059402 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bc8bd644-e411-4c7e-8b46-e8789ae18739 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1647 microversion: 2.1 time: 1.177315 Oct 16 01:13:07.062758 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1560/2954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:05 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1647 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:07.237511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:07.248661 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba2aac83-c08e-4759-859a-dea7feefe762 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.810474 Oct 16 01:13:07.262409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:07.263257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:07.276245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:07.276457 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1395/2955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:06 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:07.277198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:07.277825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:07.279929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:07.281650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:07.281860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:07.282571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:07.305449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:07.306088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:07.306427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:07.307975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:07.310019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:07.310777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:07.311434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:07.395120 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:13:07.663534 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83d2dd2d-0ea0-4cdf-a484-ead50d27a0b5 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 204 len: 0 microversion: 2.1 time: 0.399654 Oct 16 01:13:07.666976 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1561/2956] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:13:07 2022] DELETE /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:13:07.686071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:07.687086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:07.709542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:07.710574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:07.711349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:07.711754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:07.712259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:07.712630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:07.824167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:07.852779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:07.855838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:07.868768 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d95d5b70-aa94-4f73-aaf0-06f0cd2dd839 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.591085 Oct 16 01:13:07.870738 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1396/2957] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:07 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:07.880068 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-268c2570-caa3-4d47-b1f1-1e8087daaf1b req-0b4e853c-d5e3-4faa-b082-b07cadec0e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c741ee8-74ef-4feb-bc05-d01a47195446", "name": "network-vif-deleted", "tag": "2e367a32-57a9-4501-8aab-6af3c3d2d359"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:07.906171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-268c2570-caa3-4d47-b1f1-1e8087daaf1b req-0b4e853c-d5e3-4faa-b082-b07cadec0e3b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:07.906876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-268c2570-caa3-4d47-b1f1-1e8087daaf1b req-0b4e853c-d5e3-4faa-b082-b07cadec0e3b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:07.907701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-268c2570-caa3-4d47-b1f1-1e8087daaf1b req-0b4e853c-d5e3-4faa-b082-b07cadec0e3b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:07.952782 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-268c2570-caa3-4d47-b1f1-1e8087daaf1b req-0b4e853c-d5e3-4faa-b082-b07cadec0e3b service nova] Creating event network-vif-deleted:2e367a32-57a9-4501-8aab-6af3c3d2d359 for instance 4c741ee8-74ef-4feb-bc05-d01a47195446 on n-h2-master-1 Oct 16 01:13:07.967663 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-268c2570-caa3-4d47-b1f1-1e8087daaf1b req-0b4e853c-d5e3-4faa-b082-b07cadec0e3b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094941 Oct 16 01:13:07.968887 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1397/2958] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:08.093643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:08.094352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:08.108751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:08.109253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:08.109892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:08.110619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:08.111113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:08.111536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:08.334288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:08.344129 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-553ee31a-de38-44ce-9e88-b980931b4666 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1467 microversion: 2.1 time: 0.255277 Oct 16 01:13:08.356846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:08.363181 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1398/2959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:08 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1467 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:08.366776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e7aaf40b-4562-4c32-ab02-05ba94080881 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1665 microversion: 2.1 time: 0.694897 Oct 16 01:13:08.370302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:08.371149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:08.371891 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1562/2960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:07 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1665 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:08.379508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:08.380179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:08.380765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:08.381649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:08.382578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:08.383251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:08.871963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:08.882827 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-304ddd50-4c87-40db-9490-c9681ca31be9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.518132 Oct 16 01:13:08.884008 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1399/2961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:08 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:08.907509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:08.908126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:08.921543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:08.923168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:08.923811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:08.924730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:08.925407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:08.926030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:09.152588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:09.166459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:09.176510 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:09.194589 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e5e7e797-3b09-4aa9-bd4b-4cd029818072 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.286742 Oct 16 01:13:09.196745 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1563/2962] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:08 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:09.254549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0dd3d0bc-6883-4117-b9a3-27ddf14428be req-1aac4f05-20e6-4268-9026-6541fdabb6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8395135d-ce46-43bd-89d3-58c071e2c08c", "name": "network-vif-plugged", "status": "completed", "tag": "16d56f63-8f6d-4e42-82d1-53e1bc83b86a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:09.271957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0dd3d0bc-6883-4117-b9a3-27ddf14428be req-1aac4f05-20e6-4268-9026-6541fdabb6b3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:09.272482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0dd3d0bc-6883-4117-b9a3-27ddf14428be req-1aac4f05-20e6-4268-9026-6541fdabb6b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:09.273008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0dd3d0bc-6883-4117-b9a3-27ddf14428be req-1aac4f05-20e6-4268-9026-6541fdabb6b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:09.307622 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0dd3d0bc-6883-4117-b9a3-27ddf14428be req-1aac4f05-20e6-4268-9026-6541fdabb6b3 service nova] Creating event network-vif-plugged:16d56f63-8f6d-4e42-82d1-53e1bc83b86a for instance 8395135d-ce46-43bd-89d3-58c071e2c08c on n-h1-master-1 Oct 16 01:13:09.322147 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0dd3d0bc-6883-4117-b9a3-27ddf14428be req-1aac4f05-20e6-4268-9026-6541fdabb6b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071403 Oct 16 01:13:09.323058 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1400/2963] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:09.377219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:09.378848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:09.389592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:09.392898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:09.393620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:09.394543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:09.398760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:09.399457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:09.399630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:09.400435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:09.418288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:09.420810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:09.421536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:09.423357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:09.430499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:09.431145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:09.477439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:09.478039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:09.478486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:09.478973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lazy-loading 'fault' on Instance uuid 4c741ee8-74ef-4feb-bc05-d01a47195446 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:13:09.767574 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:09.776187 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f35d8334-6c47-4c0a-b7ac-8c04d7c8c5ce tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 200 len: 1306 microversion: 2.1 time: 0.403565 Oct 16 01:13:09.776766 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1564/2964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:09 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 1306 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:09.912144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:09.912767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:09.921529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:09.922016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:09.922456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:09.935106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:09.935754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:09.936207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:10.494029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:10.502429 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16e40da1-86a7-488c-8f9c-ec711116c570 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1665 microversion: 2.1 time: 1.108193 Oct 16 01:13:10.503012 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1401/2965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:09 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1665 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:10.512702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:10.513322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:10.534257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:10.534822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:10.539100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:10.541065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:10.541803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:10.542467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:10.683855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:10.688210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:10.703204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:10.704353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-41fc8c91-25c2-4cf7-b70d-aa55faf30f4c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1308 microversion: 2.1 time: 0.798233 Oct 16 01:13:10.707770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:10.720785 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1565/2966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:09 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1308 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:10.725692 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c107621-c595-4d97-9ae5-25e1def05d77 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.216622 Oct 16 01:13:10.727746 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1402/2967] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:10 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:10.807105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:10.808523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:10.820165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:10.821006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:10.825068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:10.826356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:10.827175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:10.827837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:10.877115 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 HTTP/1.1 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '4c741ee8-74ef-4feb-bc05-d01a47195446'} Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:10.884095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:10.888871 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:10.888871 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:10.888871 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:10.888871 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:10.888871 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:10.888871 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:10.888871 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:10.889623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:10.890589 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bc00722e-a770-413e-9d45-d65e852ff77a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 404 len: 111 microversion: 2.1 time: 0.088605 Oct 16 01:13:10.893582 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1566/2968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:10 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:10.902451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32e30ee5-83db-44e4-9bd0-2016fc190713 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64db01700>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:11.370235 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32e30ee5-83db-44e4-9bd0-2016fc190713 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/f410fe4f-5e85-4e79-9eba-8e9d211936b7" status: 202 len: 0 microversion: 2.1 time: 0.472606 Oct 16 01:13:11.373759 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1403/2969] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:10 2022] DELETE /compute/v2.1/os-security-groups/f410fe4f-5e85-4e79-9eba-8e9d211936b7 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:13:11.380539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef809ec9-cb46-4735-b3cb-2843068a752b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd65271d3a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:11.526506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:11.528142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:11.573107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:11.575736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:11.576213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:11.576962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:11.580159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:11.582291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:12.127090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befcf8a010bb48d3a174a52ea94d012e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd688e31f04ce4d14bbc9c4d2635d3e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:12.138155 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3322e286-5f62-43bd-a35e-5aec834d919e tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 200 len: 1598 microversion: 2.1 time: 0.616233 Oct 16 01:13:12.141806 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1404/2970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:11 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 1598 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:12.152163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:12.153643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:12.175566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:12.176525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:12.176972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:12.177708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:12.178179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:12.179565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:12.578353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:12.595550 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ce8b669-d9fc-4a71-9399-1e259da8ebb5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1489 microversion: 2.1 time: 0.450199 Oct 16 01:13:12.597035 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1405/2971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:12 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1489 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:12.603973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:12.605720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:12.623165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:12.627744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:12.628422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:12.629372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:12.629987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:12.630572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:12.728783 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ef809ec9-cb46-4735-b3cb-2843068a752b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e033acc4-4dfa-4726-9f28-3910e74a316c" status: 202 len: 0 microversion: 2.1 time: 1.353604 Oct 16 01:13:12.730443 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1567/2972] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:11 2022] DELETE /compute/v2.1/os-security-groups/e033acc4-4dfa-4726-9f28-3910e74a316c => generated 0 bytes in 1356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:13:12.737291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-31a51aaa-c94e-4be8-a307-7db95ca26a4b req-bbbd658a-d0e8-4b49-9d50-9887024142a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219", "name": "network-vif-deleted", "tag": "ae7e0904-3430-4daa-9aca-2e07fd0e9fe3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:12.768951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31a51aaa-c94e-4be8-a307-7db95ca26a4b req-bbbd658a-d0e8-4b49-9d50-9887024142a0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:12.770601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31a51aaa-c94e-4be8-a307-7db95ca26a4b req-bbbd658a-d0e8-4b49-9d50-9887024142a0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:12.773294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31a51aaa-c94e-4be8-a307-7db95ca26a4b req-bbbd658a-d0e8-4b49-9d50-9887024142a0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:12.812363 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-31a51aaa-c94e-4be8-a307-7db95ca26a4b req-bbbd658a-d0e8-4b49-9d50-9887024142a0 service nova] Creating event network-vif-deleted:ae7e0904-3430-4daa-9aca-2e07fd0e9fe3 for instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 on n-h2-master-1 Oct 16 01:13:12.820772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-31a51aaa-c94e-4be8-a307-7db95ca26a4b req-bbbd658a-d0e8-4b49-9d50-9887024142a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087010 Oct 16 01:13:12.822083 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1568/2973] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:12.833224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:12.841824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:12.855433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:12.858439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:12.859115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:12.860023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:12.862308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:12.862761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:12.920737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:12.947014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:12.960018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:13.013216 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-47d17a8c-5d9a-47aa-8dae-63684b1b60a1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "PUT /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1084 microversion: 2.1 time: 0.184835 Oct 16 01:13:13.013978 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1569/2974] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:13:12 2022] PUT /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1084 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:13.021875 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed17e9be-7f76-4e55-bb82-cc968ba9b811 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.420902 Oct 16 01:13:13.028964 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1406/2975] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:12 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:13.032306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-598528e8-fde4-4249-acd5-0a527c0b01a6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'create', calling method: .version_select at 0x7fd652786430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1015202804", "description": "tempest-description-943951439"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:13.052341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:13.054523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:13.084854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:13.085607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:13.087454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:13.090874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:13.091818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:13.092967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:13.629844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:13.642740 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8a8b607-524a-43ad-8328-c8bb47fc0fbb tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1510 microversion: 2.1 time: 0.611249 Oct 16 01:13:13.647769 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1407/2976] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:13 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1510 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:13.654026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:13.659152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] [instance: a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:13.685340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:13.689981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:13.690366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:13.694351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:13.694946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:13.695399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:13.747207 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] HTTP exception thrown: Instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 could not be found. Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Request method failure captured: Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 HTTP/1.1 Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pc-Oet_nQwGdkvw_e--6OTZqFTH7sPmHh10BYCtdEvpHNQ2YI93LSZjXkuWgk-fcLBM9lnUovJOGvnMDJPINrgaWcGdiATzrVl0_EJmRhYES80HAGfJU5QsNT6oY1VwKrTL4X-b2WoyTk088Kve5nNIC_aSSTzomhaituWaFbiw0g Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: d688e31f04ce4d14bbc9c4d2635d3e2a Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestFqdnHostnames-1011192542 Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d688e31f04ce4d14bbc9c4d2635d3e2a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d688e31f04ce4d14bbc9c4d2635d3e2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d688e31f04ce4d14bbc9c4d2635d3e2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d688e31f04ce4d14bbc9c4d2635d3e2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestFqdnHostnames-1011192542 Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: d688e31f04ce4d14bbc9c4d2635d3e2a Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1011192542 Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestFqdnHostnames-1011192542-project Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: befcf8a010bb48d3a174a52ea94d012e Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestFqdnHostnames-1011192542-project Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 could not be found. Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219'} Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 could not be found. Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 could not be found. Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:13.754788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 could not be found. Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Returning 404 to user: Instance a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:13.760397 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-212b5f42-935e-455a-944b-809e9c120480 tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219" status: 404 len: 111 microversion: 2.1 time: 0.108203 Oct 16 01:13:13.761043 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1408/2977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:13 2022] GET /compute/v2.1/servers/a57aec4c-d1a2-4ccd-b5b6-c8e0ddc95219 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:13.773884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:13.778188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:13.798826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:13.800347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:13.800986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:13.804610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:13.805237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:13.805951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:14.018519 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-598528e8-fde4-4249-acd5-0a527c0b01a6 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.003439 Oct 16 01:13:14.019473 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1570/2978] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:13:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:14.025491 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a167f122-7fe3-458e-bd55-83c5c052fd0d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] Calling method '.version_select at 0x7fd65271d820>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:14.061604 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a167f122-7fe3-458e-bd55-83c5c052fd0d tempest-ServersTestFqdnHostnames-1011192542 tempest-ServersTestFqdnHostnames-1011192542-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-282968383" status: 202 len: 0 microversion: 2.1 time: 0.040293 Oct 16 01:13:14.063284 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1571/2979] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-282968383 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:13:14.078238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-604fac1a-7f37-4a78-a8c0-a8e92b1264d8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Action: 'update', calling method: .version_select at 0x7fd6527c00d0>, body: {"security_group": {"name": "tempest-sg-hth-2005759147", "description": "tempest-description-hth-246174314"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:14.128246 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:14.199041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:14.218262 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-896730ee-3d6d-410a-a83e-60eb9186173d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1510 microversion: 2.1 time: 0.456331 Oct 16 01:13:14.219155 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1409/2980] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:13 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:14.224346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:14.227656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:14.255708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:14.257748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:14.258154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:14.259862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:14.260346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:14.260786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:14.432330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:14.442848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:14.451419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:14.461668 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bb85f1a0-d109-48c7-a28b-cc22f5c0b249 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.241095 Oct 16 01:13:14.462502 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1410/2981] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:14 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:14.479134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:14.479651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:14.485760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:14.486257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:14.486883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:14.487454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:14.487905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:14.488513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:14.545372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:13:14.581396 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:14.665639 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-604fac1a-7f37-4a78-a8c0-a8e92b1264d8 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "PUT /compute/v2.1/os-security-groups/0ae98f76-a83b-4b15-b9f5-5b1e07a76aeb" status: 200 len: 217 microversion: 2.1 time: 0.600230 Oct 16 01:13:14.667373 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1572/2982] 10.222.0.39 () {60 vars in 1290 bytes} [Sun Oct 16 01:13:14 2022] PUT /compute/v2.1/os-security-groups/0ae98f76-a83b-4b15-b9f5-5b1e07a76aeb => generated 217 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:14.683214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea1b0040-ee5d-4ef3-8fa8-e08881da1d1e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd65271df70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:14.739102 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9bb976da-09d5-4943-b38b-fb46c76c54ee tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 204 len: 0 microversion: 2.1 time: 0.275446 Oct 16 01:13:14.742502 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1411/2983] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:13:14 2022] DELETE /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:13:14.760956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:14.764500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:14.787311 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea1b0040-ee5d-4ef3-8fa8-e08881da1d1e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/0ae98f76-a83b-4b15-b9f5-5b1e07a76aeb" status: 200 len: 217 microversion: 2.1 time: 0.111189 Oct 16 01:13:14.788623 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1573/2984] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:13:14 2022] GET /compute/v2.1/os-security-groups/0ae98f76-a83b-4b15-b9f5-5b1e07a76aeb => generated 217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:13:14.790092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:14.790959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:14.793560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:14.794535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:14.799833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:14.800608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:14.805735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-09af6775-98c6-46a7-b3ca-32401ce58d06 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd652738790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:15.270839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:15.292388 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2d90e19-d6eb-4f07-83b7-cf13b82cccf7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1516 microversion: 2.1 time: 0.542680 Oct 16 01:13:15.294608 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1412/2985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:14 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1516 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:15.468867 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-09af6775-98c6-46a7-b3ca-32401ce58d06 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/0ae98f76-a83b-4b15-b9f5-5b1e07a76aeb" status: 202 len: 0 microversion: 2.1 time: 0.668695 Oct 16 01:13:15.470159 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1574/2986] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:14 2022] DELETE /compute/v2.1/os-security-groups/0ae98f76-a83b-4b15-b9f5-5b1e07a76aeb => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:13:15.479455 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:15.480123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:15.488964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:15.489466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:15.489879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:15.489998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:15.491418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:15.491868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:15.492631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:15.493074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:15.511094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:15.511676 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.515504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:15.517099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:15.518397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:15.536849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:15.536849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 HTTP/1.1 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4c741ee8-74ef-4feb-bc05-d01a47195446'} Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:13:15.543483 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.547336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.550880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:15.552128 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-46b9aae9-466d-4b55-9ecd-5276a4a81c52 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 404 len: 111 microversion: 2.1 time: 0.077804 Oct 16 01:13:15.552980 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1413/2987] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:13:15 2022] DELETE /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:13:15.584146 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:15.585523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 4c741ee8-74ef-4feb-bc05-d01a47195446] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:15.594786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:15.595458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:15.596101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:15.596891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:15.597426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:15.597938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:15.615273 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 HTTP/1.1 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4c741ee8-74ef-4feb-bc05-d01a47195446'} Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.618023 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Instance 4c741ee8-74ef-4feb-bc05-d01a47195446 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:15.621962 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a93b6a44-1e5f-43df-90ed-f6894f8e7022 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446" status: 404 len: 111 microversion: 2.1 time: 0.061643 Oct 16 01:13:15.625416 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1414/2988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:15 2022] GET /compute/v2.1/servers/4c741ee8-74ef-4feb-bc05-d01a47195446 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:15.633699 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-958a2889-347b-4309-b91f-90b00f76781b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64e155b80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:15.689976 n-d-master-1 devstack@n-api.service[120546]: DEBUG neutronclient.v2_0.client [None req-958a2889-347b-4309-b91f-90b00f76781b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e033acc4-4dfa-4726-9f28-3910e74a316c does not exist", "detail": ""}} {{(pid=120546) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:13:15.690590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.security_group_api [None req-958a2889-347b-4309-b91f-90b00f76781b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group e033acc4-4dfa-4726-9f28-3910e74a316c not found {{(pid=120546) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:13:15.691146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-958a2889-347b-4309-b91f-90b00f76781b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group e033acc4-4dfa-4726-9f28-3910e74a316c does not exist Oct 16 01:13:15.691146 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-8e6c0ed3-c045-4cc3-bedf-e71d17579b70'] Oct 16 01:13:15.692335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-958a2889-347b-4309-b91f-90b00f76781b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/os-security-groups/e033acc4-4dfa-4726-9f28-3910e74a316c HTTP/1.1 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: exception: Security group e033acc4-4dfa-4726-9f28-3910e74a316c does not exist Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-8e6c0ed3-c045-4cc3-bedf-e71d17579b70'] Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'e033acc4-4dfa-4726-9f28-3910e74a316c'} Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:13:15.694390 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e033acc4-4dfa-4726-9f28-3910e74a316c does not exist Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e6c0ed3-c045-4cc3-bedf-e71d17579b70'] Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e033acc4-4dfa-4726-9f28-3910e74a316c does not exist Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e6c0ed3-c045-4cc3-bedf-e71d17579b70'] Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e033acc4-4dfa-4726-9f28-3910e74a316c does not exist Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e6c0ed3-c045-4cc3-bedf-e71d17579b70'] Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e033acc4-4dfa-4726-9f28-3910e74a316c does not exist Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e6c0ed3-c045-4cc3-bedf-e71d17579b70'] Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-958a2889-347b-4309-b91f-90b00f76781b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group e033acc4-4dfa-4726-9f28-3910e74a316c does not exist Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-8e6c0ed3-c045-4cc3-bedf-e71d17579b70'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:15.698621 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-958a2889-347b-4309-b91f-90b00f76781b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e033acc4-4dfa-4726-9f28-3910e74a316c" status: 404 len: 194 microversion: 2.1 time: 0.070152 Oct 16 01:13:15.703605 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1415/2989] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:15 2022] DELETE /compute/v2.1/os-security-groups/e033acc4-4dfa-4726-9f28-3910e74a316c => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:15.707206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:15.709160 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd871a97-434a-4382-b82f-9daaadea393b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64e4d80d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:15.711180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:15.723574 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d3144913-014f-4201-92b9-7733b42cc665 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.237355 Oct 16 01:13:15.726137 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1575/2990] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:15 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:15.792157 n-d-master-1 devstack@n-api.service[120546]: DEBUG neutronclient.v2_0.client [None req-fd871a97-434a-4382-b82f-9daaadea393b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 does not exist", "detail": ""}} {{(pid=120546) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:13:15.793646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.security_group_api [None req-fd871a97-434a-4382-b82f-9daaadea393b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 not found {{(pid=120546) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:13:15.794458 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-fd871a97-434a-4382-b82f-9daaadea393b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 does not exist Oct 16 01:13:15.794458 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-dbb89c38-18d1-4fbb-a6f7-516f0276bd96'] Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd871a97-434a-4382-b82f-9daaadea393b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/os-security-groups/f410fe4f-5e85-4e79-9eba-8e9d211936b7 HTTP/1.1 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: exception: Security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 does not exist Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-dbb89c38-18d1-4fbb-a6f7-516f0276bd96'] Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'f410fe4f-5e85-4e79-9eba-8e9d211936b7'} Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:13:15.797660 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 does not exist Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbb89c38-18d1-4fbb-a6f7-516f0276bd96'] Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 does not exist Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbb89c38-18d1-4fbb-a6f7-516f0276bd96'] Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 does not exist Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbb89c38-18d1-4fbb-a6f7-516f0276bd96'] Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 does not exist Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dbb89c38-18d1-4fbb-a6f7-516f0276bd96'] Oct 16 01:13:15.801712 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.808816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd871a97-434a-4382-b82f-9daaadea393b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group f410fe4f-5e85-4e79-9eba-8e9d211936b7 does not exist Oct 16 01:13:15.808816 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-dbb89c38-18d1-4fbb-a6f7-516f0276bd96'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:15.810004 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd871a97-434a-4382-b82f-9daaadea393b tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/f410fe4f-5e85-4e79-9eba-8e9d211936b7" status: 404 len: 194 microversion: 2.1 time: 0.106447 Oct 16 01:13:15.815553 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1416/2991] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:15 2022] DELETE /compute/v2.1/os-security-groups/f410fe4f-5e85-4e79-9eba-8e9d211936b7 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:15.821452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-145d2323-040a-47d0-a2a9-daf0fb4c0ec2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd6527a1ee0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:15.889866 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-145d2323-040a-47d0-a2a9-daf0fb4c0ec2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:13:15.890945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-145d2323-040a-47d0-a2a9-daf0fb4c0ec2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 not found {{(pid=120545) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:13:15.891651 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-145d2323-040a-47d0-a2a9-daf0fb4c0ec2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:13:15.891651 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-91dbdbdd-23ed-4f4c-b60a-216049b4851e'] Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-145d2323-040a-47d0-a2a9-daf0fb4c0ec2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-security-groups/e5d84b0b-9582-4b6a-b293-99df1ffc42a1 HTTP/1.1 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: exception: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-91dbdbdd-23ed-4f4c-b60a-216049b4851e'] Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e5d84b0b-9582-4b6a-b293-99df1ffc42a1'} Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:13:15.894507 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91dbdbdd-23ed-4f4c-b60a-216049b4851e'] Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91dbdbdd-23ed-4f4c-b60a-216049b4851e'] Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91dbdbdd-23ed-4f4c-b60a-216049b4851e'] Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91dbdbdd-23ed-4f4c-b60a-216049b4851e'] Oct 16 01:13:15.899239 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:15.904017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-145d2323-040a-47d0-a2a9-daf0fb4c0ec2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group e5d84b0b-9582-4b6a-b293-99df1ffc42a1 does not exist Oct 16 01:13:15.904017 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-91dbdbdd-23ed-4f4c-b60a-216049b4851e'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:15.904764 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-145d2323-040a-47d0-a2a9-daf0fb4c0ec2 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e5d84b0b-9582-4b6a-b293-99df1ffc42a1" status: 404 len: 194 microversion: 2.1 time: 0.087925 Oct 16 01:13:15.905654 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1576/2992] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:15 2022] DELETE /compute/v2.1/os-security-groups/e5d84b0b-9582-4b6a-b293-99df1ffc42a1 => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:15.915167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6f13aee9-64af-4c3d-9c28-e06fda9a6a71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64daf8b80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:16.001780 n-d-master-1 devstack@n-api.service[120546]: DEBUG neutronclient.v2_0.client [None req-6f13aee9-64af-4c3d-9c28-e06fda9a6a71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist", "detail": ""}} {{(pid=120546) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:13:16.002589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.security_group_api [None req-6f13aee9-64af-4c3d-9c28-e06fda9a6a71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group dd94890b-68b6-42a3-a85a-d24581fb186b not found {{(pid=120546) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:13:16.003414 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-6f13aee9-64af-4c3d-9c28-e06fda9a6a71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:13:16.003414 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-a1d7cfad-1dc1-494e-bed8-5163bc1554b9'] Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6f13aee9-64af-4c3d-9c28-e06fda9a6a71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/os-security-groups/dd94890b-68b6-42a3-a85a-d24581fb186b HTTP/1.1 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: exception: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-a1d7cfad-1dc1-494e-bed8-5163bc1554b9'] Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'dd94890b-68b6-42a3-a85a-d24581fb186b'} Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:13:16.007424 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1d7cfad-1dc1-494e-bed8-5163bc1554b9'] Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1d7cfad-1dc1-494e-bed8-5163bc1554b9'] Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1d7cfad-1dc1-494e-bed8-5163bc1554b9'] Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1d7cfad-1dc1-494e-bed8-5163bc1554b9'] Oct 16 01:13:16.012068 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.017089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6f13aee9-64af-4c3d-9c28-e06fda9a6a71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group dd94890b-68b6-42a3-a85a-d24581fb186b does not exist Oct 16 01:13:16.017089 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-a1d7cfad-1dc1-494e-bed8-5163bc1554b9'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:16.019309 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6f13aee9-64af-4c3d-9c28-e06fda9a6a71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/dd94890b-68b6-42a3-a85a-d24581fb186b" status: 404 len: 194 microversion: 2.1 time: 0.109691 Oct 16 01:13:16.020052 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1417/2993] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:15 2022] DELETE /compute/v2.1/os-security-groups/dd94890b-68b6-42a3-a85a-d24581fb186b => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:16.039898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a75b245-72dc-4448-967a-9e2c7736e268 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd65276f430>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:16.116369 n-d-master-1 devstack@n-api.service[120545]: DEBUG neutronclient.v2_0.client [None req-9a75b245-72dc-4448-967a-9e2c7736e268 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist", "detail": ""}} {{(pid=120545) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:13:16.116979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-9a75b245-72dc-4448-967a-9e2c7736e268 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group 936b05e4-163f-47ce-b806-8bbbe7479595 not found {{(pid=120545) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:13:16.118558 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9a75b245-72dc-4448-967a-9e2c7736e268 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:13:16.118558 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-fb243143-ffc8-45b6-8c91-fa649934b728'] Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a75b245-72dc-4448-967a-9e2c7736e268 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-security-groups/936b05e4-163f-47ce-b806-8bbbe7479595 HTTP/1.1 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: exception: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-fb243143-ffc8-45b6-8c91-fa649934b728'] Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '936b05e4-163f-47ce-b806-8bbbe7479595'} Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:13:16.123815 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb243143-ffc8-45b6-8c91-fa649934b728'] Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb243143-ffc8-45b6-8c91-fa649934b728'] Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb243143-ffc8-45b6-8c91-fa649934b728'] Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb243143-ffc8-45b6-8c91-fa649934b728'] Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a75b245-72dc-4448-967a-9e2c7736e268 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group 936b05e4-163f-47ce-b806-8bbbe7479595 does not exist Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: Neutron server returns request_ids: ['req-fb243143-ffc8-45b6-8c91-fa649934b728'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9a75b245-72dc-4448-967a-9e2c7736e268 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/936b05e4-163f-47ce-b806-8bbbe7479595" status: 404 len: 194 microversion: 2.1 time: 0.100847 Oct 16 01:13:16.127895 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1577/2994] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:16 2022] DELETE /compute/v2.1/os-security-groups/936b05e4-163f-47ce-b806-8bbbe7479595 => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:16.146893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5dd171d7-cb99-448d-ad8e-7034e934955a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64e125160>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:16.305352 n-d-master-1 devstack@n-api.service[120546]: DEBUG neutronclient.v2_0.client [None req-5dd171d7-cb99-448d-ad8e-7034e934955a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist", "detail": ""}} {{(pid=120546) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 16 01:13:16.305999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.security_group_api [None req-5dd171d7-cb99-448d-ad8e-7034e934955a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Neutron security group 5518aed3-2777-4854-95a7-14a44ea7a12f not found {{(pid=120546) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 16 01:13:16.306524 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-5dd171d7-cb99-448d-ad8e-7034e934955a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:13:16.306524 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-69c23c83-3ae3-414f-aef1-89674109b0e1'] Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5dd171d7-cb99-448d-ad8e-7034e934955a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f HTTP/1.1 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: exception: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-69c23c83-3ae3-414f-aef1-89674109b0e1'] Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5518aed3-2777-4854-95a7-14a44ea7a12f'} Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 16 01:13:16.308610 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69c23c83-3ae3-414f-aef1-89674109b0e1'] Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69c23c83-3ae3-414f-aef1-89674109b0e1'] Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69c23c83-3ae3-414f-aef1-89674109b0e1'] Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-69c23c83-3ae3-414f-aef1-89674109b0e1'] Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5dd171d7-cb99-448d-ad8e-7034e934955a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Security group 5518aed3-2777-4854-95a7-14a44ea7a12f does not exist Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: Neutron server returns request_ids: ['req-69c23c83-3ae3-414f-aef1-89674109b0e1'] {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5dd171d7-cb99-448d-ad8e-7034e934955a tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f" status: 404 len: 194 microversion: 2.1 time: 0.176626 Oct 16 01:13:16.313450 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1418/2995] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:16 2022] DELETE /compute/v2.1/os-security-groups/5518aed3-2777-4854-95a7-14a44ea7a12f => generated 194 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:16.320981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:16.321597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:16.321777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:16.322776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:16.330509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:16.333654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:16.334095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:16.339224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:16.339403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:16.339741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:16.339860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:16.340185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:16.340894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:16.341521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:16.344117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:16.348236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:16.431139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:13:16.649296 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-47623292-2149-4f20-874e-5f7238018f8f tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 204 len: 0 microversion: 2.1 time: 0.331828 Oct 16 01:13:16.653459 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1578/2996] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:13:16 2022] DELETE /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:13:16.664244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:16.665508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:16.679406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:16.680196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:16.680851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:16.681765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:16.682446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:16.683254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:16.723226 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:17.831407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:17.841954 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7b7a067f-0386-4faf-ad0d-63130ac3fd71 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1645 microversion: 2.1 time: 1.183028 Oct 16 01:13:17.852799 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1579/2997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:16 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1645 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:17.857692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:17.863041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:17.877040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:17.882667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:17.883377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:17.884323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:17.885769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:17.888108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:17.890855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:17.902118 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56d634fa-19b9-4c1f-be80-a24d5037c151 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1516 microversion: 2.1 time: 1.585171 Oct 16 01:13:17.915012 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1419/2998] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:16 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1516 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:18.086247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:18.108838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:18.110663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:18.117354 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-460d6180-0516-4aaa-890e-b20a8aabb815 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.263324 Oct 16 01:13:18.118565 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1580/2999] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:17 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:18.869983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:18.870587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:18.883453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:18.883957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:18.884395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:18.885109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:18.885679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:18.886129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:18.943679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:18.944828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:18.958329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:18.958825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:18.972206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:18.979628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:18.980130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:18.980572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:19.437065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:19.455959 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c46ffa31-887d-41cc-8adf-cd9ec1491ed3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1474 microversion: 2.1 time: 0.514971 Oct 16 01:13:19.458711 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1581/3000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:18 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:19.477931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:19.478476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:19.490221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:19.497693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:19.499258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:19.503750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:19.509148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:19.510747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:19.794052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:19.807027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:19.817682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:19.837392 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a9b095e0-384a-4a56-bd65-57e93534c4e2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.376656 Oct 16 01:13:19.838891 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1582/3001] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:19 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:19.844590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a37fd454-a70f-40cd-afac-d34b58953ba2 req-5929d6f9-2638-43a4-920a-c00c02b0de50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8395135d-ce46-43bd-89d3-58c071e2c08c", "name": "network-vif-deleted", "tag": "16d56f63-8f6d-4e42-82d1-53e1bc83b86a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:19.887466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a37fd454-a70f-40cd-afac-d34b58953ba2 req-5929d6f9-2638-43a4-920a-c00c02b0de50 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:19.888056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a37fd454-a70f-40cd-afac-d34b58953ba2 req-5929d6f9-2638-43a4-920a-c00c02b0de50 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:19.888505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a37fd454-a70f-40cd-afac-d34b58953ba2 req-5929d6f9-2638-43a4-920a-c00c02b0de50 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:19.925739 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a37fd454-a70f-40cd-afac-d34b58953ba2 req-5929d6f9-2638-43a4-920a-c00c02b0de50 service nova] Creating event network-vif-deleted:16d56f63-8f6d-4e42-82d1-53e1bc83b86a for instance 8395135d-ce46-43bd-89d3-58c071e2c08c on n-h1-master-1 Oct 16 01:13:19.941183 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a37fd454-a70f-40cd-afac-d34b58953ba2 req-5929d6f9-2638-43a4-920a-c00c02b0de50 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099324 Oct 16 01:13:19.942980 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1583/3002] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:20.111771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:20.112431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-551b12ed-9fc0-4e70-b390-294d91083e27 req-a44b1d6c-38fd-4b56-a7e9-efc4b8117ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f7388b-c77c-4971-8df5-f5bb064c65ed", "name": "network-vif-deleted", "tag": "40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:20.140058 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df403066-54cf-4fc0-99eb-61eb881503bd tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1645 microversion: 2.1 time: 1.274242 Oct 16 01:13:20.140663 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1420/3003] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:18 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1645 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:20.209205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-551b12ed-9fc0-4e70-b390-294d91083e27 req-a44b1d6c-38fd-4b56-a7e9-efc4b8117ac3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:20.213280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-551b12ed-9fc0-4e70-b390-294d91083e27 req-a44b1d6c-38fd-4b56-a7e9-efc4b8117ac3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:20.217883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-551b12ed-9fc0-4e70-b390-294d91083e27 req-a44b1d6c-38fd-4b56-a7e9-efc4b8117ac3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:20.272006 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-551b12ed-9fc0-4e70-b390-294d91083e27 req-a44b1d6c-38fd-4b56-a7e9-efc4b8117ac3 service nova] Creating event network-vif-deleted:40e7eae2-33a1-4ffa-bc7d-4d9f2c3d437d for instance 35f7388b-c77c-4971-8df5-f5bb064c65ed on n-h2-master-1 Oct 16 01:13:20.312302 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-551b12ed-9fc0-4e70-b390-294d91083e27 req-a44b1d6c-38fd-4b56-a7e9-efc4b8117ac3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199272 Oct 16 01:13:20.316072 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1584/3004] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:13:20.486320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:20.487965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:20.512234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:20.516104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:20.519293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:20.521549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:20.527165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:20.529659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:20.633818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:20.636064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:20.636798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:20.638565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lazy-loading 'fault' on Instance uuid 8395135d-ce46-43bd-89d3-58c071e2c08c {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:13:20.839637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:20.877772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:20.888545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:20.946512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-34b785ef-32af-41b1-938c-9b4e80067675 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 200 len: 1319 microversion: 2.1 time: 0.461731 Oct 16 01:13:20.958947 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1421/3005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:20 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:20.959241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:20.959241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:20.959241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:20.959241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:20.959241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:20.959241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:21.167465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:21.168259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:21.173415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:21.179528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:21.188457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:21.191151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:21.192612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:21.194350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:21.195461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:21.199878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:21.205986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:21.223415 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cbcc9605-d8f7-4848-a7e2-92f58567e99f tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.357922 Oct 16 01:13:21.225754 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1585/3006] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:20 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:13:21.351738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:21.359604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:21.363832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:21.364435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lazy-loading 'fault' on Instance uuid 35f7388b-c77c-4971-8df5-f5bb064c65ed {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:13:21.465961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f95d77e66946ce9ac525cc34c61d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3986cde5f07a4eeead588c344187a0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:21.487014 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6c369d4-8efc-473b-8d90-c875f4401e56 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 200 len: 1305 microversion: 2.1 time: 0.323810 Oct 16 01:13:21.490488 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1422/3007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:21 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 1305 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:21.974888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:21.976080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:21.987654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:21.990525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:21.991883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:21.993931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:21.994628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:21.996007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:22.037066 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c HTTP/1.1 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8395135d-ce46-43bd-89d3-58c071e2c08c'} Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.039714 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:22.043803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:22.043803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:22.043803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:22.043803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:22.043803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:13:22.043803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.045987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:22.048586 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e9a779e-0857-45ef-99e4-6e28624a1db8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 404 len: 111 microversion: 2.1 time: 0.078868 Oct 16 01:13:22.051909 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1586/3008] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:21 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:22.261075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:22.261817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:22.269136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:22.277694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:22.278983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:22.280530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:22.285782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:22.286390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:22.298761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1991791808", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e837775c-af35-4cb2-89ea-5a342e83cc6f"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:22.421691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] validate_networks() for [('e837775c-af35-4cb2-89ea-5a342e83cc6f', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:13:22.517523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:22.542139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:22.547577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:22.560077 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c03389ef-1b91-4059-a02e-d0254ccb5487 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.303713 Oct 16 01:13:22.569320 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1423/3009] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:22 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:22.576310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:22.576929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] [instance: 35f7388b-c77c-4971-8df5-f5bb064c65ed] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:22.590498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:22.591032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:22.591477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:22.592253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:22.592690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:22.593093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:22.628827 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] HTTP exception thrown: Instance 35f7388b-c77c-4971-8df5-f5bb064c65ed could not be found. Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Request method failure captured: Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed HTTP/1.1 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pGMENaUtg0xpPPkvwjRtu25HorPa-lf72nqUF9cXbpUNh6d2eSqOC3o6T65UR25bs3BYTfnxjbDxIzrxLYfsrcr55TV64EmYodxSyAIUgDGCl-jJN9LGv98FlaNNeDcTaz9kkn-qVE7JwewuBoc3yQMgELgObVlSxPkm7MRIwLwmY Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3986cde5f07a4eeead588c344187a0b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3986cde5f07a4eeead588c344187a0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3986cde5f07a4eeead588c344187a0b8 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1323585285 Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 17f95d77e66946ce9ac525cc34c61d7c Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-SecurityGroupsTestJSON-1323585285-project Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 35f7388b-c77c-4971-8df5-f5bb064c65ed could not be found. Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '35f7388b-c77c-4971-8df5-f5bb064c65ed'} Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f7388b-c77c-4971-8df5-f5bb064c65ed could not be found. Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f7388b-c77c-4971-8df5-f5bb064c65ed could not be found. Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:13:22.630345 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.634820 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:13:22.634820 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:13:22.634820 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:13:22.634820 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:13:22.634820 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:13:22.634820 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f7388b-c77c-4971-8df5-f5bb064c65ed could not be found. Oct 16 01:13:22.634820 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:13:22.637739 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Returning 404 to user: Instance 35f7388b-c77c-4971-8df5-f5bb064c65ed could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:13:22.638792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3fd882e7-5cba-4d3c-b021-edb575139e4e tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed" status: 404 len: 111 microversion: 2.1 time: 0.067926 Oct 16 01:13:22.641184 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1424/3010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:22 2022] GET /compute/v2.1/servers/35f7388b-c77c-4971-8df5-f5bb064c65ed => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:13:22.653347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-560fadb4-8249-4e44-a4c1-f71477c01627 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64daaaf70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:24.342577 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-560fadb4-8249-4e44-a4c1-f71477c01627 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/0732da25-7193-46bd-b245-255f277f06a3" status: 202 len: 0 microversion: 2.1 time: 1.692836 Oct 16 01:13:24.343877 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1425/3011] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:22 2022] DELETE /compute/v2.1/os-security-groups/0732da25-7193-46bd-b245-255f277f06a3 => generated 0 bytes in 1695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:13:24.355036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:24.355943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:24.360000 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:13:24.360557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:13:24.360939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:13:24.361353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:13:24.362062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:13:24.373841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:24.376056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:24.376515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:24.378270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:24.378736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:24.379739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:24.379950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:24.382198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:24.382654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:24.383466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:24.383926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:24.384353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:24.436152 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:24.445560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:13:24.465591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Getting quotas for user df9979f0dcd74d60a55d02d432de6a51 and project 12f75cea27f642c18d60645158425380. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:13:24.509745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:13:24.534879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:13:24.639704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:24.653149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:24.655037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:24.668250 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-78b88476-3290-45f6-9bec-986c8748fe5a tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1558 microversion: 2.91 time: 0.322474 Oct 16 01:13:24.684102 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1426/3012] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:24 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1558 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:24.697451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64f8b797-fc73-4c22-b390-cabb8bd0e2a0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] Calling method '.version_select at 0x7fd64daaa160>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:24.711559 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b04c71a-e8e2-489f-adc4-24dada1b6cfd tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.407760 Oct 16 01:13:24.729454 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1587/3013] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:13:24.734668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2fe59844-6bf3-45e4-9574-6f7574426bf9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:24.735644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2fe59844-6bf3-45e4-9574-6f7574426bf9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:25.909883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2fe59844-6bf3-45e4-9574-6f7574426bf9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:25.920452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2fe59844-6bf3-45e4-9574-6f7574426bf9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1209 microversion: 2.1 time: 1.189499 Oct 16 01:13:25.924311 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1588/3014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:24 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1209 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:25.963531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:25.969792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:26.027817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:26.028796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:26.031745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:26.036518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:26.043013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:26.045361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:26.617460 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:26.662130 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:26.677652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:26.697503 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-125e99ff-61ff-44ed-b05a-1551e37f49ae tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.748587 Oct 16 01:13:26.710954 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1589/3015] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:25 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:26.953938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:26.954621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:26.970610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:26.971236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:26.971694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:26.976927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:26.977463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:26.981273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:27.165690 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64f8b797-fc73-4c22-b390-cabb8bd0e2a0 tempest-SecurityGroupsTestJSON-1323585285 tempest-SecurityGroupsTestJSON-1323585285-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/fbfb3356-c13f-4dbb-bb50-f73b7cab7277" status: 202 len: 0 microversion: 2.1 time: 2.479865 Oct 16 01:13:27.166282 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1427/3016] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:13:24 2022] DELETE /compute/v2.1/os-security-groups/fbfb3356-c13f-4dbb-bb50-f73b7cab7277 => generated 0 bytes in 2481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:13:27.382049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:27.390830 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f80167bd-432f-479e-a22a-dfd6a1374287 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1261 microversion: 2.1 time: 0.441878 Oct 16 01:13:27.403376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1590/3017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:26 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1261 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:27.734264 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:27.734965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:27.745461 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:27.778750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:27.812141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:27.813301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:27.817138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:27.822771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:27.823373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:28.345163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:28.371358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:28.380779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:28.397058 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2df831d-0c6b-453e-92d5-49fa3c8d95db tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.668786 Oct 16 01:13:28.399579 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1428/3018] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:27 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:28.421273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:28.422235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:28.439597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:28.441211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:28.446047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:28.448897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:28.453534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:28.458842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:28.706477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:28.718601 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be3adec4-a9b8-4e83-bd9f-282ad694a142 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1267 microversion: 2.1 time: 0.301356 Oct 16 01:13:28.738972 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1591/3019] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:28 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:28.921638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:28.924841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:28.941372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:28.945293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:28.947511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:28.950453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:28.953369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:28.954244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:29.110384 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e036acd-0a27-4eec-b7bb-c40c6a701a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.195362 Oct 16 01:13:29.112059 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1429/3020] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:13:28 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:13:29.124005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:29.125178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:29.140441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:29.141437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:29.142308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:29.143595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:29.144359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:29.145471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:29.436029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:29.438556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:29.462061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:29.463252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:29.465642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:29.467131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:29.470195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:29.470970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:29.643503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:29.665344 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1de93cb0-60f3-4c64-8dae-073a541ac746 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1673 microversion: 2.1 time: 0.537052 Oct 16 01:13:29.666384 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1592/3021] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:29 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1673 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:29.728327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:29.739003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:29.747698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:29.750790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:29.751452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:29.765719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:29.766218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:29.766646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74666d6e-0d43-499e-a472-3bbf66ff39ce tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.336009 Oct 16 01:13:29.766794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:29.783310 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1430/3022] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:29 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:29.783693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:29.783693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:29.783693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:30.575680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:30.587393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2e8d1f82-c623-4afb-8728-dd1e9a2a5bec tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1267 microversion: 2.1 time: 0.841458 Oct 16 01:13:30.608940 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1593/3023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:29 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1267 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:30.693898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:30.695182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:30.749623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:30.750889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:30.751549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:30.752464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:30.755687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:30.756432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:30.811142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:30.812738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:30.831262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:30.834515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:30.834997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:30.840799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:30.850734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:30.851520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:31.112251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:31.127400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:31.130725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:31.153628 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-857efd94-07e8-4c93-a46a-075903861dc5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.354684 Oct 16 01:13:31.158343 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1594/3024] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:30 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:13:31.393933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:31.409932 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-401027ef-d393-48d5-b3e3-b7acab58570d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1673 microversion: 2.1 time: 0.723684 Oct 16 01:13:31.410832 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1431/3025] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:30 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1673 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:31.616336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:31.623380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:31.651575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:31.652779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:31.654228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:31.656805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:31.657469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:31.658070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:31.851028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:31.867312 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c582d0ff-081b-401b-baeb-fc7102542cba tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1267 microversion: 2.1 time: 0.252427 Oct 16 01:13:31.878765 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1595/3026] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:31 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:32.191780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:32.194043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:32.207966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:32.209257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:32.212362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:32.214125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:32.217923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:32.220679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:32.437703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:32.438458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:32.450861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:32.458150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:32.458866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:32.463260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:32.465285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:32.466342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:33.292131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:33.309540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:33.311382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:33.329697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-714ef516-4fb3-424a-9ed4-652f4d5f1281 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 1.142380 Oct 16 01:13:33.332249 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1432/3027] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:32 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:33.339528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:33.343677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:33.358356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:33.366680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:33.367789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:33.368734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:33.370438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:33.371106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:33.409624 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:33.839970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:33.854135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7af21bd2-3fe0-4002-8f61-e5a524bf69c7 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 0.520715 Oct 16 01:13:33.863821 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1433/3028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:33 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:33.988226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:34.003218 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60b5878d-8cd6-457b-a217-2ec310fb5aa7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1673 microversion: 2.1 time: 1.568115 Oct 16 01:13:34.004515 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1596/3029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:32 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1673 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:34.361071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:34.362323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:34.378062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:34.378806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:34.379524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:34.380417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:34.381110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:34.381885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:34.840599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:34.861056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:34.868548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:34.888336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:34.889107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:34.891144 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:34.907061 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b50b027b-6658-438a-8e38-f40acb179f7d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.540604 Oct 16 01:13:34.908445 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1434/3030] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:34 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:34.922852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:34.923704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:34.927431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:34.932878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:34.933615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:34.934760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:35.027857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:35.028891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:35.057895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:35.058881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:35.060175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:35.063814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:35.064349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:35.076600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:35.918956 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:36.589763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:36.604365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-184438c0-dd3f-4eb1-aa02-2b65d8ef6a8a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 1.720391 Oct 16 01:13:36.622979 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1597/3031] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:34 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:36.637190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:36.644203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:36.668589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:36.669195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:36.670845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:36.672039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:36.672745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:36.673740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:36.867843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:36.886827 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0268558e-de06-4f52-ba7c-306a4e658fb2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1678 microversion: 2.1 time: 1.862522 Oct 16 01:13:36.887781 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1435/3032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:35 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1678 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:37.083089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:37.117447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:37.130105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:37.170890 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7df5bd8a-e0d9-4b7d-9469-29636db6fb89 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.558904 Oct 16 01:13:37.172244 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1598/3033] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:36 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:37.638958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:37.641333 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:37.652103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:37.652961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:37.653713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:37.655966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:37.656823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:37.657673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:37.916048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:37.916815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:37.931022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:37.932877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:37.933425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:37.940370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:37.942261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:37.946755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:38.077707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:38.087359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2515198-707a-496d-8fad-184795cfc476 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 0.452380 Oct 16 01:13:38.101667 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1436/3034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:37 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:38.210520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:38.211391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:38.219937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:38.228591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:38.229177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:38.229933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:38.246181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:38.246181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:39.451265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:39.461963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:39.467692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:39.483303 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c2d2f960-afd1-4bf2-ae67-687bfc52d8b2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 1.283082 Oct 16 01:13:39.484845 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1437/3035] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:38 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:39.498746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-de8afe52-7ccd-471b-bba5-7a17d8d32f18 req-84b52c4d-7465-4bd7-86e4-91813b779753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1206015-53a8-4f00-9ae7-2597eabc24f5", "tag": "3ab2ee30-2caa-40ae-b713-cf3cb1bd02c9"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:39.524434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-de8afe52-7ccd-471b-bba5-7a17d8d32f18 req-84b52c4d-7465-4bd7-86e4-91813b779753 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:39.525791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-de8afe52-7ccd-471b-bba5-7a17d8d32f18 req-84b52c4d-7465-4bd7-86e4-91813b779753 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:39.530768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-de8afe52-7ccd-471b-bba5-7a17d8d32f18 req-84b52c4d-7465-4bd7-86e4-91813b779753 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:39.563905 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-de8afe52-7ccd-471b-bba5-7a17d8d32f18 req-84b52c4d-7465-4bd7-86e4-91813b779753 service nova] Creating event network-changed:3ab2ee30-2caa-40ae-b713-cf3cb1bd02c9 for instance b1206015-53a8-4f00-9ae7-2597eabc24f5 on n-h2-master-1 Oct 16 01:13:39.570476 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-de8afe52-7ccd-471b-bba5-7a17d8d32f18 req-84b52c4d-7465-4bd7-86e4-91813b779753 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082163 Oct 16 01:13:39.571834 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1438/3036] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:39.577197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:39.584704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:39.613067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:39.614712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:39.617180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:39.618626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:39.622308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:39.624685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:40.041089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:40.066732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35c1975b-a2e6-4f36-9356-91db660f44f3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 0.486209 Oct 16 01:13:40.071341 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1439/3037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:39 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:40.313715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:40.318021 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:40.329231 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-00849f20-9961-46f8-964a-1293844aa0b1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 2.418039 Oct 16 01:13:40.330015 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1599/3038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:37 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 2420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:40.520905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:40.522115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:40.543393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:40.544134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:40.547605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:40.548579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:40.549454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:40.550054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:40.942466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:40.955780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:40.963245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:40.979904 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f81ff28-295d-4bc3-8b9c-85523fca7745 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.465480 Oct 16 01:13:40.980511 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1440/3039] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:40 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:41.097696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:41.098203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:41.124884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:41.125389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:41.125832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:41.126549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:41.141714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:41.144364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:42.010932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:42.011604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:42.030602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:42.031157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:42.031747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:42.032488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:42.032953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:42.033385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:42.086341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:42.097134 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-584b53ff-ddf7-4ae0-8df0-09cd5cae3a90 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 1.003283 Oct 16 01:13:42.111191 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1600/3040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:41 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:42.619220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:42.658660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:42.663331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:42.686763 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73959d25-4a12-486e-b7eb-d518090f9692 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.677692 Oct 16 01:13:42.714537 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1441/3041] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:42 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:13:43.125764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:43.126980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:43.145772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:43.146315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:43.146750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:43.167501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:43.168004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:43.168449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:43.722714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:43.724184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:43.745582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:43.747280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:43.748773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:43.752915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:43.755985 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d5a1f2d-81d4-4cbc-b6b3-edd928ae4308 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 0.633964 Oct 16 01:13:43.756598 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1601/3042] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:43 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:43.757773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:43.759432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:43.764379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:44.055982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:44.074722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:44.086586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:44.113051 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a1110ec7-7a79-4ccb-be81-a67ec0fcf799 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.395490 Oct 16 01:13:44.116552 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1442/3043] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:43 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:44.786396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:44.787814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:44.798095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:44.814387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:44.815530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:44.819512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:44.822676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:44.826997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:45.146952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:45.148776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:45.166562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:45.168870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:45.170699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:45.171780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:45.175262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:45.176343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:45.696818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:45.720654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:45.723292 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:45.742309 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-96323130-b45b-4ba2-9e97-13c728fa67e1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.599699 Oct 16 01:13:45.753740 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1443/3044] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:45 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:13:46.263672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:46.273140 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c8f08d03-6370-4c9c-bd74-ee87dd260ad0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 1.490434 Oct 16 01:13:46.299394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1602/3045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:44 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:46.784670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:46.785243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:46.809021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:46.809520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:46.809965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:46.810688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:46.811174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:46.826956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:47.330824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:47.334073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:47.379077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:47.379596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:47.380044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:47.393681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:47.398413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:47.402519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:48.274806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:48.294493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:48.295623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:48.333135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fb0ae54-e9ee-473f-9665-90a9b7973b1e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 1.552542 Oct 16 01:13:48.334194 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1444/3046] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:46 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:48.751933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1897965188", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f1be6366-4aa8-4d1b-bc3d-e16756e09745"}], "security_groups": [{"name": "tempest-securitygroup--846216686"}], "key_name": "tempest-keypair-366948471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "db45496e-b96b-4687-9d69-3b5d0559772d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:48.910440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:48.920122 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd9ba247-780f-493f-9c6b-b53c3b04f97a tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 1.599552 Oct 16 01:13:48.947629 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1603/3047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:47 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:49.312686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] validate_networks() for [('f1be6366-4aa8-4d1b-bc3d-e16756e09745', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:13:49.366284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:49.366446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:49.389705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:49.390212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:49.390650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:49.392028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:49.395137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:49.396601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:49.513440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:49.530825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:49.533797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:49.542525 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-12a59ef0-e039-45aa-9f56-4249a71e8863 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.181185 Oct 16 01:13:49.544449 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1604/3048] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:49 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:49.957493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:49.963433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:49.994193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:49.995089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:49.998966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:50.001347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:50.011562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:50.015181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:50.666185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:50.679688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-525f8b62-e359-43c6-9c87-b06119957338 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 0.727409 Oct 16 01:13:50.680804 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1605/3049] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:49 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:50.686228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-110b9490-98cc-4418-b11c-4f59d3a09e75 req-82e5c484-1bab-44b4-b5fd-0e636c89fa3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1206015-53a8-4f00-9ae7-2597eabc24f5", "name": "network-vif-plugged", "status": "completed", "tag": "3ab2ee30-2caa-40ae-b713-cf3cb1bd02c9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:50.712908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-110b9490-98cc-4418-b11c-4f59d3a09e75 req-82e5c484-1bab-44b4-b5fd-0e636c89fa3c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:50.722576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-110b9490-98cc-4418-b11c-4f59d3a09e75 req-82e5c484-1bab-44b4-b5fd-0e636c89fa3c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:50.723053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-110b9490-98cc-4418-b11c-4f59d3a09e75 req-82e5c484-1bab-44b4-b5fd-0e636c89fa3c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:50.782718 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-110b9490-98cc-4418-b11c-4f59d3a09e75 req-82e5c484-1bab-44b4-b5fd-0e636c89fa3c service nova] Creating event network-vif-plugged:3ab2ee30-2caa-40ae-b713-cf3cb1bd02c9 for instance b1206015-53a8-4f00-9ae7-2597eabc24f5 on n-h2-master-1 Oct 16 01:13:50.800347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-110b9490-98cc-4418-b11c-4f59d3a09e75 req-82e5c484-1bab-44b4-b5fd-0e636c89fa3c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117369 Oct 16 01:13:50.800886 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1606/3050] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:50.839341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:50.840511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:50.855986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:50.857118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:50.870962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:50.876281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:50.878118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:50.881128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:51.005294 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Getting quotas for project cfee6c66b8f5495a8eb29e4136ec3ed7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:13:51.022982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Getting quotas for user 3714a80dffe147b5b683e6a3419d0df3 and project cfee6c66b8f5495a8eb29e4136ec3ed7. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:13:51.056780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:13:51.057511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:13:51.060446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:13:51.061244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:13:51.061831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:13:51.080475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:51.080976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:51.081422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:51.086283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:51.086905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:51.087392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:51.137248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Getting quotas for project cfee6c66b8f5495a8eb29e4136ec3ed7. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:13:51.159464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Getting quotas for user 3714a80dffe147b5b683e6a3419d0df3 and project cfee6c66b8f5495a8eb29e4136ec3ed7. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:13:51.401857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:13:51.404165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db45496e-b96b-4687-9d69-3b5d0559772d',volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:13:51.712219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:51.722687 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:51.736711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:51.757817 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71c6414d-eb3a-4045-9096-00cd4927e18d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.941208 Oct 16 01:13:51.762531 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1607/3051] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:50 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:51.783148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:51.787189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:51.810135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:51.813498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:51.817271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:51.818619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:51.822301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:51.826451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:51.898410 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ad51f202-7e34-496b-888d-091f3f258143 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.151584 Oct 16 01:13:51.899123 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1445/3052] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:13:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 3153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:13:51.940243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3dd25c3f-3b6c-4657-ac7b-202003ee3165 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:51.944448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3dd25c3f-3b6c-4657-ac7b-202003ee3165 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:52.401088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3dd25c3f-3b6c-4657-ac7b-202003ee3165 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:52.418482 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3dd25c3f-3b6c-4657-ac7b-202003ee3165 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1121 microversion: 2.1 time: 0.491766 Oct 16 01:13:52.433935 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1446/3053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:51 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1121 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:52.541564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:52.555426 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-37e11040-54cd-446a-a624-f07d3acde515 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1309 microversion: 2.1 time: 0.786731 Oct 16 01:13:52.557153 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1608/3054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:51 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1309 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:52.799501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:52.800802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:52.858306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:52.861150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:52.869082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:52.872436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:52.874692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:52.878461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:53.146127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:53.158826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:53.166739 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:53.178587 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51c8db85-1fc7-4d32-9747-8218964b4b21 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.382972 Oct 16 01:13:53.184366 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1447/3055] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:52 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:53.446850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:53.449858 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:53.466053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:53.478940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:53.481619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:53.483774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:53.492226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:53.494393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:53.726307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:53.737252 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c00ca356-1364-47ad-8e2a-56bcf9d2d0b0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1171 microversion: 2.1 time: 0.294930 Oct 16 01:13:53.747845 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1448/3056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:53 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1171 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:53.763885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:53.769348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:53.796029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:53.796668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:53.797201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:53.799267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:53.799982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:53.801845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:53.852508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-41f6b8d4-7569-4383-8a8c-5d60f17694d8 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Action: 'create', calling method: .version_select at 0x7fd6527aa550>, body: {"keypair": {"name": "tempest-keypair-1087422527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKlM/Ch80fYtG8PYsyLu7Pp013m2tC87Eiu/8o1oesOaS0o3MKLst5JySh2FB1YRR/wdHf37/Q4K70SZFf3OMsUqa87NPmWw4JuByD6qN5fMxbcK/NrUhcGuHdr1FIywg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:53.915766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-41f6b8d4-7569-4383-8a8c-5d60f17694d8 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Getting quotas for project 82d1c738ddf642ed8febdb236f5bf8f3. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:13:53.925419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-41f6b8d4-7569-4383-8a8c-5d60f17694d8 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Getting quotas for user 1cb1f704f82b46bd85d0f117f1686b5d and project 82d1c738ddf642ed8febdb236f5bf8f3. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:13:53.990744 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-41f6b8d4-7569-4383-8a8c-5d60f17694d8 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.559338 Oct 16 01:13:53.991466 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1609/3057] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:13:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:13:54.211192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:54.211878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:54.227507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:54.228373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:54.230787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:54.231731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:54.233314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:54.235487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:54.353424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:54.363188 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-069868fd-43ad-4884-acdd-afd63c0efca1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1491 microversion: 2.1 time: 0.613873 Oct 16 01:13:54.366752 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1449/3058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:53 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1491 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:54.392820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1604418800"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:54.412524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:54.432094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:54.435591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:54.436184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:54.438622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:54.442364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:54.443225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:54.496298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:54.528481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:54.530066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:54.563738 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:54.570992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6fdc9e6-c4f4-44ff-b4d8-9953a41e41b5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.359128 Oct 16 01:13:54.574323 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1610/3059] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:54 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:54.637547 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aaaa847a-b487-47fe-ba01-b68898e22c20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "PUT /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1076 microversion: 2.1 time: 0.246254 Oct 16 01:13:54.639236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1450/3060] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:13:54 2022] PUT /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1076 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:54.666068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:54.667189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:54.702121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:54.702646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:54.720235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:54.726006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:54.727156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:54.727608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:54.770956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:54.772003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:54.785270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:54.786163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:54.791520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:54.792647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:54.793370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:54.794086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:55.428661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:55.431211 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:55.441430 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b1b73c5-1bbe-4af8-8e06-b8188bd2d23d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1227 microversion: 2.1 time: 0.674379 Oct 16 01:13:55.458908 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1451/3061] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:54 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1227 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:55.609124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:55.610171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:55.620108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:55.627715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:55.628485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:55.629487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:55.634066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:55.634867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:56.202209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:56.219757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-216fda68-08b4-4d6e-87d9-634eeedc8a70 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1502 microversion: 2.1 time: 1.563933 Oct 16 01:13:56.240741 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1611/3062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:54 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1502 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:56.245700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:56.246316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:56.278598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:56.279159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:56.279608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:56.280345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:56.280811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:56.281243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:56.301417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:56.320847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:56.322836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:56.344847 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f8aa19ce-a03e-4f03-9bd7-1eb314c4fb16 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.740236 Oct 16 01:13:56.346108 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1452/3063] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:55 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:13:56.477799 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:56.483477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:56.495475 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:56.498131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:56.498903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:56.499651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:56.501242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:56.502218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:56.502896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:56.760259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:56.769153 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ad5890ac-2977-48e1-b954-5ba9c42a8c2c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1237 microversion: 2.1 time: 0.295321 Oct 16 01:13:56.776852 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1453/3064] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:56 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1237 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:13:57.388895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:57.390231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:57.423827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:57.427984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:57.428611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:57.431530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:57.434465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:57.437248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:58.065900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:58.088893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:58.090668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:58.105414 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-72a15929-7d22-4045-8f09-edaec3188703 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.727395 Oct 16 01:13:58.106306 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1454/3065] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:57 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:13:58.119961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:58.120874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:58.128475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:58.129231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:58.129895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:58.132949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:58.133591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:58.134348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:58.327607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:58.337411 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-717a4209-78df-4fdc-bc96-434dca6ccca9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1502 microversion: 2.1 time: 2.095464 Oct 16 01:13:58.355549 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1612/3066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:56 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1502 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:58.378779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65ddc039-330b-4744-bf2a-daade0fdf2e8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:13:58.408651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65ddc039-330b-4744-bf2a-daade0fdf2e8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:58.409150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65ddc039-330b-4744-bf2a-daade0fdf2e8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:58.412063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65ddc039-330b-4744-bf2a-daade0fdf2e8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:58.478567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65ddc039-330b-4744-bf2a-daade0fdf2e8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Going to try to stop instance {{(pid=120545) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:13:58.509293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:58.524629 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03c522a5-17a7-4758-91c1-42d6016c5786 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1237 microversion: 2.1 time: 0.410828 Oct 16 01:13:58.525373 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1455/3067] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:58 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1237 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:13:58.609524 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65ddc039-330b-4744-bf2a-daade0fdf2e8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "POST /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5/action" status: 202 len: 0 microversion: 2.1 time: 0.238730 Oct 16 01:13:58.613470 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1613/3068] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:13:58 2022] POST /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:13:58.623504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:58.624338 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:58.642253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:58.643814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:58.650364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:58.655596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:58.656264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:58.656712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:59.140944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:59.143845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:59.159634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:59.174158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:59.175064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:59.176681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:59.179407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:59.181696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:59.482422 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:59.495618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:59.519322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:13:59.545142 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c18dbf39-f5d8-48eb-a1e1-7f7c063fe46c tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1553 microversion: 2.91 time: 0.410908 Oct 16 01:13:59.551774 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1614/3069] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:13:59 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1553 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:13:59.564684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:13:59.566661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:13:59.592976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:59.594130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:59.594873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:13:59.595874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:13:59.596589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:13:59.597302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:00.094218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:00.103802 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5130d626-e000-4878-b203-bd39f7fdfd21 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 1.485636 Oct 16 01:14:00.109689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:00.126333 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f4bb9f5e-1897-4d4a-9c5d-31bf51c5b37f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1237 microversion: 2.1 time: 0.570190 Oct 16 01:14:00.128472 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1456/3070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:58 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:00.141251 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1615/3071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:13:59 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1237 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:00.144474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1045342791", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6208d78c-d0c1-4e40-8e5e-35000822de89"}], "security_groups": [{"name": "tempest-securitygroup--218201895"}], "key_name": "tempest-keypair-1087422527", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:00.555202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] validate_networks() for [('6208d78c-d0c1-4e40-8e5e-35000822de89', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:14:00.587283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:00.588608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:00.604497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:00.605296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:00.605999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:00.606985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:00.607677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:00.608330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:00.913847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:00.936609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:00.938311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:00.951689 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0d9790e-dbfb-460a-a609-8d170709a2d9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1535 microversion: 2.91 time: 0.373816 Oct 16 01:14:00.952903 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1616/3072] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:00 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1535 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:01.115184 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:01.156820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:01.157546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:01.168658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:01.170700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:01.172455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:01.173797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:01.175056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:01.176553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:01.181948 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:01.742824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:01.752708 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d9561076-95bc-417b-b186-c691d3115e67 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.599789 Oct 16 01:14:01.773014 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1617/3073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:01 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:01.778048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:01.778676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:01.805469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:01.808282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:01.808765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:01.809512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:01.809990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:01.810434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:01.815875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Getting quotas for project 82d1c738ddf642ed8febdb236f5bf8f3. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:14:01.828270 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Getting quotas for user 1cb1f704f82b46bd85d0f117f1686b5d and project 82d1c738ddf642ed8febdb236f5bf8f3. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:14:01.862977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:14:01.863544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:14:01.864844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:14:01.867105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:14:01.868253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:14:01.885684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:01.886563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:01.887437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:01.888397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:01.889825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:01.890759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:01.913839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Getting quotas for project 82d1c738ddf642ed8febdb236f5bf8f3. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:14:01.925900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Getting quotas for user 1cb1f704f82b46bd85d0f117f1686b5d and project 82d1c738ddf642ed8febdb236f5bf8f3. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:14:01.957930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:14:01.967935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:14:02.103928 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7b73c040-c237-4c73-be9e-6c57e8da398a tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.967693 Oct 16 01:14:02.113172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1457/3074] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:14:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:14:02.163991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:02.165786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:02.197057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:02.204172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:02.204987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:02.205854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:02.210362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:02.211361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:02.632538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:02.645097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:02.659191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:02.666789 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c425999-1f5e-4f6d-bec5-d3816575c088 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1535 microversion: 2.91 time: 0.552175 Oct 16 01:14:02.668227 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1458/3075] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:02 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1535 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:02.682957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f1ac26fc-3f10-48b9-a7c4-3d33d475bc05 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:02.684588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f1ac26fc-3f10-48b9-a7c4-3d33d475bc05 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:02.915592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f1ac26fc-3f10-48b9-a7c4-3d33d475bc05 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:02.926357 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f1ac26fc-3f10-48b9-a7c4-3d33d475bc05 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1270 microversion: 2.1 time: 0.254700 Oct 16 01:14:02.927918 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1459/3076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:02 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:02.944205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:02.946696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:02.973541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:02.976095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:02.977395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:02.980029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:02.981829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:02.991563 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad356c95-11bb-4554-838f-7dfbb79ff4af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1304 microversion: 2.1 time: 1.217243 Oct 16 01:14:02.992742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:02.995080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:02.998522 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1618/3077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:01 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1304 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:03.597839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:03.608528 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd13cfc3-441a-465f-94c0-5353968516d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.674737 Oct 16 01:14:03.618550 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1460/3078] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:02 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:03.701512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:03.702175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:03.728463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:03.733312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:03.734364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:03.740823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:03.741549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:03.745027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:03.933392 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:03.948080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:03.949987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:03.952816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:03.955861 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:03.964571 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:03.969283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:03.970577 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6cfead6d-6bc2-4283-93d1-6401f4b4c47d tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1478 microversion: 2.91 time: 0.275244 Oct 16 01:14:03.975798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:03.978323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:03.979538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:03.981596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:03.982268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:03.988502 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1619/3079] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:03 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1478 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:04.006432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-master-1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:04.015023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:04.021878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:04.022737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:04.023595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:04.025330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:04.026083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:04.026735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:04.175593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-master-1". {{(pid=120545) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 01:14:04.343669 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0a2da1d4-5fca-42e2-9fad-6d4b9035cbf0 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e/action" status: 202 len: 0 microversion: 2.91 time: 0.342736 Oct 16 01:14:04.349427 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1620/3080] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:14:03 2022] POST /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:14:04.370954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:04.377446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:04.390791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:04.459417 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37a2ed66-6054-426c-a67b-752fc91a831c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1266 microversion: 2.1 time: 0.508964 Oct 16 01:14:04.462650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:04.463168 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1461/3081] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:03 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1266 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:04.467554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:04.468208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:04.469301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:04.471586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:04.499102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:04.501984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:04.502965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:04.525526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:04.528481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:04.533644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:04.535547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:04.538242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:04.538724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:05.496376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:05.518367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:05.525171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:05.545989 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d59b1134-a421-49c0-b4f1-7a31617bb6c1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1486 microversion: 2.91 time: 1.081320 Oct 16 01:14:05.548789 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1462/3082] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:04 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1486 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:05.567769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:05.568889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:05.590273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:05.597399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:05.598015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:05.601506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:05.604577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:05.605114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:05.668798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:05.682446 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b4b19545-2236-4ac6-a490-4b1c618bfed0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1304 microversion: 2.1 time: 1.331057 Oct 16 01:14:05.683070 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1621/3083] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:04 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1304 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:05.703849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:05.704920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:05.735449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:05.736012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:05.736467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:05.737208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:05.737671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:05.738098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:06.085612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:06.095773 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0269d04d-ef1a-4213-9175-c667713bda75 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1328 microversion: 2.1 time: 0.404874 Oct 16 01:14:06.104011 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1622/3084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:05 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1328 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:06.288587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:06.303086 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-937ca349-4a60-4a0b-8ed8-a6a9d97a9b20 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.751609 Oct 16 01:14:06.305778 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1463/3085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:05 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:06.581262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:06.585087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:06.593586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:06.594426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:06.595164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:06.596577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:06.597280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:06.597962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:06.662781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-64d37d24-45c5-4638-9735-2fe95a488149 req-969cec24-72b9-4532-ae3b-1d5d6c034a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e250d6e1-030e-4b1b-b4ed-3fa030574cc6", "tag": "f1472981-1e15-414d-a009-f9a3ab462d02"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:06.703651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-64d37d24-45c5-4638-9735-2fe95a488149 req-969cec24-72b9-4532-ae3b-1d5d6c034a2d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:06.704631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-64d37d24-45c5-4638-9735-2fe95a488149 req-969cec24-72b9-4532-ae3b-1d5d6c034a2d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:06.705328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-64d37d24-45c5-4638-9735-2fe95a488149 req-969cec24-72b9-4532-ae3b-1d5d6c034a2d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:06.729735 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-64d37d24-45c5-4638-9735-2fe95a488149 req-969cec24-72b9-4532-ae3b-1d5d6c034a2d service nova] Creating event network-changed:f1472981-1e15-414d-a009-f9a3ab462d02 for instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 on n-h1-master-1 Oct 16 01:14:06.738724 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-64d37d24-45c5-4638-9735-2fe95a488149 req-969cec24-72b9-4532-ae3b-1d5d6c034a2d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086664 Oct 16 01:14:06.742402 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1464/3086] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:06.748801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:06.749839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:06.760224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:06.761043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:06.761889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:06.763204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:06.763926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:06.764590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:06.792050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:06.807673 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:06.812095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:06.838433 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a28d9762-4b7e-4c01-9988-4619dca24d47 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1486 microversion: 2.91 time: 0.260566 Oct 16 01:14:06.842186 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1623/3087] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:06 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1486 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:07.137893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:07.138675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:07.156859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:07.181936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:07.183064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:07.184634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:07.186595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:07.187275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:07.432523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:07.444551 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7dfcc910-3a74-4db9-a820-f12827c7786e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1304 microversion: 2.1 time: 0.699904 Oct 16 01:14:07.447627 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1465/3088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:06 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1304 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:07.460308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:07.460907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:07.461804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:07.486098 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-40a5c5f4-5508-4f16-a7d8-da46d7e6736f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1328 microversion: 2.1 time: 0.361825 Oct 16 01:14:07.488891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:07.495398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:07.497712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:07.500688 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1624/3089] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:07 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1328 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:07.501256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:07.503028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:07.503528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:07.873245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:07.873871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:07.886664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:07.899466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:07.900367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:07.901137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:07.901625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:07.907227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:08.244667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:08.261399 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ea5749d-3d06-4644-bd5f-7e2d23349b85 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.811181 Oct 16 01:14:08.265693 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1466/3090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:07 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:08.273505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:08.321903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:08.323355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:08.330435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78800310-4bab-4307-a3a5-248487f63f74 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.461149 Oct 16 01:14:08.331088 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1625/3091] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:07 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:14:08.478179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:08.479133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:08.492160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:08.493135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:08.498677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:08.503061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:08.504431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:08.506151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:08.510986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:08.511903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:08.541721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:08.543989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:08.545391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:08.554190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:08.556830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:08.557580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:08.956938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:08.966000 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b066d70d-1609-4c2a-916a-14950d5a32ac tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 0.460163 Oct 16 01:14:08.977340 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1626/3092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:08 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:08.991691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:09.001489 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8f53028-5d72-49f3-badb-3320bfb67155 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 0.530375 Oct 16 01:14:09.003252 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1467/3093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:08 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:09.302364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:09.303730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:09.312525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:09.316277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:09.323513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:09.324517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:09.330259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:09.330716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:09.358772 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:09.359900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:09.370322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:09.391709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:09.393454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:09.394477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:09.397201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:09.397903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:09.689432 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:09.701078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:09.702540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:09.727964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2a16e7bd-fd18-4eba-b93e-8cb795cd8a2b tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.372880 Oct 16 01:14:09.728578 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1468/3094] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:09 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:10.001507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:10.002141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:10.042488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:10.043281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:10.043886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:10.044745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:10.046769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:10.047391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:10.339945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:10.349770 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf9dd85c-586d-42a5-a553-731766cb4048 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 1.051048 Oct 16 01:14:10.359509 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1627/3095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:09 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:10.375511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:10.376161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:10.401167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:10.403746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:10.410815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:10.412090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:10.412794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:10.413801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:11.688207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:11.704472 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef59571b-ee88-4310-a201-123c4d1fc308 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 1.710135 Oct 16 01:14:11.712882 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1469/3096] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:09 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:11.725273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:11.728085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:11.741058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:11.741551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:11.741994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:11.746371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:11.747271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:11.747729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:11.788552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:11.808080 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e108eb77-1390-441b-a733-9bc1eca1fa7c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 1.450418 Oct 16 01:14:11.808691 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1628/3097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:10 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:11.832164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5f4ad07d-78a8-46dd-b9a9-603a2c5ee7f1 req-5cb0baff-f5ef-4092-9467-60586cb1e9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b3db0a-f07b-4120-a1bf-47e23c1ee0a4", "tag": "b0e28d17-7ca7-4764-9b8f-63af0c185af8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:11.897613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5f4ad07d-78a8-46dd-b9a9-603a2c5ee7f1 req-5cb0baff-f5ef-4092-9467-60586cb1e9e3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:11.898421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5f4ad07d-78a8-46dd-b9a9-603a2c5ee7f1 req-5cb0baff-f5ef-4092-9467-60586cb1e9e3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:11.899063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5f4ad07d-78a8-46dd-b9a9-603a2c5ee7f1 req-5cb0baff-f5ef-4092-9467-60586cb1e9e3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:11.910192 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:11.921092 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5f4ad07d-78a8-46dd-b9a9-603a2c5ee7f1 req-5cb0baff-f5ef-4092-9467-60586cb1e9e3 service nova] Creating event network-changed:b0e28d17-7ca7-4764-9b8f-63af0c185af8 for instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 on n-h2-master-1 Oct 16 01:14:11.930902 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5f4ad07d-78a8-46dd-b9a9-603a2c5ee7f1 req-5cb0baff-f5ef-4092-9467-60586cb1e9e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116910 Oct 16 01:14:11.932012 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1629/3098] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:11.944231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:11.946256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:11.975533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:11.977785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:11.978407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:11.979794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:11.981640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:11.982265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:12.033734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:12.045867 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:12.051460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:12.053996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:12.061262 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30868f40-a41f-4329-b8ff-df96253bdec9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.347068 Oct 16 01:14:12.062800 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1470/3099] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:11 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:12.315598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:12.316575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:12.338602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:12.343247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:12.343755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:12.344542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:12.345040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:12.345508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:12.773167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:12.788389 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd668301-add6-4bc2-b6f4-71caaeb1c381 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.853368 Oct 16 01:14:12.799079 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1630/3100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:11 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:12.799704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:12.800140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:12.809754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:12.810415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:12.810948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:12.812508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:12.813037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:12.813749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:12.897122 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:12.910028 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be899999-ea13-44a3-bc4a-811286e135cc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.605689 Oct 16 01:14:12.918993 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1471/3101] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:12 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:12.925195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:12.930222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:12.953186 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=24 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:12.954877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:12.955431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:12.955998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:12.956687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:12.957301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:12.958627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:13.190366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:13.203541 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e066770a-aa85-4f99-b4b9-9aab6fdb492b tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 0.290631 Oct 16 01:14:13.204148 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1472/3102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:12 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:13.210754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:13.225724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7206df58-39aa-4562-851c-676132dbaba5 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 0.435050 Oct 16 01:14:13.227054 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1631/3103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:12 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:13.230695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:13.231535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:13.237432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:13.238254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:13.252411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:13.253978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:13.257992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:13.260117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:13.261085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:13.261405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:13.262073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:13.263405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:13.263790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:13.266270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:13.267344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:13.268642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:13.467314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:13.491109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:13.508739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:13.515218 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a035395-be28-4f35-958c-a99c4f446db5 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.286797 Oct 16 01:14:13.516419 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1632/3104] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:13 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:13.605562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:13.616170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a50b3e1-f0a1-4fb8-b3c6-30f23dd1217a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.401674 Oct 16 01:14:13.617327 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1473/3105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:13 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:13.645732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:13.647133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:13.663207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:13.669412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:13.670141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:13.673177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:13.673932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:13.674551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:13.749282 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:13.815801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:13.816460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:13.842769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:13.843316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:13.844047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:13.844999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:13.845706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:13.846386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:14.189787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:14.201084 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-55bcf085-18cf-4f6e-b2bb-0be3336ae1f9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.561129 Oct 16 01:14:14.201701 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1633/3106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:13 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:14.225393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:14.248558 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5afa179d-b858-48ad-a74d-7c48a1488b4e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.436907 Oct 16 01:14:14.253118 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1474/3107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:13 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:14.256868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:14.262754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:14.263524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:14.266220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:14.287128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:14.294594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:14.295138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:14.299762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:14.302316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:14.302806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:14.304510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:14.306759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:14.308590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:14.309614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:14.311280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:14.312466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:14.938678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:14.947739 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9544de28-373b-4cd5-a13e-dc17cf9acd5d tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 0.720657 Oct 16 01:14:14.948341 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1634/3108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:14 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:14.968765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:14.981038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:14.997325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:15.003127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:15.016862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:15.017969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:15.018660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:15.019789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:15.510310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:15.528009 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6f56b5c5-82ec-476e-9844-6d45fb3a43fb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 1.273595 Oct 16 01:14:15.528614 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1475/3109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:14 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:15.543175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:15.543175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:15.560037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:15.561040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:15.561677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:15.562586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:15.563373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:15.563970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:15.992152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:16.005572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:16.026159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:16.026704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:16.033260 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fc99dc70-41c9-45d0-bb30-1da0e02d83c2 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.503062 Oct 16 01:14:16.034449 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1476/3110] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:15 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:16.050961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:16.052707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:16.059053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cae4ffb6-f602-4926-9fd0-546e10ef608b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 1.084841 Oct 16 01:14:16.059671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:16.071039 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1635/3111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:14 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:16.072720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-862596688", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "dd811960-e386-493f-95bb-934b5e94fe90"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:16.073514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:16.074225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:16.081457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:16.082206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:16.082904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:16.221085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] validate_networks() for [('dd811960-e386-493f-95bb-934b5e94fe90', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:14:17.330808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:17.340338 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5932ce88-5c4f-4fe3-b616-518115b20243 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 1.304453 Oct 16 01:14:17.347694 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1477/3112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:16 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:17.366271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:17.371199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:17.396809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:17.402858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:17.403701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:17.405204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:17.405855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:17.408952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:18.390052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:18.403370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8222a907-4367-463a-80d5-a9c57679e57f tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 1.051642 Oct 16 01:14:18.403965 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1478/3113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:17 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:18.424671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:18.440630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:18.461087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:18.462307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:18.463157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:18.464068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:18.464697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:18.465475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:18.735081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:18.750533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:18.761635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:18.774751 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57b17751-065e-4030-b5a5-f2c7dbe5e276 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.355038 Oct 16 01:14:18.777980 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1479/3114] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:18 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:18.790895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:18.791581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:18.812858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:18.815718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:18.816393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:18.817637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:18.818306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:18.819560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:18.930300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:14:18.932131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:14:18.932789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:14:18.933366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:14:18.933953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:14:18.949552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:18.952011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:18.955306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:18.956962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:18.958229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:18.962193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:19.003451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:14:19.019705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for user 0c8da9a32cb54d0a87d914234b1e9f40 and project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:14:19.053933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:14:19.056898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:14:19.206541 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05c1d73f-eb10-4edf-be95-c0f805e04bb8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.143188 Oct 16 01:14:19.217852 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1636/3115] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:14:19.250635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:19.259596 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c21becf-007a-48ee-9bfb-836e6e9fb621 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 0.480837 Oct 16 01:14:19.291893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:19.291893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:19.292595 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1480/3116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:18 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:19.306280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-abc30a89-f402-4980-baf6-404e25e6f455 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:19.307266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-abc30a89-f402-4980-baf6-404e25e6f455 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:19.316145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:19.316992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:19.321678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:19.323048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:19.323048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:19.323499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:19.651897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-abc30a89-f402-4980-baf6-404e25e6f455 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:19.672185 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-abc30a89-f402-4980-baf6-404e25e6f455 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1214 microversion: 2.1 time: 0.378180 Oct 16 01:14:19.688178 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1481/3117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:19 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1214 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:19.694369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:19.695925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:19.722205 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:19.723927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:19.724626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:19.725136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:19.725920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:19.726381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:19.734259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:20.044644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:20.065955 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-56b123a1-83d0-4f5e-92d3-bed331845c5f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.831792 Oct 16 01:14:20.087191 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1637/3118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:19 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:20.102096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:20.102731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:20.136626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:20.137138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:20.148549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:20.149436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:20.156933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:20.157554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:20.661344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:20.680544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:20.686044 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:20.702500 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bbce2bed-0230-42d9-9d91-cafcd8cc6efd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.621069 Oct 16 01:14:20.703564 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1638/3119] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:20 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:20.717267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:20.719666 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:20.737404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:20.739107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:20.741865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:20.743329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:20.744871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:20.747121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:20.778627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:20.793933 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19ab12cd-770a-4453-bf7f-f0279d705832 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 1.112231 Oct 16 01:14:20.797216 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1482/3120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:19 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:20.819161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:20.820500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:20.853342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:20.856815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:20.861270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:20.862454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:20.867147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:20.874469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:21.113315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:21.132048 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19f7625b-2e14-4f8c-b369-76be36ba796d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1218 microversion: 2.1 time: 0.331963 Oct 16 01:14:21.136383 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1483/3121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:20 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1218 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:21.146817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:21.147878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:21.165745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:21.167383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:21.170996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:21.173641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:21.177210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:21.178631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:21.575803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:21.595977 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-06aaa559-136e-4e01-a27e-0e2de2dd2bb7 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 0.888674 Oct 16 01:14:21.611015 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1639/3122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:20 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:21.649133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:21.657665 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d42396b2-e7b1-40fd-b116-a81197e48e7c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.519909 Oct 16 01:14:21.664294 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1484/3123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:21 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:21.736895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:21.738026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:21.753403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:21.755390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:21.756186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:21.757386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:21.758174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:21.758882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:21.824469 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:21.825285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:21.838963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:21.839827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:21.843606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:21.844679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:21.845404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:21.846074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:22.344386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:22.353307 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-467ae9a7-7f93-47c5-956c-2f3ac30b9ed5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 0.532722 Oct 16 01:14:22.367376 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1485/3124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:21 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:22.373691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:22.374300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:22.421527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:22.422032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:22.422475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:22.423218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:22.423670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:22.424094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:22.445542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:22.456287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:22.458663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:22.480787 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f7dfaa18-b1b7-49ab-a6c8-05421e96f2c0 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.750279 Oct 16 01:14:22.482025 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1640/3125] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:21 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:22.625642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:22.626278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:22.653965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:22.654497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:22.654972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:22.655737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:22.656204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:22.656634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:22.888203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:22.901472 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-517758fa-5f35-4d28-9518-a39ce76f4572 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1272 microversion: 2.1 time: 0.533259 Oct 16 01:14:22.908606 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1486/3126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:22 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1272 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:22.919620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:22.920588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:22.932288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:22.933027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:22.933847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:22.934728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:22.935736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:22.936313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:23.670665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:23.680642 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea54b881-e909-4813-9d49-3bd6d5d79ab6 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 1.059271 Oct 16 01:14:23.686230 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1641/3127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:22 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:23.697399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:23.698278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:23.712700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:23.717499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:23.718209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:23.719217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:23.719911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:23.720539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:23.799012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:23.837753 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82b91de9-2cec-46e8-8c35-4e8707c5fd3e tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1512 microversion: 2.1 time: 0.909096 Oct 16 01:14:23.838799 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1487/3128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:22 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1512 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:23.873420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:23.874254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:23.894129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:23.904684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:23.905415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:23.906393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:23.909208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:23.909908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:23.992932 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:24.104131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:24.113612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:24.129111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:24.135599 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59836bcf-8751-4e13-b648-56062e2aa91e tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.295114 Oct 16 01:14:24.151320 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1488/3129] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:23 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:24.166503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:24.170949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:24.182296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:24.183212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:24.184889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:24.187096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:24.187733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:24.195694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:24.423795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:24.448588 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-77ebdabd-3ea9-43ad-a33f-19276850e4d8 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1272 microversion: 2.1 time: 0.295611 Oct 16 01:14:24.458556 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1489/3130] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:24 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1272 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:24.571838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:24.583184 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e14add88-3fff-4039-a548-7c3279d6cadb tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 0.893272 Oct 16 01:14:24.603226 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1642/3131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:23 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:24.712931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:24.713951 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:24.738055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:24.740309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:24.741310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:24.746380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:24.748024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:24.749312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:24.869296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:24.875687 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:24.908002 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:24.908002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:24.908002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:24.908002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:24.908002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:24.908002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:24.908002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.097845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:26.108561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6488a29c-2abc-4e11-8a0e-7f7cb79fcb35 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 1.399495 Oct 16 01:14:26.109157 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1490/3132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:24 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:26.125360 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:26.127078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:26.127703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:26.137271 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4dfc6ad6-0a17-4f10-80c2-859e32a6bc35 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1489 microversion: 2.1 time: 1.276762 Oct 16 01:14:26.141217 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1643/3133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:24 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1489 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:26.165601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:26.168946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.169846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:26.170580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.173458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.175778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.177564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.179735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.188740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.192095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.192708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.194432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.196476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.197781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.561080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:26.631062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:26.637610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:26.655748 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9eff895a-4d41-4647-bced-649281aca5f8 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.539173 Oct 16 01:14:26.657939 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1491/3134] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:26 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:26.670669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:26.673339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:26.684342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.685545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.686296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.687307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.688478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.689619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.780188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:26.790377 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1ae999d0-8ad6-419e-bb13-6c1e14ddcbe7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1314 microversion: 2.1 time: 0.645043 Oct 16 01:14:26.804115 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1644/3135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:26 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:26.814620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-7ecb9bb0-f926-4584-8fb6-d5ea549d6666 req-fc95db6b-3f13-4fb8-b4cd-51c69c295f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e250d6e1-030e-4b1b-b4ed-3fa030574cc6", "name": "network-vif-plugged", "status": "completed", "tag": "f1472981-1e15-414d-a009-f9a3ab462d02"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:26.844176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7ecb9bb0-f926-4584-8fb6-d5ea549d6666 req-fc95db6b-3f13-4fb8-b4cd-51c69c295f5e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.856977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7ecb9bb0-f926-4584-8fb6-d5ea549d6666 req-fc95db6b-3f13-4fb8-b4cd-51c69c295f5e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.858789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7ecb9bb0-f926-4584-8fb6-d5ea549d6666 req-fc95db6b-3f13-4fb8-b4cd-51c69c295f5e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.875688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-7ecb9bb0-f926-4584-8fb6-d5ea549d6666 req-fc95db6b-3f13-4fb8-b4cd-51c69c295f5e service nova] Creating event network-vif-plugged:f1472981-1e15-414d-a009-f9a3ab462d02 for instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 on n-h1-master-1 Oct 16 01:14:26.881741 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-7ecb9bb0-f926-4584-8fb6-d5ea549d6666 req-fc95db6b-3f13-4fb8-b4cd-51c69c295f5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076324 Oct 16 01:14:26.882986 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1645/3136] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:26.888967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1995724981"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:26.892373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:26.900719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.901660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.902373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:26.903390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:26.904085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:26.905000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:27.078441 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-211ee1a8-e22a-4dba-98d5-2ed67e2e64b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "PUT /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1062 microversion: 2.1 time: 0.193660 Oct 16 01:14:27.102099 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1646/3137] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:14:26 2022] PUT /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1062 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:27.113359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:27.120638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:27.123738 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-458c9d33-7148-485e-87ae-583df4626c17 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 0.464035 Oct 16 01:14:27.124530 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1492/3138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:26 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:27.133627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:27.135620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:27.143141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:27.152552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:27.156254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:27.156892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:27.157790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:27.160584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:27.161346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:27.165287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:27.167658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:27.169758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:27.178786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:27.179991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:27.185011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:28.272250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:28.282045 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-24fed3bb-b95a-4aa3-9b54-4a5712548d24 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1489 microversion: 2.1 time: 1.178554 Oct 16 01:14:28.287003 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1647/3139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:27 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1489 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:28.292087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:28.308904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:28.323892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:28.325822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:28.326550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:28.328561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:28.331324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:28.333054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:28.399674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:28.415708 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d45c1a3e-1310-4ef9-a333-22ade6566ebd tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 1.286441 Oct 16 01:14:28.416308 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1493/3140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:27 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:28.453501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:28.460768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:28.483388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:28.485655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:28.486173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:28.487749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:28.492943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:28.493489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:28.581064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:28.590412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:28.594467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:28.617578 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0298b5b-5cf0-446f-a2d0-bf6e8bc2b9f1 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.329217 Oct 16 01:14:28.618363 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1648/3141] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:28 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:28.643582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:28.652052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:28.661424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:28.663911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:28.664586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:28.666846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:28.668430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:28.670580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:28.983324 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:29.039122 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:29.390569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:29.405943 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-232c5a8c-51c5-4ca3-83ec-6b8d0d5cf885 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1292 microversion: 2.1 time: 0.766185 Oct 16 01:14:29.406801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1649/3142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:28 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1292 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:29.429148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:29.429773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:29.431296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:29.448782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:29.449287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:29.449779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:29.450956 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e78753e6-b423-4d7f-aa13-527eaa967007 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1314 microversion: 2.1 time: 1.011880 Oct 16 01:14:29.452048 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1494/3143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:28 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1314 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:29.459582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:29.460378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:29.461006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:29.488521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-01bc8617-527d-4306-b0e2-b1aeb6a0a898 req-4ae8d6e6-194b-4356-9126-06b5630f2a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b3db0a-f07b-4120-a1bf-47e23c1ee0a4", "name": "network-vif-plugged", "status": "completed", "tag": "b0e28d17-7ca7-4764-9b8f-63af0c185af8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:29.489169 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:29.513964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-01bc8617-527d-4306-b0e2-b1aeb6a0a898 req-4ae8d6e6-194b-4356-9126-06b5630f2a71 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:29.514493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-01bc8617-527d-4306-b0e2-b1aeb6a0a898 req-4ae8d6e6-194b-4356-9126-06b5630f2a71 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:29.514900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-01bc8617-527d-4306-b0e2-b1aeb6a0a898 req-4ae8d6e6-194b-4356-9126-06b5630f2a71 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:29.557284 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-01bc8617-527d-4306-b0e2-b1aeb6a0a898 req-4ae8d6e6-194b-4356-9126-06b5630f2a71 service nova] Creating event network-vif-plugged:b0e28d17-7ca7-4764-9b8f-63af0c185af8 for instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 on n-h2-master-1 Oct 16 01:14:29.569170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-01bc8617-527d-4306-b0e2-b1aeb6a0a898 req-4ae8d6e6-194b-4356-9126-06b5630f2a71 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091325 Oct 16 01:14:29.572174 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1495/3144] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:29.578826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:29.579551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:29.592722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:29.593742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:29.594359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:29.595324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:29.595937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:29.596605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:29.671205 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:30.115977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:30.133483 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4e32b476-0788-4b17-ad8f-66731fa937b0 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1489 microversion: 2.1 time: 0.708730 Oct 16 01:14:30.135248 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1650/3145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:29 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1489 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:30.155437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:30.155437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:30.163647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.164151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.164590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:30.172361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.172936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.173532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:30.228119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:30.265262 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82e5523c-ef37-4e52-9b67-f1ae5d9c3250 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 0.688571 Oct 16 01:14:30.270879 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1496/3146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:29 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:30.284420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b45f650c-af91-4afa-84b4-d2b86135d617 req-3a10ba0e-fd03-4eb5-b08d-f34e679dc427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f4f955-3e6c-470b-8256-f1e81712a96f", "tag": "30fd1143-c017-4978-8af1-692e9c8204c7"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:30.302998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b45f650c-af91-4afa-84b4-d2b86135d617 req-3a10ba0e-fd03-4eb5-b08d-f34e679dc427 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.304544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b45f650c-af91-4afa-84b4-d2b86135d617 req-3a10ba0e-fd03-4eb5-b08d-f34e679dc427 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.305436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b45f650c-af91-4afa-84b4-d2b86135d617 req-3a10ba0e-fd03-4eb5-b08d-f34e679dc427 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:30.327020 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b45f650c-af91-4afa-84b4-d2b86135d617 req-3a10ba0e-fd03-4eb5-b08d-f34e679dc427 service nova] Creating event network-changed:30fd1143-c017-4978-8af1-692e9c8204c7 for instance 29f4f955-3e6c-470b-8256-f1e81712a96f on n-h1-master-1 Oct 16 01:14:30.337324 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b45f650c-af91-4afa-84b4-d2b86135d617 req-3a10ba0e-fd03-4eb5-b08d-f34e679dc427 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062659 Oct 16 01:14:30.339218 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1497/3147] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:30.351130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:30.352514 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:30.361362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.362182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.362807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:30.363945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.364816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.365620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:30.415033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:30.432193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:14:30.436408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:30.439700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:30.460433 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0cfe8b0-4449-4b06-a5d9-5aa54f80d858 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1544 microversion: 2.91 time: 0.317768 Oct 16 01:14:30.461702 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1651/3148] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:30 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1544 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:30.507406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:30.509671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:30.530067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.533047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.533687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:30.534709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.537217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.537864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:30.698009 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f59215d3-e0be-420b-84a7-d78e4146a9b9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 204 len: 0 microversion: 2.1 time: 0.354263 Oct 16 01:14:30.701010 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1498/3149] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:30 2022] DELETE /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:14:30.727211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:30.727962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:30.742801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.744223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.749740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:30.751333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:30.754644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:30.757212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:31.275172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:31.283771 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c63f25fc-5023-488b-9653-9174211979aa tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1483 microversion: 2.1 time: 0.798169 Oct 16 01:14:31.289370 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1652/3150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:30 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1483 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:31.304315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:31.305405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:31.318902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:31.319428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:31.319869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:31.320582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:31.321044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:31.321472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:31.410041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:31.419502 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2875bb85-37a6-4fb4-9608-134315d01ee7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1314 microversion: 2.1 time: 0.705138 Oct 16 01:14:31.420108 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1499/3151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:30 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:31.443198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:31.444019 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:31.458358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:31.459386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:31.460017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:31.460931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:31.461563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:31.462156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:31.846987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:31.855192 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e245f35-3b45-4ffc-baa5-3a31ec31fc3c tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1395 microversion: 2.1 time: 0.422373 Oct 16 01:14:31.855782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1500/3152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:31 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1395 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:31.867235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:31.875803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:31.885122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:31.885620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:31.886060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:31.886762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:31.889859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:31.890487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:31.925589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:31.939534 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-74294382-c61e-46ca-a6ae-53c4b9cabd19 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1495 microversion: 2.1 time: 0.648735 Oct 16 01:14:31.960212 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1653/3153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:31 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1495 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:31.968522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:31.971328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:31.981682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:31.982519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:31.983435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:31.984518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:31.985482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:31.986174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:32.175768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:32.188559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:32.194659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:32.202010 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-846e081b-0b62-4904-8992-1acb3ad8cae3 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1531 microversion: 2.91 time: 0.239014 Oct 16 01:14:32.203374 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1654/3154] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:31 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1531 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:32.214733 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5e86c986-8944-4af6-a80d-a29dfc526a15 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.351682 Oct 16 01:14:32.215366 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1501/3155] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:14:31 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:32.235059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:32.235943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:32.249696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:32.250397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:32.251031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:32.251930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:32.252544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:32.254153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:32.449302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:32.450332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:32.491072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:32.492526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:32.492526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:32.492966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:32.501670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:32.502167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:32.504967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] Lazy-loading 'services' on Instance uuid 4405ee0b-a476-446d-a5b2-e5c6bf483b0e {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:14:32.552868 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-055c8f0e-98de-440f-8574-57080bc4efb1 tempest-UnshelveToHostMultiNodesTest-1101304734 tempest-UnshelveToHostMultiNodesTest-1101304734-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1936 microversion: 2.91 time: 0.321388 Oct 16 01:14:32.592225 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1655/3156] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:32 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1936 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:32.623488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:32.624343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:32.641672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:32.642706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:32.643375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:32.644314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:32.644990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:32.645593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:32.742731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:14:32.905286 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e887d2a-842c-4ff5-ae99-6c979efb1cd9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 204 len: 0 microversion: 2.91 time: 0.297640 Oct 16 01:14:32.909155 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1656/3157] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:14:32 2022] DELETE /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:14:32.919196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:32.919931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:32.938096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:32.938734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:32.938973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:32.941114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:32.942473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:32.944518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:33.633820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:33.656037 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2135d308-89f8-4cca-9900-a6050cc46fb0 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1314 microversion: 2.1 time: 1.211152 Oct 16 01:14:33.657521 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1502/3158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:32 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1314 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:33.665109 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:33.666672 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:33.674695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:33.677074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:33.678252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:33.681763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:33.682672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:33.683526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:33.923213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:33.947985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:33.956646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:33.974969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:33.976579 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f73fe4e0-b4a4-40d7-89ec-8bd5661c64fd tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.314009 Oct 16 01:14:33.978572 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1503/3159] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:33 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:33.983920 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-61a051f1-27a5-49fe-80b4-fef2982471fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1575 microversion: 2.1 time: 1.073389 Oct 16 01:14:33.995176 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1657/3160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:32 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1575 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:34.005044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:34.005463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:34.011655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:34.012354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:34.027975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:34.028228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:34.028747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:34.028904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:34.029195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:34.029327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:34.030038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:34.030502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:34.031749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:34.036844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:34.037515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:34.038665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:34.361008 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-75c42873-516d-4cac-b41b-00feaf36fdb2 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.353830 Oct 16 01:14:34.361855 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1658/3161] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:14:34 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4/os-interface => generated 284 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:34.476221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:34.487919 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d1a0d6b7-39b6-414f-bd2e-acc3d6a3e7c2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1495 microversion: 2.1 time: 0.506548 Oct 16 01:14:34.490046 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1504/3162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:33 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1495 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:34.684574 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:34.685605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:34.701272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:34.701766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:34.702210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:34.702945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:34.703411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:34.703842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:34.778082 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d2098820-b30d-4256-bbe9-1896d76d2fa3 req-7cbf2597-a57d-4bed-9b2c-b610e1436558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1206015-53a8-4f00-9ae7-2597eabc24f5", "name": "network-vif-deleted", "tag": "3ab2ee30-2caa-40ae-b713-cf3cb1bd02c9"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:34.797255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d2098820-b30d-4256-bbe9-1896d76d2fa3 req-7cbf2597-a57d-4bed-9b2c-b610e1436558 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:34.803736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d2098820-b30d-4256-bbe9-1896d76d2fa3 req-7cbf2597-a57d-4bed-9b2c-b610e1436558 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:34.804471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d2098820-b30d-4256-bbe9-1896d76d2fa3 req-7cbf2597-a57d-4bed-9b2c-b610e1436558 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:34.807818 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:34.833596 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d2098820-b30d-4256-bbe9-1896d76d2fa3 req-7cbf2597-a57d-4bed-9b2c-b610e1436558 service nova] Creating event network-vif-deleted:3ab2ee30-2caa-40ae-b713-cf3cb1bd02c9 for instance b1206015-53a8-4f00-9ae7-2597eabc24f5 on n-h2-master-1 Oct 16 01:14:34.847546 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d2098820-b30d-4256-bbe9-1896d76d2fa3 req-7cbf2597-a57d-4bed-9b2c-b610e1436558 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073018 Oct 16 01:14:34.849372 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1505/3163] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:14:35.017377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:35.018078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:35.040336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:35.040845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:35.044839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:35.045630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:35.046117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:35.046562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:35.781016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:35.794679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:35.805059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbd559440454d2f82801ee6bbe280c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fc396554c84269805db99beff5e471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:35.811165 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f4b90290-c715-43c5-a8c5-fad32d8e3ac9 tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 200 len: 1537 microversion: 2.91 time: 0.798022 Oct 16 01:14:35.823334 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1506/3164] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:35 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 1537 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:14:35.828535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:35.829378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:35.840832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:35.846800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:35.847515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:35.849018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:35.849815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:35.850410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:35.941594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:35.954647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:35.959953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:35.960649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lazy-loading 'fault' on Instance uuid b1206015-53a8-4f00-9ae7-2597eabc24f5 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:14:36.409297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:36.420869 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-acd12545-3470-4c6c-a9df-75b8d0e9dc14 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 200 len: 1310 microversion: 2.1 time: 0.594920 Oct 16 01:14:36.443194 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1507/3165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:35 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 1310 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:36.627155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:36.637341 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd7fea80-6a8f-4975-ba3b-33c29b681e01 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1314 microversion: 2.1 time: 1.956639 Oct 16 01:14:36.638141 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1659/3166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:34 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1314 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:36.850659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:36.852352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] [instance: 4405ee0b-a476-446d-a5b2-e5c6bf483b0e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:36.862429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:36.863220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:36.866380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:36.867762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:36.868436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:36.871477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:36.918391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] HTTP exception thrown: Instance 4405ee0b-a476-446d-a5b2-e5c6bf483b0e could not be found. Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Request method failure captured: Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e HTTP/1.1 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1pBPfidlq8yrBthY3iIISCxN6G0LQO4hyiPM6VsP6OMYp08T4N5MdAF5NvYLXipZfX5sGhOzYQSpHbCToQWeMHYdJcNkaJOEgqHUyPVM7Hyie5NFPbui4oqRg_gH_fDWWyl8nsEVfSgk1WbOIZEBiCfMSceKqJZKF2iWk_og-n7JcI Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.91 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b8fc396554c84269805db99beff5e471 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1686681387 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b8fc396554c84269805db99beff5e471", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b8fc396554c84269805db99beff5e471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b8fc396554c84269805db99beff5e471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b8fc396554c84269805db99beff5e471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1686681387 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b8fc396554c84269805db99beff5e471 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1686681387 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-UnshelveToHostMultiNodesTest-1686681387-project Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: cdbd559440454d2f82801ee6bbe280c0 Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1686681387-project Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 4405ee0b-a476-446d-a5b2-e5c6bf483b0e could not be found. Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4405ee0b-a476-446d-a5b2-e5c6bf483b0e'} Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4405ee0b-a476-446d-a5b2-e5c6bf483b0e could not be found. Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4405ee0b-a476-446d-a5b2-e5c6bf483b0e could not be found. Oct 16 01:14:36.924000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4405ee0b-a476-446d-a5b2-e5c6bf483b0e could not be found. Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] Returning 404 to user: Instance 4405ee0b-a476-446d-a5b2-e5c6bf483b0e could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:36.929098 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bc12e5ed-ecb1-429b-9c79-da092aba0fbb tempest-UnshelveToHostMultiNodesTest-1686681387 tempest-UnshelveToHostMultiNodesTest-1686681387-project] 10.222.0.39 "GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e" status: 404 len: 111 microversion: 2.91 time: 0.087864 Oct 16 01:14:36.931234 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1508/3167] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:36 2022] GET /compute/v2.1/servers/4405ee0b-a476-446d-a5b2-e5c6bf483b0e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:14:37.452091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:37.452732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:37.463757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.464255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.464694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.465408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.487166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.494324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.528772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 HTTP/1.1 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: exception: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'b1206015-53a8-4f00-9ae7-2597eabc24f5'} Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.531620 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6e9026d-eaf4-4dd8-8b16-ca172c84e115 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 404 len: 111 microversion: 2.1 time: 0.087065 Oct 16 01:14:37.536360 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1660/3168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:37 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:37.551949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:37.553063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:37.586454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.591447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.592645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.593607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.594258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.595311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.624608 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 HTTP/1.1 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: exception: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'b1206015-53a8-4f00-9ae7-2597eabc24f5'} Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:37.626746 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.632242 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.636355 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:37.638826 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b3ad07e8-3d16-40fe-9545-2e5afa0c437d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 404 len: 111 microversion: 2.1 time: 0.091012 Oct 16 01:14:37.640053 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1509/3169] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:37 2022] DELETE /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:37.650012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:37.651345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: b1206015-53a8-4f00-9ae7-2597eabc24f5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:37.668938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:37.674316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.675509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.676767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:37.677790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.678700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.680323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.683234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.695450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.698312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.698949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.699997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.703523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.704355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.718676 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 HTTP/1.1 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: exception: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'b1206015-53a8-4f00-9ae7-2597eabc24f5'} Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.721965 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.726751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.726751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.726751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:37.726751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:37.726751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. Oct 16 01:14:37.726751 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.733677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance b1206015-53a8-4f00-9ae7-2597eabc24f5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:37.736855 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f8ec795-dfad-4260-865b-b04bf79ab193 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5" status: 404 len: 111 microversion: 2.1 time: 0.090621 Oct 16 01:14:37.737658 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1661/3170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:37 2022] GET /compute/v2.1/servers/b1206015-53a8-4f00-9ae7-2597eabc24f5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:37.749624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:37.751799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:37.764563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.766742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.768357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.770099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.771714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.774101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.804738 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c HTTP/1.1 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8395135d-ce46-43bd-89d3-58c071e2c08c'} Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:37.806650 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.811611 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.813245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:37.814530 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f9bf4cd-149c-4224-a56f-8cb55acb1365 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 404 len: 111 microversion: 2.1 time: 0.071858 Oct 16 01:14:37.815898 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1662/3171] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:37 2022] DELETE /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:37.834727 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:37.836546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 8395135d-ce46-43bd-89d3-58c071e2c08c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:37.855266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.857561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.859748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.861587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.863603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.864548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.895932 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c HTTP/1.1 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8395135d-ce46-43bd-89d3-58c071e2c08c'} Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.902467 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:37.908695 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:37.908695 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:37.908695 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:37.908695 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:37.908695 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. Oct 16 01:14:37.908695 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:37.912176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 8395135d-ce46-43bd-89d3-58c071e2c08c could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:37.915641 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be6eb997-f148-40fe-8752-e845e9a9ff45 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c" status: 404 len: 111 microversion: 2.1 time: 0.093383 Oct 16 01:14:37.920043 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1663/3172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:37 2022] GET /compute/v2.1/servers/8395135d-ce46-43bd-89d3-58c071e2c08c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:37.936175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:37.938331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:37.954456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.955263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.958252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:37.962079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:37.964559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:37.966832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.003513 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 HTTP/1.1 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '0cc3574c-4ad5-4069-b6a1-86290bae32d5'} Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:38.006082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.010323 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.011983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:38.013440 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f74c683-6b0f-4684-9a04-a68e4a1dc1a9 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 404 len: 111 microversion: 2.1 time: 0.090966 Oct 16 01:14:38.014391 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1664/3173] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:37 2022] DELETE /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:38.026139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:38.026759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 0cc3574c-4ad5-4069-b6a1-86290bae32d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:38.039075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.039562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.043846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.048126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.048909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.058777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.096906 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 HTTP/1.1 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '0cc3574c-4ad5-4069-b6a1-86290bae32d5'} Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.108029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.112772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:38.112772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:38.112772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:38.112772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:38.112772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. Oct 16 01:14:38.112772 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.116822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 0cc3574c-4ad5-4069-b6a1-86290bae32d5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:38.122471 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-31e0cf47-2c1a-42fa-9636-b24fad8dc345 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5" status: 404 len: 111 microversion: 2.1 time: 0.100904 Oct 16 01:14:38.126848 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1665/3174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:38 2022] GET /compute/v2.1/servers/0cc3574c-4ad5-4069-b6a1-86290bae32d5 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:38.142466 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:38.144910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:38.162838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.164493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.165450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.168854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.171039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.171850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.751567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:38.766728 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e07e8c03-434e-4adc-8ddf-98b345169cc4 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1314 microversion: 2.1 time: 1.103090 Oct 16 01:14:38.770394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:38.774982 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1510/3175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:37 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1314 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:38.784180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6a49d14c-55da-48ec-ad6b-7e70dbdbc884 req-81ff0d83-1944-41e3-9ab1-c429231290f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e250d6e1-030e-4b1b-b4ed-3fa030574cc6", "tag": "f1472981-1e15-414d-a009-f9a3ab462d02"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:38.795750 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3ef5fbc4-45a4-4df4-9827-382d0d91a4be tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1483 microversion: 2.1 time: 0.663778 Oct 16 01:14:38.797033 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1666/3176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:38 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1483 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:38.803447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:38.804258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:38.820575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.823590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.824317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.827918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.828684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.829465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.843185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6a49d14c-55da-48ec-ad6b-7e70dbdbc884 req-81ff0d83-1944-41e3-9ab1-c429231290f8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.843741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6a49d14c-55da-48ec-ad6b-7e70dbdbc884 req-81ff0d83-1944-41e3-9ab1-c429231290f8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.847404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6a49d14c-55da-48ec-ad6b-7e70dbdbc884 req-81ff0d83-1944-41e3-9ab1-c429231290f8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.864541 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e HTTP/1.1 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '13cd5566-b29c-4a2b-8b91-26dd91bf207e'} Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:38.876444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.880919 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.889925 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:38.891458 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d73f733-ba51-41e6-ac3d-10feb78410f5 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 404 len: 111 microversion: 2.1 time: 0.093215 Oct 16 01:14:38.898834 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1667/3177] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:38 2022] DELETE /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:38.900130 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6a49d14c-55da-48ec-ad6b-7e70dbdbc884 req-81ff0d83-1944-41e3-9ab1-c429231290f8 service nova] Creating event network-changed:f1472981-1e15-414d-a009-f9a3ab462d02 for instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 on n-h1-master-1 Oct 16 01:14:38.916773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:38.917582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 13cd5566-b29c-4a2b-8b91-26dd91bf207e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:38.918217 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6a49d14c-55da-48ec-ad6b-7e70dbdbc884 req-81ff0d83-1944-41e3-9ab1-c429231290f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139617 Oct 16 01:14:38.922212 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1511/3178] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:38.928110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.928694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.930030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.936821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:38.937327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:38.938115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:38.970458 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e HTTP/1.1 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '13cd5566-b29c-4a2b-8b91-26dd91bf207e'} Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.972357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:38.977476 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:38.977476 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:38.977476 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:38.977476 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:38.977476 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. Oct 16 01:14:38.977476 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:38.995570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 13cd5566-b29c-4a2b-8b91-26dd91bf207e could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:38.999100 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ed9200b7-c589-4b6f-8c05-18711aee44d3 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e" status: 404 len: 111 microversion: 2.1 time: 0.095570 Oct 16 01:14:38.999871 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1668/3179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:38 2022] GET /compute/v2.1/servers/13cd5566-b29c-4a2b-8b91-26dd91bf207e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:39.020339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.021360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.041027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.043413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.044266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.045655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.048801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.055891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.108803 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 HTTP/1.1 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a96f9006-082a-45f2-bfef-5ba9d429bcf1'} Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:39.111055 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.118083 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.123488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:39.125319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-36ed73c1-2bf6-401a-8025-70c5718ce72f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 404 len: 111 microversion: 2.1 time: 0.118246 Oct 16 01:14:39.126731 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1512/3180] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:39 2022] DELETE /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:39.135561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.136268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: a96f9006-082a-45f2-bfef-5ba9d429bcf1] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.145618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.146208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.146637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.147378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.147838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.148264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.197831 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 HTTP/1.1 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: exception: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'a96f9006-082a-45f2-bfef-5ba9d429bcf1'} Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.209238 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance a96f9006-082a-45f2-bfef-5ba9d429bcf1 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-adfd3c13-3f37-4271-9dc6-0570fb717d1c tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1" status: 404 len: 111 microversion: 2.1 time: 0.079254 Oct 16 01:14:39.216762 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1669/3181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:39 2022] GET /compute/v2.1/servers/a96f9006-082a-45f2-bfef-5ba9d429bcf1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:14:39.227382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.228046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.242413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.244973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.247051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.248988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.250552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.251146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.290419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 HTTP/1.1 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '66900da4-f78f-44d8-91f4-d65e73d5fd43'} Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:39.296851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.300987 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.305623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:39.309136 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1f673fa-33f4-42f5-b63a-7e9dae788622 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 404 len: 111 microversion: 2.1 time: 0.089490 Oct 16 01:14:39.312403 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1513/3182] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:39 2022] DELETE /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:39.319964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.320588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 66900da4-f78f-44d8-91f4-d65e73d5fd43] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.326724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.327539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.328156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.329028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.329652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.330080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.349792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 HTTP/1.1 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '66900da4-f78f-44d8-91f4-d65e73d5fd43'} Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.354690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.358671 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.358671 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.358671 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:39.358671 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:39.358671 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. Oct 16 01:14:39.358671 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.365025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 66900da4-f78f-44d8-91f4-d65e73d5fd43 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:39.365910 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5b2306f0-2c25-43da-ac16-f828ac8838e2 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43" status: 404 len: 111 microversion: 2.1 time: 0.050834 Oct 16 01:14:39.368847 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1670/3183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:39 2022] GET /compute/v2.1/servers/66900da4-f78f-44d8-91f4-d65e73d5fd43 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:39.375438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.376473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 88d4a756-77ff-44de-baf2-d67b6721283e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.384856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.385912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.387804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.389027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.389712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.390381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.408844 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e HTTP/1.1 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '88d4a756-77ff-44de-baf2-d67b6721283e'} Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:39.411550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.417485 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.424425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:39.425429 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d40ac6ba-5f0f-4826-8078-20ab5d02a9b1 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e" status: 404 len: 111 microversion: 2.1 time: 0.054595 Oct 16 01:14:39.427609 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1514/3184] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:39 2022] DELETE /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:39.436390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.437008 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 88d4a756-77ff-44de-baf2-d67b6721283e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.448577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.450341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.452544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.454120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.455332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.455945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.494450 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e HTTP/1.1 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '88d4a756-77ff-44de-baf2-d67b6721283e'} Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.499059 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 88d4a756-77ff-44de-baf2-d67b6721283e could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-57fcf21c-b1df-4676-aa04-360022872e6f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e" status: 404 len: 111 microversion: 2.1 time: 0.071490 Oct 16 01:14:39.509734 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1671/3185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:39 2022] GET /compute/v2.1/servers/88d4a756-77ff-44de-baf2-d67b6721283e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:39.513544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.514051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.525320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.525835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.526286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.536048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.536808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.537477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.602860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:14:39.802856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.818367 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f2e2ee72-3d01-43be-ae09-3ccde73db89d tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 204 len: 0 microversion: 2.1 time: 0.308567 Oct 16 01:14:39.819268 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1515/3186] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:14:39 2022] DELETE /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:14:39.821204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.836773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.842194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.842902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.843081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:39.843948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:39.849768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.850576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.851539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.859671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.860181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.860620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:39.861371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:39.874782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:39.875426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:41.152883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:41.156647 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:41.166430 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68bc00e4-610b-4e74-9b91-c336bf9d474d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1314 microversion: 2.1 time: 1.365475 Oct 16 01:14:41.167268 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1672/3187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:39 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1314 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:41.178177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2d40914d-d0c9-4b54-9cfa-380ee88a6bb6 req-47460c42-0008-48e3-bda2-c3db6549b2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f4f955-3e6c-470b-8256-f1e81712a96f", "name": "network-vif-plugged", "status": "completed", "tag": "30fd1143-c017-4978-8af1-692e9c8204c7"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:41.200734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:41.205505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2d40914d-d0c9-4b54-9cfa-380ee88a6bb6 req-47460c42-0008-48e3-bda2-c3db6549b2bf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:41.206359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2d40914d-d0c9-4b54-9cfa-380ee88a6bb6 req-47460c42-0008-48e3-bda2-c3db6549b2bf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:41.210185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2d40914d-d0c9-4b54-9cfa-380ee88a6bb6 req-47460c42-0008-48e3-bda2-c3db6549b2bf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:41.216879 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bf41590-c987-4540-b441-6134963eeec8 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1479 microversion: 2.1 time: 1.384304 Oct 16 01:14:41.233791 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1516/3188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:39 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1479 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:41.243220 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2d40914d-d0c9-4b54-9cfa-380ee88a6bb6 req-47460c42-0008-48e3-bda2-c3db6549b2bf service nova] Creating event network-vif-plugged:30fd1143-c017-4978-8af1-692e9c8204c7 for instance 29f4f955-3e6c-470b-8256-f1e81712a96f on n-h1-master-1 Oct 16 01:14:41.252091 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:41.254791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:41.268965 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2d40914d-d0c9-4b54-9cfa-380ee88a6bb6 req-47460c42-0008-48e3-bda2-c3db6549b2bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093338 Oct 16 01:14:41.271189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:41.273498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:41.275488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:41.276333 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1673/3189] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:41.277294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:41.279607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:41.280199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:41.297110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-002515c7-81fd-43cf-98e8-695f11ad699b req-23434337-97f4-4789-8e8a-66b331c6c386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b3db0a-f07b-4120-a1bf-47e23c1ee0a4", "tag": "b0e28d17-7ca7-4764-9b8f-63af0c185af8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:41.331049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-002515c7-81fd-43cf-98e8-695f11ad699b req-23434337-97f4-4789-8e8a-66b331c6c386 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:41.333395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-002515c7-81fd-43cf-98e8-695f11ad699b req-23434337-97f4-4789-8e8a-66b331c6c386 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:41.335389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-002515c7-81fd-43cf-98e8-695f11ad699b req-23434337-97f4-4789-8e8a-66b331c6c386 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:41.382419 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-002515c7-81fd-43cf-98e8-695f11ad699b req-23434337-97f4-4789-8e8a-66b331c6c386 service nova] Creating event network-changed:b0e28d17-7ca7-4764-9b8f-63af0c185af8 for instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 on n-h2-master-1 Oct 16 01:14:41.400889 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-002515c7-81fd-43cf-98e8-695f11ad699b req-23434337-97f4-4789-8e8a-66b331c6c386 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112453 Oct 16 01:14:41.402408 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1674/3190] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:41.422018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89d674cd-2545-41e0-9da7-8f8488165a61 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Action: 'create', calling method: .version_select at 0x7fd64e154f70>, body: {"keypair": {"name": "tempest-keypair-2132386502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRaPmvzx1caG0MVVfwVH3REYd5saTUxBDCZmXsueOdJTjmpP2+cB+byZ2OfMYkjUDuFXbNpFyPD5hULezzbh8wy2gSsrzQWmW9v2p+hDcuBisfR5lYk5x2FBPjXRnyPxg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:41.500890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89d674cd-2545-41e0-9da7-8f8488165a61 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Getting quotas for project 3078012968784295bc15ee359b50fd67. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:14:41.522130 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-89d674cd-2545-41e0-9da7-8f8488165a61 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Getting quotas for user 49b3edfc62e747a8a21e76bfde79f40e and project 3078012968784295bc15ee359b50fd67. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:14:41.622956 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89d674cd-2545-41e0-9da7-8f8488165a61 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.218395 Oct 16 01:14:41.623851 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1675/3191] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:14:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 221 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:14:41.663691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:41.684460 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ceb1f96b-d925-46d4-a950-066b369c1263 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1575 microversion: 2.1 time: 0.446061 Oct 16 01:14:41.685094 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1517/3192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:41 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1575 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:42.193820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:42.194788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:42.212875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:42.216989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:42.219604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:42.221487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:42.224088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:42.224848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:42.249161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:42.249775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:42.264087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:42.264849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:42.267139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:42.268061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:42.271207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:42.272766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:42.880851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:42.913844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:42.932423 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd1cdff2-6ea1-45a2-9bc0-3c6ad19f3586 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1479 microversion: 2.1 time: 0.688245 Oct 16 01:14:42.936522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9b95926a-a99b-47c9-aba3-75e174604a37 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1314 microversion: 2.1 time: 0.748782 Oct 16 01:14:42.937458 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1518/3193] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:42 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1479 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:42.954989 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1676/3194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:42 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:43.971247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:43.975036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:43.978299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:43.979868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:44.002806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:44.005677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:44.007147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:44.009528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:44.011642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:44.012524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:44.014421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:44.015761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:44.016428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:44.021688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:44.022435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:44.024462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:44.257552 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:44.277817 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-335c7841-e072-4a68-8421-310c60165a9f tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1437 microversion: 2.1 time: 0.318306 Oct 16 01:14:44.280233 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1519/3195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:43 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1437 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:44.472031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a6f6159c-1337-4a01-9789-32b65ff18798 req-a7cb36be-610d-47cd-88e4-5e1fb77ad3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c37e3c-d741-4bc5-bbbc-6a77da9d3650", "name": "network-vif-deleted", "tag": "2706a2c3-a765-4ac9-8158-56085ed044a8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:44.499310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a6f6159c-1337-4a01-9789-32b65ff18798 req-a7cb36be-610d-47cd-88e4-5e1fb77ad3bf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:44.511290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a6f6159c-1337-4a01-9789-32b65ff18798 req-a7cb36be-610d-47cd-88e4-5e1fb77ad3bf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:44.513963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:44.515128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a6f6159c-1337-4a01-9789-32b65ff18798 req-a7cb36be-610d-47cd-88e4-5e1fb77ad3bf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:44.526162 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cba44a9a-f8a0-4088-a88a-55d951aa22bb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1500 microversion: 2.1 time: 0.562398 Oct 16 01:14:44.527558 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1677/3196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:43 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1500 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:44.535282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a6f6159c-1337-4a01-9789-32b65ff18798 req-a7cb36be-610d-47cd-88e4-5e1fb77ad3bf service nova] Creating event network-vif-deleted:2706a2c3-a765-4ac9-8158-56085ed044a8 for instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 on n-h2-master-1 Oct 16 01:14:44.540375 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a6f6159c-1337-4a01-9789-32b65ff18798 req-a7cb36be-610d-47cd-88e4-5e1fb77ad3bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074794 Oct 16 01:14:44.541202 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1520/3197] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:44.558022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:44.563099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:44.590114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:44.590631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:44.591110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:44.591831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:44.594185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:44.595974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:44.982181 n-d-master-1 devstack@n-api.service[120545]: INFO nova.network.security_group_api [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Removing security group 9de45a18-5cbf-4f41-bae2-b9e81764e00a from port 30fd1143-c017-4978-8af1-692e9c8204c7 Oct 16 01:14:45.303745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:45.305035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:45.308088 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:45.328468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:45.328967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:45.329412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:45.330123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:45.330681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:45.331228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:45.438349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:45.440603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:45.443150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:45.445698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lazy-loading 'fault' on Instance uuid 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:14:45.604783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9979f0dcd74d60a55d02d432de6a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f75cea27f642c18d60645158425380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:45.626225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e5d6c295-0e6a-4bfe-8457-a4b487d11263 tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 200 len: 1282 microversion: 2.1 time: 0.325158 Oct 16 01:14:45.638939 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1521/3198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:45 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 1282 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:45.842458 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0bb51ca8-e6f6-4502-809b-8b0f89e914b9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f/action" status: 202 len: 0 microversion: 2.1 time: 1.293016 Oct 16 01:14:45.843833 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1678/3199] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:14:44 2022] POST /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f/action => generated 0 bytes in 1295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:14:45.853750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:45.854519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:45.872324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:45.872829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:45.876247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:45.877261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:45.880331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:45.881009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:45.946721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a1b38090-ee16-4090-8680-082bc347396e req-ddbb5d76-1f5c-44d1-a0d6-9914d7df6a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f4f955-3e6c-470b-8256-f1e81712a96f", "tag": "30fd1143-c017-4978-8af1-692e9c8204c7"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:45.974334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a1b38090-ee16-4090-8680-082bc347396e req-ddbb5d76-1f5c-44d1-a0d6-9914d7df6a68 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:45.975431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a1b38090-ee16-4090-8680-082bc347396e req-ddbb5d76-1f5c-44d1-a0d6-9914d7df6a68 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:45.976091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a1b38090-ee16-4090-8680-082bc347396e req-ddbb5d76-1f5c-44d1-a0d6-9914d7df6a68 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:46.028599 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a1b38090-ee16-4090-8680-082bc347396e req-ddbb5d76-1f5c-44d1-a0d6-9914d7df6a68 service nova] Creating event network-changed:30fd1143-c017-4978-8af1-692e9c8204c7 for instance 29f4f955-3e6c-470b-8256-f1e81712a96f on n-h1-master-1 Oct 16 01:14:46.046711 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a1b38090-ee16-4090-8680-082bc347396e req-ddbb5d76-1f5c-44d1-a0d6-9914d7df6a68 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105455 Oct 16 01:14:46.047514 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1679/3200] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:14:46.084482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:46.096535 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-993ff7a0-5f5c-4c1c-a69a-20073ae45672 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1458 microversion: 2.1 time: 0.248455 Oct 16 01:14:46.099332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1522/3201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:45 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1458 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:46.120942 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:46.121625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:46.132156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:46.133318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:46.133974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:46.134878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:46.138593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:46.139128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:46.436801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:46.454632 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-980125f8-0fdf-4508-8312-8b9463b36650 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.337550 Oct 16 01:14:46.479499 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1680/3202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:46 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:46.505804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:46.506481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:46.521650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:46.522160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:46.522611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:46.523377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:46.526875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:46.527361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:46.651654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:46.652228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] [instance: 44c37e3c-d741-4bc5-bbbc-6a77da9d3650] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:46.672764 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:46.682614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:46.683156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:46.683598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:46.684323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:46.687861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:46.688372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:46.733534 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] HTTP exception thrown: Instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 could not be found. Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Request method failure captured: Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 HTTP/1.1 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ngNNJ9wQTQIXOO_Kem65vttH71fKGDeuvdSmWOVQqu1OAq1cCLOvqmGr1lh5qkTLbUkcPdVShZp-YtAizpGiKEPspCQc9AevDQG9KNBYjlzYOsg5cUk9NlasruvZ4m1KCTEL6N7E39dqaAuZPbFYPabAO15gbrIyhKGbXLwBgS2QE Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_12f75cea27f642c18d60645158425380", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/12f75cea27f642c18d60645158425380"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/12f75cea27f642c18d60645158425380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestJSON-529503287 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 12f75cea27f642c18d60645158425380 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestJSON-529503287 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestJSON-529503287-project Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: df9979f0dcd74d60a55d02d432de6a51 Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestJSON-529503287-project Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 could not be found. Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '44c37e3c-d741-4bc5-bbbc-6a77da9d3650'} Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 could not be found. Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 could not be found. Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:46.736399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 could not be found. Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] Returning 404 to user: Instance 44c37e3c-d741-4bc5-bbbc-6a77da9d3650 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-54e59396-4203-47ac-bad0-3ba3ab8414cc tempest-ServersTestJSON-529503287 tempest-ServersTestJSON-529503287-project] 10.222.0.39 "GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650" status: 404 len: 111 microversion: 2.1 time: 0.094145 Oct 16 01:14:46.742523 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1681/3203] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:46 2022] GET /compute/v2.1/servers/44c37e3c-d741-4bc5-bbbc-6a77da9d3650 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:14:46.788081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:46.799950 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-99d80cce-b488-49a4-aed5-712a048a183a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.312592 Oct 16 01:14:46.800841 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1523/3204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:46 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:46.829852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:46.830468 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:46.842558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:46.843126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:46.843722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:46.844471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:46.844926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:46.847496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.039371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Action: 'update', calling method: .version_select at 0x7fd64df15d30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:47.045430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.045937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.046384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.063824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.064500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.065027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.074901 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] HTTP exception thrown: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Request method failure captured: Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee HTTP/1.1 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 56 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1sGLcT1j-BKooq_c2XFcnHk96CNVVdbuagOEAA5ttj9FxsivgAj5tdUb9XnEHi1tbiVAWgeB7i_Gw_nVIwfY4bn8YWeo5Ca3P4oUdiDjjjqJ4Dj6BOEhwIcEDjdvr7qfCc9A5-JOPU0ow1bQopdkofdzyPBEvfEQtbmX3_4eZqxt1M Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.53 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b36dcf096eea494aa835aecd4fc9965f Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b36dcf096eea494aa835aecd4fc9965f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b36dcf096eea494aa835aecd4fc9965f Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7687b91fc67f43a9a6880d9f29ef3d73 Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: exception: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ef0fda33-32fa-4017-bf8b-0e8fb7e87aee', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:14:47.077715 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Returning 404 to user: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:47.083024 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba808e43-2071-42f2-9ee9-aa1a2bc87290 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee" status: 404 len: 110 microversion: 2.53 time: 0.263263 Oct 16 01:14:47.085739 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1682/3205] 10.222.0.39 () {62 vars in 1309 bytes} [Sun Oct 16 01:14:46 2022] PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee => generated 110 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:14:47.091193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Action: 'update', calling method: .version_select at 0x7fd652830dc0>, body: {"status": "disabled"} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:47.094981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.095908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.096366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.103319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.103818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.104261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.110742 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] HTTP exception thrown: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Request method failure captured: Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee HTTP/1.1 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 22 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1sGLcT1j-BKooq_c2XFcnHk96CNVVdbuagOEAA5ttj9FxsivgAj5tdUb9XnEHi1tbiVAWgeB7i_Gw_nVIwfY4bn8YWeo5Ca3P4oUdiDjjjqJ4Dj6BOEhwIcEDjdvr7qfCc9A5-JOPU0ow1bQopdkofdzyPBEvfEQtbmX3_4eZqxt1M Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.53 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b36dcf096eea494aa835aecd4fc9965f Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b36dcf096eea494aa835aecd4fc9965f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b36dcf096eea494aa835aecd4fc9965f Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7687b91fc67f43a9a6880d9f29ef3d73 Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: {"status": "disabled"} Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: exception: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ef0fda33-32fa-4017-bf8b-0e8fb7e87aee', 'body': {'status': 'disabled'}} Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:14:47.112738 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Returning 404 to user: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:47.117224 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eae04351-9e5d-49d6-ab92-6efcf335e21e tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee" status: 404 len: 110 microversion: 2.53 time: 0.028188 Oct 16 01:14:47.121472 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1683/3206] 10.222.0.39 () {62 vars in 1309 bytes} [Sun Oct 16 01:14:47 2022] PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:14:47.128355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Action: 'update', calling method: .version_select at 0x7fd64e20cdc0>, body: {"status": "enabled"} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:47.130526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:47.132824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.133316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.133763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.140392 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:47.145933 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51849c7b-341b-44c5-865b-72fb632ab4c1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.318947 Oct 16 01:14:47.149351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.149857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.150306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.150849 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1524/3207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:46 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:47.156207 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] HTTP exception thrown: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Request method failure captured: Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee HTTP/1.1 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 21 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1sGLcT1j-BKooq_c2XFcnHk96CNVVdbuagOEAA5ttj9FxsivgAj5tdUb9XnEHi1tbiVAWgeB7i_Gw_nVIwfY4bn8YWeo5Ca3P4oUdiDjjjqJ4Dj6BOEhwIcEDjdvr7qfCc9A5-JOPU0ow1bQopdkofdzyPBEvfEQtbmX3_4eZqxt1M Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.53 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b36dcf096eea494aa835aecd4fc9965f Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b36dcf096eea494aa835aecd4fc9965f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b36dcf096eea494aa835aecd4fc9965f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b36dcf096eea494aa835aecd4fc9965f Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7687b91fc67f43a9a6880d9f29ef3d73 Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: {"status": "enabled"} Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: exception: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ef0fda33-32fa-4017-bf8b-0e8fb7e87aee', 'body': {'status': 'enabled'}} Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:14:47.157999 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Returning 404 to user: Service ef0fda33-32fa-4017-bf8b-0e8fb7e87aee could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-99d58d10-2433-4e5a-9fd6-09cc1068154d tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee" status: 404 len: 110 microversion: 2.53 time: 0.036860 Oct 16 01:14:47.162295 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1684/3208] 10.222.0.39 () {62 vars in 1309 bytes} [Sun Oct 16 01:14:47 2022] PUT /compute/v2.1/os-services/ef0fda33-32fa-4017-bf8b-0e8fb7e87aee => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:14:47.168430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:47.169058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:47.180352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.180862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.181298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.182043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.187588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.188373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.189408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f380d399-1611-438b-ad7f-49eb848b2f4c tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:47.197608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f380d399-1611-438b-ad7f-49eb848b2f4c tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.198122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f380d399-1611-438b-ad7f-49eb848b2f4c tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.198575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f380d399-1611-438b-ad7f-49eb848b2f4c tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.199358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f380d399-1611-438b-ad7f-49eb848b2f4c tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.199824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f380d399-1611-438b-ad7f-49eb848b2f4c tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.200255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f380d399-1611-438b-ad7f-49eb848b2f4c tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.267579 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f380d399-1611-438b-ad7f-49eb848b2f4c tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.083257 Oct 16 01:14:47.268646 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1685/3209] 10.222.0.39 () {60 vars in 1178 bytes} [Sun Oct 16 01:14:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:47.284751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8accd452-379f-429a-9307-6286b84a20ce tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:47.289033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accd452-379f-429a-9307-6286b84a20ce tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.303912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accd452-379f-429a-9307-6286b84a20ce tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.305375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accd452-379f-429a-9307-6286b84a20ce tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.306894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accd452-379f-429a-9307-6286b84a20ce tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.307657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accd452-379f-429a-9307-6286b84a20ce tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.308311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accd452-379f-429a-9307-6286b84a20ce tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.341354 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8accd452-379f-429a-9307-6286b84a20ce tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.060956 Oct 16 01:14:47.342756 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1686/3210] 10.222.0.39 () {60 vars in 1211 bytes} [Sun Oct 16 01:14:47 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:47.360361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b54bbb0e-9be5-4513-820e-a511f166e264 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:47.364969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b54bbb0e-9be5-4513-820e-a511f166e264 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.365697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b54bbb0e-9be5-4513-820e-a511f166e264 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.366369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b54bbb0e-9be5-4513-820e-a511f166e264 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.367857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b54bbb0e-9be5-4513-820e-a511f166e264 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.368668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b54bbb0e-9be5-4513-820e-a511f166e264 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.369257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b54bbb0e-9be5-4513-820e-a511f166e264 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.432484 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b54bbb0e-9be5-4513-820e-a511f166e264 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.078382 Oct 16 01:14:47.433132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1687/3211] 10.222.0.39 () {60 vars in 1178 bytes} [Sun Oct 16 01:14:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:14:47.469051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-046a9063-5e03-4309-8adf-35b89a9109c7 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:47.473234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-046a9063-5e03-4309-8adf-35b89a9109c7 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.473729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-046a9063-5e03-4309-8adf-35b89a9109c7 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.474179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-046a9063-5e03-4309-8adf-35b89a9109c7 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.475117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-046a9063-5e03-4309-8adf-35b89a9109c7 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.475615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-046a9063-5e03-4309-8adf-35b89a9109c7 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.476209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-046a9063-5e03-4309-8adf-35b89a9109c7 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.502532 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-046a9063-5e03-4309-8adf-35b89a9109c7 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038567 Oct 16 01:14:47.510717 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1688/3212] 10.222.0.39 () {60 vars in 1235 bytes} [Sun Oct 16 01:14:47 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:47.519116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99f6cd6c-cac0-47e4-b4a8-306708d59c76 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:47.524032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99f6cd6c-cac0-47e4-b4a8-306708d59c76 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.524492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99f6cd6c-cac0-47e4-b4a8-306708d59c76 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.524944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99f6cd6c-cac0-47e4-b4a8-306708d59c76 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.526208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99f6cd6c-cac0-47e4-b4a8-306708d59c76 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.526687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99f6cd6c-cac0-47e4-b4a8-306708d59c76 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.527163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99f6cd6c-cac0-47e4-b4a8-306708d59c76 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.567603 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-99f6cd6c-cac0-47e4-b4a8-306708d59c76 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.055483 Oct 16 01:14:47.576551 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1689/3213] 10.222.0.39 () {60 vars in 1178 bytes} [Sun Oct 16 01:14:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:14:47.582808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-685f35ef-49a7-4a87-b127-0ecffc9ad5c1 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:47.587586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-685f35ef-49a7-4a87-b127-0ecffc9ad5c1 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.588077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-685f35ef-49a7-4a87-b127-0ecffc9ad5c1 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.591139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-685f35ef-49a7-4a87-b127-0ecffc9ad5c1 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.596802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-685f35ef-49a7-4a87-b127-0ecffc9ad5c1 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:47.597318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-685f35ef-49a7-4a87-b127-0ecffc9ad5c1 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:47.597958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-685f35ef-49a7-4a87-b127-0ecffc9ad5c1 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:47.625476 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-685f35ef-49a7-4a87-b127-0ecffc9ad5c1 tempest-ServicesAdminNegativeV253TestJSON-1447041066 tempest-ServicesAdminNegativeV253TestJSON-1447041066-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.047429 Oct 16 01:14:47.626440 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1690/3214] 10.222.0.39 () {60 vars in 1239 bytes} [Sun Oct 16 01:14:47 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:47.761118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:47.781011 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ebcb6c45-ca4c-4efe-978b-dd27b3fee986 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.616781 Oct 16 01:14:47.787326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1525/3215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:47 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:47.855727 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-146506b2-9fcf-408c-b5f4-b83cb307ecab tempest-ServicesAdminNegativeV253TestJSON-403664950 tempest-ServicesAdminNegativeV253TestJSON-403664950-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:47.859618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-146506b2-9fcf-408c-b5f4-b83cb307ecab tempest-ServicesAdminNegativeV253TestJSON-403664950 tempest-ServicesAdminNegativeV253TestJSON-403664950-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '15efdbb672a24b37a7b483f40eca67f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd11774ad374cff9a6825b5eebcc70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-146506b2-9fcf-408c-b5f4-b83cb307ecab tempest-ServicesAdminNegativeV253TestJSON-403664950 tempest-ServicesAdminNegativeV253TestJSON-403664950-project] Request method failure captured: Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1sF5hJ6WbayAFHC0WnTKjfm4r7i6s-q_9V2zamLp65BlOFjrp1b1hy6XWyNpfFvy7AO6AeNTEBVZmyrIQkLxXKEpQyNTbLxQv45QGEtelSD18Ec1Q5F9RmJAJxPGQJnmXhUpT7Id6K-rhX7apQyEqUR3wJgt9jZ2vBqkOKGwrrKKys Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.53 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 2dd11774ad374cff9a6825b5eebcc70d Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-403664950 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2dd11774ad374cff9a6825b5eebcc70d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2dd11774ad374cff9a6825b5eebcc70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2dd11774ad374cff9a6825b5eebcc70d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2dd11774ad374cff9a6825b5eebcc70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-403664950 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 2dd11774ad374cff9a6825b5eebcc70d Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-403664950 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServicesAdminNegativeV253TestJSON-403664950-project Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 15efdbb672a24b37a7b483f40eca67f9 Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-403664950-project Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: action_args: {} Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise self.value Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 16 01:14:47.861438 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-146506b2-9fcf-408c-b5f4-b83cb307ecab tempest-ServicesAdminNegativeV253TestJSON-403664950 tempest-ServicesAdminNegativeV253TestJSON-403664950-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-146506b2-9fcf-408c-b5f4-b83cb307ecab tempest-ServicesAdminNegativeV253TestJSON-403664950 tempest-ServicesAdminNegativeV253TestJSON-403664950-project] 10.222.0.39 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.227408 Oct 16 01:14:47.870900 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1691/3216] 10.222.0.39 () {60 vars in 1178 bytes} [Sun Oct 16 01:14:47 2022] GET /compute/v2.1/os-services => generated 112 bytes in 230 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:14:48.023471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1401325795", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "dd811960-e386-493f-95bb-934b5e94fe90"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:48.142268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] validate_networks() for [('dd811960-e386-493f-95bb-934b5e94fe90', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:14:48.777875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-325161114", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c46794f1-8314-4c65-a0c7-8312b3640750"}, {"port": "3811721c-014f-4626-9fbf-6567a6f833aa", "tag": "port-1"}, {"port": "ef822297-368f-4d3b-b62b-2b48e310bdbe", "tag": "port-2"}, {"uuid": "5ede794f-da74-44c8-a3c2-b27dab3a4258", "tag": "net-1"}, {"uuid": "5ede794f-da74-44c8-a3c2-b27dab3a4258"}, {"uuid": "cf13b1f7-959b-48ff-8281-8003630d3f7b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "cf13b1f7-959b-48ff-8281-8003630d3f7b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8514951e-d944-4827-91fb-d43fd16023ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "72786d98-182f-420b-b91f-e7571ee7f9bb", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "28fe4df4-ca30-4ade-9981-af1fe9f88299", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--434646402"}], "key_name": "tempest-keypair-2132386502", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:49.297940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] validate_networks() for [('c46794f1-8314-4c65-a0c7-8312b3640750', None, None, None, None, None), (None, None, '3811721c-014f-4626-9fbf-6567a6f833aa', None, None, None), (None, None, 'ef822297-368f-4d3b-b62b-2b48e310bdbe', None, None, None), ('5ede794f-da74-44c8-a3c2-b27dab3a4258', None, None, None, None, None), ('5ede794f-da74-44c8-a3c2-b27dab3a4258', None, None, None, None, None), ('cf13b1f7-959b-48ff-8281-8003630d3f7b', '10.2.2.100', None, None, None, None), ('cf13b1f7-959b-48ff-8281-8003630d3f7b', '10.2.2.200', None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:14:49.562121 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:14:49.563879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:14:49.564923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:14:49.565395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:14:49.565829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:14:49.578172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:49.578964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:49.580037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:49.581088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:49.582143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:49.582904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:49.622464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:14:49.657471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Getting quotas for user 0c8da9a32cb54d0a87d914234b1e9f40 and project cb799a0263a14d1a93ba6e3fd37c260a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:14:49.701760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:14:49.705700 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:14:49.819311 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3099a98f-aa55-471b-9ec6-4415ea41000c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802421 Oct 16 01:14:49.820744 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1526/3217] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:14:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:14:49.833017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01ac76c9-ddba-4c69-9f19-f1bc83459617 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:49.835350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01ac76c9-ddba-4c69-9f19-f1bc83459617 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:49.989028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01ac76c9-ddba-4c69-9f19-f1bc83459617 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:49.996448 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01ac76c9-ddba-4c69-9f19-f1bc83459617 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1215 microversion: 2.1 time: 0.169117 Oct 16 01:14:49.999965 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1527/3218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:49 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:51.022056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:51.022812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:51.035129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:51.035647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:51.036996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:51.040539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:51.041188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:51.043065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:51.340331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:51.365240 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-894805b2-8d84-4428-81a4-744badf9a4bd tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1267 microversion: 2.1 time: 0.348225 Oct 16 01:14:51.383971 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1528/3219] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:51 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:51.584772 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:51.936840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1633480394", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:52.056614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:14:52.819440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:14:52.820071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:14:52.820722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:14:52.821805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:14:52.822381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:14:52.846333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:52.855655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:52.856204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:52.857110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:52.857674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:52.858169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:52.881524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Getting quotas for project ec64ba1a19d54d38aecbabcd25b075da. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:14:52.887731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Getting quotas for user 7c1e0fc9ff7e4c0da77439e27166264f and project ec64ba1a19d54d38aecbabcd25b075da. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:14:52.902587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:14:52.905102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:14:52.976508 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-212a75c3-9d40-46bc-bb11-4712475f9db5 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402844 Oct 16 01:14:52.984796 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1529/3220] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:14:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:14:52.991202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:52.992563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:52.999951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:53.000807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:53.001499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:53.002469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:53.003398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:53.005086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:53.191234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:53.206506 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a1cee434-7d82-4a53-8881-e775d27d825d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1273 microversion: 2.1 time: 0.218586 Oct 16 01:14:53.210870 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1530/3221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:52 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:53.225863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-862a0008-7509-4b76-977c-38a24eeae967 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:53.226498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-862a0008-7509-4b76-977c-38a24eeae967 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:53.499095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-862a0008-7509-4b76-977c-38a24eeae967 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:53.508282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-862a0008-7509-4b76-977c-38a24eeae967 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1217 microversion: 2.1 time: 0.296331 Oct 16 01:14:53.510033 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1531/3222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:53 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1217 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:54.240104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:54.241590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:54.265703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:54.265703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:54.265703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:54.279357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:54.280341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:54.281001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:55.235880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:55.258557 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eb39dbff-1ace-4388-8674-871917a151a9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1315 microversion: 2.1 time: 1.022820 Oct 16 01:14:55.267002 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1532/3223] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:54 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:55.272643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:55.275645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:55.304286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:55.307685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:55.308313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:55.309249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:55.311642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:55.312447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:55.672538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:55.682087 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d86ae668-6e21-421b-9c22-eea0afc5ff81 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1277 microversion: 2.1 time: 0.413305 Oct 16 01:14:55.682696 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1533/3224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:55 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1277 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:56.013373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a3d74237-fd09-49af-a6c9-b51fa6c5e38a req-e8e26467-a55f-4011-8b32-23302b94f752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8", "tag": "f51d946f-90c4-477a-a66e-65be4d8cd928"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:14:56.033229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a3d74237-fd09-49af-a6c9-b51fa6c5e38a req-e8e26467-a55f-4011-8b32-23302b94f752 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:56.034281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a3d74237-fd09-49af-a6c9-b51fa6c5e38a req-e8e26467-a55f-4011-8b32-23302b94f752 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:56.035732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a3d74237-fd09-49af-a6c9-b51fa6c5e38a req-e8e26467-a55f-4011-8b32-23302b94f752 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:56.078117 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a3d74237-fd09-49af-a6c9-b51fa6c5e38a req-e8e26467-a55f-4011-8b32-23302b94f752 service nova] Creating event network-changed:f51d946f-90c4-477a-a66e-65be4d8cd928 for instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 on n-h2-master-1 Oct 16 01:14:56.085519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a3d74237-fd09-49af-a6c9-b51fa6c5e38a req-e8e26467-a55f-4011-8b32-23302b94f752 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076236 Oct 16 01:14:56.086721 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1534/3225] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:14:56.290772 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:56.294217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:56.305033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:56.306135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:56.307080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:56.308383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:56.309140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:56.310296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:56.677472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:56.687429 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8098c570-ad78-46de-85f0-d0b8ed1782be tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1315 microversion: 2.1 time: 0.406392 Oct 16 01:14:56.688022 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1535/3226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:56 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:14:56.711907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:56.712630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:56.728108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:56.728809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:56.730278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:56.732203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:56.732698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:56.733142 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:56.830020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:56.859874 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c8cc974-8221-4544-a236-1ebfcced6d90 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1275 microversion: 2.1 time: 0.157437 Oct 16 01:14:56.861103 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1536/3227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:56 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:57.410810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:14:57.412011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:14:57.413425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:14:57.414041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:14:57.415116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:14:57.431592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:57.432472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:57.433359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:57.434421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:57.435225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:57.435956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:57.473030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Getting quotas for project 3078012968784295bc15ee359b50fd67. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:14:57.485192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Getting quotas for user 49b3edfc62e747a8a21e76bfde79f40e and project 3078012968784295bc15ee359b50fd67. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:14:57.717898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:57.718531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:57.734332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:57.734834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:57.737041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:57.738943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:57.755460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:57.756079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:57.867160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:14:57.871610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8514951e-d944-4827-91fb-d43fd16023ad',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='72786d98-182f-420b-b91f-e7571ee7f9bb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='28fe4df4-ca30-4ade-9981-af1fe9f88299',volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:14:58.181598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:58.196554 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5cd3525d-73f4-4207-9dc8-d92ef5c93cd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1315 microversion: 2.1 time: 0.484316 Oct 16 01:14:58.199636 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1537/3228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:57 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:58.208621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:58.210390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:58.228892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:58.230519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:58.231566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:58.233978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:58.235690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:58.237418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:58.462171 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f8835ede-90b7-4c59-8aa4-3439d4ee68c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 9.689402 Oct 16 01:14:58.467328 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1692/3229] 10.222.0.39 () {62 vars in 1189 bytes} [Sun Oct 16 01:14:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 9691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 16 01:14:58.477873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-94e3da23-af9e-4126-b617-4b08c224bec9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:58.478881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-94e3da23-af9e-4126-b617-4b08c224bec9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:58.594972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-94e3da23-af9e-4126-b617-4b08c224bec9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:58.607156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-94e3da23-af9e-4126-b617-4b08c224bec9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:58.609038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-94e3da23-af9e-4126-b617-4b08c224bec9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:58.610999 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-94e3da23-af9e-4126-b617-4b08c224bec9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1285 microversion: 2.42 time: 0.139696 Oct 16 01:14:58.611931 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1693/3230] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:58 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:14:58.668031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:58.684778 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9eff4c98-c053-4804-8bd3-009b3b6d4d50 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1317 microversion: 2.1 time: 0.483810 Oct 16 01:14:58.691952 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1538/3231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:58 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:59.227361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:59.227816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:59.279317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:59.280584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:59.281103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:59.285045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:59.288509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:59.288963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:59.641099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b7fd350-d212-4d18-9cd1-ed94cc5a5199 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:59.641712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b7fd350-d212-4d18-9cd1-ed94cc5a5199 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:59.816858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:59.827080 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c9a0c3fa-7a62-4d74-ade0-fcbdc94fe304 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1315 microversion: 2.1 time: 0.606344 Oct 16 01:14:59.845228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1694/3232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:59 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:14:59.874448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:14:59.882364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:14:59.900431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b7fd350-d212-4d18-9cd1-ed94cc5a5199 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:59.908656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b7fd350-d212-4d18-9cd1-ed94cc5a5199 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:59.921807 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b7fd350-d212-4d18-9cd1-ed94cc5a5199 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:14:59.924413 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b7fd350-d212-4d18-9cd1-ed94cc5a5199 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1285 microversion: 2.42 time: 0.286431 Oct 16 01:14:59.927720 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1539/3233] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:14:59 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1285 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:14:59.937715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:59.942583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:59.944358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:14:59.945491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:14:59.952260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:14:59.958251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:00.818006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:00.859190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-182f44e6-1f84-4584-93cd-546834321078 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1317 microversion: 2.1 time: 0.996409 Oct 16 01:15:00.859870 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1695/3234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:14:59 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1317 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:00.881813 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:00.883222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:00.893469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:00.894807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:00.895501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:00.896729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:00.897410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:00.898533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:00.966227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:00.966906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:00.978438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:00.979979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:00.981748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:00.985075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:00.985670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:00.986235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:01.318455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:01.337902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:01.344106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:01.345765 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8020d0a-b60e-43fd-a148-c1d232f5fcc9 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1575 microversion: 2.42 time: 0.383993 Oct 16 01:15:01.364832 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1696/3235] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:00 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1575 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:15:01.381428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d603cf8c-05ea-4438-88b9-e921b350740f req-7ab54270-0d53-48c4-88fc-a866800e4812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3da552-c78a-4056-a089-5f43fd09c352", "tag": "d6fbc6e9-4414-402c-ad89-3992ab039f56"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:01.392910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d603cf8c-05ea-4438-88b9-e921b350740f req-7ab54270-0d53-48c4-88fc-a866800e4812 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:01.393578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d603cf8c-05ea-4438-88b9-e921b350740f req-7ab54270-0d53-48c4-88fc-a866800e4812 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:01.394298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d603cf8c-05ea-4438-88b9-e921b350740f req-7ab54270-0d53-48c4-88fc-a866800e4812 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:01.415502 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d603cf8c-05ea-4438-88b9-e921b350740f req-7ab54270-0d53-48c4-88fc-a866800e4812 service nova] Creating event network-changed:d6fbc6e9-4414-402c-ad89-3992ab039f56 for instance 5f3da552-c78a-4056-a089-5f43fd09c352 on n-h2-master-1 Oct 16 01:15:01.422420 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d603cf8c-05ea-4438-88b9-e921b350740f req-7ab54270-0d53-48c4-88fc-a866800e4812 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056046 Oct 16 01:15:01.424001 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1697/3236] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:01.475241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:01.485574 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ca794392-abdf-453a-8f83-03f3477b0cc7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1315 microversion: 2.1 time: 0.608240 Oct 16 01:15:01.487273 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1540/3237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:00 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:01.888940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:01.890464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:01.902125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:01.905742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:01.906438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:01.907865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:01.911027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:01.911555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:02.353734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:02.368971 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc605c07-5b3c-4d0a-9abb-f28a2585c7a9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1317 microversion: 2.1 time: 0.482823 Oct 16 01:15:02.370962 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1698/3238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:01 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:02.380992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:02.382228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:02.397664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:02.398478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:02.403728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:02.404775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:02.405775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:02.406992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:02.512414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:02.513038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:02.523528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:02.523960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:02.524396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:02.525197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:02.525654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:02.530062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:02.597437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:02.618303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:02.621143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:02.622345 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4b264f3-60ed-417f-bfa3-4f7d0c468254 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1593 microversion: 2.42 time: 0.246109 Oct 16 01:15:02.632133 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1541/3239] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:02 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1593 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:03.214984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:03.229897 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe0a1781-ad4e-45ee-9e9f-4e3a4dcfcf34 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1315 microversion: 2.1 time: 0.723724 Oct 16 01:15:03.234283 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1699/3240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:02 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:15:03.394660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:03.397103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:03.399712 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:03.422451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:03.448347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:03.450653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:03.454549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:03.459061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:03.460695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:03.589033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-aa641144-3754-447d-b184-6d660c33f06f req-fe9ebdd7-afdd-4f87-81bc-d701ecb21027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8", "name": "network-vif-plugged", "status": "completed", "tag": "f51d946f-90c4-477a-a66e-65be4d8cd928"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:03.606539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-aa641144-3754-447d-b184-6d660c33f06f req-fe9ebdd7-afdd-4f87-81bc-d701ecb21027 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:03.612234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-aa641144-3754-447d-b184-6d660c33f06f req-fe9ebdd7-afdd-4f87-81bc-d701ecb21027 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:03.613033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-aa641144-3754-447d-b184-6d660c33f06f req-fe9ebdd7-afdd-4f87-81bc-d701ecb21027 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:03.653896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-aa641144-3754-447d-b184-6d660c33f06f req-fe9ebdd7-afdd-4f87-81bc-d701ecb21027 service nova] Creating event network-vif-plugged:f51d946f-90c4-477a-a66e-65be4d8cd928 for instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 on n-h2-master-1 Oct 16 01:15:03.670950 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-aa641144-3754-447d-b184-6d660c33f06f req-fe9ebdd7-afdd-4f87-81bc-d701ecb21027 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085494 Oct 16 01:15:03.678132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1700/3241] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:15:03.689493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:03.699903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:03.724205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:03.725059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:03.725758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:03.726714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:03.727408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:03.729471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:03.951317 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:03.970056 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb6b4c40-e65d-46ae-afa9-3dae9cd31420 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1317 microversion: 2.1 time: 0.575727 Oct 16 01:15:03.971524 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1542/3242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:03 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:04.180909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:04.197150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:04.206234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:04.207557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92f6f38b-a00a-4f14-a2b2-c98c9a82fec8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1660 microversion: 2.42 time: 0.527994 Oct 16 01:15:04.211917 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1701/3243] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:03 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1660 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:04.261523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:04.262239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:04.268439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:04.269595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:04.270435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:04.271550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:04.272320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:04.273047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:04.840772 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:04.854156 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-965588d7-05fb-4e37-a169-306f7ceaa45c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1315 microversion: 2.1 time: 0.597013 Oct 16 01:15:04.856305 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1543/3244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:04 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:05.006484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:05.007161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:05.030371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:05.033357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:05.036850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:05.037624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:05.038106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:05.038542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:05.237042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:05.238057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:05.251884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:05.252551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:05.252860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:05.254484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:05.259028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:05.259610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:05.358287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:05.379446 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d5b73a3-f309-402d-9ee0-bc539324077d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1317 microversion: 2.1 time: 0.376729 Oct 16 01:15:05.382287 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1702/3245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:04 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:05.696119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:05.713272 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:05.714704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:05.715947 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-129d62de-5e51-4069-bb2e-17e46754b698 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1706 microversion: 2.42 time: 0.483469 Oct 16 01:15:05.731355 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1544/3246] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:05 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1706 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:05.884940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:05.885949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:05.904905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:05.905613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:05.907027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:05.909223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:05.909813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:05.911154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:05.967421 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:06.360586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:06.370342 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7425d1f2-c83a-4e7a-baaa-bf115dd25896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1501 microversion: 2.1 time: 0.491926 Oct 16 01:15:06.383780 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1703/3247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:05 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1501 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:06.399579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:06.401209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:06.417402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:06.418402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:06.419817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:06.420422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:06.420753 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:06.423823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:06.424528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:06.425498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:06.454244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:06.457298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:06.459163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:06.479092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:06.479767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:06.480222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:06.566896 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:06.607026 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-66812be8-3677-4ad2-b0c6-60e50d3c0a69 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8/action" status: 202 len: 0 microversion: 2.1 time: 0.209366 Oct 16 01:15:06.607026 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1545/3248] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:15:06 2022] POST /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:15:06.614295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:06.615098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:06.622478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:06.623154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:06.623627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:06.624330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:06.624974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:06.625665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:07.059247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:07.068189 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-16a4a9df-c408-40df-a7e1-43f3ba63e417 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1317 microversion: 2.1 time: 0.661469 Oct 16 01:15:07.072040 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1704/3249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:06 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1317 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:07.112171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:07.117645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:07.137480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:07.138269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:07.140864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:07.141880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:07.142377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:07.142827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:07.359159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:07.369539 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39bb2afe-a166-492d-b96e-fd7dcb51de2b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1506 microversion: 2.1 time: 0.760993 Oct 16 01:15:07.372687 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1546/3250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:06 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:07.386868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a8f9d75d-e7ab-4020-babb-da33f20e497f req-f2e9f210-014f-4c33-aded-7b079d638840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3da552-c78a-4056-a089-5f43fd09c352", "name": "network-vif-plugged", "status": "completed", "tag": "d6fbc6e9-4414-402c-ad89-3992ab039f56"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:07.417392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a8f9d75d-e7ab-4020-babb-da33f20e497f req-f2e9f210-014f-4c33-aded-7b079d638840 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:07.418571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a8f9d75d-e7ab-4020-babb-da33f20e497f req-f2e9f210-014f-4c33-aded-7b079d638840 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:07.419228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a8f9d75d-e7ab-4020-babb-da33f20e497f req-f2e9f210-014f-4c33-aded-7b079d638840 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:07.438015 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a8f9d75d-e7ab-4020-babb-da33f20e497f req-f2e9f210-014f-4c33-aded-7b079d638840 service nova] Creating event network-vif-plugged:d6fbc6e9-4414-402c-ad89-3992ab039f56 for instance 5f3da552-c78a-4056-a089-5f43fd09c352 on n-h2-master-1 Oct 16 01:15:07.446269 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a8f9d75d-e7ab-4020-babb-da33f20e497f req-f2e9f210-014f-4c33-aded-7b079d638840 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071453 Oct 16 01:15:07.448720 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1547/3251] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:07.454869 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=20 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:07.954562 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:07.987314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:07.993311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:07.994893 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1edf02db-a456-498a-b95c-be94724730c2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1752 microversion: 2.42 time: 0.898937 Oct 16 01:15:07.998712 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1705/3252] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:07 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1752 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:08.099182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:08.100185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:08.115002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:08.120922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:08.121635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:08.122580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:08.123239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:08.123846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:08.398043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:08.399284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:08.409590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:08.410881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:08.412684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:08.415018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:08.416875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:08.418518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:08.602040 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:08.684653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:08.698017 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c667d18-1cd0-49d5-9c28-d486dfb324ee tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1317 microversion: 2.1 time: 0.604073 Oct 16 01:15:08.698857 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1548/3253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:08 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:08.836939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:08.861561 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-577c1b4f-0dea-49d8-b543-c49ee31ee94f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1486 microversion: 2.1 time: 0.469265 Oct 16 01:15:08.868977 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1706/3254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:08 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1486 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:08.899544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:08.900082 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:08.911075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:08.919345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:08.920344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:08.921669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:08.922523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:08.923413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:08.978230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lazy-loading 'flavor' on Instance uuid 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:15:09.028462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:09.029458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:09.041742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:09.044579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:09.045844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:09.051473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:09.052388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:09.054140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:09.563309 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cbf95b3f-d13f-4856-9336-115e31236381 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8/action" status: 202 len: 0 microversion: 2.1 time: 0.666272 Oct 16 01:15:09.565254 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1549/3255] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:15:08 2022] POST /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:15:09.595662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:09.603184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:09.633182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:09.633785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:09.634486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:09.635532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:09.636242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:09.636994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:09.867492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:09.891906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:09.897729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:09.901538 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-64b04f71-2956-4bf9-815f-776cc3a9eaf6 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1798 microversion: 2.42 time: 0.876117 Oct 16 01:15:09.904263 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1707/3256] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:09 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1798 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:09.909758 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=18 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:09.919354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:09.920612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:09.936801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:09.939420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:09.940285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:09.943348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:09.945331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:09.946049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:09.975110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:09.988736 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7055c14c-7ed7-4306-9b24-c87ede8dde6d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1492 microversion: 2.1 time: 0.417631 Oct 16 01:15:09.991359 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1550/3257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:09 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1492 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:10.236620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:10.258809 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cbc620c0-2ba9-4e4b-ab51-a7e2024854ea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1466 microversion: 2.1 time: 0.352484 Oct 16 01:15:10.264564 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1708/3258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:09 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1466 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:10.293476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1328108232", "metadata": {"image_type": "test"}}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:10.296090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:10.304999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:10.306289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:10.306788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:10.307540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:10.308047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:10.308482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:10.352591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Getting quotas for project ec64ba1a19d54d38aecbabcd25b075da. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:15:10.357863 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:10.359322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Getting quotas for user 7c1e0fc9ff7e4c0da77439e27166264f and project ec64ba1a19d54d38aecbabcd25b075da. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:15:10.749628 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80b41b17-fbdf-4227-bfc6-5cf5ccf97fec tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "POST /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352/action" status: 202 len: 0 microversion: 2.1 time: 0.457775 Oct 16 01:15:10.756543 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1551/3259] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:15:10 2022] POST /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:15:10.768194 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8761d8a0-bd35-4605-a4da-097ab8b10382 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e4dba60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:10.862129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:10.898138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:10.902225 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8761d8a0-bd35-4605-a4da-097ab8b10382 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29" status: 200 len: 1422 microversion: 2.1 time: 0.139008 Oct 16 01:15:10.903841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Searching by: {'deleted': False, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:15:10.909292 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1709/3260] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:10 2022] GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 => generated 1422 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:10.930711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:10.933848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:10.935026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:10.937359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:10.942631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:10.946039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:10.947314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:10.952197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:10.953628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Searching by: {'deleted': False, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:15:10.973722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:10.975203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:10.979133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:10.982022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:10.982826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:10.983916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:11.029610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:15:11.043851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:15:11.153716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc79bb42-f2b9-4c66-9a96-f4a6e770999b tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.233746 Oct 16 01:15:11.154895 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1710/3261] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:15:10 2022] GET /compute/v2.1/servers => generated 334 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:11.160056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:11.162566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:11.170960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:11.193607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:11.195002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:11.201427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:11.202313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:11.203024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:11.210282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-97d3ae70-50eb-443f-9629-be1e0cc622d8 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.365132 Oct 16 01:15:11.212088 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1552/3262] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:15:10 2022] GET /compute/v2.1/servers => generated 344 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:11.220738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:11.226890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:11.248528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:11.249037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:11.249477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:11.250188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:11.250649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:11.251115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:11.833137 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:11.853943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:11.857029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:11.858605 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e14a5a83-df16-4324-8f8f-d75589ddf223 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1798 microversion: 2.42 time: 0.702616 Oct 16 01:15:11.861411 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1711/3263] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:11 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1798 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:11.881744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:11.900357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:11.901675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Searching by: {'deleted': False, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:15:11.911074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:11.911654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:11.912076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:11.912941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:11.913397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:11.924261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:12.029711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:15:12.114696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:12.130934 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:12.135561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:12.137346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:12.137993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:12.161654 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4991dd76-93eb-4bec-aa5b-9e264beda015 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1513 microversion: 2.1 time: 0.948248 Oct 16 01:15:12.162267 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1553/3264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:11 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1513 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:12.197436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:12.219055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:12.219943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Searching by: {'deleted': False, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:15:12.239203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:12.247871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:12.248364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:12.251723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:12.252212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:12.256701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:12.356482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:15:12.560344 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:12.576086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:12.576386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:12.582081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:14.179060 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a536bcc4-02da-42f5-88f1-cc6fd9e9f10d tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 2.316267 Oct 16 01:15:14.181022 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1712/3265] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:15:11 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:14.185995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9657e0a7-0d63-4fd2-9f31-3841cefb6507 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e3d7820>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:14.491936 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9657e0a7-0d63-4fd2-9f31-3841cefb6507 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29" status: 200 len: 1422 microversion: 2.1 time: 0.303240 Oct 16 01:15:14.495670 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1713/3266] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:14 2022] GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 => generated 1422 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:14.537817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:14.538465 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:14.587165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:14.588404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:14.594135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:14.598579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:14.599155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:14.606283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:14.704169 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bcca290c-cb6b-4c74-a9d6-50ea7eae62a0 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 2.534152 Oct 16 01:15:14.704876 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1554/3267] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:15:12 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 2535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:14.735483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:14.736725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:14.747752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:14.748686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:14.749580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:14.750513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:14.751209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:14.752799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:15.762340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:15.778292 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ab9e3f8-b912-4893-b57d-0fd1254b2970 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1508 microversion: 2.1 time: 1.050360 Oct 16 01:15:15.790861 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1555/3268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:14 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1508 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:15.828414 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56c7143e-077b-4db2-9b3d-527acc48f135 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:15.862324 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56c7143e-077b-4db2-9b3d-527acc48f135 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.057038 Oct 16 01:15:15.885774 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1556/3269] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:15:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:15.907474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:15.908026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aab95718-e227-49eb-96eb-95dd70f59dc5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:15.935512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:15.941585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:15.951350 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-490b7c45-5632-4a86-86f2-290205b53c80 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1844 microversion: 2.42 time: 1.454369 Oct 16 01:15:15.953244 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1714/3270] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:14 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1844 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:15.962012 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aab95718-e227-49eb-96eb-95dd70f59dc5 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065578 Oct 16 01:15:15.971737 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1557/3271] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:15:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:15.994490 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bdd23e38-64fc-47a9-860c-a1836febc495 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e2064c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:16.198846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:16.199391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:16.208570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:16.209070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:16.213428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:16.214259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:16.214737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:16.215361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:16.305429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:15:16.424076 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:16.516268 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-933de875-c453-4089-ac9a-334b0a02704e tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "DELETE /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 204 len: 0 microversion: 2.1 time: 0.320779 Oct 16 01:15:16.517772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1558/3272] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:15:16 2022] DELETE /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:15:16.527133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d7b28a9-7755-40cb-94d6-97d7b134be49 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Action: 'create', calling method: .version_select at 0x7fd64e2ab550>, body: {"keypair": {"name": "tempest-keypair-490641971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3NM+Abs4kvIJrePEr+g453JrqvNarMnHmB/l3hVqICEtvhFRU9gpbF+8PEuU9j19R5x85QugQj/mibGv+tTAAyS/yLhtVJy+JHVpvw+e1RzVyN+nkWPRyVHiX8tuzKRw=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:16.571262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-0d7b28a9-7755-40cb-94d6-97d7b134be49 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Getting quotas for project 50faaea815f44af798f20a9977157801. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:15:16.582123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-0d7b28a9-7755-40cb-94d6-97d7b134be49 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Getting quotas for user d0213371a83f4a85bacc0ecdec5b2535 and project 50faaea815f44af798f20a9977157801. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:15:16.642760 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0d7b28a9-7755-40cb-94d6-97d7b134be49 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.123325 Oct 16 01:15:16.645216 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1559/3273] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:15:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:15:16.652632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-51ce03ac-e048-466c-ad76-0f6b9219b18c req-1ebd7a2b-1b38-4ae0-8fc2-deb5803b6149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "tag": "2255ee2d-6056-4dcf-a235-38289bda0980"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:16.674453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51ce03ac-e048-466c-ad76-0f6b9219b18c req-1ebd7a2b-1b38-4ae0-8fc2-deb5803b6149 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:16.676728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51ce03ac-e048-466c-ad76-0f6b9219b18c req-1ebd7a2b-1b38-4ae0-8fc2-deb5803b6149 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:16.677488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51ce03ac-e048-466c-ad76-0f6b9219b18c req-1ebd7a2b-1b38-4ae0-8fc2-deb5803b6149 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:16.705211 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-51ce03ac-e048-466c-ad76-0f6b9219b18c req-1ebd7a2b-1b38-4ae0-8fc2-deb5803b6149 service nova] Creating event network-changed:2255ee2d-6056-4dcf-a235-38289bda0980 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:15:16.715578 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-51ce03ac-e048-466c-ad76-0f6b9219b18c req-1ebd7a2b-1b38-4ae0-8fc2-deb5803b6149 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066682 Oct 16 01:15:16.719749 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1560/3274] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:16.739566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:16.741727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:16.761416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:16.769617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:16.775316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:16.776438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:16.777030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:16.777723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:16.890335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:15:17.121246 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7be9b971-51b9-4b93-82da-e39a3339dda6 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 204 len: 0 microversion: 2.1 time: 0.396322 Oct 16 01:15:17.123531 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1561/3275] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:15:16 2022] DELETE /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:15:17.136794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:17.137866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:17.156360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:17.159400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:17.161099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:17.163108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:17.164097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:17.165071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:17.820694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:17.832927 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f71ad904-450e-41fe-9e7c-9424124b9fef tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1699 microversion: 2.1 time: 0.707859 Oct 16 01:15:17.835613 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1562/3276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:17 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1699 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:17.860523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:17.864717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:17.902987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:17.905624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:17.919698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:17.920505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:17.920997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:17.921431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:18.418199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:18.433825 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8777486-bf59-40d2-a5c6-93c6ee1d6c31 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1508 microversion: 2.1 time: 0.594190 Oct 16 01:15:18.452935 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1563/3277] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:17 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1508 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:18.469668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:18.470328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:18.488705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:18.489254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:18.489687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:18.496896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:18.497422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:18.501015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:19.670637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:19.696993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:19.698441 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:19.713260 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab6d6726-2980-43d3-8740-d0d99ca01e9a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1844 microversion: 2.42 time: 1.256195 Oct 16 01:15:19.713881 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1564/3278] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:18 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1844 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:19.726746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:19.727443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:19.740236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:19.749410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:19.750042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:19.752025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:19.753560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:19.754372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:21.117149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:21.126017 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-031ca844-879a-4dda-b145-a017de74f0af tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1608 microversion: 2.1 time: 1.411071 Oct 16 01:15:21.131961 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1565/3279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:19 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1608 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:21.137045 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:21.149690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:21.186390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:21.187132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:21.195649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:21.196707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:21.197359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:21.197977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:21.966353 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:22.071757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:22.080316 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-edb615b2-d9e7-442e-a0d7-e8de9e4bfa46 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1699 microversion: 2.1 time: 0.946874 Oct 16 01:15:22.111311 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1566/3280] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:21 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1699 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:22.112911 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:22.117625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:22.118261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:22.135915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:22.136417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:22.136863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:22.137579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:22.138045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:22.138478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:22.298776 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:23.283389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:23.294436 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5308bb0b-c1db-4fc7-9709-9a12122eb857 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1508 microversion: 2.1 time: 1.181802 Oct 16 01:15:23.300538 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1567/3281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:22 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1508 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:23.342168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c264a1cd-2c80-4e32-904c-a326f814e947 req-6ac448fb-d80a-490d-8f4e-a31f5920abe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8", "name": "network-vif-plugged", "status": "completed", "tag": "f51d946f-90c4-477a-a66e-65be4d8cd928"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:23.382344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c264a1cd-2c80-4e32-904c-a326f814e947 req-6ac448fb-d80a-490d-8f4e-a31f5920abe6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:23.382834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c264a1cd-2c80-4e32-904c-a326f814e947 req-6ac448fb-d80a-490d-8f4e-a31f5920abe6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:23.383290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c264a1cd-2c80-4e32-904c-a326f814e947 req-6ac448fb-d80a-490d-8f4e-a31f5920abe6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:23.417914 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c264a1cd-2c80-4e32-904c-a326f814e947 req-6ac448fb-d80a-490d-8f4e-a31f5920abe6 service nova] Creating event network-vif-plugged:f51d946f-90c4-477a-a66e-65be4d8cd928 for instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 on n-h2-master-1 Oct 16 01:15:23.433814 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c264a1cd-2c80-4e32-904c-a326f814e947 req-6ac448fb-d80a-490d-8f4e-a31f5920abe6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113871 Oct 16 01:15:23.435133 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1568/3282] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:23.450700 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:23.451841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:23.465812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:23.471062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:23.472473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:23.473608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:23.475338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:23.475998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:24.147512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:24.198286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:24.203761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:24.210403 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b697b6d-4c8b-4886-bf4b-3d751934b300 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1865 microversion: 2.42 time: 0.772113 Oct 16 01:15:24.214698 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1569/3283] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:23 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1865 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:24.233362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:24.235649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:24.262035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:24.262876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:24.263596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:24.265969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:24.270217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:24.276535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:24.542167 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:24.543582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:24.562480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-84afb13c-4b2d-4ea0-a9e3-c8f3a4c06b06 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1541 microversion: 2.1 time: 0.344832 Oct 16 01:15:24.563371 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1570/3284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:24 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1541 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:24.581234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:24.603830 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:24.647404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:24.652964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:24.654578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:24.656550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:24.660233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:24.664874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:25.806221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb1f704f82b46bd85d0f117f1686b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82d1c738ddf642ed8febdb236f5bf8f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:25.825888 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22220e57-a5e1-4cb4-8efd-d20ba49591fa tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 200 len: 1632 microversion: 2.1 time: 1.253661 Oct 16 01:15:25.826712 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1571/3285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:24 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 1632 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:25.839221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fd199f9d-0c3f-4605-937d-34adf1f036f6 req-1dff3cc8-0e7e-4cfe-8fd1-88192b1c70e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "tag": "3811721c-014f-4626-9fbf-6567a6f833aa"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:25.874051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd199f9d-0c3f-4605-937d-34adf1f036f6 req-1dff3cc8-0e7e-4cfe-8fd1-88192b1c70e0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:25.877252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd199f9d-0c3f-4605-937d-34adf1f036f6 req-1dff3cc8-0e7e-4cfe-8fd1-88192b1c70e0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:25.881406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd199f9d-0c3f-4605-937d-34adf1f036f6 req-1dff3cc8-0e7e-4cfe-8fd1-88192b1c70e0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:25.912228 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=62 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:25.934741 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fd199f9d-0c3f-4605-937d-34adf1f036f6 req-1dff3cc8-0e7e-4cfe-8fd1-88192b1c70e0 service nova] Creating event network-changed:3811721c-014f-4626-9fbf-6567a6f833aa for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:15:25.956254 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fd199f9d-0c3f-4605-937d-34adf1f036f6 req-1dff3cc8-0e7e-4cfe-8fd1-88192b1c70e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124993 Oct 16 01:15:25.962184 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1572/3286] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:25.984488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:25.998261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:26.032323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:26.043401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:26.043955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:26.045974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:26.045974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:26.054765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:26.613632 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:26.671383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:26.687170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f7fe6ad3-39cf-467b-af46-6c18647ec0c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1508 microversion: 2.1 time: 0.723127 Oct 16 01:15:26.691144 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1573/3287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:25 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1508 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:26.711199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:26.712131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:26.723681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:26.724953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:26.726186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:26.728756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:26.729472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:26.730298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:27.786388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:27.831426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:27.833394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:27.838304 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-27b1556c-fb16-42ff-b5fd-1d12d6e140cd tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1865 microversion: 2.42 time: 1.139960 Oct 16 01:15:27.865190 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1574/3288] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:26 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1865 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:27.873347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0e2a9810-ef3d-46c9-86bd-d72d8783f7b1 req-4ace6093-f155-4b9b-bdd7-b4c53f7fa9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3da552-c78a-4056-a089-5f43fd09c352", "name": "network-vif-plugged", "status": "completed", "tag": "d6fbc6e9-4414-402c-ad89-3992ab039f56"}, {"server_uuid": "81b3db0a-f07b-4120-a1bf-47e23c1ee0a4", "name": "network-vif-unplugged", "status": "completed", "tag": "b0e28d17-7ca7-4764-9b8f-63af0c185af8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:27.963801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0e2a9810-ef3d-46c9-86bd-d72d8783f7b1 req-4ace6093-f155-4b9b-bdd7-b4c53f7fa9ac service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:27.964311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0e2a9810-ef3d-46c9-86bd-d72d8783f7b1 req-4ace6093-f155-4b9b-bdd7-b4c53f7fa9ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:27.964762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0e2a9810-ef3d-46c9-86bd-d72d8783f7b1 req-4ace6093-f155-4b9b-bdd7-b4c53f7fa9ac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:28.064403 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0e2a9810-ef3d-46c9-86bd-d72d8783f7b1 req-4ace6093-f155-4b9b-bdd7-b4c53f7fa9ac service nova] Creating event network-vif-plugged:d6fbc6e9-4414-402c-ad89-3992ab039f56 for instance 5f3da552-c78a-4056-a089-5f43fd09c352 on n-h2-master-1 Oct 16 01:15:28.065508 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0e2a9810-ef3d-46c9-86bd-d72d8783f7b1 req-4ace6093-f155-4b9b-bdd7-b4c53f7fa9ac service nova] Creating event network-vif-unplugged:b0e28d17-7ca7-4764-9b8f-63af0c185af8 for instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 on n-h2-master-1 Oct 16 01:15:28.079479 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0e2a9810-ef3d-46c9-86bd-d72d8783f7b1 req-4ace6093-f155-4b9b-bdd7-b4c53f7fa9ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.212677 Oct 16 01:15:28.089882 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1575/3289] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:28.101188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:28.107996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:28.135582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:28.136667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:28.138737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:28.139704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:28.144971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:28.146429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:28.505065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:28.512065 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:28.531153 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-110c59a3-3fcb-4638-8a97-afac94b32798 tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1252 microversion: 2.1 time: 0.439603 Oct 16 01:15:28.538438 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1576/3290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:28 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1252 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:28.555444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ad791b35-d1ea-417e-bd9d-699f80dadcf2 req-f74670ea-6179-4aa5-beff-b6a0ce6fabd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e250d6e1-030e-4b1b-b4ed-3fa030574cc6", "name": "network-vif-deleted", "tag": "f1472981-1e15-414d-a009-f9a3ab462d02"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:28.581922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ad791b35-d1ea-417e-bd9d-699f80dadcf2 req-f74670ea-6179-4aa5-beff-b6a0ce6fabd9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:28.585532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ad791b35-d1ea-417e-bd9d-699f80dadcf2 req-f74670ea-6179-4aa5-beff-b6a0ce6fabd9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:28.586211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ad791b35-d1ea-417e-bd9d-699f80dadcf2 req-f74670ea-6179-4aa5-beff-b6a0ce6fabd9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:28.640467 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ad791b35-d1ea-417e-bd9d-699f80dadcf2 req-f74670ea-6179-4aa5-beff-b6a0ce6fabd9 service nova] Creating event network-vif-deleted:f1472981-1e15-414d-a009-f9a3ab462d02 for instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 on n-h1-master-1 Oct 16 01:15:28.657665 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ad791b35-d1ea-417e-bd9d-699f80dadcf2 req-f74670ea-6179-4aa5-beff-b6a0ce6fabd9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116912 Oct 16 01:15:28.663674 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1577/3291] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:28.679276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:28.680404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] [instance: 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:28.707266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:28.709538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:28.710161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:28.711122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:28.720569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:28.721346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:28.777259 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] HTTP exception thrown: Instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 could not be found. Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Request method failure captured: Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 HTTP/1.1 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1rRtNqGwlZfMByc6nyAbVjYA-y2AbjTcDCCcSgv1wCQq_cDtzM6lXRechRHyJz8iYTAUotRg7pc_KEr9276CMRJ7QrofOOluxQFH17P1N-JZywFTXMINUOIf7pFI_ru85doSxVetMPPdRb4PIRPbG1Ymd9H-hScTaijZ9WxUmFgclI Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 82d1c738ddf642ed8febdb236f5bf8f3 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestJSON-920135621 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_82d1c738ddf642ed8febdb236f5bf8f3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/82d1c738ddf642ed8febdb236f5bf8f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/82d1c738ddf642ed8febdb236f5bf8f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/82d1c738ddf642ed8febdb236f5bf8f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestJSON-920135621 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 82d1c738ddf642ed8febdb236f5bf8f3 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestJSON-920135621 Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestJSON-920135621-project Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1cb1f704f82b46bd85d0f117f1686b5d Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestJSON-920135621-project Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 could not be found. Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '81b3db0a-f07b-4120-a1bf-47e23c1ee0a4'} Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 could not be found. Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 could not be found. Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:15:28.782253 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:28.788480 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:15:28.788480 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:15:28.788480 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:15:28.788480 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:15:28.788480 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 could not be found. Oct 16 01:15:28.788480 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:15:28.790379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Returning 404 to user: Instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:15:28.794882 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1e6a24d-5df5-46e3-9fa1-9e731f39ae9f tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4" status: 404 len: 111 microversion: 2.1 time: 0.125893 Oct 16 01:15:28.806516 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1578/3292] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:28 2022] GET /compute/v2.1/servers/81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:15:28.814818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1251581620", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6cbf1773-bbd1-446d-a4ec-4c0dd6140c5c"}, {"port": "6232908a-2443-4f5d-9f4e-ab5cbda8380a", "tag": "port-1"}, {"port": "6eae5487-8226-4e36-857f-2781b0723f1e", "tag": "port-2"}, {"uuid": "4f84f982-96e0-4a00-a459-bca4d5e737d3", "tag": "net-1"}, {"uuid": "4f84f982-96e0-4a00-a459-bca4d5e737d3"}, {"uuid": "f4cd1142-4ba3-4189-8a81-8f0de038858d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f4cd1142-4ba3-4189-8a81-8f0de038858d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2d2420bf-b47f-4a15-a291-caa09511a573", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ea5eccae-eaef-4b52-ac60-e61e376519a7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7e14ee39-27db-43ca-a79b-46b2d74609c2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1397350160"}], "key_name": "tempest-keypair-490641971", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:38.776827 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=5 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:38.860962 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:40.168289 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bdd23e38-64fc-47a9-860c-a1836febc495 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29" status: 200 len: 1431 microversion: 2.1 time: 24.213481 Oct 16 01:15:40.182222 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1715/3293] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:15 2022] GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 => generated 1431 bytes in 24219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:40.193858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:40.194540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:40.216679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:40.217185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:40.217627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:40.227060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:40.229317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:40.234393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:40.506094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] validate_networks() for [('6cbf1773-bbd1-446d-a4ec-4c0dd6140c5c', None, None, None, None, None), (None, None, '6232908a-2443-4f5d-9f4e-ab5cbda8380a', None, None, None), (None, None, '6eae5487-8226-4e36-857f-2781b0723f1e', None, None, None), ('4f84f982-96e0-4a00-a459-bca4d5e737d3', None, None, None, None, None), ('4f84f982-96e0-4a00-a459-bca4d5e737d3', None, None, None, None, None), ('f4cd1142-4ba3-4189-8a81-8f0de038858d', '10.2.2.100', None, None, None, None), ('f4cd1142-4ba3-4189-8a81-8f0de038858d', '10.2.2.200', None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:15:41.120673 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:41.129389 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fb3f8413-0e90-4f25-a32a-18298d5c2be2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1508 microversion: 2.1 time: 0.953791 Oct 16 01:15:41.130031 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1716/3294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:40 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1508 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:41.139897 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9a8fe5bd-0d9c-4133-ad0f-760dccaaf900 req-0d30ce61-8652-4b05-9999-3a3ba0cd4fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b3db0a-f07b-4120-a1bf-47e23c1ee0a4", "name": "network-vif-deleted", "tag": "b0e28d17-7ca7-4764-9b8f-63af0c185af8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:41.171915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a8fe5bd-0d9c-4133-ad0f-760dccaaf900 req-0d30ce61-8652-4b05-9999-3a3ba0cd4fdf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:41.173112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a8fe5bd-0d9c-4133-ad0f-760dccaaf900 req-0d30ce61-8652-4b05-9999-3a3ba0cd4fdf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:41.173709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a8fe5bd-0d9c-4133-ad0f-760dccaaf900 req-0d30ce61-8652-4b05-9999-3a3ba0cd4fdf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:41.198944 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9a8fe5bd-0d9c-4133-ad0f-760dccaaf900 req-0d30ce61-8652-4b05-9999-3a3ba0cd4fdf service nova] Creating event network-vif-deleted:b0e28d17-7ca7-4764-9b8f-63af0c185af8 for instance 81b3db0a-f07b-4120-a1bf-47e23c1ee0a4 on n-h2-master-1 Oct 16 01:15:41.211468 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9a8fe5bd-0d9c-4133-ad0f-760dccaaf900 req-0d30ce61-8652-4b05-9999-3a3ba0cd4fdf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074991 Oct 16 01:15:41.219557 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1717/3295] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:41.225794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ac2d688-1317-4b80-b61b-3e1f8e02b369 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] Calling method '.version_select at 0x7fd64e7e6dc0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:41.274597 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6ac2d688-1317-4b80-b61b-3e1f8e02b369 tempest-ServersTestJSON-920135621 tempest-ServersTestJSON-920135621-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087422527" status: 202 len: 0 microversion: 2.1 time: 0.053434 Oct 16 01:15:41.275252 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1718/3296] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087422527 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:15:41.291933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:41.292739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:41.303280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:41.303871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:41.304312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:41.305063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:41.305618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:41.308077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:42.125437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:42.153650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:42.161513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:42.167995 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34b4e173-98a6-4e16-bc7b-ebd0afa21bff tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1886 microversion: 2.42 time: 0.888161 Oct 16 01:15:42.170389 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1719/3297] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:41 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1886 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:42.186213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:42.186865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:42.203808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:42.208152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:42.208687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:42.209599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:42.210547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:42.211583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:42.285997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:42.286415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:42.290746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:42.291831 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lazy-loading 'fault' on Instance uuid e250d6e1-030e-4b1b-b4ed-3fa030574cc6 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:15:42.420258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3714a80dffe147b5b683e6a3419d0df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfee6c66b8f5495a8eb29e4136ec3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:42.432322 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e491d01-c6ae-4225-89d9-1204b3c0c7ec tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 200 len: 1257 microversion: 2.1 time: 0.260169 Oct 16 01:15:42.441729 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1720/3298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:42 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 1257 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:42.448244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ffc9d46-1a17-40b1-920e-bbae85ae9626 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e1fbe50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:42.587613 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ffc9d46-1a17-40b1-920e-bbae85ae9626 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29" status: 200 len: 1431 microversion: 2.1 time: 0.144693 Oct 16 01:15:42.588375 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1721/3299] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:42 2022] GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 => generated 1431 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:42.606084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:42.606813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:42.620321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:42.622066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:42.624495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:42.625322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:42.628428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:42.629101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:43.794437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:43.810285 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f6e212bc-9077-40bd-a797-67fa323d1fff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1505 microversion: 2.1 time: 1.220609 Oct 16 01:15:43.810888 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1722/3300] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:42 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1505 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:43.833574 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:43.841002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:43.851458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:43.852178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:43.852807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:43.853691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:43.854336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:43.866819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:44.474769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:44.487861 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0919c2d4-1731-42a9-8d3b-a6d71d526e35 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1466 microversion: 2.1 time: 0.659746 Oct 16 01:15:44.488490 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1723/3301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:43 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1466 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:44.528401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:44.529053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:44.552886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:44.553760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:44.554598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:44.562550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:44.565365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:44.571740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:45.078040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:45.094097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:45.095582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:45.101349 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0decffb-d1a0-4c4d-88f3-ef0e4f8928ac tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1886 microversion: 2.42 time: 0.594126 Oct 16 01:15:45.124240 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1724/3302] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:44 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1886 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:45.136601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:45.137627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] [instance: e250d6e1-030e-4b1b-b4ed-3fa030574cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:45.148676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:45.149532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:45.150194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:45.151170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:45.151900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:45.152547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:45.171887 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] HTTP exception thrown: Instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 could not be found. Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Request method failure captured: Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 HTTP/1.1 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1qf6aRW6cHkS3O3WTBaNptYgsQdTtzeGrgoeHVSzCz9WTIyJsuB-3pKg3Od_LNYjm-0IiVoE7jAMNY3E-toms32B4RMM_TpyvvczdidovbKdgv44GjC4ftIRTu5CZ1s3NT7rH_H1wmK1wAcoXPGrAL8kUXHiB7WzSIY5zbbPdEL6Hs Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: cfee6c66b8f5495a8eb29e4136ec3ed7 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestBootFromVolume-1507447158 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cfee6c66b8f5495a8eb29e4136ec3ed7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cfee6c66b8f5495a8eb29e4136ec3ed7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cfee6c66b8f5495a8eb29e4136ec3ed7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cfee6c66b8f5495a8eb29e4136ec3ed7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestBootFromVolume-1507447158 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: cfee6c66b8f5495a8eb29e4136ec3ed7 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1507447158 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestBootFromVolume-1507447158-project Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 3714a80dffe147b5b683e6a3419d0df3 Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestBootFromVolume-1507447158-project Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 could not be found. Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e250d6e1-030e-4b1b-b4ed-3fa030574cc6'} Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 could not be found. Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 could not be found. Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:15:45.173961 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:45.181398 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:45.181398 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:15:45.181398 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:15:45.181398 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:15:45.181398 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:15:45.181398 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 could not be found. Oct 16 01:15:45.181398 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:45.184224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Returning 404 to user: Instance e250d6e1-030e-4b1b-b4ed-3fa030574cc6 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:15:45.185737 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa8bc209-c798-4f42-8155-6cc7ede1754e tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6" status: 404 len: 111 microversion: 2.1 time: 0.055747 Oct 16 01:15:45.186685 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1725/3303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:45 2022] GET /compute/v2.1/servers/e250d6e1-030e-4b1b-b4ed-3fa030574cc6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:15:45.194599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "tag": "ef822297-368f-4d3b-b62b-2b48e310bdbe"}, {"name": "network-changed", "server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "tag": "f7e6e0d5-ea9e-40be-817f-0b90f99facfc"}, {"name": "network-changed", "server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "tag": "3906f22f-b88f-45bd-af84-22eb74721ab9"}, {"name": "network-changed", "server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "tag": "547d449f-ecbd-47ce-a60f-af7bad8cb901"}, {"name": "network-changed", "server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "tag": "2601fd55-e7bc-4577-b604-f788d6cf784d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:45.208491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:45.209272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:45.209879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:45.230190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Creating event network-changed:ef822297-368f-4d3b-b62b-2b48e310bdbe for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:15:45.231194 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Creating event network-changed:f7e6e0d5-ea9e-40be-817f-0b90f99facfc for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:15:45.231961 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Creating event network-changed:3906f22f-b88f-45bd-af84-22eb74721ab9 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:15:45.233387 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Creating event network-changed:547d449f-ecbd-47ce-a60f-af7bad8cb901 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:15:45.235166 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] Creating event network-changed:2601fd55-e7bc-4577-b604-f788d6cf784d for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:15:45.243190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-92cffb8c-49bb-486d-af02-331a3cfcd413 req-0e135b66-88b2-461a-8587-c8a9c3676b6c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 847 microversion: 2.1 time: 0.054832 Oct 16 01:15:45.244446 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1726/3304] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 847 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:45.252535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c3ecb706-6758-4438-b726-71565a05102b req-765c8361-df95-4720-b880-ba8a79d23eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3da552-c78a-4056-a089-5f43fd09c352", "name": "network-vif-unplugged", "status": "completed", "tag": "d6fbc6e9-4414-402c-ad89-3992ab039f56"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:45.268492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c3ecb706-6758-4438-b726-71565a05102b req-765c8361-df95-4720-b880-ba8a79d23eb8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:45.269340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c3ecb706-6758-4438-b726-71565a05102b req-765c8361-df95-4720-b880-ba8a79d23eb8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:45.269974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c3ecb706-6758-4438-b726-71565a05102b req-765c8361-df95-4720-b880-ba8a79d23eb8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:45.301426 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c3ecb706-6758-4438-b726-71565a05102b req-765c8361-df95-4720-b880-ba8a79d23eb8 service nova] Creating event network-vif-unplugged:d6fbc6e9-4414-402c-ad89-3992ab039f56 for instance 5f3da552-c78a-4056-a089-5f43fd09c352 on n-h2-master-1 Oct 16 01:15:45.308535 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c3ecb706-6758-4438-b726-71565a05102b req-765c8361-df95-4720-b880-ba8a79d23eb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062163 Oct 16 01:15:45.310301 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1727/3305] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:45.317121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8de6b5f2-1831-4090-85cd-0cfe74db93af tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e139940>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:45.377990 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8de6b5f2-1831-4090-85cd-0cfe74db93af tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a103d6a4-5636-40e5-8e77-0179ae547423" status: 200 len: 784 microversion: 2.1 time: 0.065973 Oct 16 01:15:45.389810 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1728/3306] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:45 2022] GET /compute/v2.1/images/a103d6a4-5636-40e5-8e77-0179ae547423 => generated 784 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:45.396239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:45.397198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:45.404338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:45.405099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:45.405771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:45.406650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:45.407334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:45.407929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:46.030030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:46.043635 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2e82ad5f-40d4-48c8-8767-a517494703c3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1505 microversion: 2.1 time: 0.651738 Oct 16 01:15:46.044463 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1729/3307] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:45 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1505 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:46.054671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e6ae492-a983-42fb-a00b-9df8a2ae264c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] Calling method '.version_select at 0x7fd64e139550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:46.096657 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e6ae492-a983-42fb-a00b-9df8a2ae264c tempest-ServersTestBootFromVolume-1507447158 tempest-ServersTestBootFromVolume-1507447158-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366948471" status: 202 len: 0 microversion: 2.1 time: 0.050297 Oct 16 01:15:46.097655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1730/3308] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:15:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366948471 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:15:46.102271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-95751cc9-5ae3-401f-b44f-44bfddab21a6 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:46.128675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-95751cc9-5ae3-401f-b44f-44bfddab21a6 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029894 Oct 16 01:15:46.129592 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1731/3309] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:15:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:15:46.144229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:46.145182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:46.151930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:46.152707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:46.153321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:46.154264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:46.154909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:46.155561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:46.745910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:46.757134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:46.764655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:46.766045 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f07b5193-28df-4196-9882-33cef3b907c1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.626929 Oct 16 01:15:46.771483 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1732/3310] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:46 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:46.776533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92bc19c2-6aa8-4979-b87b-c51a6445bd2d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd6527aa5e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:48.054021 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92bc19c2-6aa8-4979-b87b-c51a6445bd2d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "DELETE /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29" status: 204 len: 0 microversion: 2.1 time: 1.280214 Oct 16 01:15:48.055598 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1733/3311] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:46 2022] DELETE /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 => generated 0 bytes in 1283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:15:48.060939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:48.061795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:48.082740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:48.083270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:48.083940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:48.086146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:48.093895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:48.093895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:48.713272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:48.729069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-efeece1f-ee9b-4623-a312-293df9998b0c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 200 len: 1448 microversion: 2.1 time: 0.672130 Oct 16 01:15:48.730453 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1734/3312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:48 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 1448 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:48.738804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4b11d84d-2831-4eae-b335-e08ed01ed221 req-5a53c4db-f1c4-4f0d-b1a7-1e8135b6f70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8", "name": "network-vif-unplugged", "status": "completed", "tag": "f51d946f-90c4-477a-a66e-65be4d8cd928"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:48.762527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4b11d84d-2831-4eae-b335-e08ed01ed221 req-5a53c4db-f1c4-4f0d-b1a7-1e8135b6f70e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:48.763432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4b11d84d-2831-4eae-b335-e08ed01ed221 req-5a53c4db-f1c4-4f0d-b1a7-1e8135b6f70e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:48.765270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4b11d84d-2831-4eae-b335-e08ed01ed221 req-5a53c4db-f1c4-4f0d-b1a7-1e8135b6f70e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:48.784862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.compute.server_external_events [req-4b11d84d-2831-4eae-b335-e08ed01ed221 req-5a53c4db-f1c4-4f0d-b1a7-1e8135b6f70e service nova] Unable to find a host for instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8. Dropping event network-vif-unplugged {{(pid=120545) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 16 01:15:48.786370 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4b11d84d-2831-4eae-b335-e08ed01ed221 req-5a53c4db-f1c4-4f0d-b1a7-1e8135b6f70e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054711 Oct 16 01:15:48.787341 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1735/3313] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 16 01:15:48.794383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:48.796353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:48.809941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:48.810855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:48.811546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:48.813716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:48.815202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:48.816382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:49.157716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:49.177011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:49.185689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:49.187391 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f0aca7c-e035-4ef4-8f1d-5ae191736d08 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.398700 Oct 16 01:15:49.191286 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1736/3314] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:48 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:49.199436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5cc69a9b-f43d-4aa0-9702-cc891ab4e710 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e27a430>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:49.233350 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5cc69a9b-f43d-4aa0-9702-cc891ab4e710 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] HTTP exception thrown: Image not found. Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5cc69a9b-f43d-4aa0-9702-cc891ab4e710 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Request method failure captured: Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 HTTP/1.1 Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1sLRz-M1p_K7qkqs2YTFAzdJIUrvHRH-3yuUyySIvTOWavKfoPYZJsjfjpJeh6wMyT_rwsR85AaPMoi7bneqGdbBqvEXXoYSPw451q71dln8jsOOJO5oMfyjGXAiphExiH2QucbI34X8bBDnf0VmsDxSGuNF_b-YjeDJjBT71ycdmQ Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: ec64ba1a19d54d38aecbabcd25b075da Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec64ba1a19d54d38aecbabcd25b075da", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: ec64ba1a19d54d38aecbabcd25b075da Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerTestJSON-348139423-project Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7c1e0fc9ff7e4c0da77439e27166264f Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerTestJSON-348139423-project Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '4833bb37-de6c-4b1e-9af0-cce0e9fc6e29'} Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:15:49.238790 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 could not be found. Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5cc69a9b-f43d-4aa0-9702-cc891ab4e710 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5cc69a9b-f43d-4aa0-9702-cc891ab4e710 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29" status: 404 len: 62 microversion: 2.1 time: 0.047887 Oct 16 01:15:49.243605 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1737/3315] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:49 2022] GET /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:15:49.257119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:49.258892 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:49.273220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:49.274079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:49.274813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:49.276841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:49.277817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:49.278453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:49.727412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:15:49.729310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:15:49.730085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:15:49.731648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:15:49.733688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:15:49.777836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:49.783392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:49.785831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:49.787685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:49.788090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:49.788999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:49.790759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:49.796185 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-990d8912-6b4d-4cb1-8838-3e567d776709 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.553783 Oct 16 01:15:49.801009 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1738/3316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:49 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:49.823303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2075194605"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:49.825862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:49.839791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:49.841225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Getting quotas for project 50faaea815f44af798f20a9977157801. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:15:49.842400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:49.845700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:49.846762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:49.847482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:49.848078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:49.855881 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Getting quotas for user d0213371a83f4a85bacc0ecdec5b2535 and project 50faaea815f44af798f20a9977157801. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:15:50.227539 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e3f0f5e1-4abd-40a2-9134-c6d51cd6fc7d tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "POST /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352/action" status: 202 len: 0 microversion: 2.1 time: 0.424738 Oct 16 01:15:50.229180 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1739/3317] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:15:49 2022] POST /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:15:50.235263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:50.237799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:50.246435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:15:50.247541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:50.248529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:50.249293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:50.252865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2d2420bf-b47f-4a15-a291-caa09511a573',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ea5eccae-eaef-4b52-ac60-e61e376519a7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e14ee39-27db-43ca-a79b-46b2d74609c2',volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:15:50.255396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:50.256989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:50.257874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:50.888283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:50.920420 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-61de948b-29d9-4a83-b959-2fc21f648674 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.689746 Oct 16 01:15:50.921017 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1740/3318] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:50 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:50.944476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:50.945951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:50.953894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:50.954689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:50.956319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:50.957416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:50.958061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:50.958677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:50.964182 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:50.988226 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e40bf35-2acd-4635-9284-e573d70f0a2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 22.180229 Oct 16 01:15:50.989393 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1579/3319] 10.222.0.39 () {62 vars in 1189 bytes} [Sun Oct 16 01:15:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 22182 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:15:50.995378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-90c6abc1-7fb6-4b13-9424-ac24850496ef tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd6526dd820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:51.058383 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-90c6abc1-7fb6-4b13-9424-ac24850496ef tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.067516 Oct 16 01:15:51.059388 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1580/3320] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:50 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:51.066707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:51.068919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:51.077133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:51.077720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:51.078216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:51.079847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:51.081641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:51.082305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:51.599326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:51.610404 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f4e704a1-4fdd-41e0-8869-033dada67cff tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.549530 Oct 16 01:15:51.620419 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1581/3321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:51 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:51.631096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53ab0204-8cd2-4b01-9861-da83f80a03ff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:51.633532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53ab0204-8cd2-4b01-9861-da83f80a03ff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:51.670087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:51.706196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:51.710179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:51.719382 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82b75e3d-d2c2-43bc-bebd-4fe4d07058f2 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.779470 Oct 16 01:15:51.723523 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1741/3322] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:50 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:51.732253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:51.732975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:51.745085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:51.747940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:51.748584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:51.749479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:51.750123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:51.751680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:51.772660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-53ab0204-8cd2-4b01-9861-da83f80a03ff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:51.780505 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-53ab0204-8cd2-4b01-9861-da83f80a03ff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:51.781954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-53ab0204-8cd2-4b01-9861-da83f80a03ff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:51.783180 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53ab0204-8cd2-4b01-9861-da83f80a03ff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1285 microversion: 2.32 time: 0.161120 Oct 16 01:15:51.791331 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1582/3323] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:51 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:52.076672 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5c212df9-ceca-420b-97b4-867b504d9431 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd652758d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:52.161086 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5c212df9-ceca-420b-97b4-867b504d9431 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.088203 Oct 16 01:15:52.162957 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1583/3324] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:52 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:52.311077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:52.324490 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9836fe86-af16-4a36-ac96-44ecc92db3ac tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.599631 Oct 16 01:15:52.343174 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1742/3325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:51 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:52.351139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-133935d9-c1c8-4410-ab8f-ca478568a2d5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:52.358064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-133935d9-c1c8-4410-ab8f-ca478568a2d5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:52.358616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-133935d9-c1c8-4410-ab8f-ca478568a2d5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:52.359080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-133935d9-c1c8-4410-ab8f-ca478568a2d5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:52.388632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-133935d9-c1c8-4410-ab8f-ca478568a2d5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Going to try to stop instance {{(pid=120546) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:15:52.489849 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-133935d9-c1c8-4410-ab8f-ca478568a2d5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.144120 Oct 16 01:15:52.505569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:52.506447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:52.510507 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1584/3326] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:15:52 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:15:52.517916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:52.519987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:52.521748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:52.522613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:52.523168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:52.523608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:52.750743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:52.751782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:52.772918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:52.774291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:52.776368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:52.778512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:52.779216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:52.780379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:53.130380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:53.147225 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b200f376-89a3-4efa-8f6b-3feb7737ff19 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.646670 Oct 16 01:15:53.148801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1743/3327] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:52 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:53.168939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:53.171646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:53.197460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:53.198297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:53.199492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:53.203212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:53.208323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:53.209395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:53.754854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:53.774972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:53.781219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:53.782838 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-84a1711d-af41-478d-a795-2463d498f807 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1527 microversion: 2.32 time: 0.632580 Oct 16 01:15:53.796101 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1744/3328] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:53 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1527 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:53.798023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:53.812729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7dd1775-bcfa-4e16-9bbe-400c3f365118 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e3878b0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:53.817227 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:53.818775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:53.820039 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e69ec9dd-e010-47c6-8ece-11fd586d95ca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.074441 Oct 16 01:15:53.839376 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1585/3329] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:52 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:53.885347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7dd1775-bcfa-4e16-9bbe-400c3f365118 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.087835 Oct 16 01:15:53.887701 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1745/3330] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:53 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:54.174841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:54.175635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:54.190483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:54.191029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:54.191774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:54.199715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:54.200337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:54.201075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:54.813772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:54.815132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:54.840338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:54.840821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:54.846717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:54.851243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:54.852000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:54.852602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:55.056662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:55.066944 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a007d2f-664b-4eae-b0eb-6c4be289156c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.896703 Oct 16 01:15:55.071867 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1586/3331] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:54 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:55.085012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:55.085839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:55.099500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:55.103491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:55.104169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:55.105097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:55.105737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:55.108694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:55.207682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:55.224700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:55.232527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:55.239353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-54bba0c4-be02-43ad-a553-70f8eb34adf8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1593 microversion: 2.32 time: 0.428631 Oct 16 01:15:55.243198 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1746/3332] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:54 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1593 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:15:55.259552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1606accf-a7ad-4b73-b354-6099f7a38db1 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e1fb700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:55.366350 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1606accf-a7ad-4b73-b354-6099f7a38db1 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.122036 Oct 16 01:15:55.366964 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1747/3333] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:55 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:56.097709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:56.099623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:56.115649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:56.121391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:56.122892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:56.125639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:56.128162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:56.128926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:56.154861 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:56.166359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:56.167880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:56.172330 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e26ae647-b4de-4f82-99e4-4cc6418627e7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.098970 Oct 16 01:15:56.172914 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1587/3334] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:55 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:56.268415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:56.269059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:56.293056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:56.293556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:56.293999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:56.307346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:56.307972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:56.308496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:56.596280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:56.607561 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:56.618225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:56.620173 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-da2c6f95-ec0c-4c91-aee0-ad7c5037dbad tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1593 microversion: 2.32 time: 0.356950 Oct 16 01:15:56.621316 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1588/3335] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:56 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1593 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:15:56.636087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cca74d4a-f843-430f-9e5b-9660f2e12339 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd652830790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:56.708861 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cca74d4a-f843-430f-9e5b-9660f2e12339 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.086235 Oct 16 01:15:56.716731 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1589/3336] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:56 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:56.773122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:56.783090 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c47c6232-2d3f-4015-a80b-95351043ebfa tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.691540 Oct 16 01:15:56.797082 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1748/3337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:56 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:57.203886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:57.205535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:57.224415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:57.224937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:57.225380 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:57.226148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:57.233357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:57.233886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:57.266873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b6aa1cdc-4324-4d8f-8a23-a7f25cd0219c req-57924305-0783-43e8-9deb-a889b3e38ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3da552-c78a-4056-a089-5f43fd09c352", "name": "network-vif-plugged", "status": "completed", "tag": "d6fbc6e9-4414-402c-ad89-3992ab039f56"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:15:57.295275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b6aa1cdc-4324-4d8f-8a23-a7f25cd0219c req-57924305-0783-43e8-9deb-a889b3e38ec8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:57.296300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b6aa1cdc-4324-4d8f-8a23-a7f25cd0219c req-57924305-0783-43e8-9deb-a889b3e38ec8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:57.296961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b6aa1cdc-4324-4d8f-8a23-a7f25cd0219c req-57924305-0783-43e8-9deb-a889b3e38ec8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:57.322867 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b6aa1cdc-4324-4d8f-8a23-a7f25cd0219c req-57924305-0783-43e8-9deb-a889b3e38ec8 service nova] Creating event network-vif-plugged:d6fbc6e9-4414-402c-ad89-3992ab039f56 for instance 5f3da552-c78a-4056-a089-5f43fd09c352 on n-h2-master-1 Oct 16 01:15:57.353750 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b6aa1cdc-4324-4d8f-8a23-a7f25cd0219c req-57924305-0783-43e8-9deb-a889b3e38ec8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.594140 Oct 16 01:15:57.357310 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1590/3338] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:15:57.653520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:57.654702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:57.672293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:57.672794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:57.675675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:57.676859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:57.679540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:57.680983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:58.026097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:58.061821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:58.067631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:58.071722 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-730cd249-1128-4743-8acb-996d231f3213 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1593 microversion: 2.32 time: 0.422656 Oct 16 01:15:58.073782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1591/3339] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:57 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1593 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:15:58.098568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2e71947b-1408-4669-be33-c319b7dcd238 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e44f790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:58.215074 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2e71947b-1408-4669-be33-c319b7dcd238 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.137332 Oct 16 01:15:58.216487 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1592/3340] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:58 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:58.239191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:58.262104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:58.308644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:58.311587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:58.315464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:58.319148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:58.322707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:58.324024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:58.385619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:58.404167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:58.405653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:58.410730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7e10dff-6d73-470b-93e1-ddfb2ea93d98 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.211010 Oct 16 01:15:58.412670 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1749/3341] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:57 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:15:58.957679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:58.975477 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-52baf7aa-7b50-4e1b-88b7-aed7ee351d96 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.755180 Oct 16 01:15:58.976213 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1593/3342] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:58 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:15:59.102225 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:59.102849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:59.132029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:59.132555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:59.133001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:59.136813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:59.140756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:59.142196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:59.233074 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-371f098d-233f-47be-9fdf-1fb71d2f95ba tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd652830160>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:59.323092 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-371f098d-233f-47be-9fdf-1fb71d2f95ba tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.093610 Oct 16 01:15:59.324509 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1594/3343] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:15:59 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:15:59.442744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:15:59.443540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:15:59.454713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:59.456727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:59.457440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:59.458400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:15:59.459123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:15:59.459779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:15:59.810147 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:59.849422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:59.870441 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:59.881070 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:15:59.883639 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11bc389e-bfba-4fe5-8656-b415ced0bcdb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.445679 Oct 16 01:15:59.887080 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1595/3344] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:59 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:15:59.989323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:00.007008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:00.007785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:00.009133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:00.012556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:00.019353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b687e1f5-ea64-4957-9279-c140eb0e2fd1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1661 microversion: 2.32 time: 0.921445 Oct 16 01:16:00.029001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:00.034838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:00.035696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:00.037142 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:00.039081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:00.040294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:00.041418 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1750/3345] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:15:59 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1661 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:00.341758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1011534a-e3e8-440c-9616-226b59473901 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e3a8d30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:00.481155 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1011534a-e3e8-440c-9616-226b59473901 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.130533 Oct 16 01:16:00.484410 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1751/3346] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:00 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:00.538707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:00.549090 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f8cd356e-51f4-46a9-af04-a7963d30944a tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.547134 Oct 16 01:16:00.564931 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1596/3347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:15:59 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:00.928014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:00.928694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:00.957362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:00.957881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:00.958331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:00.965340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:00.965987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:00.966447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:01.058594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:01.060214 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:01.078448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:01.088801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:01.089855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:01.093675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:01.100247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:01.103289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:01.779744 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:01.975925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:01.998929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:02.007384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:02.010943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aff91c11-0489-4db8-8f55-1a7079550f3b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1708 microversion: 2.32 time: 0.956905 Oct 16 01:16:02.027884 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1597/3348] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:01 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1708 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:02.045089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc909a9d-02d5-4d91-91b2-025aa7e45845 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64ea13b80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:02.151466 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bc909a9d-02d5-4d91-91b2-025aa7e45845 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.120590 Oct 16 01:16:02.153795 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1598/3349] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:02 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:02.165511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:02.166636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:02.215623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:02.216137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:02.216581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:02.217307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:02.217772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:02.218202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:02.273580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:02.297974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:02.303159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:02.306371 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f72220ad-bf1a-4144-a5b5-b00aa386e3b3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.394349 Oct 16 01:16:02.322962 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1752/3350] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:00 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:02.969721 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:02.979116 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11bb85bd-13ff-4b92-a235-e8a6e1ff25f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1681 microversion: 2.1 time: 0.824010 Oct 16 01:16:02.982338 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1599/3351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:02 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1681 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:03.044373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:03.044983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:03.059119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:03.062267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:03.068254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:03.072321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:03.073010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:03.073630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:03.169002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e43d8de9-5376-45a2-a02a-b823f172d458 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e82c9d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:03.275184 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e43d8de9-5376-45a2-a02a-b823f172d458 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.109875 Oct 16 01:16:03.275914 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1600/3352] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:03 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:03.339659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:03.340275 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:03.352635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:03.355533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:03.356174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:03.357115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:03.359051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:03.360028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:04.391725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:04.402498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:04.410453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:04.411726 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf55123f-9656-4653-873f-6184aeb6e5c2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1755 microversion: 2.32 time: 1.373969 Oct 16 01:16:04.422996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1753/3353] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:03 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1755 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:04.429806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:04.430671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:04.442695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:04.447592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:04.448268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:04.449210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:04.450065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:04.454666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:04.659276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:04.687286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:04.699366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:04.705638 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a9bcca4-309a-4694-9acd-fdf8f18caae1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.366250 Oct 16 01:16:04.706254 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1601/3354] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:03 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:04.726771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d2e700b-62b7-4cb6-9d8b-216ef2148e6c tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e8271f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:04.866075 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d2e700b-62b7-4cb6-9d8b-216ef2148e6c tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.156785 Oct 16 01:16:04.867875 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1602/3355] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:04 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:05.341687 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:05.351686 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6cc40324-2c44-42ed-93b0-fdac81e8ffd7 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1658 microversion: 2.1 time: 0.926574 Oct 16 01:16:05.367411 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1754/3356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:04 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1658 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:05.387000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f928572f-6c3e-479f-99d8-6d82a7ee8e73 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:05.424161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f928572f-6c3e-479f-99d8-6d82a7ee8e73 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:05.424689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f928572f-6c3e-479f-99d8-6d82a7ee8e73 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:05.425141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f928572f-6c3e-479f-99d8-6d82a7ee8e73 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:05.454149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:05.455386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:05.467951 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:05.523927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:05.527750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:05.528237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:05.529004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:05.529477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:05.543707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:05.611447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f928572f-6c3e-479f-99d8-6d82a7ee8e73 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Going to try to start instance {{(pid=120546) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 01:16:05.724588 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:05.758640 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f928572f-6c3e-479f-99d8-6d82a7ee8e73 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.378868 Oct 16 01:16:05.775091 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1603/3357] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:16:05 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:16:05.791478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:05.805328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:05.830871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:05.837850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:05.843669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:05.844585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:05.848541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:05.849134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:06.474593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:06.494764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:06.499417 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:06.504452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ebeedbf-3f0f-4015-82ee-b27cfe4d65c6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1802 microversion: 2.32 time: 1.055171 Oct 16 01:16:06.507717 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1755/3358] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:05 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1802 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:06.514679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:06.515376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:06.549192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:06.551490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:06.553519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:06.554501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:06.567309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:06.568201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:06.937803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:06.949584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:06.964267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:06.970272 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4dfd24fd-6716-4717-a001-9a213e8fda59 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.193066 Oct 16 01:16:06.991837 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1604/3359] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:05 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:07.015783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1f75bdca-5944-4ce6-a4ff-67f497597829 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd6526ddee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:07.170017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:07.191493 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c93d3e16-c407-47e4-9116-fe4d8c4748f5 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1667 microversion: 2.1 time: 0.680558 Oct 16 01:16:07.192523 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1f75bdca-5944-4ce6-a4ff-67f497597829 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.199018 Oct 16 01:16:07.193936 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1605/3360] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:06 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:07.227485 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1756/3361] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:06 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1667 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:07.534874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:07.535397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:07.546346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:07.550172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:07.551691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:07.554587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:07.561117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:07.561957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:08.000788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:08.002598 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:08.014629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:08.015367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:08.016029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:08.019961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:08.020797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:08.021437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:08.387433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:08.407480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:08.413671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:08.415146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-29d673eb-06d1-4438-8dab-e93ee618ec99 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1802 microversion: 2.32 time: 0.885333 Oct 16 01:16:08.415966 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1606/3362] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:07 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1802 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:08.430947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2726fda4-1c0f-420c-b422-a8d7b54dbb25 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd6527a0d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:08.507829 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2726fda4-1c0f-420c-b422-a8d7b54dbb25 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.089087 Oct 16 01:16:08.517005 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1607/3363] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:08 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:08.524299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:08.527982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:08.545454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:08.545960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:08.546403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:08.547401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:08.547619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:08.548036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:09.265716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:09.288677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:09.298350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:09.302179 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b6baa27-a5e7-4044-8f50-0122ad5b8f6d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.305482 Oct 16 01:16:09.323029 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1757/3364] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:07 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:09.444711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:09.446873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:09.467567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:09.469215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:09.472296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:09.473306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:09.475677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:09.476908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:09.821517 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:09.849450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2482ecd0-91ec-46a5-b7fb-654ff731f5d2 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1667 microversion: 2.1 time: 1.334575 Oct 16 01:16:09.854175 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1608/3365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:08 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1667 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:09.870038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed601f81-8e3a-44f0-b783-f7f0a0a3e8d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e82c940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:09.978268 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed601f81-8e3a-44f0-b783-f7f0a0a3e8d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.121248 Oct 16 01:16:09.981473 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1609/3366] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:09 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:10.227770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:10.253616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:10.258497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:10.259805 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8d916f6-4795-4d00-8670-7042ea7ed1b1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1849 microversion: 2.32 time: 0.821564 Oct 16 01:16:10.271597 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1758/3367] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:09 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1849 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:10.347091 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:10.347726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:10.351101 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:10.367483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:10.367982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:10.368608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:10.371352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:10.372022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:10.373899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:10.877688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:10.878316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:10.889458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:10.889984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:10.890430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:10.901845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:10.902486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:10.902961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:10.999205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:11.014762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:11.021709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:11.034524 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3a906998-2215-4300-a0c9-799f05370a8d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.696770 Oct 16 01:16:11.035816 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1610/3368] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:10 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:11.040631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05cbf705-f42a-45cd-b10b-634aa3bcdf8b tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64dae9c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:11.133398 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-05cbf705-f42a-45cd-b10b-634aa3bcdf8b tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.096000 Oct 16 01:16:11.144823 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1611/3369] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:11 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:11.275827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:11.293842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:11.295541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:11.308931 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a2666b21-0925-4d74-ab70-2626d7ee610b tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.436441 Oct 16 01:16:11.313066 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1759/3370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:10 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:11.316373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:11.317721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:11.319478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:11.322343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:11.323059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:11.324642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:11.342577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:11.343703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:11.367397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:11.368530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:11.377178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:11.379842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:11.380556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:11.384543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:12.697399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:12.722311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:12.733610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:12.736366 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f107b0b6-a0a6-4583-a22f-39e28047ab65 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1849 microversion: 2.32 time: 1.451135 Oct 16 01:16:12.739069 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1612/3371] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:11 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1849 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:12.764800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:12.765382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:12.785590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:12.793646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:12.794390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:12.795360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:12.797573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:12.798804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:13.420131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:13.435086 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:13.438626 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-76bfaaf9-503a-485a-b51b-ba2d4f826abc tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 2.101636 Oct 16 01:16:13.439690 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1760/3372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:11 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:13.454263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8551ed04-b96e-48e4-b1c5-b347b3378e79 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e62a3a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:13.543206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8551ed04-b96e-48e4-b1c5-b347b3378e79 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.093656 Oct 16 01:16:13.555293 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1761/3373] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:13 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:13.566166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:13.572893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:13.585038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:13.585454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:13.585898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:13.586612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:13.593545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:13.599214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:13.711974 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:13.724934 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:13.732442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:13.733869 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2cf1fe8a-c3c2-446a-8a7f-0c49979c84cc tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.987178 Oct 16 01:16:13.737492 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1613/3374] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:12 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:13.763785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:13.764879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:13.777332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:13.778713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:13.781433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:13.784144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:13.785983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:13.786600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:14.322984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:14.336722 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c9fc4e5-6ea9-49bc-b494-38ada0800962 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.772295 Oct 16 01:16:14.337375 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1762/3375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:13 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:14.707878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:14.726538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:14.738400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:14.744576 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c27ea7a-f37a-4b05-90a0-c34c6457fc1c tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1849 microversion: 2.32 time: 0.985328 Oct 16 01:16:14.750943 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1614/3376] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:13 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1849 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:14.759226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:14.774082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-decee347-f151-422b-92f9-2aa112df71ed req-7491a735-1dad-470e-898f-738cef9da410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "tag": "6ae41fd0-83d8-42e9-b4e5-8d61d0a332d2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:14.786419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:14.805374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:14.806268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:14.807117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-decee347-f151-422b-92f9-2aa112df71ed req-7491a735-1dad-470e-898f-738cef9da410 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:14.807823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-decee347-f151-422b-92f9-2aa112df71ed req-7491a735-1dad-470e-898f-738cef9da410 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:14.808114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:14.808640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-decee347-f151-422b-92f9-2aa112df71ed req-7491a735-1dad-470e-898f-738cef9da410 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:14.810154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:14.811727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:14.814213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:14.844053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-decee347-f151-422b-92f9-2aa112df71ed req-7491a735-1dad-470e-898f-738cef9da410 service nova] Creating event network-changed:6ae41fd0-83d8-42e9-b4e5-8d61d0a332d2 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:16:14.860393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-decee347-f151-422b-92f9-2aa112df71ed req-7491a735-1dad-470e-898f-738cef9da410 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.517357 Oct 16 01:16:14.865105 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1763/3377] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:14.880475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e691f64-017a-4e34-ab76-3dc6a072733e tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e62af70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:14.993931 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e691f64-017a-4e34-ab76-3dc6a072733e tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.121404 Oct 16 01:16:14.995145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1764/3378] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:14 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:15.008778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:15.010679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:15.029507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:15.030648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:15.033999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:15.037812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:15.038486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:15.039133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:15.803526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:15.814453 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0106de60-0be3-450f-8db3-03ebe3577596 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 1.058652 Oct 16 01:16:15.819755 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1615/3379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:14 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:15.828153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:15.835736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:15.854893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:15.870563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:15.872019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:15.873850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:15.877757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e56c6d7f-d5ac-4b98-b522-d96ff4aa644e tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.881276 Oct 16 01:16:15.882584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:15.884166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:15.898945 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1765/3380] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:14 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:15.899273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:15.899273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:15.899273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:15.899554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:15.899554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:15.926013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:15.931142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:15.931823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:15.932707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:15.933301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:15.933863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:16.691233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:16.733096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:16.734493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:16.744914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:16.752092 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be3783f6-a4ad-4189-b1cd-d5c414995b07 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 0.858985 Oct 16 01:16:16.753429 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1766/3381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:15 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:16.757247 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-513dda8d-6c50-43f3-890b-31cc3faacfe3 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1870 microversion: 2.32 time: 0.927527 Oct 16 01:16:16.763520 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1616/3382] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:15 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1870 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:16.763806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99d06ee9-af52-4086-9ed4-7feead74260e tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e542d30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:16.825626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e2dbf945-6c27-410d-b213-cac6704c3d32 req-5afe059b-e150-40a1-a0a2-be85243dbf9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-plugged", "status": "completed", "tag": "3906f22f-b88f-45bd-af84-22eb74721ab9"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:16.915233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e2dbf945-6c27-410d-b213-cac6704c3d32 req-5afe059b-e150-40a1-a0a2-be85243dbf9f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:16.922304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e2dbf945-6c27-410d-b213-cac6704c3d32 req-5afe059b-e150-40a1-a0a2-be85243dbf9f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:16.923832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e2dbf945-6c27-410d-b213-cac6704c3d32 req-5afe059b-e150-40a1-a0a2-be85243dbf9f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:16.937646 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-99d06ee9-af52-4086-9ed4-7feead74260e tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.182916 Oct 16 01:16:16.938614 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1767/3383] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:16 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:16.959593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:16.960349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:16.973479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:16.976366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:16.978654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:16.981671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:16.982421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:16.983073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:16.997483 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e2dbf945-6c27-410d-b213-cac6704c3d32 req-5afe059b-e150-40a1-a0a2-be85243dbf9f service nova] Creating event network-vif-plugged:3906f22f-b88f-45bd-af84-22eb74721ab9 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:16:17.019010 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e2dbf945-6c27-410d-b213-cac6704c3d32 req-5afe059b-e150-40a1-a0a2-be85243dbf9f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252450 Oct 16 01:16:17.019931 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1617/3384] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:17.031341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:17.035611 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:17.045927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lazy-loading 'flavor' on Instance uuid c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:16:17.049308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:17.049816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:17.050259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:17.051002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:17.051739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:17.052175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:17.290833 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a73d323-7373-43be-be0a-7074f72c5896 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.334974 Oct 16 01:16:17.295675 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1768/3385] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:16:16 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:16:17.325210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:17.327855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:17.357992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:17.363981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:17.367012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:17.369924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:17.370601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:17.373642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:18.429198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:18.452170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:18.456084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:18.460503 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f64f2e18-d025-4c72-8de7-ac9a0ce0ee11 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.439236 Oct 16 01:16:18.462066 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1618/3386] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:17 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:18.475800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:18.479437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:18.523313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:18.524132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:18.528043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:18.530292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:18.530989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:18.531590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:18.582157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:18.604022 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-151a8f17-e993-4e3b-8a79-cb786115126f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1679 microversion: 2.1 time: 1.299815 Oct 16 01:16:18.608273 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1769/3387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:17 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1679 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:18.629303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6cea028-6ca1-4fe3-b23b-2be1a325845b tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e687790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:18.758060 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f6cea028-6ca1-4fe3-b23b-2be1a325845b tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.148427 Oct 16 01:16:18.760835 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1770/3388] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:18 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:18.765795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-bdf0d171-b945-436e-af76-8c6c98152778 req-bd6b45df-f086-4983-ab53-863a52466719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "tag": "6232908a-2443-4f5d-9f4e-ab5cbda8380a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:18.781940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bdf0d171-b945-436e-af76-8c6c98152778 req-bd6b45df-f086-4983-ab53-863a52466719 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:18.783342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bdf0d171-b945-436e-af76-8c6c98152778 req-bd6b45df-f086-4983-ab53-863a52466719 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:18.783946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bdf0d171-b945-436e-af76-8c6c98152778 req-bd6b45df-f086-4983-ab53-863a52466719 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:18.797109 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-bdf0d171-b945-436e-af76-8c6c98152778 req-bd6b45df-f086-4983-ab53-863a52466719 service nova] Creating event network-changed:6232908a-2443-4f5d-9f4e-ab5cbda8380a for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:16:18.805197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-bdf0d171-b945-436e-af76-8c6c98152778 req-bd6b45df-f086-4983-ab53-863a52466719 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042747 Oct 16 01:16:18.806488 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1771/3389] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:19.498769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:19.498769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:19.508542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:19.514467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:19.515133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:19.515912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:19.516404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:19.517532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:19.566831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:19.596384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:19.604738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:19.607973 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b49417db-55dd-4027-a3d8-824584b3e811 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1870 microversion: 2.32 time: 1.142622 Oct 16 01:16:19.623529 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1619/3390] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:18 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1870 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:19.651021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:19.660680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:19.696094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:19.697914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:19.699505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:19.705530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:19.706404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:19.708672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:20.355398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:20.369378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:20.371172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:20.377117 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ee83cfd1-07ee-4a19-9c71-766e2690140f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.890560 Oct 16 01:16:20.378956 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1772/3391] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:19 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:20.393589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-48c8bcdd-ec08-46b6-819c-3522997755ac tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e206280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:20.530646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:20.549924 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eea0253e-1cbf-4134-a72a-71cbf6a0dec3 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1662 microversion: 2.1 time: 0.917932 Oct 16 01:16:20.570905 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1620/3392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:19 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1662 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:20.601340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:20.602047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:20.618860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:20.620916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:20.659071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:20.661933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:20.664014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:20.665988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:20.866873 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd3fa541-2087-41f8-9df7-3b720b616548 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action" status: 202 len: 0 microversion: 2.1 time: 0.286342 Oct 16 01:16:20.874166 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1621/3393] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:16:20 2022] POST /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:16:20.902547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:20.905626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:20.936915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:20.939492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:20.940190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:20.941136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:20.941968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:20.942621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:21.014779 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-48c8bcdd-ec08-46b6-819c-3522997755ac tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.631069 Oct 16 01:16:21.018069 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1773/3394] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:20 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:21.057134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:21.057935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:21.081705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:21.082226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:21.082678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:21.083453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:21.097874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:21.099709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:22.560970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:22.581768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:22.593232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:22.608291 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37f06ca6-ac9d-4fbf-9f94-713e484dca2d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1870 microversion: 2.32 time: 1.719232 Oct 16 01:16:22.609162 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1622/3395] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:20 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1870 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:22.613556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:22.616866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:22.617479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:22.639270 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-04b5b2d7-aac4-4061-9260-fd1750f7f79d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1668 microversion: 2.1 time: 1.612229 Oct 16 01:16:22.641475 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1774/3396] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:21 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1668 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:22.656405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bec2b597-f52f-4aaa-99d7-2ebcbd7b7915 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e464e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:22.658809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:22.668441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:22.670452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:22.672083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:22.675199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:22.676004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:22.750825 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bec2b597-f52f-4aaa-99d7-2ebcbd7b7915 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.107969 Oct 16 01:16:22.759387 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1775/3397] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:22 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:23.507316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:23.536252 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:23.538283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:23.544942 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01665f39-4ad7-4c01-b4e9-b53ee80c4d75 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.934680 Oct 16 01:16:23.550075 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1623/3398] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:22 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:23.646658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:23.650037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:23.663796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:23.665154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:23.678943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:23.682369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:23.682869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:23.683344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:23.684071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:23.684531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:23.689703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:23.690643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:23.693497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:23.695343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:23.700213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:23.701074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:23.717706 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:24.749316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:24.764626 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c7d6a57-436e-4449-a68d-e3b81ec8a98c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1668 microversion: 2.1 time: 1.104528 Oct 16 01:16:24.765226 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1624/3399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:23 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1668 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:24.775494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:24.787296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:24.799000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-96a4c6c2-7baa-419e-aa29-d70a77e46a9c tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e82cd30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:24.801612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:24.812575 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b3893a2-6f8e-4083-9f77-5846649afdb7 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1891 microversion: 2.32 time: 1.175091 Oct 16 01:16:24.816061 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1776/3400] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:23 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1891 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:24.840559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-7c926dc2-f6b0-4b57-b457-1e6e0e1a0fa6 req-1280203e-c29d-4aaf-b0b7-aa84bc1de212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-plugged", "status": "completed", "tag": "f7e6e0d5-ea9e-40be-817f-0b90f99facfc"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:24.857445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7c926dc2-f6b0-4b57-b457-1e6e0e1a0fa6 req-1280203e-c29d-4aaf-b0b7-aa84bc1de212 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:24.858214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7c926dc2-f6b0-4b57-b457-1e6e0e1a0fa6 req-1280203e-c29d-4aaf-b0b7-aa84bc1de212 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:24.858832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7c926dc2-f6b0-4b57-b457-1e6e0e1a0fa6 req-1280203e-c29d-4aaf-b0b7-aa84bc1de212 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:24.874525 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-7c926dc2-f6b0-4b57-b457-1e6e0e1a0fa6 req-1280203e-c29d-4aaf-b0b7-aa84bc1de212 service nova] Creating event network-vif-plugged:f7e6e0d5-ea9e-40be-817f-0b90f99facfc for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:16:24.883013 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-7c926dc2-f6b0-4b57-b457-1e6e0e1a0fa6 req-1280203e-c29d-4aaf-b0b7-aa84bc1de212 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064912 Oct 16 01:16:24.884732 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1777/3401] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:24.891478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:24.892945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:24.901855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:24.902684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:24.903361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:24.904496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:24.907847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:24.908743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:24.920388 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-96a4c6c2-7baa-419e-aa29-d70a77e46a9c tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.153833 Oct 16 01:16:24.921830 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1625/3402] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:24 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:25.730163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:25.746384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:25.756354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:25.758017 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4725f0f-d4cf-4142-96a4-fb2a1be3be31 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 0.871923 Oct 16 01:16:25.759584 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1778/3403] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:24 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:25.790856 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:25.792253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:25.806840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:25.812964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:25.814386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:25.817712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:25.819120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:25.823675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:25.841656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:25.842551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:25.864650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:25.866245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:25.867668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:25.868518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:25.871504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:25.872057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:27.669850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:27.689978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:27.709812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:27.717467 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-35b1d15c-5b13-4b79-800d-3cfad8fd0a42 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1891 microversion: 2.32 time: 1.879538 Oct 16 01:16:27.728031 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1779/3404] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:25 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1891 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:27.765669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-678cc475-31f9-424b-9c58-ea8473c73433 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e08f550>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:27.826045 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:27.845615 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4b78831-21a9-4955-9819-3a9b86c95562 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1668 microversion: 2.1 time: 2.059220 Oct 16 01:16:27.849226 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1626/3405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:25 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1668 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:27.872229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-4b02db02-8550-4e87-b4fe-f73afd006a81 req-dbb2fdb7-a655-46c2-b837-90f7a4317da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "tag": "6eae5487-8226-4e36-857f-2781b0723f1e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:27.931417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4b02db02-8550-4e87-b4fe-f73afd006a81 req-dbb2fdb7-a655-46c2-b837-90f7a4317da3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:27.932224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4b02db02-8550-4e87-b4fe-f73afd006a81 req-dbb2fdb7-a655-46c2-b837-90f7a4317da3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:27.934315 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-678cc475-31f9-424b-9c58-ea8473c73433 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.203255 Oct 16 01:16:27.935579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4b02db02-8550-4e87-b4fe-f73afd006a81 req-dbb2fdb7-a655-46c2-b837-90f7a4317da3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:27.948152 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1780/3406] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:27 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:27.960755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:27.961389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:27.987485 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-4b02db02-8550-4e87-b4fe-f73afd006a81 req-dbb2fdb7-a655-46c2-b837-90f7a4317da3 service nova] Creating event network-changed:6eae5487-8226-4e36-857f-2781b0723f1e for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:16:28.001000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:28.002990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:28.003457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:28.004421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:28.004754 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-4b02db02-8550-4e87-b4fe-f73afd006a81 req-dbb2fdb7-a655-46c2-b837-90f7a4317da3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154234 Oct 16 01:16:28.008014 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1627/3407] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:28.008698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:28.009349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:28.015158 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e29416a8-64d0-4a84-ab98-ff97cc0f01ef req-38e5d066-1ae9-474d-a018-7244a91215ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-plugged", "status": "completed", "tag": "547d449f-ecbd-47ce-a60f-af7bad8cb901"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:28.045469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e29416a8-64d0-4a84-ab98-ff97cc0f01ef req-38e5d066-1ae9-474d-a018-7244a91215ae service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:28.045978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e29416a8-64d0-4a84-ab98-ff97cc0f01ef req-38e5d066-1ae9-474d-a018-7244a91215ae service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:28.046409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e29416a8-64d0-4a84-ab98-ff97cc0f01ef req-38e5d066-1ae9-474d-a018-7244a91215ae service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:28.068102 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e29416a8-64d0-4a84-ab98-ff97cc0f01ef req-38e5d066-1ae9-474d-a018-7244a91215ae service nova] Creating event network-vif-plugged:547d449f-ecbd-47ce-a60f-af7bad8cb901 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:16:28.080638 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e29416a8-64d0-4a84-ab98-ff97cc0f01ef req-38e5d066-1ae9-474d-a018-7244a91215ae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071147 Oct 16 01:16:28.087936 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1628/3408] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:28.759746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:28.760942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:28.772328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:28.775219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:28.775985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:28.787389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:28.788237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:28.788908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:29.401971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:29.417434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:29.421335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:29.424180 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8482c2b5-9260-4135-9645-3642f9131ed8 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.474323 Oct 16 01:16:29.426990 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1781/3409] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:27 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:29.439704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:29.440487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:29.463561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:29.471040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:29.471918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:29.473927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:29.475931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:29.478019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:30.106632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:30.142854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:30.146437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:30.148490 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6c7dfb51-baf8-4033-8fb7-30f73f95c86b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1891 microversion: 2.32 time: 1.393744 Oct 16 01:16:30.172251 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1629/3410] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:28 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1891 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:30.205790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8cfcc894-5cca-4485-8443-78735c289a8a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64dab1c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:30.305928 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8cfcc894-5cca-4485-8443-78735c289a8a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1427 microversion: 2.1 time: 0.129432 Oct 16 01:16:30.306527 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1630/3411] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:30 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:30.324954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-plugged", "status": "completed", "tag": "2255ee2d-6056-4dcf-a235-38289bda0980"}, {"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-plugged", "status": "completed", "tag": "3811721c-014f-4626-9fbf-6567a6f833aa"}, {"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-plugged", "status": "completed", "tag": "2601fd55-e7bc-4577-b604-f788d6cf784d"}, {"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-plugged", "status": "completed", "tag": "ef822297-368f-4d3b-b62b-2b48e310bdbe"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:30.383715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:30.391567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:30.393507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:30.410747 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] Creating event network-vif-plugged:2255ee2d-6056-4dcf-a235-38289bda0980 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:16:30.411741 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] Creating event network-vif-plugged:3811721c-014f-4626-9fbf-6567a6f833aa for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:16:30.412889 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] Creating event network-vif-plugged:2601fd55-e7bc-4577-b604-f788d6cf784d for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:16:30.413561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] Creating event network-vif-plugged:ef822297-368f-4d3b-b62b-2b48e310bdbe for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:16:30.420362 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ee937605-bb61-40d5-bc66-e4a540edde99 req-2eea5d12-3da6-47a5-a4a6-cef15a47ad71 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.112557 Oct 16 01:16:30.421703 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1631/3412] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:30.446518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:30.459411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:30.460575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:30.470288 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69491d47-f977-4a72-802b-dd85793ab670 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 1.040130 Oct 16 01:16:30.482621 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1782/3413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:29 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:30.483041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:30.483041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:30.483041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:30.486504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:30.487815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:30.490576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:30.496318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:30.496937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:30.509354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:30.510805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:30.511290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:30.512020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:30.512489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:30.512926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:31.798897 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:31.814274 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-86f0ef2a-aa07-415c-bdae-9905389bfe85 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1671 microversion: 2.1 time: 1.321850 Oct 16 01:16:31.814990 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1783/3414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:30 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1671 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:31.847815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4039749a-2941-4442-883d-8d00ce6425b3 req-d6d3a079-fd8c-46e8-95b8-260b64d99a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "tag": "79104e9d-c9a5-4a7e-a71d-9b185dcbe67f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:31.866366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4039749a-2941-4442-883d-8d00ce6425b3 req-d6d3a079-fd8c-46e8-95b8-260b64d99a41 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:31.867226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4039749a-2941-4442-883d-8d00ce6425b3 req-d6d3a079-fd8c-46e8-95b8-260b64d99a41 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:31.867883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4039749a-2941-4442-883d-8d00ce6425b3 req-d6d3a079-fd8c-46e8-95b8-260b64d99a41 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:31.880941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:31.882815 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4039749a-2941-4442-883d-8d00ce6425b3 req-d6d3a079-fd8c-46e8-95b8-260b64d99a41 service nova] Creating event network-changed:79104e9d-c9a5-4a7e-a71d-9b185dcbe67f for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:16:31.895944 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4039749a-2941-4442-883d-8d00ce6425b3 req-d6d3a079-fd8c-46e8-95b8-260b64d99a41 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054291 Oct 16 01:16:31.897741 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1784/3415] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:31.911924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:31.914251 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:31.915939 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-55cd3252-16bd-4956-9259-055457804a25 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1874 microversion: 2.42 time: 1.462539 Oct 16 01:16:31.917165 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1632/3416] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:30 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1874 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:31.936186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:31.936949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:31.948476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-680cd3b6-4fbc-4ab8-a919-4a4e50d5b6fe tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64dae9c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:31.952358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:31.952988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:31.953438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:31.954177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:31.955582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:31.956183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:32.021161 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:32.031373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-680cd3b6-4fbc-4ab8-a919-4a4e50d5b6fe tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1436 microversion: 2.1 time: 0.112813 Oct 16 01:16:32.034638 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1633/3417] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:31 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1436 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:32.044937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:32.048771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:32.101948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:32.102502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:32.103002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:32.103748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:32.104396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:32.105002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:32.166636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:16:32.185536 n-d-master-1 devstack@n-api.service[120546]: INFO nova.compute.api [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Working on deleting snapshot 75da16d8-c847-430c-9f81-2f84ddcd13bb from shelved instance... Oct 16 01:16:32.817820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:32.844493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:32.846888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:32.849404 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e560b1f4-9756-45f8-9953-84cdb9b27efd tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.948732 Oct 16 01:16:32.858398 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1785/3418] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:31 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:32.864945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c29b6bf-eae8-4c2f-8803-f3ac12dd1e57 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e139940>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:33.206136 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c29b6bf-eae8-4c2f-8803-f3ac12dd1e57 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 200 len: 1436 microversion: 2.1 time: 0.345792 Oct 16 01:16:33.206728 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1786/3419] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:16:32 2022] GET /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 1436 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:33.635908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Doing local delete in cell 15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) {{(pid=120546) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 16 01:16:33.637242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:33.637899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:33.638503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:33.639132 n-d-master-1 devstack@n-api.service[120546]: INFO nova.compute.api [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 16 01:16:33.644028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] deallocate_for_instance() {{(pid=120546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 16 01:16:33.745931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ca0a9f6-1e01-40ad-8ab7-e5e052c943a0 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Action: 'create', calling method: .version_select at 0x7fd64e66cf70>, body: {"keypair": {"name": "tempest-keypair-206582404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO8FLxQf1sTUGHwh1Auf8X4S3BRiY7/js/QqT4LeXDy+GZpsLiO4tjOOV5T5U1coZtt2xLy1+z8xmvPxPvzJ6cbhpg6JhGCyIf/WbPMbvrmznCiuSkTFZyAsPg//3jVJg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:33.799397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5ca0a9f6-1e01-40ad-8ab7-e5e052c943a0 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Getting quotas for project ba3c4e3bdfdc43cea845dab830afc479. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:16:33.814033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5ca0a9f6-1e01-40ad-8ab7-e5e052c943a0 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Getting quotas for user 374430fde21f45418245b0848be3f34b and project ba3c4e3bdfdc43cea845dab830afc479. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:16:33.863761 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ca0a9f6-1e01-40ad-8ab7-e5e052c943a0 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.651443 Oct 16 01:16:33.872147 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1787/3420] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:16:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:33.882083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:33.883740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:33.898819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:33.900040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:33.901161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:33.903854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:33.905878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:33.906442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:34.650162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:34.676792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:34.692645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:34.694307 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-adc9fa72-4130-4231-9ae5-33972e4e51d5 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2833 microversion: 2.42 time: 0.820640 Oct 16 01:16:34.697123 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1788/3421] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:33 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2833 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:34.702801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:34.710887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:34.728689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:34.729205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:34.729668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:34.730387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:34.730855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:34.747239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:35.617036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:35.628668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f9ada482-17b8-4381-bd79-d865359d1914 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1466 microversion: 2.1 time: 0.927198 Oct 16 01:16:35.630069 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1789/3422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:34 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1466 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:35.647052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:35.648106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:35.655991 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:35.659373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:35.664865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:35.665570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:35.666486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:35.667152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:35.669372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:36.322237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:36.338115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:36.339660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:36.352348 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-81f1e0e7-91dc-44a5-9424-2da8a2a2d0ab tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.720897 Oct 16 01:16:36.353542 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1790/3423] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:35 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:36.367381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d3933671-d056-48f9-9ae3-3dbe222e5c82 req-8c73a679-9b20-4a19-9a5e-f09773d2b6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3da552-c78a-4056-a089-5f43fd09c352", "name": "network-vif-unplugged", "status": "completed", "tag": "d6fbc6e9-4414-402c-ad89-3992ab039f56"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:36.383055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d3933671-d056-48f9-9ae3-3dbe222e5c82 req-8c73a679-9b20-4a19-9a5e-f09773d2b6da service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:36.383548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d3933671-d056-48f9-9ae3-3dbe222e5c82 req-8c73a679-9b20-4a19-9a5e-f09773d2b6da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:36.383985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d3933671-d056-48f9-9ae3-3dbe222e5c82 req-8c73a679-9b20-4a19-9a5e-f09773d2b6da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:36.420716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d3933671-d056-48f9-9ae3-3dbe222e5c82 req-8c73a679-9b20-4a19-9a5e-f09773d2b6da service nova] Creating event network-vif-unplugged:d6fbc6e9-4414-402c-ad89-3992ab039f56 for instance 5f3da552-c78a-4056-a089-5f43fd09c352 on n-h2-master-1 Oct 16 01:16:36.427279 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d3933671-d056-48f9-9ae3-3dbe222e5c82 req-8c73a679-9b20-4a19-9a5e-f09773d2b6da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071989 Oct 16 01:16:36.427898 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1791/3424] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:36.439614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:36.440589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:36.458674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:36.459484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:36.460128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:36.461065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:36.461751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:36.462438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:36.691083 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-952b0a34-a139-45cb-ac5d-4a91fce7a05f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.261563 Oct 16 01:16:36.692412 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1792/3425] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Oct 16 01:16:36 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345/os-interface => generated 1833 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:36.697267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7aa3e672-c8f8-4849-ae76-1b0782588bed tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64e419ee0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:37.297550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Updating instance_info_cache with network_info: [] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:16:37.827283 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7aa3e672-c8f8-4849-ae76-1b0782588bed tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "DELETE /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f" status: 204 len: 0 microversion: 2.1 time: 1.132288 Oct 16 01:16:37.828286 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1793/3426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:36 2022] DELETE /compute/v2.1/images/a3b967c9-28f0-486e-a09b-1ce715dedc9f => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:16:37.885929 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0ae09338-1621-4401-a38f-de332669a0ed tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 204 len: 0 microversion: 2.1 time: 5.849942 Oct 16 01:16:37.887326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1634/3427] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:16:32 2022] DELETE /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 0 bytes in 5852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:16:37.895360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-7b49659a-7596-4611-9df9-7c0e568c7f24 req-9e2414f3-c894-4920-9f6d-87a2145f569b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "tag": "c8ad3925-dc7f-4b61-a13a-cc7ae0c226c4"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:37.910794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7b49659a-7596-4611-9df9-7c0e568c7f24 req-9e2414f3-c894-4920-9f6d-87a2145f569b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:37.911513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7b49659a-7596-4611-9df9-7c0e568c7f24 req-9e2414f3-c894-4920-9f6d-87a2145f569b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:37.913770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7b49659a-7596-4611-9df9-7c0e568c7f24 req-9e2414f3-c894-4920-9f6d-87a2145f569b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:37.934146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-7b49659a-7596-4611-9df9-7c0e568c7f24 req-9e2414f3-c894-4920-9f6d-87a2145f569b service nova] Creating event network-changed:c8ad3925-dc7f-4b61-a13a-cc7ae0c226c4 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:16:37.942952 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-7b49659a-7596-4611-9df9-7c0e568c7f24 req-9e2414f3-c894-4920-9f6d-87a2145f569b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052911 Oct 16 01:16:37.944245 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1635/3428] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:38.253541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-61136220", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "568274da-df36-43fc-b668-f6a872d918ce"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:38.277774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5def96d6-678c-462e-9dd3-be8ffd0911aa req-76512ec2-3722-4db3-a607-d7691e5a3a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8", "name": "network-vif-deleted", "tag": "f51d946f-90c4-477a-a66e-65be4d8cd928"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:38.298989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5def96d6-678c-462e-9dd3-be8ffd0911aa req-76512ec2-3722-4db3-a607-d7691e5a3a61 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:38.299658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5def96d6-678c-462e-9dd3-be8ffd0911aa req-76512ec2-3722-4db3-a607-d7691e5a3a61 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:38.305401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5def96d6-678c-462e-9dd3-be8ffd0911aa req-76512ec2-3722-4db3-a607-d7691e5a3a61 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:38.362828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.server_external_events [req-5def96d6-678c-462e-9dd3-be8ffd0911aa req-76512ec2-3722-4db3-a607-d7691e5a3a61 service nova] Unable to find a host for instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8. Dropping event network-vif-deleted {{(pid=120546) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 16 01:16:38.365862 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5def96d6-678c-462e-9dd3-be8ffd0911aa req-76512ec2-3722-4db3-a607-d7691e5a3a61 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.418511 Oct 16 01:16:38.378992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] validate_networks() for [('568274da-df36-43fc-b668-f6a872d918ce', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:16:38.379678 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1636/3429] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 434 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 16 01:16:38.391062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:38.392642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:38.401514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:38.402492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:38.403171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:38.404105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:38.404724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:38.405309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:39.472450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:39.496062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:39.504722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:39.507262 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-90b09ffe-be35-4c2a-bf46-f23fc7150841 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 1.123412 Oct 16 01:16:39.508367 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1637/3430] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:38 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:39.514191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe8f1b01-cd91-4f78-874a-e2dc8705b5a4 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '.version_select at 0x7fd64d73bb80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:39.554839 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-fe8f1b01-cd91-4f78-874a-e2dc8705b5a4 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] HTTP exception thrown: Image not found. Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe8f1b01-cd91-4f78-874a-e2dc8705b5a4 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Request method failure captured: Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 HTTP/1.1 Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1sLRz-M1p_K7qkqs2YTFAzdJIUrvHRH-3yuUyySIvTOWavKfoPYZJsjfjpJeh6wMyT_rwsR85AaPMoi7bneqGdbBqvEXXoYSPw451q71dln8jsOOJO5oMfyjGXAiphExiH2QucbI34X8bBDnf0VmsDxSGuNF_b-YjeDJjBT71ycdmQ Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: ec64ba1a19d54d38aecbabcd25b075da Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec64ba1a19d54d38aecbabcd25b075da", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: ec64ba1a19d54d38aecbabcd25b075da Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesOneServerTestJSON-348139423-project Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 7c1e0fc9ff7e4c0da77439e27166264f Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesOneServerTestJSON-348139423-project Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4833bb37-de6c-4b1e-9af0-cce0e9fc6e29'} Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 to delete Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 could not be found. Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.568139 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:16:39.573419 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.578322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe8f1b01-cd91-4f78-874a-e2dc8705b5a4 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:16:39.579913 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fe8f1b01-cd91-4f78-874a-e2dc8705b5a4 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "DELETE /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29" status: 404 len: 62 microversion: 2.1 time: 0.070230 Oct 16 01:16:39.580501 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1638/3431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:39 2022] DELETE /compute/v2.1/images/4833bb37-de6c-4b1e-9af0-cce0e9fc6e29 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:16:39.588426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:39.589369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:39.600625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:39.601127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:39.601638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:39.602352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:39.603786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:39.604396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:39.625107 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] HTTP exception thrown: Instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 could not be found. Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Request method failure captured: Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 HTTP/1.1 Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1lCQssGoLCMTEsVMxK-f6QYxp_nX9s1U_rgMVcFCuMNSWEj-XbEz5zL0fxYzYm8bfkANKAnDQ-EKcPXRqRLjNfVJQtzFY6v1LO99t-h7BlAjJTxhH4ZuAOw2s3x8zmxyligHjIsACPLjAzGVmPXDbD8mG6VEANNtObMLP94eBVvVlc Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb799a0263a14d1a93ba6e3fd37c260a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 0c8da9a32cb54d0a87d914234b1e9f40 Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 could not be found. Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8'} Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 could not be found. Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 could not be found. Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:39.629783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.635806 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:39.635806 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:39.635806 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:39.635806 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:16:39.635806 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:16:39.635806 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 could not be found. Oct 16 01:16:39.635806 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:39.638238 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Returning 404 to user: Instance 98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:16:39.639344 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c40990c2-3448-4ac6-930f-954377b99132 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8" status: 404 len: 111 microversion: 2.1 time: 0.057846 Oct 16 01:16:39.640908 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1639/3432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:39 2022] GET /compute/v2.1/servers/98d6cc8b-7cb8-4cf6-9f36-76d98a71c8e8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:16:39.648255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:39.650328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:39.656468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:39.657288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:39.658068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:39.659027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:39.659713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:39.660361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:39.698547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:16:39.904053 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:39.977002 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-83862dd8-b5a5-4e57-8a6a-7547cce9e855 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 204 len: 0 microversion: 2.1 time: 0.332211 Oct 16 01:16:39.983155 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1640/3433] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:16:39 2022] DELETE /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:16:39.992520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:39.995112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:40.011269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:40.014149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:40.014779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:40.015695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:40.016378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:40.022742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:40.057964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:16:40.059411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:16:40.064943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:16:40.065890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:16:40.066493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:16:40.069893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:16:40.078592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:40.080024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:40.080801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:40.084535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:40.085438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:40.086188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:40.140893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Getting quotas for project 16773b3925f648bbade2e6bf967a3fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:16:40.155641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Getting quotas for user f1bfe0b4f344485ab6de52f7b1423118 and project 16773b3925f648bbade2e6bf967a3fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:16:40.172800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:16:40.175895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:16:40.233124 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0f9bfb64-1d67-4b9e-b1b4-7b9b4737e58c tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 204 len: 0 microversion: 2.1 time: 0.247539 Oct 16 01:16:40.234144 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1641/3434] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:16:39 2022] DELETE /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:16:40.247092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9cc4dca7-70de-465d-b535-b8f5fe69e391 req-be1ad00b-2c7f-4cf3-ae58-91b9ca9fc3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "tag": "6226c3c9-8fe3-4a03-a63f-47872bcfc9d2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:40.289196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9cc4dca7-70de-465d-b535-b8f5fe69e391 req-be1ad00b-2c7f-4cf3-ae58-91b9ca9fc3de service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:40.290261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9cc4dca7-70de-465d-b535-b8f5fe69e391 req-be1ad00b-2c7f-4cf3-ae58-91b9ca9fc3de service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:40.290261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9cc4dca7-70de-465d-b535-b8f5fe69e391 req-be1ad00b-2c7f-4cf3-ae58-91b9ca9fc3de service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:40.299848 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-757c078f-5d9a-4915-b859-859d57492534 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.466868 Oct 16 01:16:40.307416 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1794/3435] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:16:40.325741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:40.326513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:40.345913 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9cc4dca7-70de-465d-b535-b8f5fe69e391 req-be1ad00b-2c7f-4cf3-ae58-91b9ca9fc3de service nova] Creating event network-changed:6226c3c9-8fe3-4a03-a63f-47872bcfc9d2 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:16:40.347786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:40.350685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:40.351302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:40.352216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:40.352785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:40.353317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:40.357796 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9cc4dca7-70de-465d-b535-b8f5fe69e391 req-be1ad00b-2c7f-4cf3-ae58-91b9ca9fc3de service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121937 Oct 16 01:16:40.365961 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1642/3436] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:40.373991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1721920830", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "73f92042-fc74-4652-9c90-b2469362513b"}], "security_groups": [{"name": "tempest-securitygroup--702533527"}], "key_name": "tempest-keypair-206582404", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:40.859057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] validate_networks() for [('73f92042-fc74-4652-9c90-b2469362513b', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:16:41.145744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:41.160514 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-447b7073-dfeb-48f1-9592-fca440e8bc33 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1472 microversion: 2.1 time: 0.851878 Oct 16 01:16:41.162268 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1795/3437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:40 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1472 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:41.168091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:41.168763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:41.183246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:41.184005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:41.184995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:41.185900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:41.191689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:41.192558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:41.441674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:41.451337 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b078aa1a-b422-43f3-bb5b-9fba800b3a20 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1464 microversion: 2.1 time: 0.287068 Oct 16 01:16:41.452932 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1796/3438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:41 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:41.459247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:41.459860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:41.466304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:41.466796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:41.467320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:41.468080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:41.468543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:41.468977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:41.483145 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:41.662482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:41.673280 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bcd2e41e-8296-4b04-a6ac-7ad3ddadd800 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1220 microversion: 2.1 time: 0.217201 Oct 16 01:16:41.680358 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1797/3439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:41 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1220 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:41.708011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:41.708790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:41.723442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:41.727459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:41.728072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:41.729452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:41.730628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:41.731180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:42.748291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:42.778060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:42.784827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:42.786511 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c5359385-ca68-4572-9042-6a0745de751d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 1.104650 Oct 16 01:16:42.789581 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1798/3440] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:41 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:42.795056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4de8ad7b-00a0-4735-8a22-93cd0d93179c req-4fe84e80-6cb2-4e3f-8536-881bad2afb60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "tag": "2255ee2d-6056-4dcf-a235-38289bda0980"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:42.825174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4de8ad7b-00a0-4735-8a22-93cd0d93179c req-4fe84e80-6cb2-4e3f-8536-881bad2afb60 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:42.827768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4de8ad7b-00a0-4735-8a22-93cd0d93179c req-4fe84e80-6cb2-4e3f-8536-881bad2afb60 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:42.835673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4de8ad7b-00a0-4735-8a22-93cd0d93179c req-4fe84e80-6cb2-4e3f-8536-881bad2afb60 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:42.868595 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4de8ad7b-00a0-4735-8a22-93cd0d93179c req-4fe84e80-6cb2-4e3f-8536-881bad2afb60 service nova] Creating event network-changed:2255ee2d-6056-4dcf-a235-38289bda0980 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:16:42.897265 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4de8ad7b-00a0-4735-8a22-93cd0d93179c req-4fe84e80-6cb2-4e3f-8536-881bad2afb60 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105632 Oct 16 01:16:42.897887 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1799/3441] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:42.915438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:42.916654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:42.963385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:42.971158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:42.974359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:42.979106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:42.979986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:42.983887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.056722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Getting quotas for project ba3c4e3bdfdc43cea845dab830afc479. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:16:43.073704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Getting quotas for user 374430fde21f45418245b0848be3f34b and project ba3c4e3bdfdc43cea845dab830afc479. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:16:43.134120 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:16:43.134554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:16:43.135152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:16:43.147692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:16:43.148397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:16:43.162988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.163469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.163918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.175934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.177528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.177989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.256142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Getting quotas for project ba3c4e3bdfdc43cea845dab830afc479. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:16:43.268320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Getting quotas for user 374430fde21f45418245b0848be3f34b and project ba3c4e3bdfdc43cea845dab830afc479. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:16:43.295371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:16:43.301179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:16:43.381794 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-454af46a-f3ff-4e7a-b3f6-947ea0117390 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.009764 Oct 16 01:16:43.382943 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1643/3442] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:16:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 3016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:16:43.406088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-abb0d4d3-9ba0-4496-b539-22d4d8e02b33 req-29164f7b-3ccd-434e-8897-2c28f3b79344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "tag": "bdeecbcc-2073-44c7-b6bc-319fee13943b"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:43.443427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-abb0d4d3-9ba0-4496-b539-22d4d8e02b33 req-29164f7b-3ccd-434e-8897-2c28f3b79344 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.449222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-abb0d4d3-9ba0-4496-b539-22d4d8e02b33 req-29164f7b-3ccd-434e-8897-2c28f3b79344 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.449895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-abb0d4d3-9ba0-4496-b539-22d4d8e02b33 req-29164f7b-3ccd-434e-8897-2c28f3b79344 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.486671 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-abb0d4d3-9ba0-4496-b539-22d4d8e02b33 req-29164f7b-3ccd-434e-8897-2c28f3b79344 service nova] Creating event network-changed:bdeecbcc-2073-44c7-b6bc-319fee13943b for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:16:43.505133 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-abb0d4d3-9ba0-4496-b539-22d4d8e02b33 req-29164f7b-3ccd-434e-8897-2c28f3b79344 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120559 Oct 16 01:16:43.506012 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1644/3443] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:43.512231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:43.517853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:43.536323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.539747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.540999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.542299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.544633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.547512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.611650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.613025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.615846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.616603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lazy-loading 'fault' on Instance uuid 29f4f955-3e6c-470b-8256-f1e81712a96f {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:16:43.662847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:43.671276 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-946cbb5e-1bf8-4b4b-99b6-7ef2d8daafea tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1472 microversion: 2.1 time: 0.772141 Oct 16 01:16:43.675495 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1800/3444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:42 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1472 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:43.680649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:43.681264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:43.700734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:43.701347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.701805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.702251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.703123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.703552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.704433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.716166 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7b2388c1-c499-4c45-b5ad-6603f314aff9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 200 len: 1304 microversion: 2.1 time: 0.206570 Oct 16 01:16:43.718109 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1645/3445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:43 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:43.732820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9f748cf2-135c-4e83-a7b9-853323be8d60 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:43.738186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9f748cf2-135c-4e83-a7b9-853323be8d60 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:43.914336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9f748cf2-135c-4e83-a7b9-853323be8d60 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:43.915021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:43.927444 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9f748cf2-135c-4e83-a7b9-853323be8d60 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1277 microversion: 2.1 time: 0.202911 Oct 16 01:16:43.929328 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1646/3446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:43 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:43.930606 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3c4bf102-21d3-41a4-b53c-1c54c38298cd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1274 microversion: 2.1 time: 0.253942 Oct 16 01:16:43.948395 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1801/3447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:43 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:43.953013 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:43.954642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:43.963690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.964412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.965192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:43.966184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:43.966842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:43.968931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.393774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:44.413507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:44.430864 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:44.431524 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4669428-9cab-498d-8a3d-2002a6e0dd1b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.499568 Oct 16 01:16:44.442881 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1647/3448] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:43 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:44.706256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:44.707059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:44.714679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:44.716344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:44.717023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.717977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:44.718657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:44.720079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.745453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:44.746292 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: 29f4f955-3e6c-470b-8256-f1e81712a96f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:44.762335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:44.763132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:44.765326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.766499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:44.769295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:44.769984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.794385 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] HTTP exception thrown: Instance 29f4f955-3e6c-470b-8256-f1e81712a96f could not be found. Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Request method failure captured: Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f HTTP/1.1 Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1lCQssGoLCMTEsVMxK-f6QYxp_nX9s1U_rgMVcFCuMNSWEj-XbEz5zL0fxYzYm8bfkANKAnDQ-EKcPXRqRLjNfVJQtzFY6v1LO99t-h7BlAjJTxhH4ZuAOw2s3x8zmxyligHjIsACPLjAzGVmPXDbD8mG6VEANNtObMLP94eBVvVlc Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb799a0263a14d1a93ba6e3fd37c260a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 0c8da9a32cb54d0a87d914234b1e9f40 Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 29f4f955-3e6c-470b-8256-f1e81712a96f could not be found. Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '29f4f955-3e6c-470b-8256-f1e81712a96f'} Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29f4f955-3e6c-470b-8256-f1e81712a96f could not be found. Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29f4f955-3e6c-470b-8256-f1e81712a96f could not be found. Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:44.796686 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:44.802883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:44.802883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:44.802883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:44.802883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:16:44.802883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:16:44.802883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29f4f955-3e6c-470b-8256-f1e81712a96f could not be found. Oct 16 01:16:44.802883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:44.806651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Returning 404 to user: Instance 29f4f955-3e6c-470b-8256-f1e81712a96f could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:16:44.808318 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82433931-bcb6-4471-af32-214b98b52ceb tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f" status: 404 len: 111 microversion: 2.1 time: 0.067282 Oct 16 01:16:44.809530 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1648/3449] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:44 2022] GET /compute/v2.1/servers/29f4f955-3e6c-470b-8256-f1e81712a96f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:16:44.819014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:44.819513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:44.828925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:44.830325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:44.830953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.831847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:44.832483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:44.833083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.870025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:16:44.973684 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-213b1414-0123-4ce3-98d1-de2accd6c267 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 204 len: 0 microversion: 2.1 time: 0.159375 Oct 16 01:16:44.975284 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1649/3450] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:16:44 2022] DELETE /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:16:44.980848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:44.981543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:44.988070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:44.988585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:44.989156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.989935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:44.990417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:44.991147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:44.993127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:45.001656 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bbb87f6f-f8ae-418c-b7a3-03565ffdd38a tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1472 microversion: 2.1 time: 0.302336 Oct 16 01:16:45.012708 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1802/3451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:44 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:45.025039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:45.025965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:45.032736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:45.033500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:45.034202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:45.035111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:45.035793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:45.036264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:45.143415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:45.152170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6f8e2597-c7d8-4002-8416-b6fe84aacc5a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1329 microversion: 2.1 time: 0.175412 Oct 16 01:16:45.152767 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1650/3452] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:44 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1329 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:45.168033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:45.181064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:45.192950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:45.193982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:45.194658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:45.195803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:45.196651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:45.197294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:45.212112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:45.221366 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-697e783f-7474-46fb-b7a8-53abd2a77df1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1274 microversion: 2.1 time: 0.200092 Oct 16 01:16:45.222206 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1803/3453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:45 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1274 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:45.464474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:45.466433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:45.476613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:45.477497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:45.478462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:45.479221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:45.479684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:45.480439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:45.497153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:45.507902 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a814c8ed-880d-408a-be8b-c19b9daa0f0e tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1508 microversion: 2.1 time: 0.347480 Oct 16 01:16:45.513669 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1651/3454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:45 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:45.538220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d3a6e619-9c96-4041-b3e3-92e69636c5cb req-574231ea-be51-4f47-ba00-5740562a7786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f4f955-3e6c-470b-8256-f1e81712a96f", "name": "network-vif-deleted", "tag": "30fd1143-c017-4978-8af1-692e9c8204c7"}, {"server_uuid": "5f3da552-c78a-4056-a089-5f43fd09c352", "name": "network-vif-deleted", "tag": "d6fbc6e9-4414-402c-ad89-3992ab039f56"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:45.570572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d3a6e619-9c96-4041-b3e3-92e69636c5cb req-574231ea-be51-4f47-ba00-5740562a7786 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:45.571475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d3a6e619-9c96-4041-b3e3-92e69636c5cb req-574231ea-be51-4f47-ba00-5740562a7786 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:45.572118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d3a6e619-9c96-4041-b3e3-92e69636c5cb req-574231ea-be51-4f47-ba00-5740562a7786 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:45.592214 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d3a6e619-9c96-4041-b3e3-92e69636c5cb req-574231ea-be51-4f47-ba00-5740562a7786 service nova] Creating event network-vif-deleted:30fd1143-c017-4978-8af1-692e9c8204c7 for instance 29f4f955-3e6c-470b-8256-f1e81712a96f on n-h1-master-1 Oct 16 01:16:45.598252 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d3a6e619-9c96-4041-b3e3-92e69636c5cb req-574231ea-be51-4f47-ba00-5740562a7786 service nova] Creating event network-vif-deleted:d6fbc6e9-4414-402c-ad89-3992ab039f56 for instance 5f3da552-c78a-4056-a089-5f43fd09c352 on n-h2-master-1 Oct 16 01:16:45.608516 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d3a6e619-9c96-4041-b3e3-92e69636c5cb req-574231ea-be51-4f47-ba00-5740562a7786 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073989 Oct 16 01:16:45.610163 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1652/3455] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:16:45.907744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:45.918884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:45.921130 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:45.922955 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-62b27d58-4fec-49dc-bd08-4227ff859dff tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.463622 Oct 16 01:16:45.935427 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1804/3456] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:45 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:46.028145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:46.034293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:46.052935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.055424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.056804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.058048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.061151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.061671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.114312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.114870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.115419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.116350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lazy-loading 'fault' on Instance uuid 5f3da552-c78a-4056-a089-5f43fd09c352 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:16:46.182350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:46.183002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:46.191359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.192614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.193579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.196129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.196549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c1e0fc9ff7e4c0da77439e27166264f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec64ba1a19d54d38aecbabcd25b075da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:46.197145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.198211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.206818 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7efeea4e-e66e-4d09-9166-7e3f0d98fee3 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 200 len: 1307 microversion: 2.1 time: 0.183641 Oct 16 01:16:46.209043 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1653/3457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:46 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 1307 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:46.247995 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:46.248912 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:46.257465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.257955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.258386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.259711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.260312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.260743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.359636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:46.381070 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-87f33dcd-8c15-4775-a631-9b4755c0c9da tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1337 microversion: 2.1 time: 0.208285 Oct 16 01:16:46.385169 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1805/3458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:46 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1337 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:46.414021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:46.424103 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1734cf7e-7da8-430d-8247-8cbe95236b40 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1274 microversion: 2.1 time: 0.183305 Oct 16 01:16:46.425702 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1654/3459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:46 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:46.537462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:46.539186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:46.553831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.554734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.556366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.558720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.560746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.561654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.951110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:46.951721 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:46.970976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.971750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.972204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:46.972956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:46.973415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:46.973843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:47.063953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:47.075788 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82487ed8-9cfd-4078-ad30-c4ae1f3ce091 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1508 microversion: 2.1 time: 0.545372 Oct 16 01:16:47.076703 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1806/3460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:46 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1508 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:47.229931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:47.231713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] [instance: 5f3da552-c78a-4056-a089-5f43fd09c352] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:47.240354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:47.241322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:47.242034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:47.243146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:47.244035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:47.244699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:47.263049 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] HTTP exception thrown: Instance 5f3da552-c78a-4056-a089-5f43fd09c352 could not be found. Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Request method failure captured: Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 HTTP/1.1 Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1sLRz-M1p_K7qkqs2YTFAzdJIUrvHRH-3yuUyySIvTOWavKfoPYZJsjfjpJeh6wMyT_rwsR85AaPMoi7bneqGdbBqvEXXoYSPw451q71dln8jsOOJO5oMfyjGXAiphExiH2QucbI34X8bBDnf0VmsDxSGuNF_b-YjeDJjBT71ycdmQ Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: ec64ba1a19d54d38aecbabcd25b075da Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec64ba1a19d54d38aecbabcd25b075da", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec64ba1a19d54d38aecbabcd25b075da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: ec64ba1a19d54d38aecbabcd25b075da Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-348139423 Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerTestJSON-348139423-project Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7c1e0fc9ff7e4c0da77439e27166264f Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerTestJSON-348139423-project Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 5f3da552-c78a-4056-a089-5f43fd09c352 could not be found. Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5f3da552-c78a-4056-a089-5f43fd09c352'} Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3da552-c78a-4056-a089-5f43fd09c352 could not be found. Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3da552-c78a-4056-a089-5f43fd09c352 could not be found. Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:47.265366 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3da552-c78a-4056-a089-5f43fd09c352 could not be found. Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] Returning 404 to user: Instance 5f3da552-c78a-4056-a089-5f43fd09c352 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a2c2cc0-b9c4-4b36-aacd-33b9e8d144d9 tempest-ImagesOneServerTestJSON-348139423 tempest-ImagesOneServerTestJSON-348139423-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352" status: 404 len: 111 microversion: 2.1 time: 0.042109 Oct 16 01:16:47.277102 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1807/3461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:47 2022] GET /compute/v2.1/servers/5f3da552-c78a-4056-a089-5f43fd09c352 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:16:47.410299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:47.410970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:47.420054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:47.420788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:47.423931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:47.425031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:47.425881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:47.427162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:47.433727 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:47.710959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:47.725491 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:47.727004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:47.728494 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5008280-c0bd-4023-9572-5c6d4192224d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.781394 Oct 16 01:16:47.729418 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1655/3462] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:46 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:47.734826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:47.737142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:47.737981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:47.745202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:47.745887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:47.746520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:47.747535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:47.748159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:47.748748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:47.752025 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97b1da15-8ff4-4571-909a-dc28d4a72408 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1335 microversion: 2.1 time: 0.347079 Oct 16 01:16:47.753043 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1808/3463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:47 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1335 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:48.081269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:48.100464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:48.101083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:48.108387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e8bfd3e6-9bad-472b-9a7b-af8dd49b1ab9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1316 microversion: 2.1 time: 0.377613 Oct 16 01:16:48.111188 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1656/3464] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:47 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:48.116927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:48.117386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:48.118025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:48.118932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:48.119410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:48.119842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:48.264684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:48.283804 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-522c8915-112f-4f2b-bb5c-725c6c43c5d9 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 200 len: 1466 microversion: 2.1 time: 0.186987 Oct 16 01:16:48.284248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-103ca546-4661-42f3-9568-e0f9c4097d18 req-f006021f-22a9-40a0-b53a-0ad4a97d8bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa13b8e4-6d6e-45b0-994b-6eeac448e348", "name": "network-vif-deleted", "tag": "4431a515-533b-494c-a17a-390a7820b435"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:48.285471 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1809/3465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:48 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 1466 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:48.314784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-103ca546-4661-42f3-9568-e0f9c4097d18 req-f006021f-22a9-40a0-b53a-0ad4a97d8bc0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:48.315851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-103ca546-4661-42f3-9568-e0f9c4097d18 req-f006021f-22a9-40a0-b53a-0ad4a97d8bc0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:48.316344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-103ca546-4661-42f3-9568-e0f9c4097d18 req-f006021f-22a9-40a0-b53a-0ad4a97d8bc0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:48.328146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-103ca546-4661-42f3-9568-e0f9c4097d18 req-f006021f-22a9-40a0-b53a-0ad4a97d8bc0 service nova] Creating event network-vif-deleted:4431a515-533b-494c-a17a-390a7820b435 for instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 on n-h1-master-1 Oct 16 01:16:48.337229 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-103ca546-4661-42f3-9568-e0f9c4097d18 req-f006021f-22a9-40a0-b53a-0ad4a97d8bc0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059886 Oct 16 01:16:48.338153 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1657/3466] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:16:48.759300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:48.760477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:48.767631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:48.768415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:48.769019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:48.770309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:48.770980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:48.771585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:48.778778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:48.779679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:48.787521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:48.789030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:48.789575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:48.790555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:48.791195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:48.791735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:48.824504 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:49.024486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:49.034642 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-401d7355-7ff3-4160-9c2d-ad64f8a145bc tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1335 microversion: 2.1 time: 0.263059 Oct 16 01:16:49.053987 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1658/3467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:48 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1335 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:49.135631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:49.136693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:49.154344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:49.155688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:49.156445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:49.158399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:49.158995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:49.159498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:49.473722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:49.484579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:49.490026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:49.492716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-56f3a9ff-0d3b-47ea-a600-82ce9e831259 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.738432 Oct 16 01:16:49.494927 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1810/3468] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:48 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:49.511928 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:49.512923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: aa13b8e4-6d6e-45b0-994b-6eeac448e348] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:49.522207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:49.523205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:49.524026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:49.525402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:49.526497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:49.527384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:49.569292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] HTTP exception thrown: Instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 could not be found. Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Request method failure captured: Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 HTTP/1.1 Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lCQssGoLCMTEsVMxK-f6QYxp_nX9s1U_rgMVcFCuMNSWEj-XbEz5zL0fxYzYm8bfkANKAnDQ-EKcPXRqRLjNfVJQtzFY6v1LO99t-h7BlAjJTxhH4ZuAOw2s3x8zmxyligHjIsACPLjAzGVmPXDbD8mG6VEANNtObMLP94eBVvVlc Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb799a0263a14d1a93ba6e3fd37c260a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0c8da9a32cb54d0a87d914234b1e9f40 Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: exception: Instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 could not be found. Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'aa13b8e4-6d6e-45b0-994b-6eeac448e348'} Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 could not be found. Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 could not be found. Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:49.571693 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:49.581591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:49.581591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:49.581591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:49.581591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:16:49.581591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:16:49.581591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 could not be found. Oct 16 01:16:49.581591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:49.584763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Returning 404 to user: Instance aa13b8e4-6d6e-45b0-994b-6eeac448e348 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:16:49.585859 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e57e125-a7d0-449f-8279-1e847f993d5d tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348" status: 404 len: 111 microversion: 2.1 time: 0.079586 Oct 16 01:16:49.587085 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1811/3469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:49 2022] GET /compute/v2.1/servers/aa13b8e4-6d6e-45b0-994b-6eeac448e348 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:16:49.597254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:49.598232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:49.605390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:49.606131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:49.606991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:49.608175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:49.609042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:49.610244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:49.654132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:16:49.776580 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8dd1fe92-eafb-4ac8-8f08-44e517f660ec tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 204 len: 0 microversion: 2.1 time: 0.185200 Oct 16 01:16:49.795591 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1812/3470] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:16:49 2022] DELETE /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:16:49.798729 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:49.802885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:49.804114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:49.814874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:49.815152 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5414df28-e9ff-49f3-bd59-cab2a7c34bc9 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1316 microversion: 2.1 time: 0.676642 Oct 16 01:16:49.815878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:49.816712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:49.818172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1659/3471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:49 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1316 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:49.818615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:49.819450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:49.820223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:50.060856 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:50.061602 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:50.077568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:50.078076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:50.078546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:50.079330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:50.079798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:50.080232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:50.100330 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:50.166800 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=10 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:50.332386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:50.346188 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a217564-c2b8-4726-b446-a8e89512109f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1494 microversion: 2.1 time: 0.548997 Oct 16 01:16:50.347066 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1813/3472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:49 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1494 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:50.351940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-28e21de5-16dd-4a9b-aab4-b234c145526a req-60f61a09-315b-4864-9e44-b56af308065d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf6c30be-76fa-4872-a2ff-402025041451", "tag": "f724bce2-95dc-4224-bf96-92f5f86df17b"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:50.379323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-28e21de5-16dd-4a9b-aab4-b234c145526a req-60f61a09-315b-4864-9e44-b56af308065d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:50.380253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-28e21de5-16dd-4a9b-aab4-b234c145526a req-60f61a09-315b-4864-9e44-b56af308065d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:50.380897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-28e21de5-16dd-4a9b-aab4-b234c145526a req-60f61a09-315b-4864-9e44-b56af308065d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:50.404879 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-28e21de5-16dd-4a9b-aab4-b234c145526a req-60f61a09-315b-4864-9e44-b56af308065d service nova] Creating event network-changed:f724bce2-95dc-4224-bf96-92f5f86df17b for instance bf6c30be-76fa-4872-a2ff-402025041451 on n-h2-master-1 Oct 16 01:16:50.412462 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-28e21de5-16dd-4a9b-aab4-b234c145526a req-60f61a09-315b-4864-9e44-b56af308065d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063837 Oct 16 01:16:50.413693 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1814/3473] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:50.530581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:50.532637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:50.539785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:50.540584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:50.541214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:50.542097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:50.542722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:50.543340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:50.794708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:50.808875 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-077cb757-8b43-4f1f-8107-896bc9eec1c3 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1402 microversion: 2.1 time: 0.751905 Oct 16 01:16:50.810100 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1660/3474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:50 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1402 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:50.842643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:50.843352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:50.855498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:50.858167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:50.863927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:50.866475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:50.867351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:50.868349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:51.146543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:51.168502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:51.175573 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:51.177159 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f7ce215-4be0-4672-9f73-4570ff90c53f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.651341 Oct 16 01:16:51.178077 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1815/3475] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:50 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:16:51.374354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:51.375131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:51.384054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:51.384805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:51.385404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:51.386637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:51.387323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:51.387948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:51.392167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:51.407656 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a97bbae-4430-4832-ab73-4d93ace5287f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1316 microversion: 2.1 time: 0.569649 Oct 16 01:16:51.423592 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1661/3476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:50 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:51.837200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:51.838494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:51.848658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:51.851627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:51.852297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:51.853320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:51.854009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:51.859646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:52.023771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:52.045579 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78f8ff72-0ffc-46ca-af82-ef7a6f3db433 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 200 len: 1494 microversion: 2.1 time: 0.666918 Oct 16 01:16:52.046611 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1816/3477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:51 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 1494 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:16:52.181750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-244ecad9-7915-4961-b558-a6ac3e3aa053 req-5388c69e-37ba-4eaa-93b0-6863f5139d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f199d0-c8ac-4b34-900f-d76d13a71c79", "name": "network-vif-deleted", "tag": "76e5aea7-bf51-495a-8ec2-5bf79b6c00fc"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:52.245038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-244ecad9-7915-4961-b558-a6ac3e3aa053 req-5388c69e-37ba-4eaa-93b0-6863f5139d34 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:52.252043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-244ecad9-7915-4961-b558-a6ac3e3aa053 req-5388c69e-37ba-4eaa-93b0-6863f5139d34 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:52.254351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-244ecad9-7915-4961-b558-a6ac3e3aa053 req-5388c69e-37ba-4eaa-93b0-6863f5139d34 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:52.294783 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-244ecad9-7915-4961-b558-a6ac3e3aa053 req-5388c69e-37ba-4eaa-93b0-6863f5139d34 service nova] Creating event network-vif-deleted:76e5aea7-bf51-495a-8ec2-5bf79b6c00fc for instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 on n-h1-master-1 Oct 16 01:16:52.311274 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-244ecad9-7915-4961-b558-a6ac3e3aa053 req-5388c69e-37ba-4eaa-93b0-6863f5139d34 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139150 Oct 16 01:16:52.317568 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1817/3478] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:16:52.347349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:52.348551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:52.362821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:52.363665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:52.365590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:52.367566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:52.368730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:52.369420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:52.468654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:52.488381 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f689e4f5-b4a7-4bcc-93c9-675fc8da4230 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1402 microversion: 2.1 time: 0.652885 Oct 16 01:16:52.519107 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1662/3479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:51 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1402 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:52.527909 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:52.528794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:52.545859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:52.546645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:52.548343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:52.549857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:52.554462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:52.555542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.036827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:53.053026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:53.056960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:53.061588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-21d6ed7e-2d6a-4a3a-8a54-294852b8e8f6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.740603 Oct 16 01:16:53.073403 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1818/3480] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:52 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:53.073403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:53.073859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: f5f199d0-c8ac-4b34-900f-d76d13a71c79] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:53.089391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.090306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.091875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.093253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.093963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.095154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.116874 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] HTTP exception thrown: Instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 could not be found. Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Request method failure captured: Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 HTTP/1.1 Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1lCQssGoLCMTEsVMxK-f6QYxp_nX9s1U_rgMVcFCuMNSWEj-XbEz5zL0fxYzYm8bfkANKAnDQ-EKcPXRqRLjNfVJQtzFY6v1LO99t-h7BlAjJTxhH4ZuAOw2s3x8zmxyligHjIsACPLjAzGVmPXDbD8mG6VEANNtObMLP94eBVvVlc Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb799a0263a14d1a93ba6e3fd37c260a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 0c8da9a32cb54d0a87d914234b1e9f40 Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: exception: Instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 could not be found. Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f5f199d0-c8ac-4b34-900f-d76d13a71c79'} Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 could not be found. Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 could not be found. Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:53.118674 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 could not be found. Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Returning 404 to user: Instance f5f199d0-c8ac-4b34-900f-d76d13a71c79 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-152d6c2e-bc39-4461-95de-01e5abe94616 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79" status: 404 len: 111 microversion: 2.1 time: 0.054326 Oct 16 01:16:53.124739 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1819/3481] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:53 2022] GET /compute/v2.1/servers/f5f199d0-c8ac-4b34-900f-d76d13a71c79 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:16:53.129470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-72ea7164-bd56-41b9-a258-5abf265e540c req-cc4b6eea-a6d7-4084-a8d3-feddfdaf3ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13e0541-5c0c-42d8-ab19-24a244571cc0", "tag": "b3aa0722-d6e1-40da-a884-8c11c9253b51"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:53.142121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-72ea7164-bd56-41b9-a258-5abf265e540c req-cc4b6eea-a6d7-4084-a8d3-feddfdaf3ed5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.143603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-72ea7164-bd56-41b9-a258-5abf265e540c req-cc4b6eea-a6d7-4084-a8d3-feddfdaf3ed5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.144208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-72ea7164-bd56-41b9-a258-5abf265e540c req-cc4b6eea-a6d7-4084-a8d3-feddfdaf3ed5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.162243 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-72ea7164-bd56-41b9-a258-5abf265e540c req-cc4b6eea-a6d7-4084-a8d3-feddfdaf3ed5 service nova] Creating event network-changed:b3aa0722-d6e1-40da-a884-8c11c9253b51 for instance e13e0541-5c0c-42d8-ab19-24a244571cc0 on n-h1-master-1 Oct 16 01:16:53.167826 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-72ea7164-bd56-41b9-a258-5abf265e540c req-cc4b6eea-a6d7-4084-a8d3-feddfdaf3ed5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045978 Oct 16 01:16:53.168802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1820/3482] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:53.175413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:53.176400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:53.191307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.192644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.193334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.194335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.195066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.195724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.198599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:53.216676 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:53.220880 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a89a4a91-305b-4d10-a788-2ff4dbc34c26 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1316 microversion: 2.1 time: 0.695926 Oct 16 01:16:53.230840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:16:53.235809 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1663/3483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:52 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1316 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:53.335991 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a95117a-6d76-455c-85b6-565e9a8e505f tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 204 len: 0 microversion: 2.1 time: 0.164919 Oct 16 01:16:53.341900 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1821/3484] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:16:53 2022] DELETE /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:16:53.349353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:53.352393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:53.365191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.365833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.366356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.367283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.375314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.376147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.530737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:53.532670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:53.539778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.540122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.540558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.541258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:53.542717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:53.543226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:53.883130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:53.893636 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-33f0165d-2b69-40b2-8c11-e6ed3800c557 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1677 microversion: 2.1 time: 0.548202 Oct 16 01:16:53.894510 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1664/3485] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:53 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1677 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:53.933966 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:53.948133 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f7930775-a74d-4980-82c5-8874a8ca0ea5 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1402 microversion: 2.1 time: 0.421412 Oct 16 01:16:53.948900 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1822/3486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:53 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1402 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:54.092854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:54.093481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:54.103471 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=12 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:54.107802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:54.108369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:54.108823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:54.113850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:54.114533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:54.115146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:54.245487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:54.246113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:54.255103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:54.255602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:54.256041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:54.256752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:54.257215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:54.257649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:55.268866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:55.284423 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0cb5aa14-569b-41d0-9eaa-3b5cf58bf3d4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1316 microversion: 2.1 time: 1.042588 Oct 16 01:16:55.285437 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1823/3487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:54 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1316 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:55.293819 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:55.294493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:55.306039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:55.306577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:55.307050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:55.307855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:55.308317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:55.308793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:55.326028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:55.355609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:55.361351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:55.365068 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3334f80a-bca7-42a8-9f7f-0e37c6376347 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 1.277497 Oct 16 01:16:55.367156 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1665/3488] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:54 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:55.380784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:55.381842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:55.398704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:55.399623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:55.403513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:55.404577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:55.405307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:55.405828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:55.767766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:55.771441 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:55.785726 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-510ff0d2-f24c-4eb2-b429-e5efad27e918 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1677 microversion: 2.1 time: 0.498805 Oct 16 01:16:55.786473 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1824/3489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:55 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1677 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:55.851320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:55.860600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2b7019cb-6bc6-42d4-a35a-426f99d0a677 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1402 microversion: 2.1 time: 0.491504 Oct 16 01:16:55.866886 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1666/3490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:55 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1402 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:56.312517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:56.314062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:56.332095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:56.334691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:56.335470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:56.336991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:56.341045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:56.341730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:56.400364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:56.400982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:56.421333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:56.421845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:56.422451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:56.423414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:56.423888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:56.424321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:57.077896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:57.097461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:57.099118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:57.100373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4b2928d1-bbe5-427f-a7af-c3bbfa413f96 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.711191 Oct 16 01:16:57.123101 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1667/3491] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:56 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:57.124231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:57.129105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:57.129718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:57.139947 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e876402f-3d19-4daa-b92e-21a9790a1eef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1316 microversion: 2.1 time: 0.831202 Oct 16 01:16:57.155244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:57.155244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:57.155244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:57.155244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:57.155244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:57.155244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:57.163234 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1825/3492] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:56 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1316 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:57.175228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:57.176168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:57.191777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:57.197741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:57.198442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:57.199622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:57.200261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:57.200870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:57.536215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8da9a32cb54d0a87d914234b1e9f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb799a0263a14d1a93ba6e3fd37c260a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:57.555582 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4540985-f647-4d58-8f82-4bd0a4eec8d1 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 200 len: 1609 microversion: 2.1 time: 0.430805 Oct 16 01:16:57.556269 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1668/3493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:57 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 1609 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:57.866795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:57.878843 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-37ce526a-646c-42d3-a5c5-8e6b100c34ba tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1402 microversion: 2.1 time: 0.714298 Oct 16 01:16:57.889426 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1826/3494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:57 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1402 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:58.135560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:58.136340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:58.154291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:58.156061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:58.158241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:58.160265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:58.160769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:58.161335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:58.172289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:58.173800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:58.182244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:58.195396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:58.198805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:58.200979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:58.202951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:58.204822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:59.729734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:59.746516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:59.747994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:59.749199 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-acc20c0f-804b-45e6-bfb8-a49ca6e0fb4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 1.620764 Oct 16 01:16:59.749823 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1669/3495] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:16:58 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:16:59.767619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:16:59.772604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:59.773558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] [instance: c8bd887d-2505-40d6-bbbf-e3cdd79c4f90] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:59.780318 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad91708f-f82b-42dc-9bf3-4dde291381d2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1316 microversion: 2.1 time: 1.617670 Oct 16 01:16:59.783132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:59.784485 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1827/3496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:58 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1316 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:16:59.786202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:59.788783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:59.789835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:59.790932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:59.793044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:59.805615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e2d727bb-8ad5-4239-a678-23e728597808 req-6ae851b0-5936-4308-9301-cefc86f74fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8bd887d-2505-40d6-bbbf-e3cdd79c4f90", "name": "network-vif-deleted", "tag": "4b257d35-3e2e-42ad-9d37-27972e12833a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:59.826810 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:16:59.830797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2d727bb-8ad5-4239-a678-23e728597808 req-6ae851b0-5936-4308-9301-cefc86f74fb8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:59.833086 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] HTTP exception thrown: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 could not be found. Oct 16 01:16:59.833529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2d727bb-8ad5-4239-a678-23e728597808 req-6ae851b0-5936-4308-9301-cefc86f74fb8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:59.834561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2d727bb-8ad5-4239-a678-23e728597808 req-6ae851b0-5936-4308-9301-cefc86f74fb8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Request method failure captured: Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 HTTP/1.1 Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1lCQssGoLCMTEsVMxK-f6QYxp_nX9s1U_rgMVcFCuMNSWEj-XbEz5zL0fxYzYm8bfkANKAnDQ-EKcPXRqRLjNfVJQtzFY6v1LO99t-h7BlAjJTxhH4ZuAOw2s3x8zmxyligHjIsACPLjAzGVmPXDbD8mG6VEANNtObMLP94eBVvVlc Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb799a0263a14d1a93ba6e3fd37c260a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb799a0263a14d1a93ba6e3fd37c260a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: cb799a0263a14d1a93ba6e3fd37c260a Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-616665436 Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 0c8da9a32cb54d0a87d914234b1e9f40 Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-616665436-project Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: exception: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 could not be found. Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'c8bd887d-2505-40d6-bbbf-e3cdd79c4f90'} Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 could not be found. Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 could not be found. Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:16:59.834887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 could not be found. Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Returning 404 to user: Instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e8ca0a5-f4f4-495c-9a42-f1e888d90078 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90" status: 404 len: 111 microversion: 2.1 time: 0.076844 Oct 16 01:16:59.842336 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1670/3497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:59 2022] GET /compute/v2.1/servers/c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:16:59.853632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:16:59.854264 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:16:59.861890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:59.862310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:59.873225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:59.874373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:59.875120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:59.875781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:59.878347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e2d727bb-8ad5-4239-a678-23e728597808 req-6ae851b0-5936-4308-9301-cefc86f74fb8 service nova] Creating event network-vif-deleted:4b257d35-3e2e-42ad-9d37-27972e12833a for instance c8bd887d-2505-40d6-bbbf-e3cdd79c4f90 on n-h2-master-1 Oct 16 01:16:59.894199 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e2d727bb-8ad5-4239-a678-23e728597808 req-6ae851b0-5936-4308-9301-cefc86f74fb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104445 Oct 16 01:16:59.895548 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1828/3498] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:16:59.909891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d65acb53-8bdd-4d8f-a934-6a102f9ee0a3 req-bd66e77a-d1e4-4424-9a07-ba8d54f9f05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf6c30be-76fa-4872-a2ff-402025041451", "name": "network-vif-plugged", "status": "completed", "tag": "f724bce2-95dc-4224-bf96-92f5f86df17b"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:16:59.938475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d65acb53-8bdd-4d8f-a934-6a102f9ee0a3 req-bd66e77a-d1e4-4424-9a07-ba8d54f9f05d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:16:59.940666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d65acb53-8bdd-4d8f-a934-6a102f9ee0a3 req-bd66e77a-d1e4-4424-9a07-ba8d54f9f05d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:16:59.942179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d65acb53-8bdd-4d8f-a934-6a102f9ee0a3 req-bd66e77a-d1e4-4424-9a07-ba8d54f9f05d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:16:59.973845 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d65acb53-8bdd-4d8f-a934-6a102f9ee0a3 req-bd66e77a-d1e4-4424-9a07-ba8d54f9f05d service nova] Creating event network-vif-plugged:f724bce2-95dc-4224-bf96-92f5f86df17b for instance bf6c30be-76fa-4872-a2ff-402025041451 on n-h2-master-1 Oct 16 01:16:59.989776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d65acb53-8bdd-4d8f-a934-6a102f9ee0a3 req-bd66e77a-d1e4-4424-9a07-ba8d54f9f05d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089311 Oct 16 01:16:59.991409 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1829/3499] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:00.008952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a982d90a-4750-433b-aec9-dbf452e44177 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] Calling method '.version_select at 0x7fd64e3871f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:00.060902 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a982d90a-4750-433b-aec9-dbf452e44177 tempest-ServerActionsTestJSON-616665436 tempest-ServerActionsTestJSON-616665436-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088659820" status: 202 len: 0 microversion: 2.1 time: 0.065844 Oct 16 01:17:00.064019 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1830/3500] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:16:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088659820 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:17:00.374066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:00.395523 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f1318711-d863-4c38-9fd2-a0da21039bf9 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1402 microversion: 2.1 time: 0.557283 Oct 16 01:17:00.396405 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1671/3501] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:16:59 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1402 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:00.779702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:00.781833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:00.804442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:00.810168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:00.811024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:00.812241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:00.812548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:00.814757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:00.816650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:00.818407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:00.829136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:00.829931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:00.830546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:00.831478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:00.835928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:00.836996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:01.620606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:01.630566 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-efa7a845-db32-417d-8446-37280867c548 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1316 microversion: 2.1 time: 0.823253 Oct 16 01:17:01.651369 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1672/3502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:00 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1316 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:01.658012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:01.658639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:01.667779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:01.668928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:01.669570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:01.670485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:01.671621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:01.672311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:01.772782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:01.782489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:01.783986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:01.785383 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e04632d-bf8d-4754-b614-25f6dfe63862 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 1.011170 Oct 16 01:17:01.786461 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1831/3503] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:00 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:02.200488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:02.224449 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9876393a-661e-4dfb-83f5-01587c178bc7 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1402 microversion: 2.1 time: 0.571488 Oct 16 01:17:02.225490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1673/3504] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:01 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1402 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:02.504757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f08c6e3e-ba17-4aa0-8205-b796d8c86e52 req-5ae3e8ca-a6cf-4514-9ce7-d9a6fcc2e451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13e0541-5c0c-42d8-ab19-24a244571cc0", "name": "network-vif-plugged", "status": "completed", "tag": "b3aa0722-d6e1-40da-a884-8c11c9253b51"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:02.525647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f08c6e3e-ba17-4aa0-8205-b796d8c86e52 req-5ae3e8ca-a6cf-4514-9ce7-d9a6fcc2e451 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:02.526470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f08c6e3e-ba17-4aa0-8205-b796d8c86e52 req-5ae3e8ca-a6cf-4514-9ce7-d9a6fcc2e451 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:02.527315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f08c6e3e-ba17-4aa0-8205-b796d8c86e52 req-5ae3e8ca-a6cf-4514-9ce7-d9a6fcc2e451 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:02.546843 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f08c6e3e-ba17-4aa0-8205-b796d8c86e52 req-5ae3e8ca-a6cf-4514-9ce7-d9a6fcc2e451 service nova] Creating event network-vif-plugged:b3aa0722-d6e1-40da-a884-8c11c9253b51 for instance e13e0541-5c0c-42d8-ab19-24a244571cc0 on n-h1-master-1 Oct 16 01:17:02.553392 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f08c6e3e-ba17-4aa0-8205-b796d8c86e52 req-5ae3e8ca-a6cf-4514-9ce7-d9a6fcc2e451 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054414 Oct 16 01:17:02.555282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1832/3505] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:02.659981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:02.661342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:02.670245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:02.674546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:02.675802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:02.679178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:02.680472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:02.682222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:02.816178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:02.817062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:02.842390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:02.843265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:02.865920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:02.868553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:02.869238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:02.870847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:03.895962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:03.908895 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f7a39868-2182-4c0e-966e-29f618e2d990 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1506 microversion: 2.1 time: 1.254433 Oct 16 01:17:03.911889 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1674/3506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:02 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1506 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:03.937656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:03.943803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:03.968823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:03.969610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:03.970068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:03.976728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:03.979806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:03.980447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:04.057024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:04.074629 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:04.078031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:04.083753 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d7cee7b-948b-4cd3-8a3c-8ff9fd89319a tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 1.273534 Oct 16 01:17:04.085588 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1833/3507] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:02 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:04.099488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:04.101121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:04.119327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:04.121544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:04.122452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:04.125409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:04.133098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:04.133825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:04.865692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:04.876000 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:04.882883 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-972c6a5b-80ca-4782-be5a-39e2876e6d76 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1402 microversion: 2.1 time: 0.969170 Oct 16 01:17:04.891453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:04.891995 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1675/3508] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:03 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1402 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:04.900158 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ab3526d-6ddb-4593-8864-59a11878c228 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1506 microversion: 2.1 time: 0.812697 Oct 16 01:17:04.904467 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1834/3509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:04 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1506 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:04.927347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:04.931577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:04.939377 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:04.941923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:04.942758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:04.943512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:04.944495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:04.945207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:04.946240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:05.117318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:05.118438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:05.135181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:17:05.135862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:17:05.136742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:17:05.138116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:17:05.138788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:17:05.143599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:05.144133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:05.154269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:05.161887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:05.162408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:05.162857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:05.269783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:05.286469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:05.289421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:05.290134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:05.298327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:05.300003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:05.300786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:05.336501 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c7de155-8cfa-4e6f-b1b8-4360a15c41f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "POST /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451/action" status: 202 len: 1108 microversion: 2.1 time: 0.413610 Oct 16 01:17:05.337595 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1676/3510] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:17:04 2022] POST /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451/action => generated 1108 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 16 01:17:05.361111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:05.361982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:05.372167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:05.379641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:05.382494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:05.383536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:05.384184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:05.386235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:06.089891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:06.099332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:06.101091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:06.102536 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7eff3839-26fc-4000-b4d5-1c8f0d8aec7d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.989672 Oct 16 01:17:06.103219 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1835/3511] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:05 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:17:06.108064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:06.108736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:06.115507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:06.116227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:06.116877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:06.117811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:06.120151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:06.120686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:06.180143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:06.190443 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6713062-dbf7-403a-bf4b-75aed3e86f4d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.833428 Oct 16 01:17:06.191585 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1677/3512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:05 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:06.626637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:06.650099 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ae1dc7d-0cf9-4ef7-991a-247b40110049 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1590 microversion: 2.1 time: 0.545320 Oct 16 01:17:06.660588 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1836/3513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:06 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1590 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:06.676429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:06.677227 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:06.683783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:06.684260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:06.684700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:06.685400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:06.685859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:06.686280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:07.136621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:07.137245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:07.144894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:07.146140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:07.146808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:07.147576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:07.148078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:07.148493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:07.410979 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d88fea14-8bc4-417c-9d14-054ba31cd607 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.738493 Oct 16 01:17:07.412501 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1678/3514] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:17:06 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0/os-interface => generated 285 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:17:07.418159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:07.419007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:07.428898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:07.429465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:07.430063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:07.430836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:07.431414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:07.432201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:07.971886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:07.987317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:07.989408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:07.990784 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-077de503-d86e-480c-b70a-2ae6a32817a8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.858179 Oct 16 01:17:07.993254 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1837/3515] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:07 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:17:08.168898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:08.182987 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a552353-a5fc-48c5-93ba-a4c87af1c894 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.769109 Oct 16 01:17:08.184079 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1679/3516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:07 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:09.022028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:09.023336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:09.031895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:09.032592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:09.033240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:09.034135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:09.034769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:09.035469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:09.206207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1842291834", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "2e79da2e-21b4-4a37-a7fa-8c15935d172d"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:09.285687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] validate_networks() for [('2e79da2e-21b4-4a37-a7fa-8c15935d172d', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:17:09.506017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:09.527214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:09.528921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:09.530146 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d56c44c5-bbfa-4b7d-aac8-a06c28f78c26 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.512192 Oct 16 01:17:09.545173 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1838/3517] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:09 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:09.557060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:09.557705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:09.576457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:09.577391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:09.578938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:09.579960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:09.581215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:09.581599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:10.078756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:10.088556 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f037e6d-3015-4400-a7e8-d8a5be127e6c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.542331 Oct 16 01:17:10.100434 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1839/3518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:09 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:10.129348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:17:10.129777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:17:10.130256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:17:10.130768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:17:10.131500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:17:10.153817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:10.154430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:10.154894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:10.161745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:10.163587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:10.164055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:10.185675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Getting quotas for project 131d702dc0e34408bf3e58809c5cfb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:17:10.193068 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Getting quotas for user b7cdbf32b68a44a28e4cc9c4210b5e56 and project 131d702dc0e34408bf3e58809c5cfb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:17:10.208685 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:17:10.212216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:17:10.307459 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59b1299e-e2ec-4762-a800-f70c1298fa24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288871 Oct 16 01:17:10.308117 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1680/3519] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:17:10.320632 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-15698994-4e81-4236-a8fc-a52d7f06a2ba tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:10.321271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-15698994-4e81-4236-a8fc-a52d7f06a2ba tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:10.499044 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-15698994-4e81-4236-a8fc-a52d7f06a2ba tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:10.510680 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-15698994-4e81-4236-a8fc-a52d7f06a2ba tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1225 microversion: 2.1 time: 0.194511 Oct 16 01:17:10.523452 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1840/3520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:10 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1225 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:10.567395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:10.568024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:10.588931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:10.589439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:10.589878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:10.590792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:10.596525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:10.597305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:11.092216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:11.106677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:11.123421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:11.126430 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-96673375-32f2-4319-82fd-6b95fe3d650f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.571711 Oct 16 01:17:11.127442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:11.128718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:11.144446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:11.146147 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1681/3521] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:10 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:11.147465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:11.147961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:11.148718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:11.149252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:11.149732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:11.460080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:11.480870 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2bd0efa8-5514-4f50-bb41-b27601b35b0f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.358546 Oct 16 01:17:11.498229 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1841/3522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:11 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:11.549989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:11.550740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:11.562048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:11.565329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:11.567126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:11.568171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:11.569062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:11.569944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:11.787921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:11.800322 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b33c89b1-4322-4cea-a8e6-35df8a890c7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1221 microversion: 2.1 time: 0.262844 Oct 16 01:17:11.801288 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1682/3523] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:11 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1221 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:12.040616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-aa7c611e-8107-49d6-91e1-9453cd91592e req-c3014abf-ac7d-47fd-b320-1853d555ea92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13e0541-5c0c-42d8-ab19-24a244571cc0", "tag": "b3aa0722-d6e1-40da-a884-8c11c9253b51"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:12.043393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:12.045882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:12.069266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:12.070321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:12.075603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:12.076804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:12.077410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:12.077815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:12.085346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aa7c611e-8107-49d6-91e1-9453cd91592e req-c3014abf-ac7d-47fd-b320-1853d555ea92 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:12.087074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aa7c611e-8107-49d6-91e1-9453cd91592e req-c3014abf-ac7d-47fd-b320-1853d555ea92 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:12.087517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aa7c611e-8107-49d6-91e1-9453cd91592e req-c3014abf-ac7d-47fd-b320-1853d555ea92 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:12.133141 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-aa7c611e-8107-49d6-91e1-9453cd91592e req-c3014abf-ac7d-47fd-b320-1853d555ea92 service nova] Creating event network-changed:b3aa0722-d6e1-40da-a884-8c11c9253b51 for instance e13e0541-5c0c-42d8-ab19-24a244571cc0 on n-h1-master-1 Oct 16 01:17:12.140217 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-aa7c611e-8107-49d6-91e1-9453cd91592e req-c3014abf-ac7d-47fd-b320-1853d555ea92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104126 Oct 16 01:17:12.143172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1683/3524] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:12.157980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:12.159267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:12.168314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:12.169735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:12.170376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:12.172450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:12.173325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:12.174196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:13.228085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:13.270563 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c47b7854-478c-4142-90fd-26ae6dceb25b tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1590 microversion: 2.1 time: 1.242239 Oct 16 01:17:13.274264 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1842/3525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:12 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1590 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:13.288626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:13.296583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:13.308505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:13.309716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:13.310323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:13.311245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:13.311783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:13.312602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:13.612183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:13.628845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:13.631404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:13.632937 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2edb16c5-d0d6-4421-af1a-0fdf8942b365 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 1.480459 Oct 16 01:17:13.633753 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1684/3526] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:12 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:13.672409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:13.673237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:13.680472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:13.681161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:13.681818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:13.682683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:13.683605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:13.684869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:13.838579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:13.850180 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b6144b0-fb3e-428a-9a42-9a12b478fc8b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1283 microversion: 2.1 time: 0.182160 Oct 16 01:17:13.851896 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1685/3527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:13 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:13.904763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:13.913833 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0feee8f2-d7c1-407d-9c33-04808c788d90 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.635381 Oct 16 01:17:13.914431 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1843/3528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:13 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:14.669856 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:14.671882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:14.680260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:14.681372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:14.682034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:14.682976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:14.684023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:14.686177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:14.876469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:14.877093 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:14.889159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:14.890002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:14.892263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:14.893238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:14.893952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:14.894607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:15.054839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:15.081989 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-54a783da-9371-4c4e-87a3-5755417d4386 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1283 microversion: 2.1 time: 0.208045 Oct 16 01:17:15.095849 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1844/3529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:14 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1283 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:15.119710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:15.121689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:15.131516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:15.132339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:15.132852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:15.133935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:15.134529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:15.135105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:15.143838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:15.160138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:15.162849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:15.163933 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:15.165025 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4ff297c7-3bf0-49c1-8e2d-90da7488264b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.501811 Oct 16 01:17:15.166854 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1686/3530] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:14 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:15.598540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:15.613773 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-72992810-d359-402b-9a00-881c16fa49b8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.515435 Oct 16 01:17:15.614596 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1845/3531] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:15 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:16.111444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:16.113016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:16.120707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:16.121548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:16.121988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:16.122702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:16.123318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:16.123745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:16.195021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:16.195652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:16.207063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:16.211313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:16.211914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:16.213535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:16.214264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:16.214957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:16.853734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:16.860584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:16.866219 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-651f60fb-4586-426f-8dae-518ef95af890 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 0.759236 Oct 16 01:17:16.868564 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1687/3532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:16 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:16.879548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:16.880489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:16.886227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:16.888133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:16.891950 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbcb0974-42b2-4a92-8cb5-85d89b4f7ec4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.701683 Oct 16 01:17:16.894839 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1846/3533] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:16 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:16.896676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:16.897359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:16.897987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:16.898865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:16.899517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:16.900120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:17.215406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:17.225144 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-972f8090-321a-4664-b25b-e6d0713f96d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.355052 Oct 16 01:17:17.225736 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1688/3534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:16 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:17.847158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1c745ddf-31d0-4788-a2d3-0d8a1ea3c3ff req-98e7e850-c97e-4167-b1de-8173503f91b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba45f6f-dad1-487f-893c-55a57d586424", "tag": "10d9b210-5360-4327-8158-0ddf79b6eff6"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:17.863745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1c745ddf-31d0-4788-a2d3-0d8a1ea3c3ff req-98e7e850-c97e-4167-b1de-8173503f91b2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:17.864997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1c745ddf-31d0-4788-a2d3-0d8a1ea3c3ff req-98e7e850-c97e-4167-b1de-8173503f91b2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:17.865855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1c745ddf-31d0-4788-a2d3-0d8a1ea3c3ff req-98e7e850-c97e-4167-b1de-8173503f91b2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:17.887311 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1c745ddf-31d0-4788-a2d3-0d8a1ea3c3ff req-98e7e850-c97e-4167-b1de-8173503f91b2 service nova] Creating event network-changed:10d9b210-5360-4327-8158-0ddf79b6eff6 for instance 2ba45f6f-dad1-487f-893c-55a57d586424 on n-h1-master-1 Oct 16 01:17:17.891810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:17.892293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:17.896417 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1c745ddf-31d0-4788-a2d3-0d8a1ea3c3ff req-98e7e850-c97e-4167-b1de-8173503f91b2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053161 Oct 16 01:17:17.897457 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1847/3535] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:17.907624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:17.908131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:17.908575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:17.909355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:17.910049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:17.910649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:17.926342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:17.927432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:17.934537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:17.935511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:17.936343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:17.937986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:17.939342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:17.940162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:18.663793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:18.680517 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f47a599e-76e0-4e0f-8341-09b1d7e1ed62 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 0.794480 Oct 16 01:17:18.681443 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1689/3536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:17 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:18.686433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:18.693949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:18.707892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:18.710254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:18.712823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:18.713827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:18.714602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:18.715276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:18.876577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:18.894905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:18.898785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:18.900281 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c31451df-6ef4-4ec3-b8b3-825870b4e9f9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.982290 Oct 16 01:17:18.903431 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1848/3537] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:17 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:19.714716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:19.715346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:19.723849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:19.724338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:19.724830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:19.725467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:19.736784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:19.737282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:20.142224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:20.155419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6c2c3275-ce22-47d6-80cc-63a093c10bb6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 1.472640 Oct 16 01:17:20.161772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1690/3538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:18 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:20.183785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:20.190166 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:20.211300 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:20.212224 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:20.218744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:20.222798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:20.225789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:20.227812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:20.239551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:20.240125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:20.504417 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:20.788640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:20.801268 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-172817a3-ecd7-438f-8f3a-de2f84cf62d7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 1.090320 Oct 16 01:17:20.802138 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1849/3539] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:19 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:21.081002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:21.094896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:21.099793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:21.103403 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-292a3105-0b4d-446c-bdfe-3582cd826767 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.940088 Oct 16 01:17:21.105734 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1691/3540] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:20 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:21.208447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:21.209370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:21.233857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:21.239741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:21.240801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:21.245581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:21.246560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:21.248192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:21.517806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:21.526254 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd1a2f78-0a51-4464-94bc-4f9f0c1af371 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.334875 Oct 16 01:17:21.538965 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1850/3541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:21 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:21.831838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:21.833539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:21.842372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:21.843298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:21.844793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:21.846145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:21.846984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:21.847854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:21.854859 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:22.099117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:22.112637 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b0920362-0139-4afa-aa51-464abf3cb6ca tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 0.286959 Oct 16 01:17:22.114097 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1692/3542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:21 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:22.149203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:22.150753 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:22.160999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:22.161950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:22.162603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:22.163586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:22.164308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:22.165158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:22.607039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:22.607039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:22.607039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:22.607039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:22.607039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:22.607039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:22.607039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:22.607039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:22.895558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:22.909545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:22.911489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:22.920064 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd6d9cb6-d112-444a-a584-e99f41b4f8a2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.775465 Oct 16 01:17:22.935424 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1851/3543] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:22 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:22.957003 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:22.958718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:22.968266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:22.969997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:22.970714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:22.971702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:22.972421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:22.973276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:23.480030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:23.491959 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7ca2e25-f850-4c33-ad67-ac1001c66330 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.938094 Oct 16 01:17:23.492670 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1693/3544] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:22 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:23.514345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:23.515467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:23.524113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:23.524719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:23.525118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:23.525921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:23.526379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:23.527035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:23.874265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:23.930489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:23.933387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:23.955774 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67cc1edf-fb4a-4b1a-98c0-7d694b819505 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2952 microversion: 2.42 time: 0.985901 Oct 16 01:17:23.958110 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1852/3545] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:22 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2952 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:17:23.966169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:23.967567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:23.977599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:23.978400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:23.979162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:23.983569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:23.984313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:23.989129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:24.084854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:24.187862 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-07bcd8df-74b9-49c6-b267-2db4c0111e66 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 0.626653 Oct 16 01:17:24.190717 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1694/3546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:23 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:24.210808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:24.218230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:24.241975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:24.246389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:24.246961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:24.248114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:24.250166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:24.250713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:24.521631 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:24.537628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:24.539124 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:24.540532 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bf62ad3e-2149-4890-997b-c5bdc61e03f8 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.581432 Oct 16 01:17:24.559341 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1853/3547] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:23 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:24.569895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:24.570526 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:24.587833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:24.588337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:24.588782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:24.589492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:24.593931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:24.594604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:24.660007 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-15794987-dccc-4e88-8ccb-1d2f9d5a6238 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.461688 Oct 16 01:17:24.665504 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1695/3548] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Oct 16 01:17:24 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345/os-interface => generated 1833 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:24.883804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1329378560", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:24.979279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] validate_networks() for [('fd237629-ce1a-4937-929e-be2979646ff8', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:17:25.000629 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:25.011222 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-926efd21-fb2c-408c-a901-77ae0fd2aa0b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.450571 Oct 16 01:17:25.018853 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1854/3549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:24 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:25.213899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:25.214523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:25.222387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:25.222893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:25.223363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:25.224088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:25.224584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:25.225033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:25.666067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:25.679491 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-affdfeef-bfd7-4f9a-a21f-61e6072d1500 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 0.469442 Oct 16 01:17:25.680358 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1855/3550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:25 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:25.685378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:25.689919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:25.704882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:25.707568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:25.708224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:25.709166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:25.711599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:25.712226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:26.173932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:17:26.174524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:17:26.174804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:17:26.175238 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:17:26.175650 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:17:26.196735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:26.207081 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:26.208540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:26.209747 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c9863197-6131-4395-89de-cfa1b9f331fa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.528242 Oct 16 01:17:26.210323 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1856/3551] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:25 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:26.223204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:26.228669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:26.229328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:26.231790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:26.232708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:26.233380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:26.234986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:26.238010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:26.242958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:26.244328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:26.245012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:26.245971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:26.246671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:26.247414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:26.281137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Getting quotas for project 01cfed1efa1c408287e3e10f4e0afcb2. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:17:26.290569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Getting quotas for user 50a92243b35f45a6bbcab9d288ae5271 and project 01cfed1efa1c408287e3e10f4e0afcb2. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:17:26.323410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:17:26.335366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:17:26.435294 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-27bb237b-f6ca-49ad-8840-5918c7c03cfa tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.768411 Oct 16 01:17:26.440799 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1696/3552] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:17:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:17:26.452035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3a0c0fc2-1ca9-46b5-be9d-ea515522d5b3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:26.458147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3a0c0fc2-1ca9-46b5-be9d-ea515522d5b3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:26.468049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:26.497952 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bbd8f798-a311-420c-9053-4cf7f88c2141 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.268502 Oct 16 01:17:26.499228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1857/3553] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:26 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:26.581201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3a0c0fc2-1ca9-46b5-be9d-ea515522d5b3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:26.595776 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3a0c0fc2-1ca9-46b5-be9d-ea515522d5b3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1223 microversion: 2.1 time: 0.147532 Oct 16 01:17:26.597819 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1697/3554] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:26 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:26.707199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:26.707811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:26.714430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:26.715168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:26.716268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:26.721989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:26.722738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:26.723374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:27.156473 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:27.168860 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f145e2d3-7b21-49f1-9bbb-43118a6019c1 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 0.465952 Oct 16 01:17:27.175666 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1858/3555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:26 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:27.237995 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:27.239361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:27.256031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:27.256910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:27.257819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:27.259282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:27.260139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:27.260945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:27.523957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:27.525482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:27.536455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:27.537532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:27.538293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:27.539642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:27.540156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:27.541404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:28.127830 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:28.151040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:28.156724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:28.162953 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4e3e978a-dcc6-4ffc-84e0-3188f1eac459 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.930065 Oct 16 01:17:28.164209 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1698/3556] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:27 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:28.175586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:28.177786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:28.196710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:28.197286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:28.198231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:28.199248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:28.199818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:28.200252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:28.369067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:28.381112 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-61af8f01-74e6-4367-8063-2bb6f081e2dc tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1275 microversion: 2.1 time: 0.212833 Oct 16 01:17:28.382946 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1699/3557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:28 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:28.392211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:28.403786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:28.422703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:28.425424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:28.425914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:28.427939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:28.430784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:28.431268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:28.492579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:28.517168 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6807d8d8-8d9b-42e6-bc7f-87cd72004109 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.998614 Oct 16 01:17:28.530050 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1859/3558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:27 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:28.570809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3abc2964-ac27-4b6f-8824-773837b14b39 req-c2d918b5-b084-44a9-819f-292185013804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba45f6f-dad1-487f-893c-55a57d586424", "name": "network-vif-plugged", "status": "completed", "tag": "10d9b210-5360-4327-8158-0ddf79b6eff6"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:28.601850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3abc2964-ac27-4b6f-8824-773837b14b39 req-c2d918b5-b084-44a9-819f-292185013804 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:28.602536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3abc2964-ac27-4b6f-8824-773837b14b39 req-c2d918b5-b084-44a9-819f-292185013804 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:28.603145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3abc2964-ac27-4b6f-8824-773837b14b39 req-c2d918b5-b084-44a9-819f-292185013804 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:28.659668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3abc2964-ac27-4b6f-8824-773837b14b39 req-c2d918b5-b084-44a9-819f-292185013804 service nova] Creating event network-vif-plugged:10d9b210-5360-4327-8158-0ddf79b6eff6 for instance 2ba45f6f-dad1-487f-893c-55a57d586424 on n-h1-master-1 Oct 16 01:17:28.668494 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3abc2964-ac27-4b6f-8824-773837b14b39 req-c2d918b5-b084-44a9-819f-292185013804 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113805 Oct 16 01:17:28.682382 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1860/3559] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:17:28.843043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:28.864830 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0fb21fda-d7eb-473e-b7ce-94b803ff9368 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 0.479975 Oct 16 01:17:28.867448 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1700/3560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:28 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:29.193376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:29.194407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:29.210256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:29.211376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:29.217946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:29.220696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:29.221735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:29.222551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:29.409871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:29.410491 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:29.452294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:29.456809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:29.457312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:29.458090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:29.458583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:29.465904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:29.683044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:29.695746 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4cbcfa75-4845-4a34-9208-9a654f994e54 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1281 microversion: 2.1 time: 0.289978 Oct 16 01:17:29.704279 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1701/3561] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:29 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1281 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:29.720663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:29.752637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:29.753278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:29.767902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:29.779627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:29.788758 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-04d8a346-1098-47a3-a87f-8ee76f268c7f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.597123 Oct 16 01:17:29.789499 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1861/3562] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:29 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:29.792839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:29.795226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:29.796979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:29.799642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:29.803357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:29.805821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:29.896058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:29.897067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:29.907688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:29.916741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:29.917461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:29.918464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:29.919882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:29.920581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:30.297361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:30.317305 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39b91b5a-6a79-4374-b6aa-1455588042ea tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.611448 Oct 16 01:17:30.318195 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1702/3563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:29 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:30.480011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:30.490432 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f78ad5a5-9438-49bf-986b-8d3aa54fef25 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1325 microversion: 2.1 time: 0.600174 Oct 16 01:17:30.491881 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1862/3564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:29 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1325 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:30.729571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:30.730192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:30.751876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:30.752393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:30.752840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:30.753566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:30.754030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:30.754452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:30.825738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:30.827176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:30.838517 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:30.847253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:30.848169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:30.848437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:30.849434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:30.850075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:30.851235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:30.897040 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:31.351891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:31.367451 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2bbad82f-ac25-4eb1-926e-b44c5f859a82 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1323 microversion: 2.1 time: 0.641953 Oct 16 01:17:31.368078 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1703/3565] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:30 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1323 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:31.372837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a81befaa-8761-4996-b9c2-6e0eab184d11 req-a7267b18-ede8-4cde-bc5d-eabf12aaab2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-plugged", "status": "completed", "tag": "6eae5487-8226-4e36-857f-2781b0723f1e"}, {"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-plugged", "status": "completed", "tag": "6226c3c9-8fe3-4a03-a63f-47872bcfc9d2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:31.397749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a81befaa-8761-4996-b9c2-6e0eab184d11 req-a7267b18-ede8-4cde-bc5d-eabf12aaab2a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:31.402281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a81befaa-8761-4996-b9c2-6e0eab184d11 req-a7267b18-ede8-4cde-bc5d-eabf12aaab2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:31.402959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a81befaa-8761-4996-b9c2-6e0eab184d11 req-a7267b18-ede8-4cde-bc5d-eabf12aaab2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:31.421053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:31.437668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:31.443031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a81befaa-8761-4996-b9c2-6e0eab184d11 req-a7267b18-ede8-4cde-bc5d-eabf12aaab2a service nova] Creating event network-vif-plugged:6eae5487-8226-4e36-857f-2781b0723f1e for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:17:31.445098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:31.445924 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a81befaa-8761-4996-b9c2-6e0eab184d11 req-a7267b18-ede8-4cde-bc5d-eabf12aaab2a service nova] Creating event network-vif-plugged:6226c3c9-8fe3-4a03-a63f-47872bcfc9d2 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:17:31.448842 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fadfa4dd-9ac5-4580-a78a-b72450e2523e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.627339 Oct 16 01:17:31.470582 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1863/3566] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:30 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:17:31.481288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:31.482279 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a81befaa-8761-4996-b9c2-6e0eab184d11 req-a7267b18-ede8-4cde-bc5d-eabf12aaab2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105584 Oct 16 01:17:31.483540 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1704/3567] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:31.484993 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:31.491691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:31.492598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:31.493325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:31.494460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:31.495223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:31.495967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:31.515898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:31.517034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:31.528315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:31.529229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:31.531645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:31.534813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:31.535573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:31.536266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:31.940827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:31.947307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:31.954386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7cebb8e6-4edc-45a6-beec-5fdf3fa8038d tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1513 microversion: 2.1 time: 0.479768 Oct 16 01:17:31.956223 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1864/3568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:31 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1513 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:31.960132 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-823e6853-f94d-44b8-9f1f-940a9fdfe24e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.448966 Oct 16 01:17:31.960719 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1705/3569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:31 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:31.986182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:31.986877 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:31.994110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:31.994809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:31.995422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:31.996131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:31.996824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:31.997550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:32.268698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b5b3a04f-5098-4547-8e69-84e02bb18f75 req-4a3fecf0-93da-40e6-b73a-a9563a18ceab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9077a263-02c3-436e-88a4-7c9e7fdff381", "tag": "a1f3c24b-6b41-4ee3-90f6-db432aca651c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:32.292885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b5b3a04f-5098-4547-8e69-84e02bb18f75 req-4a3fecf0-93da-40e6-b73a-a9563a18ceab service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:32.293870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b5b3a04f-5098-4547-8e69-84e02bb18f75 req-4a3fecf0-93da-40e6-b73a-a9563a18ceab service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:32.297104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b5b3a04f-5098-4547-8e69-84e02bb18f75 req-4a3fecf0-93da-40e6-b73a-a9563a18ceab service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:32.323643 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b5b3a04f-5098-4547-8e69-84e02bb18f75 req-4a3fecf0-93da-40e6-b73a-a9563a18ceab service nova] Creating event network-changed:a1f3c24b-6b41-4ee3-90f6-db432aca651c for instance 9077a263-02c3-436e-88a4-7c9e7fdff381 on n-h1-master-1 Oct 16 01:17:32.331683 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b5b3a04f-5098-4547-8e69-84e02bb18f75 req-4a3fecf0-93da-40e6-b73a-a9563a18ceab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066674 Oct 16 01:17:32.332343 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1706/3570] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:17:32.392897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:32.393796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:32.405016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:32.407829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:32.408848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:32.409790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:32.410778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:32.411995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:32.412822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:32.417094 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f4c179a9-3b7e-4f94-be58-b016d87eb792 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.435292 Oct 16 01:17:32.417692 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1865/3571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:31 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:32.451319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f7f30fb-d811-4770-9a2f-3939355d2a92 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-276287542", "metadata": {"": ""}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f7f30fb-d811-4770-9a2f-3939355d2a92 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action HTTP/1.1 Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 106 Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-276287542", "metadata": {"": ""}}} Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '2ba45f6f-dad1-487f-893c-55a57d586424', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-276287542', 'metadata': {'': ''}}}} Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'': ''} Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:17:32.459810 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f7f30fb-d811-4770-9a2f-3939355d2a92 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2f7f30fb-d811-4770-9a2f-3939355d2a92 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action" status: 400 len: 170 microversion: 2.1 time: 0.015378 Oct 16 01:17:32.467217 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1866/3572] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Oct 16 01:17:32 2022] POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action => generated 170 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:17:32.492544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:32.493210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:32.525035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:32.525577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:32.532918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:32.533562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:32.534084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:32.534545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:32.967023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:32.976936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:32.978779 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b63a1e4e-9fc9-47be-bafd-75eea93f9e5d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.511752 Oct 16 01:17:32.983504 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1867/3573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:32 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:33.003359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2f4607e9-f7dc-400f-9ce4-ff0929502a2e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1323 microversion: 2.1 time: 0.612656 Oct 16 01:17:33.003984 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1707/3574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:32 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1323 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:33.011494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:33.013501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:33.020682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:33.023417 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:33.032232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.032740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.038243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.041217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.042024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.042854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.045310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.046124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.048484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.050718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.052152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.054512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.444002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:33.455212 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b1372a9-d81a-43c8-a8bf-0c3161e4abc7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1519 microversion: 2.1 time: 0.448443 Oct 16 01:17:33.455548 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1708/3575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:33 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1519 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:33.469236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:33.469887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:33.472904 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:33.478766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:33.479692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.480401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.481020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.482030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.483228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.484474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.506156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:33.508542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:33.510603 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-74ca8b44-919d-472f-aa66-fbe510b4cfe5 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.525847 Oct 16 01:17:33.512263 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1868/3576] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:32 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:33.544070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-plugged", "status": "completed", "tag": "79104e9d-c9a5-4a7e-a71d-9b185dcbe67f"}, {"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-plugged", "status": "completed", "tag": "c8ad3925-dc7f-4b61-a13a-cc7ae0c226c4"}, {"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-plugged", "status": "completed", "tag": "bdeecbcc-2073-44c7-b6bc-319fee13943b"}, {"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-plugged", "status": "completed", "tag": "6232908a-2443-4f5d-9f4e-ab5cbda8380a"}, {"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-plugged", "status": "completed", "tag": "6ae41fd0-83d8-42e9-b4e5-8d61d0a332d2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:33.557770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.558338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.559165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.581364 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Creating event network-vif-plugged:79104e9d-c9a5-4a7e-a71d-9b185dcbe67f for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:17:33.581894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Creating event network-vif-plugged:c8ad3925-dc7f-4b61-a13a-cc7ae0c226c4 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:17:33.582390 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Creating event network-vif-plugged:bdeecbcc-2073-44c7-b6bc-319fee13943b for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:17:33.582898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Creating event network-vif-plugged:6232908a-2443-4f5d-9f4e-ab5cbda8380a for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:17:33.583433 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] Creating event network-vif-plugged:6ae41fd0-83d8-42e9-b4e5-8d61d0a332d2 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:17:33.590421 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4bf0b426-be2b-4501-bb67-8870c160ed0e req-2d28610f-da04-400d-b1d5-c9c4fa2df540 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.050842 Oct 16 01:17:33.591400 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1869/3577] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:33.685271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:33.694767 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dc55d887-e66d-410a-ab4d-ca974d2d9317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.235903 Oct 16 01:17:33.695389 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1709/3578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:33 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:33.718036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-717fb097-04af-4422-b3fb-32677466180c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2099788908", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-717fb097-04af-4422-b3fb-32677466180c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action HTTP/1.1 Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 619 Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2099788908", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '2ba45f6f-dad1-487f-893c-55a57d586424', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2099788908', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:17:33.723121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:17:33.726176 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:33.730589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-717fb097-04af-4422-b3fb-32677466180c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:17:33.730589 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-717fb097-04af-4422-b3fb-32677466180c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action" status: 400 len: 938 microversion: 2.1 time: 0.011225 Oct 16 01:17:33.735386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:33.736085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:33.740485 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1870/3579] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Oct 16 01:17:33 2022] POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action => generated 938 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:17:33.744095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.744731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.745252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.746024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:33.746543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:33.747061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:33.941208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:33.959383 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f2c9dc23-7857-4b90-953a-298e4c189b90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.228543 Oct 16 01:17:33.960214 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1710/3580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:33 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:33.987243 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:33.989442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:34.010295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:34.012213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:34.012936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:34.013964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:34.014735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:34.015473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:34.029323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:34.029898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:34.040136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:34.053718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:34.054701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:34.058385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:34.059765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:34.060606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:34.315686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:34.325122 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b31278d9-a78c-4d20-98b0-c8b7f57e1a9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1323 microversion: 2.1 time: 0.301488 Oct 16 01:17:34.326087 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1711/3581] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:34 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1323 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:34.326937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:34.338577 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-36aa3c25-f4e1-43eb-871d-157b1fdb9912 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.356968 Oct 16 01:17:34.347019 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1871/3582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:33 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:34.363466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3988ede7-9961-4c97-af49-565339a94b7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3988ede7-9961-4c97-af49-565339a94b7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action HTTP/1.1 Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 285 Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '2ba45f6f-dad1-487f-893c-55a57d586424', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:34.368267 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:17:34.372092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:34.377456 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3988ede7-9961-4c97-af49-565339a94b7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:17:34.378694 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3988ede7-9961-4c97-af49-565339a94b7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action" status: 400 len: 619 microversion: 2.1 time: 0.020179 Oct 16 01:17:34.379902 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1712/3583] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Oct 16 01:17:34 2022] POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:17:34.390533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:34.391513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:34.405063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:34.405765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:34.406772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:34.408218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:34.408816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:34.409342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:34.481379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:34.482178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:34.491676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:34.492989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:34.494327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:34.495423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:34.496707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:34.497381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:34.503658 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:35.110577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:35.124136 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a27dcbc-dd67-48b7-9a81-7878d716599a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.739892 Oct 16 01:17:35.125229 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1872/3584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:34 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:35.132230 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:35.132854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:35.141301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:35.142313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:35.143242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:35.144848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:35.145551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:35.146326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:35.262731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:35.272411 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d62d2b37-12d5-43c4-95c5-89fb6b90ba74 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1519 microversion: 2.1 time: 0.796579 Oct 16 01:17:35.274517 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1713/3585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:34 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1519 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:35.279604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:35.280407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:35.289508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:35.289992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:35.290599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:35.291547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:35.291997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:35.292606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:35.684123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:35.698206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:35.702195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:35.705211 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cdb37c2e-6396-40c3-a36a-6ec3d0025e43 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1879 microversion: 2.32 time: 0.577274 Oct 16 01:17:35.706008 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1873/3586] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:35 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1879 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:35.725758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:35.726388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:35.737134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:35.737134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:35.737134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:35.737522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:35.737912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:35.740467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:35.818877 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:35.830964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9cc6e1d7-698f-4bc8-a56d-b47f79d9fa90 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.554999 Oct 16 01:17:35.832111 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1714/3587] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:35 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:35.873777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2051345593"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:35.878793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:35.889060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:35.891873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:35.892854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:35.894906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:35.897505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:35.897950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:36.072141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:36.091674 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ee2b9a5-27e6-4d95-80bc-c7b41cf6b628 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1323 microversion: 2.1 time: 0.384406 Oct 16 01:17:36.094699 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1874/3588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:35 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:36.262196 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:36.274318 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fc83c9dc-3d46-4847-9ce9-f08e33f09910 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action" status: 202 len: 0 microversion: 2.1 time: 0.408332 Oct 16 01:17:36.287478 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1715/3589] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:17:35 2022] POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 16 01:17:36.297747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1709347441"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:36.300747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:36.301645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:36.302258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:36.319000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:36.319394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:36.322956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:36.326638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:36.327214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:36.328113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:36.328632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:36.332308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:36.333674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:36.335715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:36.336663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:36.338335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:36.389090 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Cannot 'createImage' instance 2ba45f6f-dad1-487f-893c-55a57d586424 while it is in task_state image_snapshot_pending Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action HTTP/1.1 Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 85 Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1709347441"}} Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'createImage' instance 2ba45f6f-dad1-487f-893c-55a57d586424 while it is in task_state image_snapshot_pending Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '2ba45f6f-dad1-487f-893c-55a57d586424', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1709347441'}}} Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:17:36.391003 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 2ba45f6f-dad1-487f-893c-55a57d586424 while it is in task_state image_snapshot_pending Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 2ba45f6f-dad1-487f-893c-55a57d586424 while it is in task_state image_snapshot_pending Oct 16 01:17:36.396684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:36.399046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 409 to user: Cannot 'createImage' instance 2ba45f6f-dad1-487f-893c-55a57d586424 while it is in task_state image_snapshot_pending {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:17:36.400958 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-37f169c3-f744-419d-b222-b555245d1676 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action" status: 409 len: 167 microversion: 2.1 time: 0.113440 Oct 16 01:17:36.401883 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1875/3590] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:17:36 2022] POST /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424/action => generated 167 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:17:36.413676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d408f82-4879-419a-90ca-782cf49ea21f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '.version_select at 0x7fd64df954c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:36.586235 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:36.667712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:36.686109 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d408f82-4879-419a-90ca-782cf49ea21f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/images/e8c7252f-581c-425b-bb7f-cad7c88aaa54" status: 204 len: 0 microversion: 2.1 time: 0.278789 Oct 16 01:17:36.687836 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1876/3591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:36 2022] DELETE /compute/v2.1/images/e8c7252f-581c-425b-bb7f-cad7c88aaa54 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:17:36.696347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:36.697172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:36.703498 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f88c2c4-4671-4bc2-a441-cf986fe9d4ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1519 microversion: 2.1 time: 0.406983 Oct 16 01:17:36.704813 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1716/3592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:36 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1519 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:36.725302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:36.725878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:36.726336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:36.729578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:36.731352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:36.732837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:36.734232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:36.735650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:36.742006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:36.742769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:36.743509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:36.748259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:36.748962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:36.749723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:37.107553 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:37.125114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:37.129095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:37.130690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:37.130857 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c5f5503-8d97-47cc-bba5-802dae9ad944 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2834 microversion: 2.32 time: 0.401979 Oct 16 01:17:37.143001 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1717/3593] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:17:36 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2834 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:17:37.143688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f51bbd64-05dc-4765-876b-d0100420e8f3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1534 microversion: 2.1 time: 0.450248 Oct 16 01:17:37.143688 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1877/3594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:36 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1534 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:37.147114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:37.147930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:37.154659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:37.155358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:37.156209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:37.157093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:37.157726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:37.158335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:37.162096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:37.162621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:37.171253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:37.172172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:37.174717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:37.175730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:37.176427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:37.177290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:37.377507 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97be197f-1830-4fdf-92ef-7046591e7fb4 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.219348 Oct 16 01:17:37.379140 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1878/3595] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Oct 16 01:17:37 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966/os-interface => generated 1832 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:17:37.429571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:37.445379 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-754d7dea-a0f3-4ad6-9a70-ae431e668bb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1323 microversion: 2.1 time: 0.310490 Oct 16 01:17:37.446586 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1718/3596] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:37 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:37.730672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:37.732597 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:37.742837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:37.751833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b407cac1-26cc-47d5-8ecf-879a5e94f09b req-598261c8-342d-4f40-9fbb-c0bae84ef5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf6c30be-76fa-4872-a2ff-402025041451", "name": "network-vif-unplugged", "status": "completed", "tag": "f724bce2-95dc-4224-bf96-92f5f86df17b"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:37.757942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:37.759477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:37.762343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:37.763134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:37.763819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:37.773629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b407cac1-26cc-47d5-8ecf-879a5e94f09b req-598261c8-342d-4f40-9fbb-c0bae84ef5f3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:37.774260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b407cac1-26cc-47d5-8ecf-879a5e94f09b req-598261c8-342d-4f40-9fbb-c0bae84ef5f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:37.775420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b407cac1-26cc-47d5-8ecf-879a5e94f09b req-598261c8-342d-4f40-9fbb-c0bae84ef5f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:37.808855 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b407cac1-26cc-47d5-8ecf-879a5e94f09b req-598261c8-342d-4f40-9fbb-c0bae84ef5f3 service nova] Creating event network-vif-unplugged:f724bce2-95dc-4224-bf96-92f5f86df17b for instance bf6c30be-76fa-4872-a2ff-402025041451 on n-h2-master-1 Oct 16 01:17:37.823518 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b407cac1-26cc-47d5-8ecf-879a5e94f09b req-598261c8-342d-4f40-9fbb-c0bae84ef5f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078907 Oct 16 01:17:37.831750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1719/3597] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:38.169917 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:38.170683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:38.189659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:38.191608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:38.193057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:38.193517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:38.195147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:38.195678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:38.196124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:38.201050 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8f5c313-f464-4068-ac67-e5c57a379e23 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1519 microversion: 2.1 time: 0.476601 Oct 16 01:17:38.208838 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1879/3598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:37 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1519 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:38.475763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:38.477300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:38.491079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:38.493074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:38.494811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:38.497166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:38.499903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:38.500591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:39.091048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:39.105974 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-acdcbaa7-ec02-46e6-85c0-ffa1b5f545e6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1540 microversion: 2.1 time: 0.940664 Oct 16 01:17:39.118950 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1720/3599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:38 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1540 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:39.154214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:39.169152 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da930748-52b5-4213-9109-8a61d9eb1269 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1323 microversion: 2.1 time: 0.699686 Oct 16 01:17:39.179654 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1880/3600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:38 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1323 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:39.231915 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:39.232532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:39.242814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:39.243348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:39.243786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:39.244494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:39.244956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:39.245376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:39.552183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:39.580408 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-acb66a25-f365-468b-bca8-e9ec73039813 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1519 microversion: 2.1 time: 0.347453 Oct 16 01:17:39.581268 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1721/3601] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:39 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1519 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:39.876423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5b74b957-fdf8-4b0b-9c2a-e1fed21cbb53 req-eefa3054-4722-4feb-95c0-6a27ae5a17e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9077a263-02c3-436e-88a4-7c9e7fdff381", "name": "network-vif-plugged", "status": "completed", "tag": "a1f3c24b-6b41-4ee3-90f6-db432aca651c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:39.886873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5b74b957-fdf8-4b0b-9c2a-e1fed21cbb53 req-eefa3054-4722-4feb-95c0-6a27ae5a17e9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:39.887381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5b74b957-fdf8-4b0b-9c2a-e1fed21cbb53 req-eefa3054-4722-4feb-95c0-6a27ae5a17e9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:39.887817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5b74b957-fdf8-4b0b-9c2a-e1fed21cbb53 req-eefa3054-4722-4feb-95c0-6a27ae5a17e9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:39.903146 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5b74b957-fdf8-4b0b-9c2a-e1fed21cbb53 req-eefa3054-4722-4feb-95c0-6a27ae5a17e9 service nova] Creating event network-vif-plugged:a1f3c24b-6b41-4ee3-90f6-db432aca651c for instance 9077a263-02c3-436e-88a4-7c9e7fdff381 on n-h1-master-1 Oct 16 01:17:39.911738 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5b74b957-fdf8-4b0b-9c2a-e1fed21cbb53 req-eefa3054-4722-4feb-95c0-6a27ae5a17e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040649 Oct 16 01:17:39.912666 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1881/3602] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:40.057111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2108641f-259c-48c7-98a4-90ec7554d99d req-264e7b08-3374-4d38-88d3-f2df51736b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "tag": "6ae41fd0-83d8-42e9-b4e5-8d61d0a332d2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:40.080482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2108641f-259c-48c7-98a4-90ec7554d99d req-264e7b08-3374-4d38-88d3-f2df51736b27 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.081264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2108641f-259c-48c7-98a4-90ec7554d99d req-264e7b08-3374-4d38-88d3-f2df51736b27 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.081721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2108641f-259c-48c7-98a4-90ec7554d99d req-264e7b08-3374-4d38-88d3-f2df51736b27 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.140556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:40.141300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:40.146446 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2108641f-259c-48c7-98a4-90ec7554d99d req-264e7b08-3374-4d38-88d3-f2df51736b27 service nova] Creating event network-changed:6ae41fd0-83d8-42e9-b4e5-8d61d0a332d2 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:17:40.169761 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2108641f-259c-48c7-98a4-90ec7554d99d req-264e7b08-3374-4d38-88d3-f2df51736b27 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124539 Oct 16 01:17:40.171131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.172510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.172975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.173911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.174392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.179500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.180325 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1722/3603] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:40.198176 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:40.201486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:40.229723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.230256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.230714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.231490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.231962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.233726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.685987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:40.697669 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ae61e66-431c-4233-8ccb-a1962d885551 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1522 microversion: 2.1 time: 0.567112 Oct 16 01:17:40.698615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:40.708130 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1882/3604] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:40 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:40.717027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:40.725071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:40.727233 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-de26afd6-fd44-4d2b-908f-29ac62fb6dc5 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1323 microversion: 2.1 time: 0.537192 Oct 16 01:17:40.728030 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1723/3605] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:40 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1323 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:40.747877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.748377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.748817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.749604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.750258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.750690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.752628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:40.753550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:40.772901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.774139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.774761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.776092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:40.776797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:40.777402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:40.823959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:17:41.006801 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e387272f-b788-4012-b051-0dad76bb6a05 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 204 len: 0 microversion: 2.1 time: 0.265378 Oct 16 01:17:41.012035 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1724/3606] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:17:40 2022] DELETE /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:17:41.024365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:41.025931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:41.040299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.041025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.044534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:41.045546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.046027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.046531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:41.085138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:41.099559 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1b8a1578-5046-4a5b-b108-9d4f75a95095 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1519 microversion: 2.1 time: 0.389859 Oct 16 01:17:41.103983 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1883/3607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:40 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:41.284625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:41.297051 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e3904283-fc16-40a2-8a93-f732333b1e43 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1528 microversion: 2.1 time: 0.282910 Oct 16 01:17:41.313211 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1725/3608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:41 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1528 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:41.511858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:41.520224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:41.524500 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Searching by: {'deleted': False, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:17:41.550421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.551594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.554029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:41.557035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.558615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.560768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:41.635679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:17:41.701513 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:41.706136 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a18f160-4c4f-4f1e-bc24-262b063be683 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.199272 Oct 16 01:17:41.715590 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1884/3609] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:17:41 2022] GET /compute/v2.1/servers => generated 340 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:41.726507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:41.732715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:41.734818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Searching by: {'deleted': False, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:17:41.741972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.748116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.755218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:41.757946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:41.759856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:41.760716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.763738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.764857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:41.778947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.779868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.781111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:41.782111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.786893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.787867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:41.821376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:17:41.940359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:41.956713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:41.959242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:41.959872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:42.296024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:42.310445 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f7c1f08-72b3-4541-bd42-1c3fa22ce2e9 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1323 microversion: 2.1 time: 0.560437 Oct 16 01:17:42.311065 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1885/3610] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:41 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1323 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:42.328539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:42.329290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:42.336879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:42.337297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:42.337725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:42.345152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:42.345633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:42.346076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:42.487922 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0d9f62b4-c711-4a6e-9757-0cba141bbd83 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.768620 Oct 16 01:17:42.492379 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1726/3611] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:17:41 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:42.499830 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:42.501478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:42.512886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:42.513933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:42.515206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:42.516716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:42.517439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:42.526365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:42.577909 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:42.761075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:42.772273 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a4b7646-e6b5-462c-8d1b-156e0e3521fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1519 microversion: 2.1 time: 0.458151 Oct 16 01:17:42.778201 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1886/3612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:42 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1519 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:42.783259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcd6db69-6989-49f7-8c42-9805078d5a07 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:42.794092 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcd6db69-6989-49f7-8c42-9805078d5a07 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019463 Oct 16 01:17:42.795557 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1887/3613] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:17:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:42.802950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-61373c4c-b7e2-4e82-acc4-03aa1cde1733 req-0c9b6d8b-43af-4112-802f-7698b7ce1597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf6c30be-76fa-4872-a2ff-402025041451", "name": "network-vif-plugged", "status": "completed", "tag": "f724bce2-95dc-4224-bf96-92f5f86df17b"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:42.810560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:42.817931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-61373c4c-b7e2-4e82-acc4-03aa1cde1733 req-0c9b6d8b-43af-4112-802f-7698b7ce1597 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:42.818699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-61373c4c-b7e2-4e82-acc4-03aa1cde1733 req-0c9b6d8b-43af-4112-802f-7698b7ce1597 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:42.819327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-61373c4c-b7e2-4e82-acc4-03aa1cde1733 req-0c9b6d8b-43af-4112-802f-7698b7ce1597 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:42.820709 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03aa5a71-0ecf-4736-9c86-780b08cfa8c3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1528 microversion: 2.1 time: 0.326764 Oct 16 01:17:42.821903 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1727/3614] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:42 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1528 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:42.836064 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-61373c4c-b7e2-4e82-acc4-03aa1cde1733 req-0c9b6d8b-43af-4112-802f-7698b7ce1597 service nova] Creating event network-vif-plugged:f724bce2-95dc-4224-bf96-92f5f86df17b for instance bf6c30be-76fa-4872-a2ff-402025041451 on n-h2-master-1 Oct 16 01:17:42.856848 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-61373c4c-b7e2-4e82-acc4-03aa1cde1733 req-0c9b6d8b-43af-4112-802f-7698b7ce1597 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058562 Oct 16 01:17:42.859962 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1888/3615] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:43.338461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:43.339960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:43.350010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:43.351017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:43.351670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:43.352669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:43.353385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:43.355245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:43.559834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:43.562545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:43.573081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:43.573989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:43.574853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:43.575967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:43.578619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:43.580087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:43.616210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:17:43.729880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:43.767602 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-197a0902-baaa-40b4-8d6f-2d0c83b19855 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1518 microversion: 2.1 time: 0.430394 Oct 16 01:17:43.772258 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1728/3616] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:43 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1518 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:43.784447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-171d852d-b3ba-40eb-81c1-dea24e4e1c4d tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 204 len: 0 microversion: 2.1 time: 0.256839 Oct 16 01:17:43.789967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1889/3617] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:17:43 2022] DELETE /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:17:43.795055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:43.797656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:43.807156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:43.807871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:43.813638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:43.814132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:43.814773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:43.816979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:43.817612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:43.818050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:43.822677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:43.825584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:43.829391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:43.830389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:43.840906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:43.841395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:43.892388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lazy-loading 'flavor' on Instance uuid 9077a263-02c3-436e-88a4-7c9e7fdff381 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:17:44.056348 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a441dfb9-cf15-4f61-b811-cc3768c6dc68 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action" status: 200 len: 32 microversion: 2.1 time: 0.265554 Oct 16 01:17:44.057896 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1729/3618] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:17:43 2022] POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:17:44.066819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:44.068084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:44.076093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:44.076923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:44.078138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:44.079221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:44.080218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:44.081024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:44.599295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:44.612465 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42c1815f-120b-45cc-93a7-262127eca774 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1715 microversion: 2.1 time: 0.810501 Oct 16 01:17:44.613786 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1890/3619] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:43 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1715 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:44.621496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:44.623009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:44.631283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:44.632043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:44.632664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:44.633602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:44.634230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:44.634829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:44.821071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:44.834339 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-771925e3-44e7-40bc-aee2-247b614faa76 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1486 microversion: 2.1 time: 0.219174 Oct 16 01:17:44.852043 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1891/3620] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:44 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1486 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:44.852043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:44.852043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:44.854837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:44.855600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:44.856218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:44.857118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:44.857753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:44.858763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:44.937646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:44.947660 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-733d8f19-1162-45e4-a40a-c15f6a8f146c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1519 microversion: 2.1 time: 0.887048 Oct 16 01:17:44.948330 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1730/3621] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:44 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1519 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:44.954968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f7e99939-bd74-4ef0-b2b1-bbdbde8de30a req-ed2afa7b-468e-4916-b02b-5db2e40d952b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba45f6f-dad1-487f-893c-55a57d586424", "name": "network-vif-deleted", "tag": "10d9b210-5360-4327-8158-0ddf79b6eff6"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:44.976320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7e99939-bd74-4ef0-b2b1-bbdbde8de30a req-ed2afa7b-468e-4916-b02b-5db2e40d952b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:44.979586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7e99939-bd74-4ef0-b2b1-bbdbde8de30a req-ed2afa7b-468e-4916-b02b-5db2e40d952b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:44.980288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7e99939-bd74-4ef0-b2b1-bbdbde8de30a req-ed2afa7b-468e-4916-b02b-5db2e40d952b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:45.011929 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f7e99939-bd74-4ef0-b2b1-bbdbde8de30a req-ed2afa7b-468e-4916-b02b-5db2e40d952b service nova] Creating event network-vif-deleted:10d9b210-5360-4327-8158-0ddf79b6eff6 for instance 2ba45f6f-dad1-487f-893c-55a57d586424 on n-h1-master-1 Oct 16 01:17:45.025917 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f7e99939-bd74-4ef0-b2b1-bbdbde8de30a req-ed2afa7b-468e-4916-b02b-5db2e40d952b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075938 Oct 16 01:17:45.027150 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1731/3622] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:45.252997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:45.271242 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60e582aa-e9de-4b2f-a9e6-aaaeffff9819 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 0.430888 Oct 16 01:17:45.272053 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1892/3623] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:44 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:45.644369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:45.645439 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:45.654965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:45.658788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:45.659576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:45.660707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:45.661387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:45.662058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:45.866328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:45.867595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:45.881358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:45.888236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:45.888839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:45.889613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:45.890634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:45.891493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:46.023434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:46.024224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:46.024863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:46.025504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lazy-loading 'fault' on Instance uuid 2ba45f6f-dad1-487f-893c-55a57d586424 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:17:46.163760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:46.175444 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-448725c3-c1b8-4d53-9595-5730be325441 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 200 len: 1315 microversion: 2.1 time: 0.313545 Oct 16 01:17:46.193419 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1893/3624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:45 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:46.204683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:46.205315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:46.220215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:46.221078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:46.221688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:46.222694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:46.223377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:46.223972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:46.639643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:46.662501 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22381db6-0e39-47e3-b56d-1e547b0fa46a tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1715 microversion: 2.1 time: 1.028513 Oct 16 01:17:46.663195 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1732/3625] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:45 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1715 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:46.680926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:46.681551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:46.724815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:46.726194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:46.728343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:46.730388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:46.732912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:46.736123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:46.807659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:46.828190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7cfdb9bb-c4b2-4e87-b710-4cfd47ce0f1c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1504 microversion: 2.1 time: 0.633425 Oct 16 01:17:46.831794 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1894/3626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:46 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1504 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:46.864087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:46.864733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:46.887194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:46.894532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:46.896944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:46.898031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:46.899543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:46.901604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.683576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:47.694384 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-408281c3-3b70-4942-8486-cd23bf54689e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 200 len: 1504 microversion: 2.1 time: 0.840515 Oct 16 01:17:47.695027 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1895/3627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:46 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 1504 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:47.724864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b918e1de-611f-4176-bea2-62d2c48ddbd2 req-cc2a8eb7-dee6-41c5-9208-f1b16eee2d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13e0541-5c0c-42d8-ab19-24a244571cc0", "name": "network-vif-deleted", "tag": "b3aa0722-d6e1-40da-a884-8c11c9253b51"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:47.739626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b918e1de-611f-4176-bea2-62d2c48ddbd2 req-cc2a8eb7-dee6-41c5-9208-f1b16eee2d7e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:47.740462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b918e1de-611f-4176-bea2-62d2c48ddbd2 req-cc2a8eb7-dee6-41c5-9208-f1b16eee2d7e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:47.741267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b918e1de-611f-4176-bea2-62d2c48ddbd2 req-cc2a8eb7-dee6-41c5-9208-f1b16eee2d7e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.755264 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b918e1de-611f-4176-bea2-62d2c48ddbd2 req-cc2a8eb7-dee6-41c5-9208-f1b16eee2d7e service nova] Creating event network-vif-deleted:b3aa0722-d6e1-40da-a884-8c11c9253b51 for instance e13e0541-5c0c-42d8-ab19-24a244571cc0 on n-h1-master-1 Oct 16 01:17:47.763621 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b918e1de-611f-4176-bea2-62d2c48ddbd2 req-cc2a8eb7-dee6-41c5-9208-f1b16eee2d7e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049641 Oct 16 01:17:47.764468 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1896/3628] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:47.772591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:47.773504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:47.782842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:47.783463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:47.783978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.784763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:47.785226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:47.785710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.792349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:47.810868 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-794b8036-c166-43bb-9255-bce922735df3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 1.143753 Oct 16 01:17:47.813586 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1733/3629] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:46 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:47.823994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:47.826304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:47.833178 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 HTTP/1.1 Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '2ba45f6f-dad1-487f-893c-55a57d586424'} Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:47.835906 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:47.841506 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:47.841506 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:47.841506 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:47.841506 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:47.841506 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:17:47.841506 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:17:47.841506 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:17:47.841506 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:17:47.843554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:17:47.845304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-37440d42-5702-4d41-91d1-8aca4265eb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 404 len: 111 microversion: 2.1 time: 0.079323 Oct 16 01:17:47.846424 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1897/3630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:47 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:17:47.855272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:47.856014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:47.861892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:47.862545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:47.863692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:47.864381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:47.866036 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.866948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:47.867360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.868100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:47.868236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:47.868770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:47.869161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.874785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.904538 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:17:47.950143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:47.950691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:47.951256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:47.951714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lazy-loading 'fault' on Instance uuid e13e0541-5c0c-42d8-ab19-24a244571cc0 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:17:48.047241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374430fde21f45418245b0848be3f34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3c4e3bdfdc43cea845dab830afc479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:48.064789 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-78925790-0457-4382-b2c9-621f18747965 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 200 len: 1367 microversion: 2.1 time: 0.248845 Oct 16 01:17:48.066229 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1734/3631] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:47 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:48.074667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-45a0d668-2b18-4b0b-a8ff-57e8e71d8906 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'create', calling method: .version_select at 0x7fd64d5d59d0>, body: {"keypair": {"name": "tempest-keypair-2094217530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINFeAyvpBPeNIdZoGAA6xNJ1MgGBlbiDgevYDCYcZTyIjWVx8rzHS5AiwqEgzpfoalw3SxjdrZdFcfCdfgMzFWqW0PtC/whfcHC+FTkmHeSITJ+WZV9bbHUsY27y1FspQ=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:48.104076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-45a0d668-2b18-4b0b-a8ff-57e8e71d8906 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Getting quotas for project 131d702dc0e34408bf3e58809c5cfb0d. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:17:48.105325 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-18f8e4a3-cbce-4e22-949a-e4cd3f601aa2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 204 len: 0 microversion: 2.1 time: 0.257450 Oct 16 01:17:48.106088 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1898/3632] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:17:47 2022] DELETE /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:17:48.114390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-45a0d668-2b18-4b0b-a8ff-57e8e71d8906 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Getting quotas for user b7cdbf32b68a44a28e4cc9c4210b5e56 and project 131d702dc0e34408bf3e58809c5cfb0d. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:17:48.180553 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-45a0d668-2b18-4b0b-a8ff-57e8e71d8906 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110950 Oct 16 01:17:48.187221 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1735/3633] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:17:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:48.294382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1478424726", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "568274da-df36-43fc-b668-f6a872d918ce"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:48.413758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] validate_networks() for [('568274da-df36-43fc-b668-f6a872d918ce', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:17:48.840137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:48.840748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:48.861468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:48.862273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:48.865686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:48.866649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:48.870469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:48.871297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:49.543759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:49.580683 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-48bd7363-94e5-4f6f-a284-3fa4b42a9dd4 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 0.744583 Oct 16 01:17:49.588214 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1736/3634] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:48 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:49.600511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:49.601163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] [instance: e13e0541-5c0c-42d8-ab19-24a244571cc0] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:49.609150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:49.609656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:49.610094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:49.610856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:49.611419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:49.612147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:49.628167 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] HTTP exception thrown: Instance e13e0541-5c0c-42d8-ab19-24a244571cc0 could not be found. Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Request method failure captured: Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 HTTP/1.1 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1twbrVgkjsMDKGmlo5vtnNYh7cyffEAnx1vXXPrwPjcTAxzcEEwBWzu3V8J4mx29kRSVWrWduYM3P3QnEH3Eoez2cffYztJuT4AjOgcJkir0_34DVEFHRtmxTDxk9NQ5_TWf6Ni6zaPx5VLaHT1bvHSZcu6z77dWV6HSYXlEg4gqnQ Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: ba3c4e3bdfdc43cea845dab830afc479 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestManualDisk-586561158 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba3c4e3bdfdc43cea845dab830afc479", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba3c4e3bdfdc43cea845dab830afc479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c4e3bdfdc43cea845dab830afc479"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c4e3bdfdc43cea845dab830afc479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestManualDisk-586561158 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: ba3c4e3bdfdc43cea845dab830afc479 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestManualDisk-586561158 Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestManualDisk-586561158-project Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 374430fde21f45418245b0848be3f34b Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestManualDisk-586561158-project Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: exception: Instance e13e0541-5c0c-42d8-ab19-24a244571cc0 could not be found. Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'e13e0541-5c0c-42d8-ab19-24a244571cc0'} Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13e0541-5c0c-42d8-ab19-24a244571cc0 could not be found. Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13e0541-5c0c-42d8-ab19-24a244571cc0 could not be found. Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:17:49.630340 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13e0541-5c0c-42d8-ab19-24a244571cc0 could not be found. Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Returning 404 to user: Instance e13e0541-5c0c-42d8-ab19-24a244571cc0 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32afd627-df55-4aea-9264-ba49144b3ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0" status: 404 len: 111 microversion: 2.1 time: 0.042738 Oct 16 01:17:49.636236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1737/3635] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:49 2022] GET /compute/v2.1/servers/e13e0541-5c0c-42d8-ab19-24a244571cc0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:17:49.641508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-474ac2c4-5758-454e-8e8f-f91b0b0f9ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] Calling method '.version_select at 0x7fd64d6f9af0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:49.668402 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-474ac2c4-5758-454e-8e8f-f91b0b0f9ff1 tempest-ServersTestManualDisk-586561158 tempest-ServersTestManualDisk-586561158-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-206582404" status: 202 len: 0 microversion: 2.1 time: 0.029887 Oct 16 01:17:49.676078 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1738/3636] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:17:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-206582404 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:17:50.441105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:17:50.441616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:17:50.442123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:17:50.442538 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:17:50.443315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:17:50.469516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:50.470433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:50.471328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:50.472390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:50.473581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:50.474346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:50.502953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Getting quotas for project 16773b3925f648bbade2e6bf967a3fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:17:50.512573 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Getting quotas for user f1bfe0b4f344485ab6de52f7b1423118 and project 16773b3925f648bbade2e6bf967a3fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:17:50.531333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:17:50.534903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:17:50.595028 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d72c76a-b870-49e4-adf9-16ece63bc8c8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.305643 Oct 16 01:17:50.596503 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1899/3637] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:17:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:17:50.608400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:50.610600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:50.623831 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-356f5a98-c48f-43bc-8892-5c0cb28cd2aa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:50.624517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-356f5a98-c48f-43bc-8892-5c0cb28cd2aa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:50.632199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:50.635179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:50.635665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:50.636406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:50.636873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:50.637307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:50.767488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-356f5a98-c48f-43bc-8892-5c0cb28cd2aa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:50.777545 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-356f5a98-c48f-43bc-8892-5c0cb28cd2aa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1218 microversion: 2.1 time: 0.167280 Oct 16 01:17:50.779127 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1900/3638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:50 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:51.440245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3d11b1fd-27ac-4bbf-afe8-8a559a69ac10 req-c7ee6c3b-63b9-4233-afe9-5a4e37808c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf6c30be-76fa-4872-a2ff-402025041451", "name": "network-vif-deleted", "tag": "f724bce2-95dc-4224-bf96-92f5f86df17b"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:51.447863 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:51.477090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d11b1fd-27ac-4bbf-afe8-8a559a69ac10 req-c7ee6c3b-63b9-4233-afe9-5a4e37808c55 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:51.477531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d11b1fd-27ac-4bbf-afe8-8a559a69ac10 req-c7ee6c3b-63b9-4233-afe9-5a4e37808c55 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:51.477977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d11b1fd-27ac-4bbf-afe8-8a559a69ac10 req-c7ee6c3b-63b9-4233-afe9-5a4e37808c55 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:51.510980 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3d11b1fd-27ac-4bbf-afe8-8a559a69ac10 req-c7ee6c3b-63b9-4233-afe9-5a4e37808c55 service nova] Creating event network-vif-deleted:f724bce2-95dc-4224-bf96-92f5f86df17b for instance bf6c30be-76fa-4872-a2ff-402025041451 on n-h2-master-1 Oct 16 01:17:51.528131 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3d11b1fd-27ac-4bbf-afe8-8a559a69ac10 req-c7ee6c3b-63b9-4233-afe9-5a4e37808c55 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092518 Oct 16 01:17:51.529730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:51.532896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1901/3639] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:17:51.553319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-420a2bec-34f8-4b62-9f3a-a93e719c5d0a tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 0.948740 Oct 16 01:17:51.553956 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1739/3640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:50 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:51.776427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1685668047", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:51.803676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:51.804972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:51.815079 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:51.819904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:51.820658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:51.822988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:51.831346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:51.835816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:51.836499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:51.908979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] validate_networks() for [('2e79da2e-21b4-4a37-a7fa-8c15935d172d', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:17:52.130549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:52.140131 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-618e81bf-061a-40aa-9480-070b3e4c9bf8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1214 microversion: 2.1 time: 0.340374 Oct 16 01:17:52.145615 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1740/3641] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:51 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1214 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:52.585558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:52.586396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:52.596890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:52.598346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:52.599033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:52.600299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:52.601009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:52.601643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:53.478724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:53.495840 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-05f4d6d4-6c21-47ed-ad10-10548aee1576 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 0.914116 Oct 16 01:17:53.498330 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1741/3642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:52 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:53.511931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:53.514996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:53.530812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:53.533541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:53.534773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:53.537022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:53.538495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:53.539914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:54.007552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:17:54.009268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:17:54.010140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:17:54.011847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:17:54.012619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:17:54.035290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:54.036184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:54.037050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:54.038019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:54.038703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:54.039383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:54.100139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Getting quotas for project 131d702dc0e34408bf3e58809c5cfb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:17:54.106384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:54.119501 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1f5d56d-0bd5-4b1d-b26c-8fd9dd452ba6 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1276 microversion: 2.1 time: 0.618758 Oct 16 01:17:54.121463 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1742/3643] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:53 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1276 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:54.121631 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Getting quotas for user b7cdbf32b68a44a28e4cc9c4210b5e56 and project 131d702dc0e34408bf3e58809c5cfb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:17:54.140632 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:17:54.143870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:17:54.247513 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4e973512-a69b-4738-b623-70ba8e2c4f1a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.474262 Oct 16 01:17:54.249653 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1902/3644] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:17:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:17:54.262765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e52df401-58a3-45aa-b049-f0a874a06d04 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:54.263917 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e52df401-58a3-45aa-b049-f0a874a06d04 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:54.473938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e52df401-58a3-45aa-b049-f0a874a06d04 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:54.496558 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e52df401-58a3-45aa-b049-f0a874a06d04 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1225 microversion: 2.1 time: 0.238611 Oct 16 01:17:54.500195 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1743/3645] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:54 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1225 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:54.526820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:54.527598 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:54.565590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:54.567419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:54.567419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:54.567419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:54.572858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:54.575493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:54.635329 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:55.145205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:55.146325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:55.162949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:55.165285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:55.167486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:55.169560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:55.172933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:55.174958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:55.785137 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:55.807513 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b85ae7af-6c03-4d84-b619-ea3e96254fb2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 1.285514 Oct 16 01:17:55.813144 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1903/3646] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:54 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:55.834651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:55.836578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:55.849385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:55.850448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:55.851226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:55.852411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:55.853734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:55.854932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:55.949504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:55.958485 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e01007d-35ab-483c-8081-9046a4928646 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 0.818439 Oct 16 01:17:55.959100 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1744/3647] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:55 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:56.096279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:56.117591 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e592d80b-0cd3-42ac-ac60-42714cf808e3 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1277 microversion: 2.1 time: 0.300254 Oct 16 01:17:56.152123 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1904/3648] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:55 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1277 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:56.844035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:56.845029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:56.865604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:56.866004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:56.866444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:56.870409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:56.871298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:56.871780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:56.985928 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:56.986739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:56.998696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:56.999482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:56.999957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:57.000632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:57.001117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:57.005101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:57.516309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:57.529650 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1727a9b0-86ad-40d8-a01c-cff99c015731 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 0.691161 Oct 16 01:17:57.532172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1745/3649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:56 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:57.539968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:57.540838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:57.548684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:57.549543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:57.550207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:57.551163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:57.552166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:57.552817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:57.557411 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:17:57.576447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:57.594355 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-438d91dd-13aa-4f71-a02e-b36f19c4ba43 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 0.612440 Oct 16 01:17:57.605144 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1905/3650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:56 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:17:57.792701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:17:57.805702 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f76b48b1-b61d-4dda-94c7-0d47ea0b4a18 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1283 microversion: 2.1 time: 0.272065 Oct 16 01:17:57.807908 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1746/3651] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:57 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1283 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:17:58.422448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1ab09530-892a-4d93-99e6-b1c038716ff9 req-bffcca44-37a6-4d07-adff-60061d7bab55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6f4fe2-d304-4cfc-a04d-19f1c4af763f", "tag": "f7308eab-b78c-4949-b043-f783a2f9662a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:17:58.443793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1ab09530-892a-4d93-99e6-b1c038716ff9 req-bffcca44-37a6-4d07-adff-60061d7bab55 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:58.446935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1ab09530-892a-4d93-99e6-b1c038716ff9 req-bffcca44-37a6-4d07-adff-60061d7bab55 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:58.449613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1ab09530-892a-4d93-99e6-b1c038716ff9 req-bffcca44-37a6-4d07-adff-60061d7bab55 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:58.475936 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1ab09530-892a-4d93-99e6-b1c038716ff9 req-bffcca44-37a6-4d07-adff-60061d7bab55 service nova] Creating event network-changed:f7308eab-b78c-4949-b043-f783a2f9662a for instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f on n-h1-master-1 Oct 16 01:17:58.487689 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1ab09530-892a-4d93-99e6-b1c038716ff9 req-bffcca44-37a6-4d07-adff-60061d7bab55 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070901 Oct 16 01:17:58.490836 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1906/3652] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:17:58.566670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:58.577384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:58.604585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:58.605075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:58.605516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:58.612727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:58.613546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:58.613985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:58.618502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:17:58.619720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:17:58.634743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:58.637166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:58.638476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:17:58.640226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:17:58.642184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:17:58.644435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:00.093678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:00.104230 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-890fb744-3cb3-4085-9996-c4ab2ec46aef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 1.490117 Oct 16 01:18:00.104865 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1907/3653] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:58 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:00.114973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:00.119112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:00.131746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:00.134629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:00.135404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:00.136346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:00.139704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:00.140553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:00.151599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:00.165507 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6f12d33b-67df-4627-9f09-f6721a7c3bd8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 1.606353 Oct 16 01:18:00.170419 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1747/3654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:17:58 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:00.720961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:00.733648 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c983aa6d-70d3-4f4a-85a0-972dadda7cc7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 0.625698 Oct 16 01:18:00.737313 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1908/3655] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:00 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:01.154439 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:01.155518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:01.177666 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:01.179732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:01.180247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:01.180871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:01.181711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:01.182255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:01.183503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:01.224586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:01.226522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:01.242059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:01.244170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:01.246122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:01.248550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:01.250539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:01.252337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:01.741134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:01.753231 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32bc615d-ea87-47ef-b951-08bb46df98bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 0.604878 Oct 16 01:18:01.754575 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1748/3656] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:01 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:01.759288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f1e3d22b-9118-4183-98ba-24c58a081a1d req-6d0eab41-dd65-4991-864d-5d9d773d0108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83dfd54-4a4f-4e7e-a549-97c83ff22ad5", "tag": "5f814799-da51-47b9-b87b-9d32b69cd41f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:01.770604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f1e3d22b-9118-4183-98ba-24c58a081a1d req-6d0eab41-dd65-4991-864d-5d9d773d0108 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:01.781997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f1e3d22b-9118-4183-98ba-24c58a081a1d req-6d0eab41-dd65-4991-864d-5d9d773d0108 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:01.783911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f1e3d22b-9118-4183-98ba-24c58a081a1d req-6d0eab41-dd65-4991-864d-5d9d773d0108 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:01.805106 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f1e3d22b-9118-4183-98ba-24c58a081a1d req-6d0eab41-dd65-4991-864d-5d9d773d0108 service nova] Creating event network-changed:5f814799-da51-47b9-b87b-9d32b69cd41f for instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 on n-h2-master-1 Oct 16 01:18:01.819656 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f1e3d22b-9118-4183-98ba-24c58a081a1d req-6d0eab41-dd65-4991-864d-5d9d773d0108 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059097 Oct 16 01:18:01.821654 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1749/3657] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:01.828443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:01.829529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:01.838221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:01.838832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:01.840043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:01.840895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:01.841623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:01.842318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:01.908160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:01.935173 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2219d15-2bc6-4e61-b291-46f7a2879a62 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 0.716390 Oct 16 01:18:01.936261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1909/3658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:01 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:02.120267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:02.132299 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0e3cdde7-f846-419a-af12-53f7aa4df20a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 0.308584 Oct 16 01:18:02.133771 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1750/3659] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:01 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:02.783699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:02.785436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:02.800338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:02.801341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:02.802309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:02.803358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:02.804131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:02.806888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:02.959957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:02.961450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:02.985219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:02.985812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:02.986259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:02.990521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:02.993682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:02.994698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:03.105308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:03.121393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-380952e5-e21f-4998-8275-8e2e7bf55e00 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 0.341215 Oct 16 01:18:03.135436 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1910/3660] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:02 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:03.158872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:03.159598 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:03.173610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:03.176545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:03.178090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:03.180348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:03.183464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:03.183997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:03.346582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:03.356458 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b84b7bdc-a105-4b79-90de-a5a843ebb963 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 0.401866 Oct 16 01:18:03.362129 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1751/3661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:02 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:03.444700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:03.461905 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-29d716d0-de4b-48b7-bd37-e652b9b18e3c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 0.307328 Oct 16 01:18:03.463149 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1911/3662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:03 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:04.153050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:04.154709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:04.181257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:04.185074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:04.186292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:04.189885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:04.191118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:04.194349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:04.390294 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:04.391472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:04.396004 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:04.398739 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=14 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:04.426056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:04.426844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:04.429225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:04.434014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:04.434854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:04.439754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:04.492014 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:04.623904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:04.633370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7233e498-3d4d-4d93-ae5a-2d918f5f9fd7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 0.485948 Oct 16 01:18:04.633967 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1752/3663] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:04 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:04.648244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:04.650035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:04.665858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:04.666352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:04.667794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:04.669664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:04.674879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:04.675748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:05.306323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:05.329498 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa6f460d-01c4-46a7-9964-166cfc0f298e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1524 microversion: 2.1 time: 0.944625 Oct 16 01:18:05.330770 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1912/3664] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:04 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1524 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:05.413056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:05.441252 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dccb8cb3-536d-4188-9d7c-c847c3096c20 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 0.803973 Oct 16 01:18:05.460551 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1753/3665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:04 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:05.667889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:05.668686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:05.683237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:05.683663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:05.687710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:05.688568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:05.691581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:05.692787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:05.995113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:06.008759 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a43b5de-ab0c-4594-8b1f-d6142b11ad15 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 0.344057 Oct 16 01:18:06.027848 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1913/3666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:05 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:06.355337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:06.356261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:06.368581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:06.369498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:06.370266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:06.375251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:06.376099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:06.376813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:06.468496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:06.469685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:06.487060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:06.490123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:06.492058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:06.498275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:06.500401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:06.501590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:06.920168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:06.931565 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fa433be1-9b0b-44c2-9693-2ca311582661 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1504 microversion: 2.1 time: 0.580625 Oct 16 01:18:06.931845 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1754/3667] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:06 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:06.956684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-031fdc4d-755e-4335-874d-4e11a778c7d2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Action: 'create', calling method: .version_select at 0x7fd64d661ee0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1763565048", "description": "tempest-description-142765835"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:06.959143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:06.974173 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d9c3dd2a-148b-4a8b-8c75-94a36aae0994 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 0.510394 Oct 16 01:18:06.975577 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1914/3668] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:06 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:07.033067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:07.033957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:07.040831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:07.041538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:07.042188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:07.043111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:07.043780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:07.044606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:07.339804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:07.352077 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e888e01d-2dcd-4d5f-ba5b-4d4b267865d1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 0.323237 Oct 16 01:18:07.353305 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1915/3669] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:07 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:07.754617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-031fdc4d-755e-4335-874d-4e11a778c7d2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.803393 Oct 16 01:18:07.756150 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1755/3670] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Oct 16 01:18:06 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:18:07.772076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1763565048"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:07.772627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:07.786872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:07.787175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:07.787820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:07.788978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:07.789440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:07.790010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:07.997669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:07.998284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:08.007035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:08.015361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:08.016004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:08.016938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:08.017765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:08.018378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:08.253294 n-d-master-1 devstack@n-api.service[120545]: INFO nova.network.security_group_api [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Adding security group 3d2efc87-165d-4f72-978b-285a9139aa21 to port a1f3c24b-6b41-4ee3-90f6-db432aca651c Oct 16 01:18:08.484507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:08.505083 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f814df5-33b5-4162-bff0-3bdccfc62ff2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 0.511056 Oct 16 01:18:08.506545 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1756/3671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:07 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:08.511660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fd016212-41d5-4c79-81a8-b3f71f322a48 req-018073c6-539a-49a6-a585-62f2d026af1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6f4fe2-d304-4cfc-a04d-19f1c4af763f", "name": "network-vif-plugged", "status": "completed", "tag": "f7308eab-b78c-4949-b043-f783a2f9662a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:08.537653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd016212-41d5-4c79-81a8-b3f71f322a48 req-018073c6-539a-49a6-a585-62f2d026af1e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:08.538462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd016212-41d5-4c79-81a8-b3f71f322a48 req-018073c6-539a-49a6-a585-62f2d026af1e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:08.539149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd016212-41d5-4c79-81a8-b3f71f322a48 req-018073c6-539a-49a6-a585-62f2d026af1e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:08.562778 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fd016212-41d5-4c79-81a8-b3f71f322a48 req-018073c6-539a-49a6-a585-62f2d026af1e service nova] Creating event network-vif-plugged:f7308eab-b78c-4949-b043-f783a2f9662a for instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f on n-h1-master-1 Oct 16 01:18:08.581806 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fd016212-41d5-4c79-81a8-b3f71f322a48 req-018073c6-539a-49a6-a585-62f2d026af1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073662 Oct 16 01:18:08.582767 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1757/3672] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:08.588035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:08.588601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:08.604180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:08.604685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:08.605122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:08.605830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:08.606289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:08.606715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:09.595300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:09.610697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fad2f7f7-6625-47fd-bff8-a9ef44d3f0b2 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 1.024578 Oct 16 01:18:09.613314 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1758/3673] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:08 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:09.618257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:09.628125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:09.641878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:09.642562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:09.648493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:09.649613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:09.651376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:09.651981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:09.756654 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83712513-39b8-4689-8740-3952c2479ed2 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action" status: 202 len: 0 microversion: 2.1 time: 1.989105 Oct 16 01:18:09.758760 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1916/3674] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:18:07 2022] POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action => generated 0 bytes in 1992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:18:09.770777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1763565048"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:09.771644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:09.785124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:09.787589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:09.790011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:09.795235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:09.796028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:09.796686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:10.402730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:10.411387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d5152230-a0f5-487c-a2e9-55cb567f1a22 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 0.796754 Oct 16 01:18:10.411983 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1759/3675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:09 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:10.434685 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a9894787-9b0c-4fb3-a731-602cba69823e req-72c34dcd-1777-4c1a-b4e6-45ef42c33bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9077a263-02c3-436e-88a4-7c9e7fdff381", "tag": "a1f3c24b-6b41-4ee3-90f6-db432aca651c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:10.451577 n-d-master-1 devstack@n-api.service[120545]: INFO nova.network.security_group_api [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Removing security group 3d2efc87-165d-4f72-978b-285a9139aa21 from port a1f3c24b-6b41-4ee3-90f6-db432aca651c Oct 16 01:18:10.458952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a9894787-9b0c-4fb3-a731-602cba69823e req-72c34dcd-1777-4c1a-b4e6-45ef42c33bac service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:10.463419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a9894787-9b0c-4fb3-a731-602cba69823e req-72c34dcd-1777-4c1a-b4e6-45ef42c33bac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:10.464068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a9894787-9b0c-4fb3-a731-602cba69823e req-72c34dcd-1777-4c1a-b4e6-45ef42c33bac service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:10.489498 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a9894787-9b0c-4fb3-a731-602cba69823e req-72c34dcd-1777-4c1a-b4e6-45ef42c33bac service nova] Creating event network-changed:a1f3c24b-6b41-4ee3-90f6-db432aca651c for instance 9077a263-02c3-436e-88a4-7c9e7fdff381 on n-h1-master-1 Oct 16 01:18:10.508951 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a9894787-9b0c-4fb3-a731-602cba69823e req-72c34dcd-1777-4c1a-b4e6-45ef42c33bac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091436 Oct 16 01:18:10.509792 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1760/3676] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:10.634895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:10.636277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:10.651018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:10.651756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:10.652334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:10.653189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:10.653815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:10.654384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:12.101318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:12.113927 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-639aec99-9375-45f5-b668-d24040b933bd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1318 microversion: 2.1 time: 1.483755 Oct 16 01:18:12.120171 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1761/3677] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:10 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1318 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:12.132484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-7f082f85-c661-4178-85da-7d247a19a658 req-d7011c89-e34f-4ef5-8eb1-9625eb34daf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83dfd54-4a4f-4e7e-a549-97c83ff22ad5", "name": "network-vif-plugged", "status": "completed", "tag": "5f814799-da51-47b9-b87b-9d32b69cd41f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:12.156691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7f082f85-c661-4178-85da-7d247a19a658 req-d7011c89-e34f-4ef5-8eb1-9625eb34daf4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:12.157114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7f082f85-c661-4178-85da-7d247a19a658 req-d7011c89-e34f-4ef5-8eb1-9625eb34daf4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:12.157614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7f082f85-c661-4178-85da-7d247a19a658 req-d7011c89-e34f-4ef5-8eb1-9625eb34daf4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:12.193012 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-7f082f85-c661-4178-85da-7d247a19a658 req-d7011c89-e34f-4ef5-8eb1-9625eb34daf4 service nova] Creating event network-vif-plugged:5f814799-da51-47b9-b87b-9d32b69cd41f for instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 on n-h2-master-1 Oct 16 01:18:12.202804 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-7f082f85-c661-4178-85da-7d247a19a658 req-d7011c89-e34f-4ef5-8eb1-9625eb34daf4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080505 Oct 16 01:18:12.206661 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1762/3678] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:12.229116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:12.229845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:12.261715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:12.262224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:12.262734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:12.263393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:12.275070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:12.275762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:12.875301 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4cebef8d-3cba-4105-962e-26ea0d448780 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action" status: 202 len: 0 microversion: 2.1 time: 3.110817 Oct 16 01:18:12.876322 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1917/3679] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:18:09 2022] POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action => generated 0 bytes in 3113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:18:12.886454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a96c4c21-5ff5-4c19-a50a-135e07c7f503 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Action: 'create', calling method: .version_select at 0x7fd64e0edd30>, body: {"pool": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:12.971467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:12.988569 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-950f560c-b891-448d-abfe-34dc839d7635 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 0.780389 Oct 16 01:18:12.989593 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1763/3680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:12 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:12.998252 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d852f9bb-1d17-4ead-afd8-41a399496e1f req-1fcf54fb-dc68-454e-95cf-264cc4aded51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9077a263-02c3-436e-88a4-7c9e7fdff381", "tag": "a1f3c24b-6b41-4ee3-90f6-db432aca651c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:13.045294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d852f9bb-1d17-4ead-afd8-41a399496e1f req-1fcf54fb-dc68-454e-95cf-264cc4aded51 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:13.051523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d852f9bb-1d17-4ead-afd8-41a399496e1f req-1fcf54fb-dc68-454e-95cf-264cc4aded51 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:13.058064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d852f9bb-1d17-4ead-afd8-41a399496e1f req-1fcf54fb-dc68-454e-95cf-264cc4aded51 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:13.101049 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d852f9bb-1d17-4ead-afd8-41a399496e1f req-1fcf54fb-dc68-454e-95cf-264cc4aded51 service nova] Creating event network-changed:a1f3c24b-6b41-4ee3-90f6-db432aca651c for instance 9077a263-02c3-436e-88a4-7c9e7fdff381 on n-h1-master-1 Oct 16 01:18:13.112188 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d852f9bb-1d17-4ead-afd8-41a399496e1f req-1fcf54fb-dc68-454e-95cf-264cc4aded51 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121357 Oct 16 01:18:13.118234 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1764/3681] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:13.144860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:13.146261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:13.165931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:13.166539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:13.167183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:13.167985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:13.168550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:13.169064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:14.201243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:14.213195 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b4f42d9-a1ee-4e82-b00d-52bd069fb38b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1508 microversion: 2.1 time: 1.078951 Oct 16 01:18:14.216923 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1765/3682] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:13 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1508 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:14.231735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:14.238840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:14.251615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:14.255328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:14.256303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:14.259236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:14.261031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:14.263811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:15.298215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:15.326460 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-24c0a512-95de-4c5d-bcf9-817c62ee4072 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1325 microversion: 2.1 time: 1.107394 Oct 16 01:18:15.328877 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1766/3683] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:14 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1325 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:15.335944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:15.337353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:15.347209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:15.348726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:15.349366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:15.351049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:15.351720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:15.352345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:15.360254 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:15.871630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:15.883743 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c4666531-6a6c-4192-8b29-3337369221ba tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1508 microversion: 2.1 time: 0.552848 Oct 16 01:18:15.885708 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1767/3684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:15 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1508 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:15.922708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:15.958373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:15.999106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:16.002846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:16.006508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:16.007419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:16.010329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:16.011505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:16.260115 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dca98e4a-5ab0-4a07-9f5b-ce4900e24f6f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "PUT /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1080 microversion: 2.1 time: 0.346983 Oct 16 01:18:16.260785 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1768/3685] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:18:15 2022] PUT /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1080 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:16.289307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:16.290087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:16.299076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:16.300574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:16.301245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:16.303326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:16.304222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:16.305001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:17.204134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:17.216322 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7950912a-c17b-4111-8f70-d616dec3d7c0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1506 microversion: 2.1 time: 0.932749 Oct 16 01:18:17.228156 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1769/3686] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:16 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1506 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:17.263234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:17.265401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:17.278075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:17.278754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:17.280708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:17.281735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:17.285397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:17.286985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:18.169941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:18.184908 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-481a8e05-a5da-4d80-a5c9-a1fbe938bb9a tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1521 microversion: 2.1 time: 0.948298 Oct 16 01:18:18.189180 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1770/3687] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:17 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1521 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:18.204698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:18.205248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:18.219981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:18.223218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:18.225438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:18.227611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:18.228996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:18.229725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:18.616053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:18.624967 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1302d8a3-b9ce-448f-b921-537d0931bc76 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1506 microversion: 2.1 time: 0.434609 Oct 16 01:18:18.626096 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1771/3688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:18 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:18.637687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:18.638538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:18.646633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:18.647772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:18.648570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:18.649923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:18.650596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:18.651261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:19.561709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:19.578569 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f5243349-45ef-45ef-9f42-7e73008cdce4 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1521 microversion: 2.1 time: 0.950707 Oct 16 01:18:19.579765 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1772/3689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:18 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1521 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:19.585248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:19.589012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:19.597458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:19.598681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:19.599664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:19.600603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:19.601128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:19.601621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:19.605141 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a96c4c21-5ff5-4c19-a50a-135e07c7f503 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.722886 Oct 16 01:18:19.605758 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1918/3690] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Oct 16 01:18:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:19.611102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-367447605"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:19.626890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:19.642741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:19.644750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:19.645565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:19.647758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:19.649140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:19.650523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:19.769574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:18:19.770004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:18:19.770992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:18:19.775380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:18:19.775958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:18:19.933957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:19.942070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:19.942932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:19.943626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:19.944517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:19.945191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:19.945827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:19.980774 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1248e125-c37b-496d-a4a3-3aecab98e62a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "POST /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f/action" status: 202 len: 1112 microversion: 2.1 time: 0.399606 Oct 16 01:18:19.982162 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1773/3691] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:18:19 2022] POST /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f/action => generated 1112 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 16 01:18:19.990579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.89"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:19.995590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:20.006596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:20.007501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:20.008215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:20.009251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:20.009919 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:20.010564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:20.051396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "refresh_cache-9077a263-02c3-436e-88a4-7c9e7fdff381" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:18:20.053092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquired lock "refresh_cache-9077a263-02c3-436e-88a4-7c9e7fdff381" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:18:20.117133 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30b891c6-fc16-4f9f-91d6-3d5e60f1cd09 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5/action" status: 202 len: 0 microversion: 2.1 time: 0.509025 Oct 16 01:18:20.118262 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1919/3692] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:18:19 2022] POST /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:18:20.127650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:20.128638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:20.137192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:20.137957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:20.138573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:20.140470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:20.141302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:20.141913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:20.914332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:20.932534 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f7231d6-399b-403d-ad19-9a0a2cfa7c14 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 0.812077 Oct 16 01:18:20.933163 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1920/3693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:20 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:20.952176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52529c7b-f7c1-4ad6-8ac0-68f0db67718c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '.version_select at 0x7fd64de25ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:21.314621 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52529c7b-f7c1-4ad6-8ac0-68f0db67718c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/images/3c1551c5-b3bf-4efd-abbd-69cd051c5497" status: 204 len: 0 microversion: 2.1 time: 0.380258 Oct 16 01:18:21.315383 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1921/3694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:20 2022] DELETE /compute/v2.1/images/3c1551c5-b3bf-4efd-abbd-69cd051c5497 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:18:21.325522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2ffdff6-1c7e-4b91-9584-bf7bee5bbda9 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '.version_select at 0x7fd64ddbc310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:21.380212 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-c2ffdff6-1c7e-4b91-9584-bf7bee5bbda9 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Image not found. Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2ffdff6-1c7e-4b91-9584-bf7bee5bbda9 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/images/3c1551c5-b3bf-4efd-abbd-69cd051c5497 HTTP/1.1 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '3c1551c5-b3bf-4efd-abbd-69cd051c5497'} Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3c1551c5-b3bf-4efd-abbd-69cd051c5497 Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:18:21.383085 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c1551c5-b3bf-4efd-abbd-69cd051c5497 could not be found. Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:18:21.386136 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:21.391371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2ffdff6-1c7e-4b91-9584-bf7bee5bbda9 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:18:21.392907 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c2ffdff6-1c7e-4b91-9584-bf7bee5bbda9 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/images/3c1551c5-b3bf-4efd-abbd-69cd051c5497" status: 404 len: 62 microversion: 2.1 time: 0.072486 Oct 16 01:18:21.394041 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1922/3695] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:18:21 2022] GET /compute/v2.1/images/3c1551c5-b3bf-4efd-abbd-69cd051c5497 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:18:21.408495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:21.411205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:21.435711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:21.438420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:21.439139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:21.442266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:21.444080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:21.446082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:21.458671 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:22.068152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:22.081757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9068b456-a093-48d8-9c85-bb76480fa8dd tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1539 microversion: 2.1 time: 0.681420 Oct 16 01:18:22.082903 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1923/3696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:21 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1539 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:22.116117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:22.117878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:22.124448 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:22.150855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:22.151336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:22.157355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:22.163708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:22.170995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:22.171694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:23.318862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:18:23.351121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:23.363092 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1c2700bb-529e-4754-ba71-9a5c777929c1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 1.273755 Oct 16 01:18:23.363631 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1924/3697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:22 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:23.377698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:23.378565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:23.400107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:23.402134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:23.402857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:23.405657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:23.406662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:23.407941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:23.950748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:23.962204 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f57f8a4-da51-42e3-82b8-09f59a70502b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1539 microversion: 2.1 time: 0.592205 Oct 16 01:18:23.965157 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1925/3698] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:23 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1539 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:23.977960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-313286e9-c771-49bc-b747-ce85b181a70a req-35447e13-653f-45d0-9956-afc28cd8b16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9077a263-02c3-436e-88a4-7c9e7fdff381", "tag": "a1f3c24b-6b41-4ee3-90f6-db432aca651c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:23.996653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-313286e9-c771-49bc-b747-ce85b181a70a req-35447e13-653f-45d0-9956-afc28cd8b16e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:24.001221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-313286e9-c771-49bc-b747-ce85b181a70a req-35447e13-653f-45d0-9956-afc28cd8b16e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:24.001980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-313286e9-c771-49bc-b747-ce85b181a70a req-35447e13-653f-45d0-9956-afc28cd8b16e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:24.029317 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-313286e9-c771-49bc-b747-ce85b181a70a req-35447e13-653f-45d0-9956-afc28cd8b16e service nova] Creating event network-changed:a1f3c24b-6b41-4ee3-90f6-db432aca651c for instance 9077a263-02c3-436e-88a4-7c9e7fdff381 on n-h1-master-1 Oct 16 01:18:24.042466 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-313286e9-c771-49bc-b747-ce85b181a70a req-35447e13-653f-45d0-9956-afc28cd8b16e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075159 Oct 16 01:18:24.043500 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1926/3699] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:24.393881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:24.394854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:24.409131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:24.409912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:24.410651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:24.416350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:24.417356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:24.418016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:25.233646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:25.244042 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2e98cc0-5847-4d67-bb17-8717863f7237 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 0.853419 Oct 16 01:18:25.247156 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1927/3700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:24 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:25.256245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:25.257229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:25.274308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:25.277135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:25.277930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:25.281023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:25.281906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:25.282571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:25.519773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:25.537677 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cbe2472a-9763-4541-b244-516683e3b9e8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1521 microversion: 2.1 time: 0.284336 Oct 16 01:18:25.558327 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1928/3701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:25 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:25.580550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Updating instance_info_cache with network_info: [{"id": "a1f3c24b-6b41-4ee3-90f6-db432aca651c", "address": "fa:16:3e:a1:05:59", "network": {"id": "fd237629-ce1a-4937-929e-be2979646ff8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1561591132-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "01cfed1efa1c408287e3e10f4e0afcb2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa1f3c24b-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:18:25.592790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Releasing lock "refresh_cache-9077a263-02c3-436e-88a4-7c9e7fdff381" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:18:25.593843 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c241bab-45ea-45f4-b63c-f15c88cf4c9f tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action" status: 202 len: 0 microversion: 2.1 time: 5.610304 Oct 16 01:18:25.594604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:25.597908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:25.598369 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1774/3702] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:18:19 2022] POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action => generated 0 bytes in 5615 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:18:25.608118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.89"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:25.611362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:25.611875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:25.612545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:25.613928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:25.615434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:25.616795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:25.703325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:18:25.996116 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd766e15-9611-4f5d-b4ff-862dab5bcf40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 204 len: 0 microversion: 2.1 time: 0.434343 Oct 16 01:18:25.997891 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1929/3703] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:18:25 2022] DELETE /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:18:26.015436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:26.018587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:26.051079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:26.051858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:26.052559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:26.053280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:26.053800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:26.059035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:26.116421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:26.123691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:26.124758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:26.125461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:26.127286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:26.132653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:26.134861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:26.512414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:26.529034 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-254b052d-5c5a-420b-84cd-4a4c78905157 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 200 len: 1527 microversion: 2.1 time: 0.525863 Oct 16 01:18:26.534261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1930/3704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:26 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 1527 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:26.566085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:26.568085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:26.588593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:26.590265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:26.592267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:26.593649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:26.595591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:26.598226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:27.077270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "refresh_cache-9077a263-02c3-436e-88a4-7c9e7fdff381" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 16 01:18:27.077739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquired lock "refresh_cache-9077a263-02c3-436e-88a4-7c9e7fdff381" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 16 01:18:27.082981 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:27.096368 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89c6541c-7905-4646-98c0-aac7c16335ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 0.559285 Oct 16 01:18:27.099319 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1931/3705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:26 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:27.124070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1605712115", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e03c2f39-7588-4080-b003-d9dfd1d26542"}, {"uuid": "7f0f78bf-f1fa-4778-9434-c384bff2d2b5"}, {"uuid": "e03c2f39-7588-4080-b003-d9dfd1d26542"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:27.273884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] validate_networks() for [('e03c2f39-7588-4080-b003-d9dfd1d26542', None, None, None, None, None), ('7f0f78bf-f1fa-4778-9434-c384bff2d2b5', None, None, None, None, None), ('e03c2f39-7588-4080-b003-d9dfd1d26542', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:18:29.854936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Building network info cache for instance {{(pid=120546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 16 01:18:30.874730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:18:30.875382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:18:30.875959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:18:30.876390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:18:30.877514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:18:30.897765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:30.898286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:30.898803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:30.905619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:30.906187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:30.906672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:30.952863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Getting quotas for project 1d22602edce34f6390374c40afcfd113. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:18:30.959922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Getting quotas for user 1cf0ec54a3f54abd90ece8de2aa70ffc and project 1d22602edce34f6390374c40afcfd113. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:18:30.980335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:18:30.983869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:18:31.077380 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82d553db-491f-4f29-9a80-a35f8f7b02f7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.975016 Oct 16 01:18:31.080735 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1932/3706] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:18:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:18:31.096155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:31.096921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:31.103726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.104527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.105264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.111947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.118240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.120097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.190681 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 HTTP/1.1 Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: exception: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f83dfd54-4a4f-4e7e-a549-97c83ff22ad5'} Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:31.199047 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:31.203123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:31.203123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:31.203123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:31.203123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:31.203123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:18:31.203123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:18:31.203123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:31.203123 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:31.206616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:18:31.207980 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c25e8aad-7563-4159-9496-811cf379fd9c tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 404 len: 111 microversion: 2.1 time: 0.126049 Oct 16 01:18:31.217955 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1933/3707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:31 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:18:31.225899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:31.227704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:31.235905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.237378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.238060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.239166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.239902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.240602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.696196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:31.725229 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eeb8ca7a-3599-4a18-a15e-b6b33d81ccdf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 0.504062 Oct 16 01:18:31.740382 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1934/3708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:31 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:31.761712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-77226a36-9030-471e-9333-b2bf0498840d req-0c6929a5-1b34-4107-bdaf-f273e6adc6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83dfd54-4a4f-4e7e-a549-97c83ff22ad5", "name": "network-vif-plugged", "status": "completed", "tag": "5f814799-da51-47b9-b87b-9d32b69cd41f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:31.811628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Updating instance_info_cache with network_info: [{"id": "a1f3c24b-6b41-4ee3-90f6-db432aca651c", "address": "fa:16:3e:a1:05:59", "network": {"id": "fd237629-ce1a-4937-929e-be2979646ff8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1561591132-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "01cfed1efa1c408287e3e10f4e0afcb2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa1f3c24b-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:18:31.816818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-77226a36-9030-471e-9333-b2bf0498840d req-0c6929a5-1b34-4107-bdaf-f273e6adc6fa service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.817395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-77226a36-9030-471e-9333-b2bf0498840d req-0c6929a5-1b34-4107-bdaf-f273e6adc6fa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.820845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-77226a36-9030-471e-9333-b2bf0498840d req-0c6929a5-1b34-4107-bdaf-f273e6adc6fa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.847349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Releasing lock "refresh_cache-9077a263-02c3-436e-88a4-7c9e7fdff381" {{(pid=120546) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 16 01:18:31.850497 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fbab48f9-f599-49af-a8db-a92204c13ee3 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action" status: 202 len: 0 microversion: 2.1 time: 6.249709 Oct 16 01:18:31.854040 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1775/3709] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:18:25 2022] POST /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381/action => generated 0 bytes in 6255 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 16 01:18:31.870709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-577f554c-4040-4270-8402-7059a9c694b9 req-a6471c6f-37b0-4dbe-933f-0ec8c03ef796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83dfd54-4a4f-4e7e-a549-97c83ff22ad5", "name": "network-vif-deleted", "tag": "5f814799-da51-47b9-b87b-9d32b69cd41f"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:31.871252 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-77226a36-9030-471e-9333-b2bf0498840d req-0c6929a5-1b34-4107-bdaf-f273e6adc6fa service nova] Creating event network-vif-plugged:5f814799-da51-47b9-b87b-9d32b69cd41f for instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 on n-h2-master-1 Oct 16 01:18:31.883115 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-77226a36-9030-471e-9333-b2bf0498840d req-0c6929a5-1b34-4107-bdaf-f273e6adc6fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136390 Oct 16 01:18:31.888624 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1935/3710] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:31.897900 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=58 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:31.901971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-577f554c-4040-4270-8402-7059a9c694b9 req-a6471c6f-37b0-4dbe-933f-0ec8c03ef796 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.902159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5d2766e0-8a60-4cea-a5f1-911002cf4f73 req-28a943e8-0371-42c9-96a1-2d1f02e71bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9077a263-02c3-436e-88a4-7c9e7fdff381", "tag": "a1f3c24b-6b41-4ee3-90f6-db432aca651c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:31.904250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-577f554c-4040-4270-8402-7059a9c694b9 req-a6471c6f-37b0-4dbe-933f-0ec8c03ef796 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.906192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-577f554c-4040-4270-8402-7059a9c694b9 req-a6471c6f-37b0-4dbe-933f-0ec8c03ef796 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.924749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d2766e0-8a60-4cea-a5f1-911002cf4f73 req-28a943e8-0371-42c9-96a1-2d1f02e71bfb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.925229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d2766e0-8a60-4cea-a5f1-911002cf4f73 req-28a943e8-0371-42c9-96a1-2d1f02e71bfb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.930564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d2766e0-8a60-4cea-a5f1-911002cf4f73 req-28a943e8-0371-42c9-96a1-2d1f02e71bfb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.938066 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-577f554c-4040-4270-8402-7059a9c694b9 req-a6471c6f-37b0-4dbe-933f-0ec8c03ef796 service nova] Creating event network-vif-deleted:5f814799-da51-47b9-b87b-9d32b69cd41f for instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 on n-h2-master-1 Oct 16 01:18:31.952476 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-577f554c-4040-4270-8402-7059a9c694b9 req-a6471c6f-37b0-4dbe-933f-0ec8c03ef796 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095306 Oct 16 01:18:31.954540 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1776/3711] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:31.960371 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5d2766e0-8a60-4cea-a5f1-911002cf4f73 req-28a943e8-0371-42c9-96a1-2d1f02e71bfb service nova] Creating event network-changed:a1f3c24b-6b41-4ee3-90f6-db432aca651c for instance 9077a263-02c3-436e-88a4-7c9e7fdff381 on n-h1-master-1 Oct 16 01:18:31.970261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:31.971738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:31.975191 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5d2766e0-8a60-4cea-a5f1-911002cf4f73 req-28a943e8-0371-42c9-96a1-2d1f02e71bfb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081570 Oct 16 01:18:31.977956 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1936/3712] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:31.986183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.987965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.988415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.993219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:31.993705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:31.994059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-08c4738c-6e77-48ae-b801-5405b9fd2942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:31.994651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:31.997095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-08c4738c-6e77-48ae-b801-5405b9fd2942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:32.128146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-08c4738c-6e77-48ae-b801-5405b9fd2942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:32.138066 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-08c4738c-6e77-48ae-b801-5405b9fd2942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1213 microversion: 2.1 time: 0.157485 Oct 16 01:18:32.162385 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1937/3713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:31 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:32.175188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1700361185", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:32.291628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] validate_networks() for [('2e79da2e-21b4-4a37-a7fa-8c15935d172d', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:18:32.631778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:32.645478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:32.648174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:32.650450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-652215e3-c677-4260-8468-0e32ce395099 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2952 microversion: 2.32 time: 0.693327 Oct 16 01:18:32.654362 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1777/3714] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:18:31 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2952 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:18:32.665230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-590fdf78-ed6d-46c4-9f36-9088d0b6daeb tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '.version_select at 0x7fd64d5869d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:33.728103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:18:33.728549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:18:33.729003 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:18:33.729416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:18:33.729835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:18:33.751524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:33.752051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:33.752504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:33.753291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:33.753762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:33.760883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:33.803646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Getting quotas for project 131d702dc0e34408bf3e58809c5cfb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:18:33.817358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Getting quotas for user b7cdbf32b68a44a28e4cc9c4210b5e56 and project 131d702dc0e34408bf3e58809c5cfb0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:18:33.863488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:18:33.870848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:18:33.959630 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-55d01099-4cce-4609-a775-35291fa51d9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.794486 Oct 16 01:18:33.962896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1938/3715] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:18:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:18:33.970267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:33.971655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:33.990064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:33.991416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:33.992630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:33.995105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:33.996375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:33.997743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:34.262030 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b95992f6-169c-4fe3-99d5-e6a3d42ff27f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.297868 Oct 16 01:18:34.263361 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1939/3716] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Oct 16 01:18:33 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966/os-interface => generated 1832 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:18:34.270116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:34.270804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:34.280972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:34.281600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:34.282171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:34.283034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:34.283658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:34.285939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:34.445615 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-590fdf78-ed6d-46c4-9f36-9088d0b6daeb tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/1fbbe9ec-f6e8-472e-91a6-55256e71074c" status: 202 len: 0 microversion: 2.1 time: 1.789506 Oct 16 01:18:34.446789 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1778/3717] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:18:32 2022] DELETE /compute/v2.1/os-floating-ips/1fbbe9ec-f6e8-472e-91a6-55256e71074c => generated 0 bytes in 1792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:18:34.453009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:34.454359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:34.540702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:34.558310 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eb291709-b7c5-47d0-b029-c2f930c4162c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 0.293014 Oct 16 01:18:34.571668 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1940/3718] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:34 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:34.576826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e324be5-a341-408f-9b4b-b593c4a7fa7d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:34.577443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e324be5-a341-408f-9b4b-b593c4a7fa7d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:34.709320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e324be5-a341-408f-9b4b-b593c4a7fa7d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:34.724556 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e324be5-a341-408f-9b4b-b593c4a7fa7d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1225 microversion: 2.1 time: 0.151919 Oct 16 01:18:34.725286 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1941/3719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:34 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:34.749962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3d4b6043-951e-4526-8880-74ab078c365e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '.version_select at 0x7fd64e905940>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:34.901746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:34.902232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:34.902838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:34.903732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:34.904523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:34.905642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.034546 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:35.046284 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32827286-b836-45e9-a301-64a28b2d8914 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1271 microversion: 2.1 time: 0.598076 Oct 16 01:18:35.047867 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1779/3720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:34 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1271 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:35.080545 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3d4b6043-951e-4526-8880-74ab078c365e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/3d2efc87-165d-4f72-978b-285a9139aa21" status: 202 len: 0 microversion: 2.1 time: 0.339900 Oct 16 01:18:35.084082 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1942/3721] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 01:18:34 2022] DELETE /compute/v2.1/os-security-groups/3d2efc87-165d-4f72-978b-285a9139aa21 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:18:35.096300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:35.097308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:35.110813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:35.115372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:35.118495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.120305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:35.120821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:35.121273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.152715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:18:35.180850 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:35.259346 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1504d5e4-8f78-447e-a35f-7e25c5c02b7e tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 204 len: 0 microversion: 2.1 time: 0.169278 Oct 16 01:18:35.265270 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1780/3722] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:18:35 2022] DELETE /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:18:35.270061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:35.271753 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:35.285091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:35.291318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:35.292112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.293753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:35.294364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:35.295424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.475204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:35.492508 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-33eb095f-dc3b-4f81-98e9-b02982ccfcda tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1510 microversion: 2.1 time: 0.226650 Oct 16 01:18:35.493859 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1943/3723] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:35 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:35.587636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:35.589290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:35.600215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:35.601078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:35.601727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.602538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:35.603039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:35.603462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.753097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:35.753712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:35.771923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:35.772704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:35.774208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.776459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:35.786752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:35.787252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:35.911495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:35.914760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:35.926478 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5035839a-764b-488c-a916-95f153ee75f0 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1277 microversion: 2.1 time: 0.178217 Oct 16 01:18:35.929989 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1944/3724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:35 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:35.932561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-61c17faf-411d-4c49-a2c2-3fd594c927c4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 0.352204 Oct 16 01:18:35.934048 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1781/3725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:35 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:36.083212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:36.084572 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:36.097165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:36.098205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:36.098802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:36.099939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:36.100571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:36.101745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:36.135147 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:36.217823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:36.228671 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b4586a2-8607-4bab-b2ae-a3b6401e93dd tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1271 microversion: 2.1 time: 0.158611 Oct 16 01:18:36.230142 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1945/3726] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:36 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:36.519814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:36.520997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:36.527986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:36.528781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:36.530168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:36.531212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:36.531974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:36.532880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:36.957810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:36.958489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:36.967665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:36.968985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:36.969590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:36.970721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:36.971494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:36.972211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:36.974549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:36.985368 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32264bef-7848-459b-a515-def857e4a654 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1510 microversion: 2.1 time: 0.469352 Oct 16 01:18:36.986248 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1782/3727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:36 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1510 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:36.990579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:37.004402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:37.034542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:37.036317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:37.038807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:37.039815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:37.041721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:37.046798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:37.172744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:37.185250 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e26c3b12-3101-474c-9531-6d549fa03f9b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1277 microversion: 2.1 time: 0.236753 Oct 16 01:18:37.189625 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1946/3728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:36 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:37.260167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:37.260807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:37.273883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:37.274402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:37.280509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:37.281365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:37.282129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:37.282579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:37.457123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:37.470841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e6c0563d-b28c-4843-8331-bebff1d964d5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 0.483827 Oct 16 01:18:37.472049 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1783/3729] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:36 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:37.624378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:37.632895 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb259839-ae05-4c3e-bdbd-cd5a0dc343ad tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1313 microversion: 2.1 time: 0.377127 Oct 16 01:18:37.633934 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1947/3730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:37 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:38.009610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:38.010224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:38.017565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:38.018404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:38.019159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:38.020116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:38.020783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:38.021472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:38.211885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:38.213160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:38.228227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:38.228771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:38.229297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:38.229885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:38.230350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:38.230785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:38.300158 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:38.311536 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-46e6e637-67c7-4de5-9454-e6d7f2118e67 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1510 microversion: 2.1 time: 0.304775 Oct 16 01:18:38.313130 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1784/3731] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:38 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:38.417997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:38.430696 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e91d808e-d4c4-4c41-9ae8-08c407f6c75d tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1277 microversion: 2.1 time: 0.222682 Oct 16 01:18:38.447849 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1948/3732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:38 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:38.495365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:38.495987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:38.514336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:38.515895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:38.516609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:38.517912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:38.518607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:38.519302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:38.659540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:38.660689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:38.674721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:38.675527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:38.677650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:38.680161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:38.680806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:38.681988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:39.239948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:39.249700 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-521fe162-dbfb-482d-bd98-09e9c33f114c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1517 microversion: 2.1 time: 0.758664 Oct 16 01:18:39.253356 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1785/3733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:38 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1517 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:39.335267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:39.336075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:39.349841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:39.352626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:39.354029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:39.356960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:39.357887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:39.358802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:39.379043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:39.387125 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7bcadbe8-0b03-4c4a-802b-10c589f4fd2a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1334 microversion: 2.1 time: 0.732681 Oct 16 01:18:39.406956 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1949/3734] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:38 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1334 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:39.460278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:39.465393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:39.484926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:39.485515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:39.485979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:39.486721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:39.493721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:39.495342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:39.631022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:39.641659 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d20bab47-1b29-4b58-a1b2-1a67d784a522 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1277 microversion: 2.1 time: 0.191159 Oct 16 01:18:39.646631 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1950/3735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:39 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:39.660030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:39.667857 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0164f4da-77b6-4c89-b63c-c27e103f7ec6 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1510 microversion: 2.1 time: 0.336444 Oct 16 01:18:39.668430 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1786/3736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:39 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:40.274380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:40.275355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:40.284908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:40.285650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:40.286327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:40.287297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:40.288582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:40.289257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:40.417948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:40.424729 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:40.438947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:40.440082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:40.440750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:40.442129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:40.443001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:40.443647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:40.803095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:40.811585 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5cdfc99d-f02a-497a-a245-3dcceab989a7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1523 microversion: 2.1 time: 0.542353 Oct 16 01:18:40.816412 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1951/3737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:40 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:40.829313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:40.830233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:40.839691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:40.840535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:40.840996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:40.841925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:40.842433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:40.842879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:40.868883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:40.890370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3194c58-e817-4459-a96f-db7fc479f228 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.481277 Oct 16 01:18:40.891065 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1787/3738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:40 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:40.909359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:40.913039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:40.927643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:40.928152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:40.928596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:40.929309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:40.936750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:40.937462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:41.126627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:41.139911 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-006fbb08-d14b-4725-bc87-4f7748eafa40 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1283 microversion: 2.1 time: 0.321686 Oct 16 01:18:41.141890 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1952/3739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:40 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1283 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:41.259899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a92243b35f45a6bbcab9d288ae5271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cfed1efa1c408287e3e10f4e0afcb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:41.289387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a760e5ca-a5cf-4551-a300-978125d677b8 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 200 len: 1510 microversion: 2.1 time: 0.394562 Oct 16 01:18:41.291917 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1788/3740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:40 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:41.537776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0131cf04-2f3e-4c43-be5f-c6f2f92ae8b0 req-e4839942-5a6b-41ae-a29f-cd11026fc0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9077a263-02c3-436e-88a4-7c9e7fdff381", "name": "network-vif-deleted", "tag": "a1f3c24b-6b41-4ee3-90f6-db432aca651c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:41.560060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0131cf04-2f3e-4c43-be5f-c6f2f92ae8b0 req-e4839942-5a6b-41ae-a29f-cd11026fc0ed service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:41.561490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0131cf04-2f3e-4c43-be5f-c6f2f92ae8b0 req-e4839942-5a6b-41ae-a29f-cd11026fc0ed service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:41.562133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0131cf04-2f3e-4c43-be5f-c6f2f92ae8b0 req-e4839942-5a6b-41ae-a29f-cd11026fc0ed service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:41.600745 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0131cf04-2f3e-4c43-be5f-c6f2f92ae8b0 req-e4839942-5a6b-41ae-a29f-cd11026fc0ed service nova] Creating event network-vif-deleted:a1f3c24b-6b41-4ee3-90f6-db432aca651c for instance 9077a263-02c3-436e-88a4-7c9e7fdff381 on n-h1-master-1 Oct 16 01:18:41.619939 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0131cf04-2f3e-4c43-be5f-c6f2f92ae8b0 req-e4839942-5a6b-41ae-a29f-cd11026fc0ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087020 Oct 16 01:18:41.625719 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1953/3741] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:41.837932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:41.839350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:41.856738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:41.858478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:41.860380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:41.862418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:41.864890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:41.865552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:41.922017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:41.923078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:41.936716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:41.943253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:41.945817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:41.948221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:41.974587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:41.975185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:42.626389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:42.631081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:42.637439 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a803767b-0527-4d16-b169-a1df5e64c210 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.722898 Oct 16 01:18:42.639356 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b7560737-0816-4bed-bb1c-af857bdd1f5b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1523 microversion: 2.1 time: 0.805092 Oct 16 01:18:42.639937 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1789/3742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:41 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1523 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:42.649118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:42.656023 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1954/3743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:41 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:42.656946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:42.665210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:42.666102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] [instance: 9077a263-02c3-436e-88a4-7c9e7fdff381] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:42.670874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:42.671455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:42.671907 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:42.672640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:42.673391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:42.673831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:42.676186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:42.676788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:42.678072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:42.679246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:42.679924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:42.681059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:42.701769 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] HTTP exception thrown: Instance 9077a263-02c3-436e-88a4-7c9e7fdff381 could not be found. Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Request method failure captured: Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 HTTP/1.1 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1uk3mLVbI8tLndcRWGx-pV7peDTQNZqTVpdsa6wZzHhV9naWCFT_cARo2AgCix6fBp8AFlna_HnRImQbIPMVocLewSeW2dsbTWChx0E99sNDS1xPRq8eHihWEgV96DaCIVFwLrc92m4PnsXmhSzW2wF1ylogwCc4LBTz-o5uxz5lX4 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 01cfed1efa1c408287e3e10f4e0afcb2 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-884173545 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_01cfed1efa1c408287e3e10f4e0afcb2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/01cfed1efa1c408287e3e10f4e0afcb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01cfed1efa1c408287e3e10f4e0afcb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01cfed1efa1c408287e3e10f4e0afcb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-884173545 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 01cfed1efa1c408287e3e10f4e0afcb2 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-884173545 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueTestJSONUnderV235-884173545-project Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 50a92243b35f45a6bbcab9d288ae5271 Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-884173545-project Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 9077a263-02c3-436e-88a4-7c9e7fdff381 could not be found. Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '9077a263-02c3-436e-88a4-7c9e7fdff381'} Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9077a263-02c3-436e-88a4-7c9e7fdff381 could not be found. Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9077a263-02c3-436e-88a4-7c9e7fdff381 could not be found. Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:42.703389 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9077a263-02c3-436e-88a4-7c9e7fdff381 could not be found. Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] Returning 404 to user: Instance 9077a263-02c3-436e-88a4-7c9e7fdff381 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:18:42.707463 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-df8a1d75-cbcc-4cc3-939d-9a4022fa7ca0 tempest-ServerRescueTestJSONUnderV235-884173545 tempest-ServerRescueTestJSONUnderV235-884173545-project] 10.222.0.39 "GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381" status: 404 len: 111 microversion: 2.1 time: 0.047653 Oct 16 01:18:42.708093 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1955/3744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:42 2022] GET /compute/v2.1/servers/9077a263-02c3-436e-88a4-7c9e7fdff381 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:18:43.171495 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:43.180506 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-840d03c6-a1d3-4af4-abc6-737fe9c50e7f tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1325 microversion: 2.1 time: 0.537419 Oct 16 01:18:43.196918 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1790/3745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:42 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:43.669081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:43.669831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:43.671606 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:43.673084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:43.677540 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:43.682082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:43.682589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:43.712594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:43.717372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:43.725017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:43.727644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:43.730999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:43.736354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:43.737100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:43.743850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:43.745209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:43.746772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:43.782990 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:44.222783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:44.236442 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fca121de-0c91-444e-9dc5-b82ecf12f21c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.571305 Oct 16 01:18:44.237520 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1791/3746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:43 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:44.242262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-80dfb85f-6d5f-4644-9dc2-e199810b6de5 req-471fb772-087b-41f8-861d-85183d89ee84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6f4fe2-d304-4cfc-a04d-19f1c4af763f", "name": "network-vif-unplugged", "status": "completed", "tag": "f7308eab-b78c-4949-b043-f783a2f9662a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:44.276018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-80dfb85f-6d5f-4644-9dc2-e199810b6de5 req-471fb772-087b-41f8-861d-85183d89ee84 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:44.277875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-80dfb85f-6d5f-4644-9dc2-e199810b6de5 req-471fb772-087b-41f8-861d-85183d89ee84 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:44.279352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-80dfb85f-6d5f-4644-9dc2-e199810b6de5 req-471fb772-087b-41f8-861d-85183d89ee84 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:44.312338 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-80dfb85f-6d5f-4644-9dc2-e199810b6de5 req-471fb772-087b-41f8-861d-85183d89ee84 service nova] Creating event network-vif-unplugged:f7308eab-b78c-4949-b043-f783a2f9662a for instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f on n-h1-master-1 Oct 16 01:18:44.321536 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-80dfb85f-6d5f-4644-9dc2-e199810b6de5 req-471fb772-087b-41f8-861d-85183d89ee84 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082497 Oct 16 01:18:44.324609 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1792/3747] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:44.338007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-94df3906-5eb8-42bd-b8e4-c2f608d8ad83 req-90bd552f-5387-4fdd-a39b-ce1b95cdc251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "tag": "83ab986f-2045-4218-8813-8538c238f50d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:44.368851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-94df3906-5eb8-42bd-b8e4-c2f608d8ad83 req-90bd552f-5387-4fdd-a39b-ce1b95cdc251 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:44.369344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-94df3906-5eb8-42bd-b8e4-c2f608d8ad83 req-90bd552f-5387-4fdd-a39b-ce1b95cdc251 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:44.372489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-94df3906-5eb8-42bd-b8e4-c2f608d8ad83 req-90bd552f-5387-4fdd-a39b-ce1b95cdc251 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:44.410182 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-94df3906-5eb8-42bd-b8e4-c2f608d8ad83 req-90bd552f-5387-4fdd-a39b-ce1b95cdc251 service nova] Creating event network-changed:83ab986f-2045-4218-8813-8538c238f50d for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:18:44.410834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:44.425281 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13f4ac3c-dd74-4b98-bd5f-d3b1d02b09df tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1523 microversion: 2.1 time: 0.760313 Oct 16 01:18:44.426231 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1956/3748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:43 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1523 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:44.432060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:44.436450 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:44.441010 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-94df3906-5eb8-42bd-b8e4-c2f608d8ad83 req-90bd552f-5387-4fdd-a39b-ce1b95cdc251 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098236 Oct 16 01:18:44.445021 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1793/3749] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:44.459543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:44.460221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:44.460687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:44.461648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:44.462125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:44.462551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:44.719388 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:44.860141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:44.881245 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9155f19c-0bec-44e8-b718-ad8287bf81c7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1325 microversion: 2.1 time: 0.453250 Oct 16 01:18:44.883375 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1957/3750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:44 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1325 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:45.063519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b89e9382-755e-413a-b4f9-6eba5581b5fa req-7d041c0c-b0ce-4739-8a54-d493b98634fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41af71b5-52a1-4de0-a460-bab35bc0d6fa", "tag": "cd28b150-a787-443c-96b4-4496b489fa05"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:45.102852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b89e9382-755e-413a-b4f9-6eba5581b5fa req-7d041c0c-b0ce-4739-8a54-d493b98634fa service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:45.105257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b89e9382-755e-413a-b4f9-6eba5581b5fa req-7d041c0c-b0ce-4739-8a54-d493b98634fa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:45.120500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b89e9382-755e-413a-b4f9-6eba5581b5fa req-7d041c0c-b0ce-4739-8a54-d493b98634fa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:45.165300 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b89e9382-755e-413a-b4f9-6eba5581b5fa req-7d041c0c-b0ce-4739-8a54-d493b98634fa service nova] Creating event network-changed:cd28b150-a787-443c-96b4-4496b489fa05 for instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa on n-h1-master-1 Oct 16 01:18:45.173526 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b89e9382-755e-413a-b4f9-6eba5581b5fa req-7d041c0c-b0ce-4739-8a54-d493b98634fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114173 Oct 16 01:18:45.174137 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1794/3751] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:45.278638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:45.279855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:45.290437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:45.291360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:45.292018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:45.292930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:45.293589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:45.294240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:45.450161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:45.451834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:45.460008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:45.461246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:45.461899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:45.463153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:45.463839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:45.464611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:45.819852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:45.847786 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4bbca4a5-0e89-48f5-b0f4-5ad3f8bba9da tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.574425 Oct 16 01:18:45.860969 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1958/3752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:45 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:45.866685 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:45.879608 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fae0904d-6f1c-4200-9e21-f80aa011b8f3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1523 microversion: 2.1 time: 0.433695 Oct 16 01:18:45.880654 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1795/3753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:45 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:45.915637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:45.916205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:45.927953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:45.929320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:45.930061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:45.931322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:45.932044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:45.932685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:46.265884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:46.278962 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-832a03cd-4ddb-4076-a4db-0e309e1721b6 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1325 microversion: 2.1 time: 0.367834 Oct 16 01:18:46.281026 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1959/3754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:45 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:46.414255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-415727b3-9345-4216-b52b-51a9d6a95dba req-48079bac-ad74-4396-96bc-16968608b6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6f4fe2-d304-4cfc-a04d-19f1c4af763f", "name": "network-vif-plugged", "status": "completed", "tag": "f7308eab-b78c-4949-b043-f783a2f9662a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:46.428282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-415727b3-9345-4216-b52b-51a9d6a95dba req-48079bac-ad74-4396-96bc-16968608b6e5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:46.429025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-415727b3-9345-4216-b52b-51a9d6a95dba req-48079bac-ad74-4396-96bc-16968608b6e5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:46.429628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-415727b3-9345-4216-b52b-51a9d6a95dba req-48079bac-ad74-4396-96bc-16968608b6e5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:46.444933 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-415727b3-9345-4216-b52b-51a9d6a95dba req-48079bac-ad74-4396-96bc-16968608b6e5 service nova] Creating event network-vif-plugged:f7308eab-b78c-4949-b043-f783a2f9662a for instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f on n-h1-master-1 Oct 16 01:18:46.452860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-415727b3-9345-4216-b52b-51a9d6a95dba req-48079bac-ad74-4396-96bc-16968608b6e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042165 Oct 16 01:18:46.454565 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1796/3755] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:46.476122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ae6425de-00f2-4d10-81ef-dbe66c2fe2a6 req-54fa11c9-17f1-43c8-a1b4-a44bd223a876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "tag": "b81792b8-9403-43f5-bb8e-74b08680680c"}, {"name": "network-changed", "server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "tag": "593ff79a-07d3-419d-b477-8a75ce99daac"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:46.489465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ae6425de-00f2-4d10-81ef-dbe66c2fe2a6 req-54fa11c9-17f1-43c8-a1b4-a44bd223a876 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:46.490428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ae6425de-00f2-4d10-81ef-dbe66c2fe2a6 req-54fa11c9-17f1-43c8-a1b4-a44bd223a876 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:46.491079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ae6425de-00f2-4d10-81ef-dbe66c2fe2a6 req-54fa11c9-17f1-43c8-a1b4-a44bd223a876 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:46.505083 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ae6425de-00f2-4d10-81ef-dbe66c2fe2a6 req-54fa11c9-17f1-43c8-a1b4-a44bd223a876 service nova] Creating event network-changed:b81792b8-9403-43f5-bb8e-74b08680680c for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:18:46.505900 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ae6425de-00f2-4d10-81ef-dbe66c2fe2a6 req-54fa11c9-17f1-43c8-a1b4-a44bd223a876 service nova] Creating event network-changed:593ff79a-07d3-419d-b477-8a75ce99daac for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:18:46.512929 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ae6425de-00f2-4d10-81ef-dbe66c2fe2a6 req-54fa11c9-17f1-43c8-a1b4-a44bd223a876 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040533 Oct 16 01:18:46.515069 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1960/3756] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:46.880531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:46.883025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:46.893427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:46.894307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:46.894908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:46.895822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:46.896440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:46.899414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:46.906808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:46.907590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:46.925231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:46.926672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:46.927191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:46.928299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:46.928776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:46.929208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:48.179260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:48.188623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e84d752-d861-46eb-bb04-d89705561965 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 1.318345 Oct 16 01:18:48.200687 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1797/3757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:46 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:48.210963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:48.213991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:48.216927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:48.222579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:48.223270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:48.223877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:48.224749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:48.225758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:48.226508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:48.239763 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-95ee9315-b24f-4e83-be77-8fe671f953d8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1523 microversion: 2.1 time: 1.339564 Oct 16 01:18:48.242238 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1961/3758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:46 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1523 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:48.872266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:48.888063 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d1ed9a9-8a4e-43db-b847-08fbaaa17d79 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1325 microversion: 2.1 time: 0.684826 Oct 16 01:18:48.897700 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1798/3759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:48 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1325 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:49.221412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:49.221951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:49.236993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:49.238006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:49.238628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:49.240988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:49.241780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:49.242883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:49.269965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:49.270583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:49.281861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:49.283881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:49.287499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:49.292499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:49.293152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:49.293860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:49.305659 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:49.677779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:49.688745 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d9840bb2-6172-4bc8-81c2-4b6838857eb0 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1508 microversion: 2.1 time: 0.422906 Oct 16 01:18:49.689450 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1799/3760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:49 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:49.717452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:49.720821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:49.729684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:49.736862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:49.739613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:49.743095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:49.744057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:49.744684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:49.747186 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-486173ba-7e92-43c3-814a-21deb0eb73d5 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.536963 Oct 16 01:18:49.747834 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1962/3761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:49 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:49.759518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:49.913309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:49.916033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:49.923743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:49.925086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:49.925554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:49.926279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:49.927779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:49.932224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:50.233502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:50.242097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:50.251210 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-072403eb-a800-4465-b535-1f10658d360b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 200 len: 1508 microversion: 2.1 time: 0.538433 Oct 16 01:18:50.269563 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1800/3762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:49 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 1508 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:50.272349 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4dfd9fa-8668-403f-9314-d82e3848fef2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1325 microversion: 2.1 time: 0.362975 Oct 16 01:18:50.295429 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1963/3763] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:49 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:50.297175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:50.300199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:50.307012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:50.307766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:50.308421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:50.309348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:50.310056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:50.310965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:50.352335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:18:50.476109 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b2d34a9-af7a-4f99-b99e-a3292f6858fa tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 204 len: 0 microversion: 2.1 time: 0.183531 Oct 16 01:18:50.477374 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1801/3764] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:18:50 2022] DELETE /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:18:50.677504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-681530731", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "568274da-df36-43fc-b668-f6a872d918ce"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:50.775989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:50.777070 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:50.788447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:50.797971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:50.798428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:50.799206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:50.811190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:50.811886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:50.820287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] validate_networks() for [('568274da-df36-43fc-b668-f6a872d918ce', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:18:51.231373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:51.247440 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-de7f328f-5a23-4be5-8cf0-139ceac07fd2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.476490 Oct 16 01:18:51.252412 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1802/3765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:50 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:51.297280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:51.297931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:51.307889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:51.314777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:51.316283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:51.317938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:51.318554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:51.319269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:51.820026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:51.830632 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b850d52-b15b-4b87-bf80-f1ae58c731fe tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1325 microversion: 2.1 time: 0.539021 Oct 16 01:18:51.848254 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1803/3766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:51 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:52.051633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:18:52.053164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:18:52.055342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:18:52.056545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:18:52.057266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:18:52.094052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:52.097146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:52.097821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:52.098775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:52.101336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:52.101955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:52.143409 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:18:52.176273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Getting quotas for project 16773b3925f648bbade2e6bf967a3fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:18:52.191884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Getting quotas for user f1bfe0b4f344485ab6de52f7b1423118 and project 16773b3925f648bbade2e6bf967a3fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:18:52.240564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:18:52.245862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:18:52.277228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:52.277859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:52.289251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:52.289944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:52.291649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:52.292441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:52.297583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:52.298347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:52.318678 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7514781d-ce77-406d-901b-f1eaa8f8c21b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646652 Oct 16 01:18:52.320767 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1964/3767] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:18:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:18:52.333396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f06f7b87-1beb-43c9-a333-150d410e95f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:52.334690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f06f7b87-1beb-43c9-a333-150d410e95f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:52.571795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f06f7b87-1beb-43c9-a333-150d410e95f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:52.589878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f06f7b87-1beb-43c9-a333-150d410e95f1 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1217 microversion: 2.1 time: 0.260218 Oct 16 01:18:52.592805 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1965/3768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:52 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1217 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:52.664731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1602c774-6a7f-4f7f-83da-c55f8284f381 req-ebf4e847-234c-4d4b-aa33-c36452af01f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41af71b5-52a1-4de0-a460-bab35bc0d6fa", "name": "network-vif-plugged", "status": "completed", "tag": "cd28b150-a787-443c-96b4-4496b489fa05"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:52.702435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1602c774-6a7f-4f7f-83da-c55f8284f381 req-ebf4e847-234c-4d4b-aa33-c36452af01f2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:52.702938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1602c774-6a7f-4f7f-83da-c55f8284f381 req-ebf4e847-234c-4d4b-aa33-c36452af01f2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:52.703377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1602c774-6a7f-4f7f-83da-c55f8284f381 req-ebf4e847-234c-4d4b-aa33-c36452af01f2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:52.733692 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1602c774-6a7f-4f7f-83da-c55f8284f381 req-ebf4e847-234c-4d4b-aa33-c36452af01f2 service nova] Creating event network-vif-plugged:cd28b150-a787-443c-96b4-4496b489fa05 for instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa on n-h1-master-1 Oct 16 01:18:52.746369 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1602c774-6a7f-4f7f-83da-c55f8284f381 req-ebf4e847-234c-4d4b-aa33-c36452af01f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086620 Oct 16 01:18:52.750721 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1966/3769] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:52.860595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:52.861615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:52.879409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:52.884052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:52.885692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:52.889030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:52.892739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:52.894788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:53.287887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:53.300306 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c08a3f69-9223-4f9d-b420-9c4281ea6623 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 1.027332 Oct 16 01:18:53.304071 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1804/3770] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:52 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:53.457640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:53.488833 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1325 microversion: 2.1 time: 0.637133 Oct 16 01:18:53.493607 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1967/3771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:52 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1325 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:53.614097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:53.614825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:53.628730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:53.629341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:53.629915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:53.635789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:53.636485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:53.637102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:53.910147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:53.911385 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001698 Oct 16 01:18:53.912213 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1968/3772] 10.222.0.39 () {56 vars in 886 bytes} [Sun Oct 16 01:18:53 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 16 01:18:53.920979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:53.922487 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002781 Oct 16 01:18:53.923596 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1969/3773] 10.222.0.39 () {54 vars in 1035 bytes} [Sun Oct 16 01:18:53 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 16 01:18:53.931282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:53.932316 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 16 01:18:53.932728 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1970/3774] 10.222.0.39 () {54 vars in 1041 bytes} [Sun Oct 16 01:18:53 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:18:53.944354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:53.945522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-204fa033-4f3f-4138-9328-129e6c25a9e7 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001566 Oct 16 01:18:53.960176 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1971/3775] 10.222.0.39 () {56 vars in 886 bytes} [Sun Oct 16 01:18:53 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 16 01:18:54.183738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:54.200198 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ca126625-951e-441c-b50b-104222d34962 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1213 microversion: 2.1 time: 0.589940 Oct 16 01:18:54.220241 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1805/3776] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:53 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1213 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:54.333143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:54.333755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:54.349667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:54.350500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:54.355906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:54.363708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fd04b8aa-1d82-48d3-a2c3-7e1d32d3dd08 req-b8b17b08-e710-45e2-a2a9-06dd168ac8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6f4fe2-d304-4cfc-a04d-19f1c4af763f", "name": "network-vif-deleted", "tag": "f7308eab-b78c-4949-b043-f783a2f9662a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:54.369682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:54.371589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:54.372130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:54.380849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd04b8aa-1d82-48d3-a2c3-7e1d32d3dd08 req-b8b17b08-e710-45e2-a2a9-06dd168ac8d8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:54.381783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd04b8aa-1d82-48d3-a2c3-7e1d32d3dd08 req-b8b17b08-e710-45e2-a2a9-06dd168ac8d8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:54.385723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd04b8aa-1d82-48d3-a2c3-7e1d32d3dd08 req-b8b17b08-e710-45e2-a2a9-06dd168ac8d8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:54.449753 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fd04b8aa-1d82-48d3-a2c3-7e1d32d3dd08 req-b8b17b08-e710-45e2-a2a9-06dd168ac8d8 service nova] Creating event network-vif-deleted:f7308eab-b78c-4949-b043-f783a2f9662a for instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f on n-h1-master-1 Oct 16 01:18:54.469349 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fd04b8aa-1d82-48d3-a2c3-7e1d32d3dd08 req-b8b17b08-e710-45e2-a2a9-06dd168ac8d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111102 Oct 16 01:18:54.476413 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1806/3777] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:54.515782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:54.516853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:54.533921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:54.536007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:54.536695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:54.541370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:54.542121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:54.542767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:54.781997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:54.797442 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0baee4c3-91b2-4705-ba01-7df135cbf95b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.471653 Oct 16 01:18:54.798054 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1972/3778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:54 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:54.899039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:54.912022 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4a9bbcf-ba55-4dfb-a9b9-0de6d3e2aa6e tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1522 microversion: 2.1 time: 0.402505 Oct 16 01:18:54.912750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1807/3779] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:54 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:54.943010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:54.943512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:54.951569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:54.952287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:54.952783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:54.953668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:54.954321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:54.954774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:54.991148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:18:55.130173 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a886d131-464a-40a1-b874-a8c20cf27317 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 204 len: 0 microversion: 2.1 time: 0.190738 Oct 16 01:18:55.132391 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1973/3780] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:18:54 2022] DELETE /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:18:55.141964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:55.143290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:55.152565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:55.153356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:55.154066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:55.155735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:55.156428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:55.157103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:55.229210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:55.230310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:55.240460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:55.240958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:55.241392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:55.242101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:55.242639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:55.243099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:55.348206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:55.368930 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-28333446-a2a4-45ed-bf82-8c4d75eeab3e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1275 microversion: 2.1 time: 0.143928 Oct 16 01:18:55.380905 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1974/3781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:55 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:55.426938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:55.443866 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e8047b67-95a4-4ef0-8dee-d8f86decac37 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1528 microversion: 2.1 time: 0.307119 Oct 16 01:18:55.461202 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1808/3782] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:55 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1528 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:55.835145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:55.835750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:55.862823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:55.863559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:55.864123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:55.867300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:55.867913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:55.868453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:56.285175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:56.296392 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2c7e00a3-8056-4b75-a080-4c05d34323e9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.474717 Oct 16 01:18:56.301811 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1975/3783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:55 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:56.406235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:56.407646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:56.431062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:56.436247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:56.436949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:56.438763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:56.443769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:56.444233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:56.468463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:56.469325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:56.478803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:56.483170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:56.483821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:56.484711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:56.487325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:56.488009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:56.963413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:56.971574 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff20b904-e897-4b80-ad1e-5894f48ee61b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1528 microversion: 2.1 time: 0.507192 Oct 16 01:18:56.972173 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1976/3784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:56 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1528 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:57.004348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:57.017217 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5103c1ae-fdc2-46bd-b900-63b62381bb72 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1317 microversion: 2.1 time: 0.623236 Oct 16 01:18:57.018427 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1809/3785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:56 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:57.206306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6a4b4ed2-e198-4937-905e-955ebd7c85ac req-154534d1-c4b6-4c6f-ba9a-f2080d3078f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1825b6b9-d141-4e56-aebb-06954709b85f", "tag": "387b3b92-94c8-44ea-9d83-32b230b5a0b6"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:57.232750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6a4b4ed2-e198-4937-905e-955ebd7c85ac req-154534d1-c4b6-4c6f-ba9a-f2080d3078f3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:57.233452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6a4b4ed2-e198-4937-905e-955ebd7c85ac req-154534d1-c4b6-4c6f-ba9a-f2080d3078f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:57.234055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6a4b4ed2-e198-4937-905e-955ebd7c85ac req-154534d1-c4b6-4c6f-ba9a-f2080d3078f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:57.272361 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6a4b4ed2-e198-4937-905e-955ebd7c85ac req-154534d1-c4b6-4c6f-ba9a-f2080d3078f3 service nova] Creating event network-changed:387b3b92-94c8-44ea-9d83-32b230b5a0b6 for instance 1825b6b9-d141-4e56-aebb-06954709b85f on n-h2-master-1 Oct 16 01:18:57.280498 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6a4b4ed2-e198-4937-905e-955ebd7c85ac req-154534d1-c4b6-4c6f-ba9a-f2080d3078f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093031 Oct 16 01:18:57.282250 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1977/3786] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:57.325709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:57.327573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:57.337373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:57.337873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:57.338316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:57.339446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:57.339930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:57.340597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:57.817825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:57.843933 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-601e2029-c64e-4ea3-b223-ce32a8d7e01c tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.524016 Oct 16 01:18:57.857848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1810/3787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:57 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:57.996845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:57.997594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:58.022375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:58.026666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:58.027189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:58.036710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:58.037445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:58.038043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:58.041118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:58.041889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:58.054838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:58.056785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:58.058964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:58.059892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:58.062160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:58.062899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:58.282345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7cdbf32b68a44a28e4cc9c4210b5e56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131d702dc0e34408bf3e58809c5cfb0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:58.300828 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a8544962-cd06-490d-a520-5f1ea3ee5c12 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 200 len: 1486 microversion: 2.1 time: 0.308576 Oct 16 01:18:58.320492 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1978/3788] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:57 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 1486 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:58.337545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d4d60cff-a6e9-4280-a237-a751239156ee req-5dbaa282-850b-4944-b18b-806cab59fcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41af71b5-52a1-4de0-a460-bab35bc0d6fa", "name": "network-vif-deleted", "tag": "cd28b150-a787-443c-96b4-4496b489fa05"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:58.359558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d4d60cff-a6e9-4280-a237-a751239156ee req-5dbaa282-850b-4944-b18b-806cab59fcf7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:58.360048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d4d60cff-a6e9-4280-a237-a751239156ee req-5dbaa282-850b-4944-b18b-806cab59fcf7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:58.360485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d4d60cff-a6e9-4280-a237-a751239156ee req-5dbaa282-850b-4944-b18b-806cab59fcf7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:58.377618 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d4d60cff-a6e9-4280-a237-a751239156ee req-5dbaa282-850b-4944-b18b-806cab59fcf7 service nova] Creating event network-vif-deleted:cd28b150-a787-443c-96b4-4496b489fa05 for instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa on n-h1-master-1 Oct 16 01:18:58.384666 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d4d60cff-a6e9-4280-a237-a751239156ee req-5dbaa282-850b-4944-b18b-806cab59fcf7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062258 Oct 16 01:18:58.385996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1979/3789] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:58.393206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-00ef6ead-0041-4794-a1a9-143db5de73e2 req-adb3c58d-ff88-45a3-9642-03dd3571b75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "name": "network-vif-plugged", "status": "completed", "tag": "83ab986f-2045-4218-8813-8538c238f50d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:18:58.408612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-00ef6ead-0041-4794-a1a9-143db5de73e2 req-adb3c58d-ff88-45a3-9642-03dd3571b75e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:58.409433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-00ef6ead-0041-4794-a1a9-143db5de73e2 req-adb3c58d-ff88-45a3-9642-03dd3571b75e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:58.410021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-00ef6ead-0041-4794-a1a9-143db5de73e2 req-adb3c58d-ff88-45a3-9642-03dd3571b75e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:58.428424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-00ef6ead-0041-4794-a1a9-143db5de73e2 req-adb3c58d-ff88-45a3-9642-03dd3571b75e service nova] Creating event network-vif-plugged:83ab986f-2045-4218-8813-8538c238f50d for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:18:58.436301 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-00ef6ead-0041-4794-a1a9-143db5de73e2 req-adb3c58d-ff88-45a3-9642-03dd3571b75e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047227 Oct 16 01:18:58.436602 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:58.437505 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1980/3790] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:18:58.446783 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-417a7995-f57a-47fa-9f12-e46b27308c9b tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1317 microversion: 2.1 time: 0.410005 Oct 16 01:18:58.450041 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1811/3791] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:58 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:18:58.872066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:58.875315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:58.881899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:58.882543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:58.883067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:58.884327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:58.884854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:58.885438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.298431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:59.310150 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3552bbfe-e9af-462b-812f-d54ba7febf53 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 0.443244 Oct 16 01:18:59.312167 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1981/3792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:58 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:18:59.332629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:59.333344 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 41af71b5-52a1-4de0-a460-bab35bc0d6fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:59.351204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:59.353294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:59.357774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.358310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:59.358797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:59.359257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.396811 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa could not be found. Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa HTTP/1.1 Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa could not be found. Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '41af71b5-52a1-4de0-a460-bab35bc0d6fa'} Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa could not be found. Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa could not be found. Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.402325 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa could not be found. Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Instance 41af71b5-52a1-4de0-a460-bab35bc0d6fa could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-121cb3d1-a15a-4da5-917b-ef763fc544e2 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa" status: 404 len: 111 microversion: 2.1 time: 0.075735 Oct 16 01:18:59.406798 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1812/3793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:59 2022] GET /compute/v2.1/servers/41af71b5-52a1-4de0-a460-bab35bc0d6fa => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:18:59.415794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb00d9a8-247c-40f2-a5f9-81eaebf84bd5 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '.version_select at 0x7fd6526eaf70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:59.442184 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-eb00d9a8-247c-40f2-a5f9-81eaebf84bd5 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Image not found. Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb00d9a8-247c-40f2-a5f9-81eaebf84bd5 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/images/3c1551c5-b3bf-4efd-abbd-69cd051c5497 HTTP/1.1 Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: exception: Image not found. Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '3c1551c5-b3bf-4efd-abbd-69cd051c5497'} Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3c1551c5-b3bf-4efd-abbd-69cd051c5497 to delete Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c1551c5-b3bf-4efd-abbd-69cd051c5497 could not be found. Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.444419 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:18:59.449457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.462808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb00d9a8-247c-40f2-a5f9-81eaebf84bd5 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Image not found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:18:59.464631 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eb00d9a8-247c-40f2-a5f9-81eaebf84bd5 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/images/3c1551c5-b3bf-4efd-abbd-69cd051c5497" status: 404 len: 62 microversion: 2.1 time: 0.052667 Oct 16 01:18:59.469655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1982/3794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:59 2022] DELETE /compute/v2.1/images/3c1551c5-b3bf-4efd-abbd-69cd051c5497 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:18:59.474513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:59.475053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:59.481233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:59.482611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:59.487378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:59.487871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:59.488308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.489016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:59.489471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:59.489893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.492043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:59.492774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:59.493445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.494555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:59.495274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:59.495920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.551855 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 HTTP/1.1 Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: exception: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'f83dfd54-4a4f-4e7e-a549-97c83ff22ad5'} Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:18:59.555670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ffc1e310-5178-4604-8efb-b538ceeb260b tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 404 len: 111 microversion: 2.1 time: 0.087620 Oct 16 01:18:59.558891 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1813/3795] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:18:59 2022] DELETE /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:18:59.571919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:59.572801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: f83dfd54-4a4f-4e7e-a549-97c83ff22ad5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:18:59.582631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:59.583978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:59.584909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.585935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:18:59.586412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:18:59.587062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:18:59.606604 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 HTTP/1.1 Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: exception: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'f83dfd54-4a4f-4e7e-a549-97c83ff22ad5'} Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.609410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:18:59.613045 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Instance f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:18:59.613532 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e92a91b-2b10-40a0-94ac-17b8090bea24 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5" status: 404 len: 111 microversion: 2.1 time: 0.048698 Oct 16 01:18:59.617293 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1814/3796] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:59 2022] GET /compute/v2.1/servers/f83dfd54-4a4f-4e7e-a549-97c83ff22ad5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:18:59.623099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5031898c-5944-4599-b687-04663b648665 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '.version_select at 0x7fd64d622f70>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:18:59.660910 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5031898c-5944-4599-b687-04663b648665 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094217530" status: 202 len: 0 microversion: 2.1 time: 0.040898 Oct 16 01:18:59.661517 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1815/3797] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094217530 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:18:59.907503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:18:59.915375 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa19c870-568b-45a1-b230-467660ea6ebe tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1317 microversion: 2.1 time: 0.442307 Oct 16 01:18:59.921287 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1983/3798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:18:59 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:00.333880 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:00.334426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:00.344928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:00.345434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:00.348581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:00.352619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:00.353175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:00.353630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:00.514311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-319e2b82-c921-490a-84e5-d5dae0630724 req-17a7b508-24ae-4914-bf3b-e927ebee9866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "name": "network-vif-plugged", "status": "completed", "tag": "593ff79a-07d3-419d-b477-8a75ce99daac"}, {"server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "name": "network-vif-plugged", "status": "completed", "tag": "b81792b8-9403-43f5-bb8e-74b08680680c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:00.533904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-319e2b82-c921-490a-84e5-d5dae0630724 req-17a7b508-24ae-4914-bf3b-e927ebee9866 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:00.549782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-319e2b82-c921-490a-84e5-d5dae0630724 req-17a7b508-24ae-4914-bf3b-e927ebee9866 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:00.553717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-319e2b82-c921-490a-84e5-d5dae0630724 req-17a7b508-24ae-4914-bf3b-e927ebee9866 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:00.578052 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-319e2b82-c921-490a-84e5-d5dae0630724 req-17a7b508-24ae-4914-bf3b-e927ebee9866 service nova] Creating event network-vif-plugged:593ff79a-07d3-419d-b477-8a75ce99daac for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:19:00.578557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-319e2b82-c921-490a-84e5-d5dae0630724 req-17a7b508-24ae-4914-bf3b-e927ebee9866 service nova] Creating event network-vif-plugged:b81792b8-9403-43f5-bb8e-74b08680680c for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:19:00.590790 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-319e2b82-c921-490a-84e5-d5dae0630724 req-17a7b508-24ae-4914-bf3b-e927ebee9866 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082584 Oct 16 01:19:00.594897 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1984/3799] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:00.942047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:00.942746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:00.951003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:00.951500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:00.951935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:00.952637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:00.953094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:00.953515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:01.650562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:01.663559 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d1dbdf9-2b9b-4404-85f1-a7e6fad1c66e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1355 microversion: 2.1 time: 1.329353 Oct 16 01:19:01.664530 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1816/3800] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:00 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1355 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:01.669438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eaa8c0f1-436e-4f90-9738-147dd2047586 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '.version_select at 0x7fd64d75cb80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:01.705595 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-eaa8c0f1-436e-4f90-9738-147dd2047586 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Image not found. Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eaa8c0f1-436e-4f90-9738-147dd2047586 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/images/e8c7252f-581c-425b-bb7f-cad7c88aaa54 HTTP/1.1 Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'e8c7252f-581c-425b-bb7f-cad7c88aaa54'} Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e8c7252f-581c-425b-bb7f-cad7c88aaa54 to delete Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8c7252f-581c-425b-bb7f-cad7c88aaa54 could not be found. Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:01.707436 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eaa8c0f1-436e-4f90-9738-147dd2047586 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:01.711402 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eaa8c0f1-436e-4f90-9738-147dd2047586 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/images/e8c7252f-581c-425b-bb7f-cad7c88aaa54" status: 404 len: 62 microversion: 2.1 time: 0.043196 Oct 16 01:19:01.713076 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1817/3801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:01 2022] DELETE /compute/v2.1/images/e8c7252f-581c-425b-bb7f-cad7c88aaa54 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:19:01.717660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:01.719205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:01.737544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:01.745840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:01.746432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:01.747216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:01.747727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:01.748158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:01.786512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 HTTP/1.1 Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '2ba45f6f-dad1-487f-893c-55a57d586424'} Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:19:01.789359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.792725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:01.793967 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0ce6867a-fe8d-47dc-ace8-8753252df0f8 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 404 len: 111 microversion: 2.1 time: 0.077456 Oct 16 01:19:01.798863 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1818/3802] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:19:01 2022] DELETE /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:19:01.805929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:01.806551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] [instance: 2ba45f6f-dad1-487f-893c-55a57d586424] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:01.821476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:01.825432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:01.835239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:01.844059 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea501b7c-3ffe-4e95-a41e-2d5c7e57c00c tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1317 microversion: 2.1 time: 0.906117 Oct 16 01:19:01.844329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:01.845680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:01.846588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:01.847835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:01.848877 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1985/3803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:00 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:01.890904 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] HTTP exception thrown: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Request method failure captured: Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 HTTP/1.1 Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1uUK5BhdTimPoG0cJbwcLAGzxRfeNMfoa7GEOhYeKiJde4rjSWuTj5aYOwZ5tUyUpqNulF5wc-bzGn3mLtq5s12PNo3ivqml8CYst2GKeZLgsGCxSTzzV4AQ78clQ7fwBwYAsj-dFjh5H04AH12yT8Rd2XRFnmDUyiibjY8heTgYMQ Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_131d702dc0e34408bf3e58809c5cfb0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/131d702dc0e34408bf3e58809c5cfb0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 131d702dc0e34408bf3e58809c5cfb0d Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513 Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b7cdbf32b68a44a28e4cc9c4210b5e56 Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1937535513-project Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '2ba45f6f-dad1-487f-893c-55a57d586424'} Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.895824 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] Returning 404 to user: Instance 2ba45f6f-dad1-487f-893c-55a57d586424 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:01.899671 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e3442bc9-22c5-49bc-8203-d4b0642a9663 tempest-ImagesOneServerNegativeTestJSON-1937535513 tempest-ImagesOneServerNegativeTestJSON-1937535513-project] 10.222.0.39 "GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424" status: 404 len: 111 microversion: 2.1 time: 0.097263 Oct 16 01:19:01.902345 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1819/3804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:01 2022] GET /compute/v2.1/servers/2ba45f6f-dad1-487f-893c-55a57d586424 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:19:02.689337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:02.690128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:02.692379 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:02.699773 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:02.738462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:02.741463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:02.741945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:02.742697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:02.747366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:02.750784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:02.880049 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:02.880776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:02.896532 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:02.901962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:02.902486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:02.902947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:02.905151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:02.905627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:02.907732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:02.924053 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:03.491024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:03.505502 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2c98e721-00df-4236-a6ad-81e1deddb115 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1804 microversion: 2.1 time: 0.822147 Oct 16 01:19:03.507339 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1986/3805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:02 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1804 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:03.515102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0f1c311b-bac2-4c16-9d25-a1d659581115 req-c3013571-c088-43c2-837f-d00c8e8df2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1825b6b9-d141-4e56-aebb-06954709b85f", "name": "network-vif-plugged", "status": "completed", "tag": "387b3b92-94c8-44ea-9d83-32b230b5a0b6"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:03.528365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0f1c311b-bac2-4c16-9d25-a1d659581115 req-c3013571-c088-43c2-837f-d00c8e8df2b5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:03.529380 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0f1c311b-bac2-4c16-9d25-a1d659581115 req-c3013571-c088-43c2-837f-d00c8e8df2b5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:03.530461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0f1c311b-bac2-4c16-9d25-a1d659581115 req-c3013571-c088-43c2-837f-d00c8e8df2b5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:03.576834 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0f1c311b-bac2-4c16-9d25-a1d659581115 req-c3013571-c088-43c2-837f-d00c8e8df2b5 service nova] Creating event network-vif-plugged:387b3b92-94c8-44ea-9d83-32b230b5a0b6 for instance 1825b6b9-d141-4e56-aebb-06954709b85f on n-h2-master-1 Oct 16 01:19:03.590504 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0f1c311b-bac2-4c16-9d25-a1d659581115 req-c3013571-c088-43c2-837f-d00c8e8df2b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080029 Oct 16 01:19:03.595145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1987/3806] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:03.611764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:03.615116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:03.632411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:03.633972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:03.634669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:03.635442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:03.636145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:03.637374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:03.640957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:03.645964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a6749541-82c5-4f79-93e7-109ffaa5a6d7 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1317 microversion: 2.1 time: 0.772990 Oct 16 01:19:03.646759 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1820/3807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:02 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:03.688214 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b89b2c2f-98fa-406b-ae7e-157ad091e9ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc/ips" status: 200 len: 217 microversion: 2.1 time: 0.090947 Oct 16 01:19:03.695604 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1988/3808] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:19:03 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc/ips => generated 217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:03.703525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:03.704036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:03.713481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:03.721299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:03.721975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:03.724079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:03.724722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:03.726961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:03.790029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:19:04.001759 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-93a4f5a2-ab62-4f41-acdf-b8f14c47f65a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 204 len: 0 microversion: 2.1 time: 0.304492 Oct 16 01:19:04.002413 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1821/3809] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:19:03 2022] DELETE /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:19:04.012293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:04.012833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:04.030327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:04.035875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:04.036704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:04.037677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:04.041841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:04.042519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:04.540814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:04.556575 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-714ff43c-cae4-4787-9042-e4ccef2fb73d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1810 microversion: 2.1 time: 0.549497 Oct 16 01:19:04.557417 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1989/3810] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:04 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1810 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:04.671952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:04.672669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:04.683257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:04.686957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:04.687524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:04.688856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:04.690803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:04.691483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:05.026477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:05.038439 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5db0110d-2c82-412c-82b8-2a99cbe6dcd4 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1317 microversion: 2.1 time: 0.372681 Oct 16 01:19:05.039373 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1822/3811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:04 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:05.587182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:05.594362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:05.615456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:05.615948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:05.621642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:05.623188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:05.623678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:05.624117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:05.684343 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:06.066295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:06.067133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:06.082838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:06.083684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:06.084134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:06.096944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:06.099083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:06.100107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:06.123542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:06.137369 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9b80fb44-cf8f-4ab9-bb2b-c0464d3d6ad8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1810 microversion: 2.1 time: 0.555068 Oct 16 01:19:06.139784 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1990/3812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:05 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1810 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:06.492604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:06.505687 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-daf314b2-5b13-401f-a8ea-7211a05a9820 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1317 microversion: 2.1 time: 0.444468 Oct 16 01:19:06.508054 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1823/3813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:06 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:07.166701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:07.168139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:07.181568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:07.188107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:07.189145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:07.190624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:07.191515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:07.194075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:07.288917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ede34ae8-63d0-4e15-8d99-b031e1605271 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: .version_select at 0x7fd6526ea040>, body: {"keypair": {"name": "tempest-keypair-1652602376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxpAHasaNR9k31+hsOqCnxza46Cb0e5o5G2+HmeKNKeEFG+Vf0p41QOFdkvU8Io0/efQVl7wbs9ajqQ+B/dwEOamizP2jzVXzJ0mcAufj3LDvntryl4PGotBi77o+5JJg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:07.322501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ede34ae8-63d0-4e15-8d99-b031e1605271 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for project e664ea80daaf450886978f25b2d9e373. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:19:07.334151 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ede34ae8-63d0-4e15-8d99-b031e1605271 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for user d5e97960c4eb488b900951e0898f34c8 and project e664ea80daaf450886978f25b2d9e373. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:19:07.391584 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ede34ae8-63d0-4e15-8d99-b031e1605271 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.342680 Oct 16 01:19:07.392816 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1991/3814] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:19:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:07.565423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:07.566690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:07.578145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:07.583964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:07.588410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:07.590740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:07.592129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:07.594499 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce0b9d2a-2445-4750-a7f8-68caab963942 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1810 microversion: 2.1 time: 0.433002 Oct 16 01:19:07.595132 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1824/3815] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:07 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1810 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:07.597849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:07.598573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:08.485284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-234d60f3-b960-4cf1-9e25-9b46d6d85491 req-67fa3fcd-2338-4a74-8cd4-97622f5370df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "name": "network-vif-deleted", "tag": "593ff79a-07d3-419d-b477-8a75ce99daac"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:08.519605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-234d60f3-b960-4cf1-9e25-9b46d6d85491 req-67fa3fcd-2338-4a74-8cd4-97622f5370df service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:08.520122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-234d60f3-b960-4cf1-9e25-9b46d6d85491 req-67fa3fcd-2338-4a74-8cd4-97622f5370df service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:08.520694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-234d60f3-b960-4cf1-9e25-9b46d6d85491 req-67fa3fcd-2338-4a74-8cd4-97622f5370df service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:08.579290 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-234d60f3-b960-4cf1-9e25-9b46d6d85491 req-67fa3fcd-2338-4a74-8cd4-97622f5370df service nova] Creating event network-vif-deleted:593ff79a-07d3-419d-b477-8a75ce99daac for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:19:08.598484 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-234d60f3-b960-4cf1-9e25-9b46d6d85491 req-67fa3fcd-2338-4a74-8cd4-97622f5370df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117395 Oct 16 01:19:08.599239 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1825/3816] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:19:08.624849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:08.625569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:08.649192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:08.649718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:08.650178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:08.650950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:08.651445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:08.651906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:08.807676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:08.820242 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-94c042b2-1dab-4261-b526-1e0530ab32f8 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1506 microversion: 2.1 time: 1.287406 Oct 16 01:19:08.824379 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1992/3817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:07 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1506 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:08.856758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:08.856758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:08.895603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:08.896113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:08.896553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:08.897276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:08.897743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:08.898171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:09.192399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:09.204245 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-108ff03e-a900-4109-a9cc-66de34f1cac5 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1506 microversion: 2.1 time: 0.354777 Oct 16 01:19:09.221848 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1993/3818] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:08 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:09.233056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:09.235650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:09.254657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:09.255188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:09.255629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:09.256533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:09.256996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:09.257601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:09.401962 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-26adf685-955e-4b20-8b84-de1b925537ae tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "PUT /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1078 microversion: 2.1 time: 0.173305 Oct 16 01:19:09.402611 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1994/3819] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:19:09 2022] PUT /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1078 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:09.422630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:09.426010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:09.430018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:09.432089 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:09.443363 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d362d764-5d3f-4fab-a087-4ac92b292d78 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1674 microversion: 2.1 time: 0.825226 Oct 16 01:19:09.444682 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1826/3820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:08 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1674 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:09.445478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:09.445991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:09.446651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:09.447425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:09.447892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:09.451869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:10.042290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:10.063232 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d9650192-1eb3-4e27-967b-cde0818f35dd tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1504 microversion: 2.1 time: 0.630325 Oct 16 01:19:10.064131 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1995/3821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:09 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:10.086809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:10.087470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:10.107802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:10.109085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:10.109747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:10.112352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:10.113079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:10.113872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:10.474725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:10.475382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:10.489398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:10.489916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:10.490365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:10.491127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:10.491595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:10.492032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:10.961598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:10.971047 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e6cecbc-37e9-4e14-b88b-665c6e3e4c3f tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1504 microversion: 2.1 time: 0.887977 Oct 16 01:19:10.973110 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1827/3822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:10 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1504 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:10.978158 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2e8fd65e-03fa-41d5-8e82-83503257d219 req-51d76083-3a36-4a30-b436-58bd93bf8527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "name": "network-vif-unplugged", "status": "completed", "tag": "83ab986f-2045-4218-8813-8538c238f50d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:10.989073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e8fd65e-03fa-41d5-8e82-83503257d219 req-51d76083-3a36-4a30-b436-58bd93bf8527 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:10.990422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e8fd65e-03fa-41d5-8e82-83503257d219 req-51d76083-3a36-4a30-b436-58bd93bf8527 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:10.991140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e8fd65e-03fa-41d5-8e82-83503257d219 req-51d76083-3a36-4a30-b436-58bd93bf8527 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:11.006399 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2e8fd65e-03fa-41d5-8e82-83503257d219 req-51d76083-3a36-4a30-b436-58bd93bf8527 service nova] Creating event network-vif-unplugged:83ab986f-2045-4218-8813-8538c238f50d for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:19:11.011948 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2e8fd65e-03fa-41d5-8e82-83503257d219 req-51d76083-3a36-4a30-b436-58bd93bf8527 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037469 Oct 16 01:19:11.013403 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1828/3823] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:11.018702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ee2ba593-0d71-450d-9807-2adaf7b9f1a2 req-bb7d72a1-9241-4fae-ace4-ab59ecc82bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "name": "network-vif-deleted", "tag": "b81792b8-9403-43f5-bb8e-74b08680680c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:11.030428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee2ba593-0d71-450d-9807-2adaf7b9f1a2 req-bb7d72a1-9241-4fae-ace4-ab59ecc82bd3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:11.031487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee2ba593-0d71-450d-9807-2adaf7b9f1a2 req-bb7d72a1-9241-4fae-ace4-ab59ecc82bd3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:11.032187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee2ba593-0d71-450d-9807-2adaf7b9f1a2 req-bb7d72a1-9241-4fae-ace4-ab59ecc82bd3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:11.052282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ee2ba593-0d71-450d-9807-2adaf7b9f1a2 req-bb7d72a1-9241-4fae-ace4-ab59ecc82bd3 service nova] Creating event network-vif-deleted:b81792b8-9403-43f5-bb8e-74b08680680c for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:19:11.063141 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ee2ba593-0d71-450d-9807-2adaf7b9f1a2 req-bb7d72a1-9241-4fae-ace4-ab59ecc82bd3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048105 Oct 16 01:19:11.064110 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1829/3824] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:11.071124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:11.073971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:11.116372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:11.118701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:11.120772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:11.122376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:11.128713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:11.129945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:11.339197 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2a2ef832-8d89-4a12-9185-32b90870472e tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "PUT /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1080 microversion: 2.1 time: 0.272772 Oct 16 01:19:11.353133 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1830/3825] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:19:11 2022] PUT /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1080 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:11.361987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:11.364091 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:11.371269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:11.372047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:11.372743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:11.373715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:11.374341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:11.374957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:11.730672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:11.739617 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5c6c5086-a7a8-420f-aec2-809f83a1f626 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1653 microversion: 2.1 time: 1.268694 Oct 16 01:19:11.744640 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1996/3826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:10 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1653 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:12.077209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:12.089406 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73198728-ae84-4d91-b810-66aeb6b67a34 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1506 microversion: 2.1 time: 0.732120 Oct 16 01:19:12.109950 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1831/3827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:11 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1506 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:12.116902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:12.117641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:12.131425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:12.132034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:12.132576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:12.133388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:12.133933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:12.134439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:12.693641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:12.701708 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ef89b032-a5e0-4ea0-bf73-add5ff1d1043 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1506 microversion: 2.1 time: 0.589018 Oct 16 01:19:12.705162 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1997/3828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:12 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:12.732519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:12.732973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:12.742680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:12.743209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:12.743641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:12.749812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:12.750510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:12.751138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:12.769477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:12.770705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:12.781684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:12.782863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:12.785008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:12.786279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:12.787296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:12.788433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:12.817459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:19:12.877179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:12.877712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:12.878212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:12.878672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lazy-loading 'fault' on Instance uuid 8833ae34-0f31-4b6e-89f9-9b33f4377cbc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:19:12.980843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:13.005709 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a8ac91cb-d39d-423d-a156-7f4b4f5c9c97 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1303 microversion: 2.1 time: 0.237076 Oct 16 01:19:13.010120 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1998/3829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:12 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:13.037547 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-10bf0fb5-ddc7-4071-ab34-5c98d96d0922 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 204 len: 0 microversion: 2.1 time: 0.308953 Oct 16 01:19:13.045128 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1832/3830] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:19:12 2022] DELETE /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:19:13.050142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:13.050650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:13.060361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:13.060881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:13.061354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:13.070448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:13.071162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:13.071625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:13.101619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-7605dbeb-e577-48dd-8c7b-84f29bce862b req-1c91b18a-6b71-4f1c-b30f-734ddd5efb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8833ae34-0f31-4b6e-89f9-9b33f4377cbc", "name": "network-vif-deleted", "tag": "83ab986f-2045-4218-8813-8538c238f50d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:13.125470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7605dbeb-e577-48dd-8c7b-84f29bce862b req-1c91b18a-6b71-4f1c-b30f-734ddd5efb36 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:13.126008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7605dbeb-e577-48dd-8c7b-84f29bce862b req-1c91b18a-6b71-4f1c-b30f-734ddd5efb36 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:13.126453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7605dbeb-e577-48dd-8c7b-84f29bce862b req-1c91b18a-6b71-4f1c-b30f-734ddd5efb36 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:13.144069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:19:13.164678 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-7605dbeb-e577-48dd-8c7b-84f29bce862b req-1c91b18a-6b71-4f1c-b30f-734ddd5efb36 service nova] Creating event network-vif-deleted:83ab986f-2045-4218-8813-8538c238f50d for instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc on n-h2-master-1 Oct 16 01:19:13.173520 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-7605dbeb-e577-48dd-8c7b-84f29bce862b req-1c91b18a-6b71-4f1c-b30f-734ddd5efb36 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076876 Oct 16 01:19:13.175175 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1833/3831] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:19:13.225545 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Instance is already in deleting state, ignoring this request Oct 16 01:19:13.226398 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9c812c5e-f648-4402-8885-cfbb619319ef tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 204 len: 0 microversion: 2.1 time: 0.180290 Oct 16 01:19:13.235428 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 1999/3832] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:19:13 2022] DELETE /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:19:13.246692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:13.264666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:13.270458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:13.271012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:13.271489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:13.276850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:13.277401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:13.277852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:13.384066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1049760294", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52e8b52a-a014-46fd-b3eb-a7709906aae7"}], "security_groups": [{"name": "tempest-securitygroup--1632154241"}], "key_name": "tempest-keypair-1652602376", "user_data": "}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:13.493119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:13.511768 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a372dea5-23bc-4888-b26a-fcac63125fd3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1512 microversion: 2.1 time: 0.260341 Oct 16 01:19:13.513723 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1834/3833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:13 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:13.584260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] validate_networks() for [('52e8b52a-a014-46fd-b3eb-a7709906aae7', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:19:14.037619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:14.038256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:14.052924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:14.053468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:14.054099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:14.054815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:14.056822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:14.062397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:14.128054 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:14.173144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:14.174104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:14.175413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:14.176036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lazy-loading 'fault' on Instance uuid 8833ae34-0f31-4b6e-89f9-9b33f4377cbc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:19:14.237363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:19:14.237901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:19:14.238275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:19:14.238684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:19:14.239127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:19:14.253469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:14.253959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:14.254381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:14.254770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:14.255904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:14.256537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:14.257120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:14.265587 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-671b37c2-3eed-4d0e-ba0b-e55624d91002 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 200 len: 1303 microversion: 2.1 time: 0.234134 Oct 16 01:19:14.273342 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1835/3834] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:14 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 1303 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:14.277473 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for project e664ea80daaf450886978f25b2d9e373. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:19:14.283390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for user d5e97960c4eb488b900951e0898f34c8 and project e664ea80daaf450886978f25b2d9e373. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:19:14.299435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:19:14.302339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:19:14.355762 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13d5e2a4-86d6-43e2-ba1d-460c1f633b74 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.977874 Oct 16 01:19:14.357750 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2000/3835] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:19:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:19:14.370095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2c46e6c-ffc1-40a5-bf65-f5b9d49a5b17 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:14.370956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c2c46e6c-ffc1-40a5-bf65-f5b9d49a5b17 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:14.518148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c2c46e6c-ffc1-40a5-bf65-f5b9d49a5b17 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:14.529092 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c2c46e6c-ffc1-40a5-bf65-f5b9d49a5b17 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1242 microversion: 2.1 time: 0.162848 Oct 16 01:19:14.533024 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2001/3836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:14 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1242 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:14.542742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:14.548900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:14.557551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-14104b54-8fb2-4225-826f-140c81fd06e1 tempest-ListImageFiltersNegativeTestJSON-1337150520 tempest-ListImageFiltersNegativeTestJSON-1337150520-project] Calling method '.version_select at 0x7fd64d52fb80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:14.562111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:14.563635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:14.564185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:14.569506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:14.569506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:14.569679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:14.590274 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-14104b54-8fb2-4225-826f-140c81fd06e1 tempest-ListImageFiltersNegativeTestJSON-1337150520 tempest-ListImageFiltersNegativeTestJSON-1337150520-project] HTTP exception thrown: Image not found. Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-14104b54-8fb2-4225-826f-140c81fd06e1 tempest-ListImageFiltersNegativeTestJSON-1337150520 tempest-ListImageFiltersNegativeTestJSON-1337150520-project] Request method failure captured: Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/images/318b5db3-2b15-473a-9736-61e483b9b592 HTTP/1.1 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wSfqyhSfgukOoj1Ok4r451LxtXOiUs5VJECCglNrFEu4Rvf5Y2ksB4LD7b5Le9BUbgWMl_daaQFGEg2jwD81rjUj6wDTfwQhUcY6iEZANlk7ls5PKKJ3n4Hp8g3FaroKQPy9c809kqiwN28Iqgtz_PU1XGStVXMbO4Y1v5D9eCpnA Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 9fa9afc8930a498b903ff5dc6d0fcc01 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1337150520 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9fa9afc8930a498b903ff5dc6d0fcc01", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9fa9afc8930a498b903ff5dc6d0fcc01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9fa9afc8930a498b903ff5dc6d0fcc01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9fa9afc8930a498b903ff5dc6d0fcc01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1337150520 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 9fa9afc8930a498b903ff5dc6d0fcc01 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1337150520 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ListImageFiltersNegativeTestJSON-1337150520-project Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 8eedf325213940439cdc24ae2882156d Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1337150520-project Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: exception: Image not found. Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '318b5db3-2b15-473a-9736-61e483b9b592'} Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 318b5db3-2b15-473a-9736-61e483b9b592 Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 16 01:19:14.593413 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 318b5db3-2b15-473a-9736-61e483b9b592 could not be found. Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 16 01:19:14.597155 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:14.603055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-14104b54-8fb2-4225-826f-140c81fd06e1 tempest-ListImageFiltersNegativeTestJSON-1337150520 tempest-ListImageFiltersNegativeTestJSON-1337150520-project] Returning 404 to user: Image not found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:14.605185 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-14104b54-8fb2-4225-826f-140c81fd06e1 tempest-ListImageFiltersNegativeTestJSON-1337150520 tempest-ListImageFiltersNegativeTestJSON-1337150520-project] 10.222.0.39 "GET /compute/v2.1/images/318b5db3-2b15-473a-9736-61e483b9b592" status: 404 len: 62 microversion: 2.1 time: 0.329514 Oct 16 01:19:14.605723 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1836/3837] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Oct 16 01:19:14 2022] GET /compute/v2.1/images/318b5db3-2b15-473a-9736-61e483b9b592 => generated 62 bytes in 332 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:19:14.909166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:14.922938 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2b3fc5b2-1135-4130-ad2f-8de4882f7e1a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1512 microversion: 2.1 time: 0.386401 Oct 16 01:19:14.939130 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2002/3838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:14 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:15.297681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:15.298323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:15.316736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:15.317219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:15.317648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:15.318539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:15.319186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:15.323587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:15.361114 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] HTTP exception thrown: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Request method failure captured: Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc HTTP/1.1 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1vbNBdhJ3iRrLhJ7pPUF1TN375lDQAuTPfgm7lICO2Q1F0Biy4VuDlGALPWWmbRzUUUv48BQe74HJm9fFvRKWxJajzQkH6vvFEfwo4hiJ06MqrXHTBKKZ2Jb6Z6Zkvt5X-N-Viy2I5TSRS1uTdaAoJv9Efy_HreGK9Z5yGdlZohLag Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d22602edce34f6390374c40afcfd113", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d22602edce34f6390374c40afcfd113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestMultiNic-2077507435 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1cf0ec54a3f54abd90ece8de2aa70ffc Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '8833ae34-0f31-4b6e-89f9-9b33f4377cbc'} Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:15.362612 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Returning 404 to user: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58509b0c-230e-4c0e-9f55-6fbc03566e19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 404 len: 111 microversion: 2.1 time: 0.076823 Oct 16 01:19:15.366655 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1837/3839] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:15 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:19:15.558185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:15.559795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:15.573677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:15.578671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:15.583597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:15.584620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:15.585318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:15.588062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:15.614404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d1e0fb9a-9cb7-4b14-ab9d-3a66ac39f089 req-804fc263-255d-4719-b002-d1a731d77fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1825b6b9-d141-4e56-aebb-06954709b85f", "name": "network-vif-deleted", "tag": "387b3b92-94c8-44ea-9d83-32b230b5a0b6"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:15.633189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d1e0fb9a-9cb7-4b14-ab9d-3a66ac39f089 req-804fc263-255d-4719-b002-d1a731d77fc7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:15.633670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d1e0fb9a-9cb7-4b14-ab9d-3a66ac39f089 req-804fc263-255d-4719-b002-d1a731d77fc7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:15.634098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d1e0fb9a-9cb7-4b14-ab9d-3a66ac39f089 req-804fc263-255d-4719-b002-d1a731d77fc7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:15.666473 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d1e0fb9a-9cb7-4b14-ab9d-3a66ac39f089 req-804fc263-255d-4719-b002-d1a731d77fc7 service nova] Creating event network-vif-deleted:387b3b92-94c8-44ea-9d83-32b230b5a0b6 for instance 1825b6b9-d141-4e56-aebb-06954709b85f on n-h2-master-1 Oct 16 01:19:15.685139 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d1e0fb9a-9cb7-4b14-ab9d-3a66ac39f089 req-804fc263-255d-4719-b002-d1a731d77fc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074323 Oct 16 01:19:15.685763 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1838/3840] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:19:15.794881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:15.805736 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da7ec626-f1df-42f7-8048-22ed307eca25 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1238 microversion: 2.1 time: 0.252855 Oct 16 01:19:15.809052 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2003/3841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:15 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1238 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:15.965767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:15.967103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:15.989362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:15.989891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:15.990341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:15.991443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:15.994292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:15.996661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:16.056659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:16.057822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:16.058461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:16.059488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lazy-loading 'fault' on Instance uuid 1825b6b9-d141-4e56-aebb-06954709b85f {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:19:16.151568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bfe0b4f344485ab6de52f7b1423118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16773b3925f648bbade2e6bf967a3fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:16.163131 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c1557f9-d267-4f5a-9117-c9eb63ac70bf tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 200 len: 1307 microversion: 2.1 time: 0.216058 Oct 16 01:19:16.193774 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1839/3842] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:15 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:16.838036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:16.842894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:16.865179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:16.869770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:16.870449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:16.879442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:16.880032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:16.880644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.077530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:17.095184 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bed9a64f-0ac7-461c-8623-cdbf349747ee tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1300 microversion: 2.1 time: 0.265700 Oct 16 01:19:17.097390 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2004/3843] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:16 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:17.193230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:17.193931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 1825b6b9-d141-4e56-aebb-06954709b85f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:17.214524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.218959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.219553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.221146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.223690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.225638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.263698 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] HTTP exception thrown: Instance 1825b6b9-d141-4e56-aebb-06954709b85f could not be found. Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Request method failure captured: Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f HTTP/1.1 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1tzqIgZhjxgo7tRRFv7u7FGoMKELH6lq48bNHAZjNFCZTEvhUqytS3wrwome9nYC8wr4-8syYlEy6RMRRA4inqCsuLp8jEY_-hdAHyAcSLVEvDL8w9JN1kuyBF2lxGXTIZtcqe6hf6ae4Cvd94H8-GQBmzmijpHpMVixTIEKLmcI24 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_16773b3925f648bbade2e6bf967a3fbf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: f1bfe0b4f344485ab6de52f7b1423118 Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 1825b6b9-d141-4e56-aebb-06954709b85f could not be found. Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '1825b6b9-d141-4e56-aebb-06954709b85f'} Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1825b6b9-d141-4e56-aebb-06954709b85f could not be found. Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1825b6b9-d141-4e56-aebb-06954709b85f could not be found. Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.266517 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.270748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.270748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.270748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.270748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:17.270748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:17.270748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1825b6b9-d141-4e56-aebb-06954709b85f could not be found. Oct 16 01:19:17.270748 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.271288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Returning 404 to user: Instance 1825b6b9-d141-4e56-aebb-06954709b85f could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:17.275601 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-de785592-642a-4d41-9ee2-9fe08eecec3a tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f" status: 404 len: 111 microversion: 2.1 time: 0.084929 Oct 16 01:19:17.276738 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1840/3844] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:17 2022] GET /compute/v2.1/servers/1825b6b9-d141-4e56-aebb-06954709b85f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:19:17.286639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:17.287420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:17.297203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.300241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.303342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.305309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.305795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.306233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.350059 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] HTTP exception thrown: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Request method failure captured: Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f HTTP/1.1 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1tzqIgZhjxgo7tRRFv7u7FGoMKELH6lq48bNHAZjNFCZTEvhUqytS3wrwome9nYC8wr4-8syYlEy6RMRRA4inqCsuLp8jEY_-hdAHyAcSLVEvDL8w9JN1kuyBF2lxGXTIZtcqe6hf6ae4Cvd94H8-GQBmzmijpHpMVixTIEKLmcI24 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_16773b3925f648bbade2e6bf967a3fbf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: f1bfe0b4f344485ab6de52f7b1423118 Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '3b6f4fe2-d304-4cfc-a04d-19f1c4af763f'} Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:19:17.352045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.362069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Returning 404 to user: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:17.363765 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de9c9640-67e8-47d2-ba67-f3a86dc78383 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 404 len: 111 microversion: 2.1 time: 0.081555 Oct 16 01:19:17.364547 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2005/3845] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:19:17 2022] DELETE /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:19:17.377213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:17.378064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:17.386589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.388387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.389118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.398434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.399659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.400699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.420166 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] HTTP exception thrown: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Request method failure captured: Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f HTTP/1.1 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1tzqIgZhjxgo7tRRFv7u7FGoMKELH6lq48bNHAZjNFCZTEvhUqytS3wrwome9nYC8wr4-8syYlEy6RMRRA4inqCsuLp8jEY_-hdAHyAcSLVEvDL8w9JN1kuyBF2lxGXTIZtcqe6hf6ae4Cvd94H8-GQBmzmijpHpMVixTIEKLmcI24 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_16773b3925f648bbade2e6bf967a3fbf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: f1bfe0b4f344485ab6de52f7b1423118 Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3b6f4fe2-d304-4cfc-a04d-19f1c4af763f'} Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.424334 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.428745 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.428745 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.428745 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.428745 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:17.428745 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:17.428745 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. Oct 16 01:19:17.428745 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.428745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Returning 404 to user: Instance 3b6f4fe2-d304-4cfc-a04d-19f1c4af763f could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:17.430596 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cad86e5a-85db-49f9-aada-7e33bda1a8d3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f" status: 404 len: 111 microversion: 2.1 time: 0.057397 Oct 16 01:19:17.431645 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1841/3846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:17 2022] GET /compute/v2.1/servers/3b6f4fe2-d304-4cfc-a04d-19f1c4af763f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:19:17.440015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:17.440746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:17.449378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.450176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.451544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.452512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.453589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.454206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.483554 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] HTTP exception thrown: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Request method failure captured: Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 HTTP/1.1 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1tzqIgZhjxgo7tRRFv7u7FGoMKELH6lq48bNHAZjNFCZTEvhUqytS3wrwome9nYC8wr4-8syYlEy6RMRRA4inqCsuLp8jEY_-hdAHyAcSLVEvDL8w9JN1kuyBF2lxGXTIZtcqe6hf6ae4Cvd94H8-GQBmzmijpHpMVixTIEKLmcI24 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_16773b3925f648bbade2e6bf967a3fbf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: f1bfe0b4f344485ab6de52f7b1423118 Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: exception: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'bf6c30be-76fa-4872-a2ff-402025041451'} Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:19:17.489884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.493316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Returning 404 to user: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:17.494737 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-604e4397-b542-4d51-81dc-91f1087e2ae3 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 404 len: 111 microversion: 2.1 time: 0.058175 Oct 16 01:19:17.495272 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2006/3847] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:19:17 2022] DELETE /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:19:17.503326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:17.504201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] [instance: bf6c30be-76fa-4872-a2ff-402025041451] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:17.513613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.514685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.515234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.516106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:17.516806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:17.517389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:17.538123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] HTTP exception thrown: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Request method failure captured: Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 HTTP/1.1 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1tzqIgZhjxgo7tRRFv7u7FGoMKELH6lq48bNHAZjNFCZTEvhUqytS3wrwome9nYC8wr4-8syYlEy6RMRRA4inqCsuLp8jEY_-hdAHyAcSLVEvDL8w9JN1kuyBF2lxGXTIZtcqe6hf6ae4Cvd94H8-GQBmzmijpHpMVixTIEKLmcI24 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_16773b3925f648bbade2e6bf967a3fbf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16773b3925f648bbade2e6bf967a3fbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 16773b3925f648bbade2e6bf967a3fbf Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1121406400 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: f1bfe0b4f344485ab6de52f7b1423118 Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerDiskConfigTestJSON-1121406400-project Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: exception: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'bf6c30be-76fa-4872-a2ff-402025041451'} Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:19:17.540475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] Returning 404 to user: Instance bf6c30be-76fa-4872-a2ff-402025041451 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6932bee0-2665-4cb9-81e4-fa7dc4062123 tempest-ServerDiskConfigTestJSON-1121406400 tempest-ServerDiskConfigTestJSON-1121406400-project] 10.222.0.39 "GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451" status: 404 len: 111 microversion: 2.1 time: 0.042441 Oct 16 01:19:17.543877 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1842/3848] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:17 2022] GET /compute/v2.1/servers/bf6c30be-76fa-4872-a2ff-402025041451 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:19:18.124877 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:18.125615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:18.135795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:18.139209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:18.140249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:18.141585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:18.142505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:18.144015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:18.396569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:18.413954 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-28b1a4c2-7a7a-4476-b104-d25ba4d1a4ba tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1300 microversion: 2.1 time: 0.294226 Oct 16 01:19:18.429467 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2007/3849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:18 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1300 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:19.439290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:19.442004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:19.461163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:19.464475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:19.465185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:19.469072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:19.477753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:19.495184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:20.311064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:20.330591 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b85f2a8e-8a94-4ac9-bf8e-84d06494815c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 0.897829 Oct 16 01:19:20.331765 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1843/3850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:19 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:21.365004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:21.366146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:21.380005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:21.381671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:21.382298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:21.383529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:21.384412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:21.384996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:21.440165 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:22.296334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:22.311475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc26cfdb-056d-4412-b847-5f22f745d636 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 0.951179 Oct 16 01:19:22.336426 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2008/3851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:21 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:23.354094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:23.357192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:23.393531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:23.395741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:23.398639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:23.402098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:23.412529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:23.424305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:23.839764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-16663452-adb3-4951-ac4d-fb72bdc6ec42 req-70af96cc-ae74-4423-b618-fbfa15b6841b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f39da51-b797-405f-8c98-c4d962123c45", "tag": "15cdae2a-120b-4511-8163-93980f8cde06"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:23.870326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-16663452-adb3-4951-ac4d-fb72bdc6ec42 req-70af96cc-ae74-4423-b618-fbfa15b6841b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:23.870991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-16663452-adb3-4951-ac4d-fb72bdc6ec42 req-70af96cc-ae74-4423-b618-fbfa15b6841b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:23.874657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-16663452-adb3-4951-ac4d-fb72bdc6ec42 req-70af96cc-ae74-4423-b618-fbfa15b6841b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:23.930700 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-16663452-adb3-4951-ac4d-fb72bdc6ec42 req-70af96cc-ae74-4423-b618-fbfa15b6841b service nova] Creating event network-changed:15cdae2a-120b-4511-8163-93980f8cde06 for instance 5f39da51-b797-405f-8c98-c4d962123c45 on n-h1-master-1 Oct 16 01:19:23.939306 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-16663452-adb3-4951-ac4d-fb72bdc6ec42 req-70af96cc-ae74-4423-b618-fbfa15b6841b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107747 Oct 16 01:19:23.943825 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2009/3852] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:24.573339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:24.588790 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6fc3929a-f008-49b1-86b3-547097073334 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 1.254370 Oct 16 01:19:24.592782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1844/3853] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:23 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:25.610956 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:25.611881 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:25.617851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:25.619316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:25.634822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:25.645077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:25.645817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:25.650761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:25.651485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:25.652079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:26.112735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-370300150", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "12d7e837-e79b-4c72-9db4-cfa5714f1145"}, {"uuid": "6002a704-ac06-46b7-b3d2-480b1dcd2fa5"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:26.194297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] validate_networks() for [('12d7e837-e79b-4c72-9db4-cfa5714f1145', None, None, None, None, None), ('6002a704-ac06-46b7-b3d2-480b1dcd2fa5', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:19:26.788058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:26.811536 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-14d46630-4554-488d-a733-65c8ccc48f20 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 1.195040 Oct 16 01:19:26.812997 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2010/3854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:25 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:27.842949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:27.847529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:27.860682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:27.861406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:27.862260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:27.864416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:27.865102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:27.865747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:28.771010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:28.792309 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d2c719f-0bda-4ec3-a1f1-83b62049baae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 0.949819 Oct 16 01:19:28.807311 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2011/3855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:27 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:28.858557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:19:28.859644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:19:28.861620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:19:28.862435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:19:28.863035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:19:28.883605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:28.884641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:28.885332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:28.886364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:28.887076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:28.888620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:28.915933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Getting quotas for project 1d22602edce34f6390374c40afcfd113. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:19:28.923041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Getting quotas for user 1cf0ec54a3f54abd90ece8de2aa70ffc and project 1d22602edce34f6390374c40afcfd113. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:19:28.941196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:19:28.944142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:19:29.036486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ad010032-ffca-43ba-9e4d-595c7f76cfed tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.926995 Oct 16 01:19:29.052900 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1845/3856] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:19:29.065262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-054df44c-1ae3-450d-acb0-4cb6e9e61192 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:29.066060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-054df44c-1ae3-450d-acb0-4cb6e9e61192 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:29.174457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-054df44c-1ae3-450d-acb0-4cb6e9e61192 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:29.187391 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-054df44c-1ae3-450d-acb0-4cb6e9e61192 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1212 microversion: 2.1 time: 0.125721 Oct 16 01:19:29.188305 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2012/3857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:29 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1212 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:29.820707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:29.821602 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:29.842099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:29.842680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:29.843260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:29.844005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:29.844534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:29.844983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:30.449362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:30.460419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1123b79-41fd-4674-b18a-723f7dce0e72 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 0.646233 Oct 16 01:19:30.461715 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1846/3858] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:29 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:30.481549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:30.482785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:30.494506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:30.495293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:30.499192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:30.500575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:30.501038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:30.501460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:30.521484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:30.522782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:30.534935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:30.535651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:30.536313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:30.537240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:30.538492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:30.539765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:30.570423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:19:30.871265 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2c91b5f2-ba41-4c0a-aea0-4e51250db252 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 204 len: 0 microversion: 2.42 time: 0.764504 Oct 16 01:19:30.880345 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2013/3859] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:19:30 2022] DELETE /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:19:30.895718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:30.896213 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:30.947968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:30.949328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:30.954663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:30.956256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:30.958074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:30.968511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:31.003800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:31.013160 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d71eca6-b4b6-4f41-9154-f1c18538cfc7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1208 microversion: 2.1 time: 0.550229 Oct 16 01:19:31.013745 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1847/3860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:30 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1208 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:31.504478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:31.507959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:31.530636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:31.531929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:31.535626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:31.540817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:31.544942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:31.545710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:31.646519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:31.673299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:31.679103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:31.689325 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5707515d-04ea-4ab4-bcc6-0a1a9e9a2061 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2958 microversion: 2.42 time: 0.800386 Oct 16 01:19:31.690381 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2014/3861] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:30 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2958 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:31.933589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:31.951480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30b42082-d7d4-40dc-8790-d6b156bf48f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 0.463943 Oct 16 01:19:31.952359 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1848/3862] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:31 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:32.041258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:32.041940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:32.055684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:32.056244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:32.060104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:32.063993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:32.066398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:32.067156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:32.339010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:32.365274 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-48d95f81-ec18-4aff-adf5-7dd5e738db73 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1270 microversion: 2.1 time: 0.328047 Oct 16 01:19:32.366539 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2015/3863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:32 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1270 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:32.723148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:32.723776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:32.730670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:32.741320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:32.741739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:32.746004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:32.746512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:32.747639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:32.979128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:32.979806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:32.994101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:32.996059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:32.996552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:33.002770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:33.011206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:33.011886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:34.476308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:34.491846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:34.499532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:34.501379 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a13178a4-121e-49d8-bea3-019d16477dad tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2958 microversion: 2.42 time: 1.782151 Oct 16 01:19:34.516453 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1849/3864] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:32 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2958 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:34.522505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:34.534376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:34.535273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:34.539682 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-43e9c41a-328a-4fea-ac53-346db4f3703b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 1.565609 Oct 16 01:19:34.546094 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2016/3865] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:32 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:34.546746 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:34.553199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:34.555982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:34.556678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:34.557651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:34.560141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:34.561518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:34.760345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:34.773285 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cca5f4c8-a88f-419e-a185-fe5f052d3af2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1270 microversion: 2.1 time: 0.255449 Oct 16 01:19:34.774062 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1850/3866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:34 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1270 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:35.537820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:35.539068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:35.574219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:35.576267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:35.579583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:35.584491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:35.585053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:35.585828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:35.586310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:35.586756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:35.589764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:35.593872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:35.595136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:35.596152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:35.598184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:35.601180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:36.367797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:36.386702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:36.395820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:36.399046 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e44b56ac-8cd7-4900-ae12-74c4f67a5ee7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2937 microversion: 2.42 time: 0.865108 Oct 16 01:19:36.405265 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2017/3867] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:35 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2937 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:36.410449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:36.417648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:36.432227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:36.433064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:36.433764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:36.434793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:36.435530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:36.436176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:36.475087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:36.486895 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1a0e2b6c-a727-42df-9a82-2b8455866aec tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 0.917760 Oct 16 01:19:36.494474 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1851/3868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:35 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:36.502473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-74321753-07e2-491b-b998-8584fc8252d8 req-25ef2f63-c5ce-476e-ae56-efb14785e2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f39da51-b797-405f-8c98-c4d962123c45", "name": "network-vif-plugged", "status": "completed", "tag": "15cdae2a-120b-4511-8163-93980f8cde06"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:36.548038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-74321753-07e2-491b-b998-8584fc8252d8 req-25ef2f63-c5ce-476e-ae56-efb14785e2b7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:36.556175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-74321753-07e2-491b-b998-8584fc8252d8 req-25ef2f63-c5ce-476e-ae56-efb14785e2b7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:36.556878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-74321753-07e2-491b-b998-8584fc8252d8 req-25ef2f63-c5ce-476e-ae56-efb14785e2b7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:36.582244 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-74321753-07e2-491b-b998-8584fc8252d8 req-25ef2f63-c5ce-476e-ae56-efb14785e2b7 service nova] Creating event network-vif-plugged:15cdae2a-120b-4511-8163-93980f8cde06 for instance 5f39da51-b797-405f-8c98-c4d962123c45 on n-h1-master-1 Oct 16 01:19:36.598479 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-74321753-07e2-491b-b998-8584fc8252d8 req-25ef2f63-c5ce-476e-ae56-efb14785e2b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102012 Oct 16 01:19:36.601293 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1852/3869] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:36.865457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:36.897344 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1617f095-8263-4a6b-a292-b66a48f36248 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1312 microversion: 2.1 time: 0.490676 Oct 16 01:19:36.899211 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2018/3870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:36 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:37.444540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:37.445363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:37.520749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:37.522211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:37.534869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:37.541384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:37.543580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:37.553366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:37.553921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:37.554370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:37.577011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:37.577580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:37.578059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:37.578803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:37.592093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:37.595871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:38.419487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:38.451326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:38.461989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:38.468361 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cabffdea-1f37-4760-b403-0471386d7745 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2916 microversion: 2.42 time: 1.031911 Oct 16 01:19:38.472432 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1853/3871] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:37 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2916 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:38.498175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:38.499185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:38.534234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:38.535326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:38.555865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:38.558197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:38.563420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:38.564284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:38.613732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:38.644149 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80884363-edc3-4be4-ba24-3857781a9ac8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1368 microversion: 2.1 time: 1.127046 Oct 16 01:19:38.648667 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2019/3872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:37 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1368 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:38.779330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3d633188-c2ee-4bf9-bbd9-a5c861a59cdf req-dbe95325-b4f2-4eb1-871c-ad55d4a763d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-unplugged", "status": "completed", "tag": "f7e6e0d5-ea9e-40be-817f-0b90f99facfc"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:38.808179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d633188-c2ee-4bf9-bbd9-a5c861a59cdf req-dbe95325-b4f2-4eb1-871c-ad55d4a763d7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:38.810886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d633188-c2ee-4bf9-bbd9-a5c861a59cdf req-dbe95325-b4f2-4eb1-871c-ad55d4a763d7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:38.811543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d633188-c2ee-4bf9-bbd9-a5c861a59cdf req-dbe95325-b4f2-4eb1-871c-ad55d4a763d7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:38.831099 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3d633188-c2ee-4bf9-bbd9-a5c861a59cdf req-dbe95325-b4f2-4eb1-871c-ad55d4a763d7 service nova] Creating event network-vif-unplugged:f7e6e0d5-ea9e-40be-817f-0b90f99facfc for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:38.838886 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3d633188-c2ee-4bf9-bbd9-a5c861a59cdf req-dbe95325-b4f2-4eb1-871c-ad55d4a763d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079348 Oct 16 01:19:38.839765 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2020/3873] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:38.905340 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:38.935050 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:39.183631 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:39.315212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1759101673", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "823b1047-41a6-4406-a9b3-ac44cdb88cee"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:39.491534 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] validate_networks() for [('823b1047-41a6-4406-a9b3-ac44cdb88cee', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:19:39.538854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:39.552651 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a74bd336-e316-4980-b2bd-75341f02fb6d tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1312 microversion: 2.1 time: 1.078219 Oct 16 01:19:39.553550 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1854/3874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:38 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1312 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:39.566848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:39.571740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:39.592765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:39.593246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:39.601784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:39.606894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:39.607218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:39.607617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:41.132259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:41.178874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:41.190132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:41.200056 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-de72f0f4-abfd-4e4b-9c25-bca8685b6ef7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2916 microversion: 2.42 time: 1.645410 Oct 16 01:19:41.200877 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1855/3875] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:39 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2916 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:41.219414 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:41.224465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:41.248869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:19:41.250086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:19:41.251330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:19:41.252193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:19:41.252808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:19:41.260122 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:41.275728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:41.277824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:41.279777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:41.280789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:41.282118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:41.284201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:41.285155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:41.290128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:41.303205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:41.304069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:41.308824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:41.311425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:41.366637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Getting quotas for project 0426937b803f46279c2cb410ba6c5de4. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:19:41.386436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Getting quotas for user d5e73ffbd1e84f3a9d1bc147f47b3abe and project 0426937b803f46279c2cb410ba6c5de4. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:19:41.445425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Going to run 3 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:19:41.449393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:19:41.549980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=dccaf194-81ee-440c-bdcb-eefc6002de8a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:19:41.621623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=ad438ca6-c331-4557-aa3d-9d9846ec87da,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:19:41.748687 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f4d1851-39c2-4439-a882-cd7cede566f0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.593756 Oct 16 01:19:41.755469 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2021/3876] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:19:41.755469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:41.756276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:41.764502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:41.765305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:41.765864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:41.766789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:41.767365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:41.767890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:42.235469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:42.253130 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b69e39a-ed18-45fc-81c1-3c3d71c798ee tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.500887 Oct 16 01:19:42.256245 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2022/3877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:41 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:42.287372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-45790d30-875c-46c1-8a2b-d38d9a4e4e79 req-b173e97d-792d-4646-a6ec-141d30f177c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-unplugged", "status": "completed", "tag": "2255ee2d-6056-4dcf-a235-38289bda0980"}, {"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-unplugged", "status": "completed", "tag": "3906f22f-b88f-45bd-af84-22eb74721ab9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:42.330206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45790d30-875c-46c1-8a2b-d38d9a4e4e79 req-b173e97d-792d-4646-a6ec-141d30f177c6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:42.333445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45790d30-875c-46c1-8a2b-d38d9a4e4e79 req-b173e97d-792d-4646-a6ec-141d30f177c6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:42.336411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45790d30-875c-46c1-8a2b-d38d9a4e4e79 req-b173e97d-792d-4646-a6ec-141d30f177c6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:42.392996 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-45790d30-875c-46c1-8a2b-d38d9a4e4e79 req-b173e97d-792d-4646-a6ec-141d30f177c6 service nova] Creating event network-vif-unplugged:2255ee2d-6056-4dcf-a235-38289bda0980 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:42.395608 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-45790d30-875c-46c1-8a2b-d38d9a4e4e79 req-b173e97d-792d-4646-a6ec-141d30f177c6 service nova] Creating event network-vif-unplugged:3906f22f-b88f-45bd-af84-22eb74721ab9 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:42.438742 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-45790d30-875c-46c1-8a2b-d38d9a4e4e79 req-b173e97d-792d-4646-a6ec-141d30f177c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.177704 Oct 16 01:19:42.443943 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2023/3878] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:42.491176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:42.515802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:42.520802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'deleted': False, 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:19:42.626727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:42.639933 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ffec833c-10ba-4e48-8e4a-5bef9b5a5f1a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1559 microversion: 2.1 time: 1.438162 Oct 16 01:19:42.642165 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1856/3879] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:41 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1559 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:42.651205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1813c16b-5fcb-46fa-b37c-0e018b5a3f61 req-3974caec-0412-4e7c-93bd-2fc23c924504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-deleted", "tag": "2255ee2d-6056-4dcf-a235-38289bda0980"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:42.672901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:42.673402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:42.680050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1813c16b-5fcb-46fa-b37c-0e018b5a3f61 req-3974caec-0412-4e7c-93bd-2fc23c924504 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:42.680920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1813c16b-5fcb-46fa-b37c-0e018b5a3f61 req-3974caec-0412-4e7c-93bd-2fc23c924504 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:42.683414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1813c16b-5fcb-46fa-b37c-0e018b5a3f61 req-3974caec-0412-4e7c-93bd-2fc23c924504 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:42.701147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:42.702215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:42.702724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:42.703205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:42.742526 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:42.755964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1813c16b-5fcb-46fa-b37c-0e018b5a3f61 req-3974caec-0412-4e7c-93bd-2fc23c924504 service nova] Creating event network-vif-deleted:2255ee2d-6056-4dcf-a235-38289bda0980 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:42.765730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd19746b-5b87-4ce8-99a4-bdd1a796c0f6 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.316949 Oct 16 01:19:42.766353 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2024/3880] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:19:42 2022] GET /compute/v2.1/servers => generated 1018 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:42.775698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:42.776456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:42.788357 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1813c16b-5fcb-46fa-b37c-0e018b5a3f61 req-3974caec-0412-4e7c-93bd-2fc23c924504 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142841 Oct 16 01:19:42.793463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:42.794505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:42.795044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:42.795704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:42.796170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:42.796605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:42.799146 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1857/3881] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:42.831764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:42.836779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:42.878692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:42.879218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:42.879677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:42.888853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:42.889362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:42.889805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:44.186034 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f7ed763-2fd3-428a-bb5e-82153c2e03a3 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.385427 Oct 16 01:19:44.192219 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1858/3882] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:19:42 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-interface => generated 285 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:44.197702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9d40a40-415a-484d-b78c-70c3a4b64f42 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:44.198283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c9d40a40-415a-484d-b78c-70c3a4b64f42 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:44.267141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:44.314012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:44.326460 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:44.331088 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-47f809ee-188d-4aa6-a04e-464113282b5a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2870 microversion: 2.42 time: 1.563612 Oct 16 01:19:44.335288 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2025/3883] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:42 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2870 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:44.358855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:44.366857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:44.381630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:44.382336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:44.382640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:44.383812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:44.385454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:44.389423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:44.516551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9d40a40-415a-484d-b78c-70c3a4b64f42 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:44.525597 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c9d40a40-415a-484d-b78c-70c3a4b64f42 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1223 microversion: 2.1 time: 0.332084 Oct 16 01:19:44.531630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1859/3884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:44 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1223 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:44.616019 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-35c1c1e5-864e-44b1-a5bf-72841d26495e req-eafe8d80-cbe7-453b-a198-cf6b58fbea18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-unplugged", "status": "completed", "tag": "547d449f-ecbd-47ce-a60f-af7bad8cb901"}, {"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-unplugged", "status": "completed", "tag": "2601fd55-e7bc-4577-b604-f788d6cf784d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:44.667703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35c1c1e5-864e-44b1-a5bf-72841d26495e req-eafe8d80-cbe7-453b-a198-cf6b58fbea18 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:44.671938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35c1c1e5-864e-44b1-a5bf-72841d26495e req-eafe8d80-cbe7-453b-a198-cf6b58fbea18 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:44.672623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35c1c1e5-864e-44b1-a5bf-72841d26495e req-eafe8d80-cbe7-453b-a198-cf6b58fbea18 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:44.718660 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-35c1c1e5-864e-44b1-a5bf-72841d26495e req-eafe8d80-cbe7-453b-a198-cf6b58fbea18 service nova] Creating event network-vif-unplugged:547d449f-ecbd-47ce-a60f-af7bad8cb901 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:44.719582 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-35c1c1e5-864e-44b1-a5bf-72841d26495e req-eafe8d80-cbe7-453b-a198-cf6b58fbea18 service nova] Creating event network-vif-unplugged:2601fd55-e7bc-4577-b604-f788d6cf784d for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:44.738619 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-35c1c1e5-864e-44b1-a5bf-72841d26495e req-eafe8d80-cbe7-453b-a198-cf6b58fbea18 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.128051 Oct 16 01:19:44.740316 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1860/3885] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:45.368528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:45.369503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:45.398634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:45.401266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:45.402436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:45.405857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:45.406354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:45.413264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:45.671244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:45.687809 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-491bcf1d-70d1-49df-a79f-481c5fe6fb41 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 1.344009 Oct 16 01:19:45.689661 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2026/3886] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:44 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:45.704819 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:45.705455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:45.724527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:45.725006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:45.725474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:45.726229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:45.730210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:45.730684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:45.904700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:45.910316 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:45.928288 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7f800d5-371d-4e03-8e2b-e597f5c75c80 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1275 microversion: 2.1 time: 0.233325 Oct 16 01:19:45.929685 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2027/3887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:45 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:46.050795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:46.075882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:46.077566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:46.079104 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-798dea75-bc98-43a0-ad7a-93808c75f464 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2578 microversion: 2.42 time: 0.716815 Oct 16 01:19:46.080220 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1861/3888] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:45 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2578 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:46.591376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-17668d06-20b4-41d5-bcad-f9e1bc967f86 req-4c52c069-a8e2-472f-b84c-273d0e025117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-deleted", "tag": "3906f22f-b88f-45bd-af84-22eb74721ab9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:46.607309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-17668d06-20b4-41d5-bcad-f9e1bc967f86 req-4c52c069-a8e2-472f-b84c-273d0e025117 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:46.613389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-17668d06-20b4-41d5-bcad-f9e1bc967f86 req-4c52c069-a8e2-472f-b84c-273d0e025117 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:46.613974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-17668d06-20b4-41d5-bcad-f9e1bc967f86 req-4c52c069-a8e2-472f-b84c-273d0e025117 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:46.647522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-17668d06-20b4-41d5-bcad-f9e1bc967f86 req-4c52c069-a8e2-472f-b84c-273d0e025117 service nova] Creating event network-vif-deleted:3906f22f-b88f-45bd-af84-22eb74721ab9 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:46.673353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-17668d06-20b4-41d5-bcad-f9e1bc967f86 req-4c52c069-a8e2-472f-b84c-273d0e025117 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088414 Oct 16 01:19:46.675584 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2028/3889] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:46.719090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:46.720600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:46.739293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:46.739796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:46.744782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:46.745668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:46.748789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:46.749241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:46.955512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:46.956231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:46.986173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:47.001901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:47.003659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:47.006131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:47.009674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:47.010426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:47.664190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:47.680439 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a5e9b42-070b-415d-8f04-8fa5e520f291 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1281 microversion: 2.1 time: 0.730532 Oct 16 01:19:47.692525 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2029/3890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:46 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1281 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:47.692525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:47.692525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:47.713661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:47.714179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:47.714627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:47.715553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:47.716217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:47.716655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:48.573602 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:48.583712 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f9bad204-4b50-4f62-8203-2fe26c63f510 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 1.870908 Oct 16 01:19:48.588486 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1862/3891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:46 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:48.724462 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:48.725267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:48.741061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:48.742135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:48.743101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:48.745848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:48.750726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:48.751542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:48.799138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:48.812379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:48.827411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:48.837419 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad805578-c02e-4094-bb6e-7f38855cb4d3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2372 microversion: 2.42 time: 1.154843 Oct 16 01:19:48.841523 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2030/3892] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:47 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2372 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:48.880550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0d5fa8ec-2ca0-49f2-9a09-eca728320027 req-b13179d9-dabd-4f5b-a097-19d0b11a3589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-deleted", "tag": "547d449f-ecbd-47ce-a60f-af7bad8cb901"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:48.909881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0d5fa8ec-2ca0-49f2-9a09-eca728320027 req-b13179d9-dabd-4f5b-a097-19d0b11a3589 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:48.910424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0d5fa8ec-2ca0-49f2-9a09-eca728320027 req-b13179d9-dabd-4f5b-a097-19d0b11a3589 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:48.911207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0d5fa8ec-2ca0-49f2-9a09-eca728320027 req-b13179d9-dabd-4f5b-a097-19d0b11a3589 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:48.929084 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0d5fa8ec-2ca0-49f2-9a09-eca728320027 req-b13179d9-dabd-4f5b-a097-19d0b11a3589 service nova] Creating event network-vif-deleted:547d449f-ecbd-47ce-a60f-af7bad8cb901 for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:48.936409 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0d5fa8ec-2ca0-49f2-9a09-eca728320027 req-b13179d9-dabd-4f5b-a097-19d0b11a3589 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083205 Oct 16 01:19:48.937585 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2031/3893] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:48.942885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5d93c577-87fb-4450-9d07-078efcf221ed req-e4ec7c24-f9b2-4140-9896-f1b8e4455c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14741b1e-ac5b-4f37-9575-ee65bb41addb", "tag": "7c041d71-b92f-4cec-b647-f4b6aa4fc79a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:48.957403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d93c577-87fb-4450-9d07-078efcf221ed req-e4ec7c24-f9b2-4140-9896-f1b8e4455c1d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:48.958262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d93c577-87fb-4450-9d07-078efcf221ed req-e4ec7c24-f9b2-4140-9896-f1b8e4455c1d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:48.958809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d93c577-87fb-4450-9d07-078efcf221ed req-e4ec7c24-f9b2-4140-9896-f1b8e4455c1d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:48.972868 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5d93c577-87fb-4450-9d07-078efcf221ed req-e4ec7c24-f9b2-4140-9896-f1b8e4455c1d service nova] Creating event network-changed:7c041d71-b92f-4cec-b647-f4b6aa4fc79a for instance 14741b1e-ac5b-4f37-9575-ee65bb41addb on n-h2-master-1 Oct 16 01:19:48.979247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5d93c577-87fb-4450-9d07-078efcf221ed req-e4ec7c24-f9b2-4140-9896-f1b8e4455c1d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040094 Oct 16 01:19:48.980195 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2032/3894] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:49.203720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:49.218444 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03430f9a-9cd6-4490-bb3b-9aa2c9b05c31 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1281 microversion: 2.1 time: 0.514364 Oct 16 01:19:49.219848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1863/3895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:48 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1281 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:49.618708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:49.619466 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:49.632693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:49.635056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:49.635526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:49.636278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:49.636759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:49.637236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:49.877852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:49.878396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:49.888970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:49.895726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:49.896582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:49.897503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:49.898134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:49.898811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:50.870498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:50.881098 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3eac3a4b-edc3-433e-ac0a-1fb133cea1e3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 1.266592 Oct 16 01:19:50.891985 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2033/3896] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:49 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:50.907482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:50.923425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:50.928932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:50.931293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:50.937763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:50.947429 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58816292-01c7-429f-8995-12e29115e585 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2258 microversion: 2.42 time: 1.072910 Oct 16 01:19:50.952191 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1864/3897] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:49 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2258 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:19:50.984392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:50.988633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:50.991541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:50.992588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:50.997319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:51.003015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:51.037028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-92375f34-a281-46a4-a6b8-e99b9162f7da req-937c190f-40d0-46bb-952f-4d26575e9996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f39da51-b797-405f-8c98-c4d962123c45", "tag": "15cdae2a-120b-4511-8163-93980f8cde06"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:51.064452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-92375f34-a281-46a4-a6b8-e99b9162f7da req-937c190f-40d0-46bb-952f-4d26575e9996 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:51.065229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-92375f34-a281-46a4-a6b8-e99b9162f7da req-937c190f-40d0-46bb-952f-4d26575e9996 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:51.065878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-92375f34-a281-46a4-a6b8-e99b9162f7da req-937c190f-40d0-46bb-952f-4d26575e9996 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:51.105067 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-92375f34-a281-46a4-a6b8-e99b9162f7da req-937c190f-40d0-46bb-952f-4d26575e9996 service nova] Creating event network-changed:15cdae2a-120b-4511-8163-93980f8cde06 for instance 5f39da51-b797-405f-8c98-c4d962123c45 on n-h1-master-1 Oct 16 01:19:51.112201 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-92375f34-a281-46a4-a6b8-e99b9162f7da req-937c190f-40d0-46bb-952f-4d26575e9996 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079916 Oct 16 01:19:51.116227 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1865/3898] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:51.196305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:51.214351 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89e841fc-497b-428f-bdf4-863f32452d4d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1281 microversion: 2.1 time: 0.318433 Oct 16 01:19:51.231376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2034/3899] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:50 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1281 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:51.921692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:51.923770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:51.939684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:51.942400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:51.944444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:51.945506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:51.948539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:51.954823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:51.984585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:51.986045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:51.991425 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:52.022547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:52.025060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:52.026389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:52.047559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:52.048445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:52.052362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:52.280544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:52.296743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:52.298832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:52.302026 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-419ba8c2-4ef7-4787-93d9-3d16f87af63a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 2145 microversion: 2.42 time: 0.323613 Oct 16 01:19:52.305066 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2035/3900] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:51 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 2145 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:52.315959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:52.316893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:52.333100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:52.333945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:52.334612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:52.335679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:52.338737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:52.339535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:52.731348 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:52.786286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:52.792502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:52.806463 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58b229fd-f72c-43f4-a040-44cb290caae4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.500053 Oct 16 01:19:52.810370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4a054ad6-b0f8-4e13-ba25-9db8c551d4bc tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.894920 Oct 16 01:19:52.811021 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1866/3901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:51 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:52.818389 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2036/3902] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:52 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:53.169838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b2ec0626-79de-404e-b944-19c53662b5af req-f33e1391-6b76-4675-bce6-00ac8c8a88f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-deleted", "tag": "f7e6e0d5-ea9e-40be-817f-0b90f99facfc"}, {"server_uuid": "3c682283-1fc6-456b-921a-c8644cbba345", "name": "network-vif-deleted", "tag": "2601fd55-e7bc-4577-b604-f788d6cf784d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:53.224019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b2ec0626-79de-404e-b944-19c53662b5af req-f33e1391-6b76-4675-bce6-00ac8c8a88f0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:53.224541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b2ec0626-79de-404e-b944-19c53662b5af req-f33e1391-6b76-4675-bce6-00ac8c8a88f0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:53.224967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b2ec0626-79de-404e-b944-19c53662b5af req-f33e1391-6b76-4675-bce6-00ac8c8a88f0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:53.257601 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b2ec0626-79de-404e-b944-19c53662b5af req-f33e1391-6b76-4675-bce6-00ac8c8a88f0 service nova] Creating event network-vif-deleted:f7e6e0d5-ea9e-40be-817f-0b90f99facfc for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:53.258124 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b2ec0626-79de-404e-b944-19c53662b5af req-f33e1391-6b76-4675-bce6-00ac8c8a88f0 service nova] Creating event network-vif-deleted:2601fd55-e7bc-4577-b604-f788d6cf784d for instance 3c682283-1fc6-456b-921a-c8644cbba345 on n-h1-master-1 Oct 16 01:19:53.285176 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b2ec0626-79de-404e-b944-19c53662b5af req-f33e1391-6b76-4675-bce6-00ac8c8a88f0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.121694 Oct 16 01:19:53.317299 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2037/3903] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:53.347684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:53.360637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:53.433418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:53.434760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:53.436003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:53.438447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:53.439145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:53.439737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:53.598084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:53.614460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:53.627800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:53.629272 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e31e35c-c31e-4dd9-bd1e-8f5e813b9b9f tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.294602 Oct 16 01:19:53.632638 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1867/3904] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:53 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:53.840046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:53.842353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:53.843099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:53.844861 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:53.861655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:53.864439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:53.864916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:53.865818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:53.866771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:53.868799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:53.869440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:53.870107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:53.873277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:53.874031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:53.875108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:53.876921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:54.524053 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:19:54.557647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:54.566206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aad94afd-deb7-4f85-b915-7bcc15a7e0ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.734400 Oct 16 01:19:54.566810 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2038/3905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:53 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:54.600199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:54.612170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7af2479c-066d-408a-9f77-6e61769decb0 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.776049 Oct 16 01:19:54.617947 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1868/3906] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:53 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:54.663961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:54.664581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:54.681460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:54.683719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:54.687241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:54.688024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:54.688495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:54.688929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:54.893464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:54.906644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:54.912789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:54.915999 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a0f71eb3-9f16-4ec7-a04e-7cb59e6fe218 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.257042 Oct 16 01:19:54.919353 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2039/3907] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:54 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:55.352267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f4a8a573-7279-4315-8682-ed1217217485 req-cf30442c-ea25-42c3-ae77-cd3f22d75b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14741b1e-ac5b-4f37-9575-ee65bb41addb", "tag": "f0d5dbb0-d61e-43e2-a01a-96037acc9322"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:55.382173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f4a8a573-7279-4315-8682-ed1217217485 req-cf30442c-ea25-42c3-ae77-cd3f22d75b30 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:55.384308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f4a8a573-7279-4315-8682-ed1217217485 req-cf30442c-ea25-42c3-ae77-cd3f22d75b30 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:55.385002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f4a8a573-7279-4315-8682-ed1217217485 req-cf30442c-ea25-42c3-ae77-cd3f22d75b30 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:55.405133 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f4a8a573-7279-4315-8682-ed1217217485 req-cf30442c-ea25-42c3-ae77-cd3f22d75b30 service nova] Creating event network-changed:f0d5dbb0-d61e-43e2-a01a-96037acc9322 for instance 14741b1e-ac5b-4f37-9575-ee65bb41addb on n-h2-master-1 Oct 16 01:19:55.415846 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f4a8a573-7279-4315-8682-ed1217217485 req-cf30442c-ea25-42c3-ae77-cd3f22d75b30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067738 Oct 16 01:19:55.419876 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1869/3908] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:55.590976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:55.592812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:55.631497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:55.634336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:55.635237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:55.636000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:55.636474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:55.636907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:55.645419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:55.646136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:55.663027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:55.663528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:55.663971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:55.664684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:55.665145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:55.665583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:56.201184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:56.210947 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7fecb57-f0c0-4b51-90cb-26016b7cb972 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.625221 Oct 16 01:19:56.228625 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2040/3909] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:55 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:56.241304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:56.248222 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:56.259501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:56.260272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:56.260882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:56.268278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:56.269180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:56.269789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:56.307732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:56.320709 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfb65333-ffb9-4b96-87be-23696aa6a26f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.679375 Oct 16 01:19:56.329065 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1870/3910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:55 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:19:56.542864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:56.572060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:56.573834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:56.575878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-684c4e9b-4d55-4cb9-a2a9-cd34ef3d8cc3 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.345924 Oct 16 01:19:56.581622 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2041/3911] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:56 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:57.245651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:57.247896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:57.270680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d141a3d7-25e8-4531-a562-2867d3e40909 req-13577f82-b0bc-4d7d-9b95-5e2d4a176335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad438ca6-c331-4557-aa3d-9d9846ec87da", "tag": "b777e3a4-5f24-46e7-81b2-6c3af4bd4640"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:57.276478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:57.277527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:57.279646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:57.280908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:57.281395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:57.282301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:57.284806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d141a3d7-25e8-4531-a562-2867d3e40909 req-13577f82-b0bc-4d7d-9b95-5e2d4a176335 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:57.285374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d141a3d7-25e8-4531-a562-2867d3e40909 req-13577f82-b0bc-4d7d-9b95-5e2d4a176335 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:57.285887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d141a3d7-25e8-4531-a562-2867d3e40909 req-13577f82-b0bc-4d7d-9b95-5e2d4a176335 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:57.301076 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d141a3d7-25e8-4531-a562-2867d3e40909 req-13577f82-b0bc-4d7d-9b95-5e2d4a176335 service nova] Creating event network-changed:b777e3a4-5f24-46e7-81b2-6c3af4bd4640 for instance ad438ca6-c331-4557-aa3d-9d9846ec87da on n-h2-master-1 Oct 16 01:19:57.307766 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d141a3d7-25e8-4531-a562-2867d3e40909 req-13577f82-b0bc-4d7d-9b95-5e2d4a176335 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041217 Oct 16 01:19:57.308764 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2042/3912] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:57.364660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:57.365741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:57.385154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:57.386048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:57.386719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:57.387774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:57.388483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:57.389833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:57.877888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:57.887040 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2363f2f2-58f0-4b92-82c0-8e2610024c3e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.526645 Oct 16 01:19:57.892024 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2043/3913] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:57 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:57.897136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:57.902792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:57.917806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:57.922657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:57.924408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:57.926954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:57.928684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:57.930256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:58.056661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:58.073547 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fde4614b-8d0f-4608-96dd-12274d3e9b16 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.831493 Oct 16 01:19:58.093773 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1871/3914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:57 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:58.122759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:58.136122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:58.140521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:58.144156 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d547b853-9583-4d85-abe5-ce8db2afa37d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.250758 Oct 16 01:19:58.165470 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2044/3915] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:57 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:58.915531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:58.917490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:58.935723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:58.938389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:58.940765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:58.943883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:58.944795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:58.945760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:59.101075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:59.102370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:59.117180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:59.117926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:59.121180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:59.122184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:59.122839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:59.123454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:59.202671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:59.217288 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b2cce74-aa15-479f-adf3-836c0f37e087 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.307384 Oct 16 01:19:59.222989 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1872/3916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:58 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:19:59.228486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:19:59.229291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:19:59.255562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:59.256072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:59.256507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:59.257668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:59.258138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:59.258571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:59.405948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:59.419592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:59.421784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:59.424149 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-67aea5dd-a7cb-4f70-a6af-9fa249d40eca tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.199613 Oct 16 01:19:59.440047 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1873/3917] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:19:59 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:19:59.451237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-104bb055-c9d5-4a8a-891d-829f1df2a16e req-c700470e-ef9a-4232-a257-89d32c5fcbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299", "tag": "08313485-f159-4a8e-9a64-8cd1ceaeb548"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:19:59.463303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-104bb055-c9d5-4a8a-891d-829f1df2a16e req-c700470e-ef9a-4232-a257-89d32c5fcbb8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:19:59.464051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-104bb055-c9d5-4a8a-891d-829f1df2a16e req-c700470e-ef9a-4232-a257-89d32c5fcbb8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:19:59.464649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-104bb055-c9d5-4a8a-891d-829f1df2a16e req-c700470e-ef9a-4232-a257-89d32c5fcbb8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:19:59.482046 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-104bb055-c9d5-4a8a-891d-829f1df2a16e req-c700470e-ef9a-4232-a257-89d32c5fcbb8 service nova] Creating event network-changed:08313485-f159-4a8e-9a64-8cd1ceaeb548 for instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 on n-h2-master-1 Oct 16 01:19:59.486041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:19:59.487764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-104bb055-c9d5-4a8a-891d-829f1df2a16e req-c700470e-ef9a-4232-a257-89d32c5fcbb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046007 Oct 16 01:19:59.488566 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1874/3918] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:19:59.494329 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-317d4195-1d6e-4eb0-8575-aa553adbbd88 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.397815 Oct 16 01:19:59.494936 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2045/3919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:19:59 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:00.250376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:00.251297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:00.261246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:00.262702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:00.263415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:00.264370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:00.265012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:00.265779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:00.458559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:00.460656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:00.471587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:00.473410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:00.474223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:00.475655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:00.476582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:00.478254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:00.731609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:00.744448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:00.747202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:00.747514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:00.749828 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85b9c23b-dab5-4d9c-997f-78afb9ff5f24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.296005 Oct 16 01:20:00.755355 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c0c95a3-59cb-4df9-94bd-b7c3bc1b9cf9 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.510035 Oct 16 01:20:00.760467 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1875/3920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:00 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:00.766717 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2046/3921] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:00 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:00.775361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:00.778548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:00.794034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:00.794551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:00.795024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:00.795745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:00.796355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:00.796796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:01.061513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:01.065162 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:01.070310 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-889f092c-b702-4471-b952-9ba862de24be tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.302487 Oct 16 01:20:01.084201 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2047/3922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:00 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:01.598969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2d5f96d3-f39b-4471-86a7-833c85592f04 req-a317d3c2-3ee4-4cfe-b5b8-95a031afb15f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dccaf194-81ee-440c-bdcb-eefc6002de8a", "tag": "3262819b-c017-4deb-b10a-9e74c47f7ca0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:01.617715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d5f96d3-f39b-4471-86a7-833c85592f04 req-a317d3c2-3ee4-4cfe-b5b8-95a031afb15f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:01.622749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d5f96d3-f39b-4471-86a7-833c85592f04 req-a317d3c2-3ee4-4cfe-b5b8-95a031afb15f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:01.624045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d5f96d3-f39b-4471-86a7-833c85592f04 req-a317d3c2-3ee4-4cfe-b5b8-95a031afb15f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:01.653234 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2d5f96d3-f39b-4471-86a7-833c85592f04 req-a317d3c2-3ee4-4cfe-b5b8-95a031afb15f service nova] Creating event network-changed:3262819b-c017-4deb-b10a-9e74c47f7ca0 for instance dccaf194-81ee-440c-bdcb-eefc6002de8a on n-h1-master-1 Oct 16 01:20:01.664162 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2d5f96d3-f39b-4471-86a7-833c85592f04 req-a317d3c2-3ee4-4cfe-b5b8-95a031afb15f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068967 Oct 16 01:20:01.667975 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1876/3923] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:01.801747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:01.802460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:01.803798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:01.807878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:01.815766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:01.816659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:01.817296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:01.818145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:01.818728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:01.818903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:01.819527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:01.819784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:01.822001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:01.822846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:01.827316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:01.827902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:01.899748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:01.912820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:01.920731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:01.921968 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-86307719-20d8-43e5-8ee7-f573665e6b24 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.136155 Oct 16 01:20:01.922847 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2048/3924] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:01 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:02.133580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1495927476", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "3979c760-6358-41da-a8d1-904eb4013d85"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:02.163575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:02.175768 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-54aa21b6-16fd-42a8-9629-c0983949ca19 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.385850 Oct 16 01:20:02.180538 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1877/3925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:01 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:02.186242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:02.194946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:02.205591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:02.207335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:02.208557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:02.211625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:02.213589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:02.214876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:02.225759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] validate_networks() for [('3979c760-6358-41da-a8d1-904eb4013d85', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:20:02.724426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:02.739134 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e3e4c3c2-8ae5-41a2-b10d-bf0fcb4a3dde tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.556093 Oct 16 01:20:02.753772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1878/3926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:02 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:02.951005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:02.951548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:02.967604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:02.968273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:02.972536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:02.973385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:02.973879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:02.974328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:02.998115 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:03.152174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:03.166348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:03.181611 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:03.184883 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-40a7acfe-e71d-4f57-be61-7cd22541bfb7 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.238632 Oct 16 01:20:03.188141 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1879/3927] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:02 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:20:03.203025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:03.208649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:03.236215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:20:03.236756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:20:03.236896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:03.237098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:20:03.237535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:03.237658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:20:03.238225 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:20:03.239832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:03.240609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:03.247582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:03.248423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:03.256914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:03.258847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:03.260592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:03.263682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:03.264732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:03.267055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:03.315852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Getting quotas for project 3accb70d34644a70a56bab34c8ef57bf. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:20:03.342812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Getting quotas for user 8ab02499c2b64768878fa1d06909e682 and project 3accb70d34644a70a56bab34c8ef57bf. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:20:03.379464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:20:03.385355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:20:03.538563 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5aa434c1-04cb-4668-8278-27a92893cbb4 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.613914 Oct 16 01:20:03.541149 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2049/3928] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:20:03.543086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:03.551646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bf9c7f8a-4431-4c9d-99f8-786f2172024e tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:03.552271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bf9c7f8a-4431-4c9d-99f8-786f2172024e tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:03.554826 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ff5fb163-1430-46c5-ba42-7562bef6ddcc tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.355945 Oct 16 01:20:03.556256 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1880/3929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:03 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:03.714958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bf9c7f8a-4431-4c9d-99f8-786f2172024e tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:03.723256 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bf9c7f8a-4431-4c9d-99f8-786f2172024e tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1225 microversion: 2.1 time: 0.175327 Oct 16 01:20:03.739286 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2050/3930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:03 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1225 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:03.768406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:03.769608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:03.785328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:03.786380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:03.786901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:03.789177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:03.791564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:03.793098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:04.187923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:04.202427 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-87e57b89-223a-49d0-ab7b-7f69ff662e5e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.440864 Oct 16 01:20:04.203066 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1881/3931] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:03 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:04.218985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:04.219965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:04.239089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:04.242074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:04.243274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:04.244329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:04.245061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:04.245631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:04.367837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:04.381056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:04.391825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:04.394774 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60cf0deb-d9f5-45e0-a9ae-309c54359a81 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.179886 Oct 16 01:20:04.397193 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2051/3932] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:04 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:04.579267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:04.579885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:04.588544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:04.589048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:04.589493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:04.590373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:04.590963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:04.599495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:04.747285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:04.748183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:04.761670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:04.762242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:04.762821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:04.764696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:04.765176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:04.765618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:04.955658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:04.973572 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fdb6fa18-2ce5-4281-92a1-ede8d4632b13 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1221 microversion: 2.1 time: 0.231015 Oct 16 01:20:04.984309 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2052/3933] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:04 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:05.012845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:05.035274 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ddd3c2ff-094c-4061-88f8-01d50b22d7a8 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.458483 Oct 16 01:20:05.037235 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1882/3934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:04 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:05.228100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:05.228993 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:05.232779 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:05.260107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:05.267357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:05.268174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:05.269183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:05.270981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:05.272396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:05.428277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:05.430364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:05.440682 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=68 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:05.448731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:05.449660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:05.451519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:05.452453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:05.453756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:05.455613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:05.721512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:05.737386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9dda1894-014d-4a81-b6f7-17a65a84aff2 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.512603 Oct 16 01:20:05.738833 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2053/3935] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:05 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:05.739384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:05.753109 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:05.758741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:05.763035 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5db641c1-c96a-4f9c-8cdc-e57076133246 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.341175 Oct 16 01:20:05.766971 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1883/3936] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:05 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:20:06.000268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:06.001299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:06.012389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:06.015787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:06.016448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:06.018793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:06.019720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:06.020373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:06.062360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:06.063181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:06.083694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:06.090530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:06.091412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:06.093357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:06.095859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:06.097643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:06.280346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:06.296754 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-970458ca-6c7a-4a79-a04b-54d436ba695b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1283 microversion: 2.1 time: 0.302251 Oct 16 01:20:06.299032 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2054/3937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:05 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1283 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:06.762531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:06.763654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:06.774279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:06.777839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:06.783367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:06.786052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:06.787344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:06.788023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:07.626400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:07.640237 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-75a57881-1056-4ac5-974b-5f52c87415eb tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.876789 Oct 16 01:20:07.640953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2055/3938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:06 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:07.663604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:07.664596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:07.666388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:07.674986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:07.675834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:07.676112 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-550926f2-b556-4727-9674-91a86e011bfe tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 1.621272 Oct 16 01:20:07.677594 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1884/3939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:06 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:07.682866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:07.683808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:07.693333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:07.694484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:07.695193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:07.695783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:07.700054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:07.700627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:07.701134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:07.706702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:07.707323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:07.707830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:07.793312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:07.809524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:07.813766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:07.819400 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13461ece-c83a-4fdf-a170-6f7bd30e5e71 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.176306 Oct 16 01:20:07.821046 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2056/3940] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:07 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:07.829389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-48540c25-dcbb-46da-a25b-82521bcc2f51 req-dcbe674c-948e-4171-80e7-57f69d4e1b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad438ca6-c331-4557-aa3d-9d9846ec87da", "name": "network-vif-plugged", "status": "completed", "tag": "b777e3a4-5f24-46e7-81b2-6c3af4bd4640"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:07.855268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-48540c25-dcbb-46da-a25b-82521bcc2f51 req-dcbe674c-948e-4171-80e7-57f69d4e1b0d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:07.859215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-48540c25-dcbb-46da-a25b-82521bcc2f51 req-dcbe674c-948e-4171-80e7-57f69d4e1b0d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:07.860842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-48540c25-dcbb-46da-a25b-82521bcc2f51 req-dcbe674c-948e-4171-80e7-57f69d4e1b0d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:07.895920 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-48540c25-dcbb-46da-a25b-82521bcc2f51 req-dcbe674c-948e-4171-80e7-57f69d4e1b0d service nova] Creating event network-vif-plugged:b777e3a4-5f24-46e7-81b2-6c3af4bd4640 for instance ad438ca6-c331-4557-aa3d-9d9846ec87da on n-h2-master-1 Oct 16 01:20:07.905584 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-48540c25-dcbb-46da-a25b-82521bcc2f51 req-dcbe674c-948e-4171-80e7-57f69d4e1b0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083058 Oct 16 01:20:07.906201 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2057/3941] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:07.922864 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:07.937117 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-595c7b38-6288-4da5-ad90-6dad4b91f0c3 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.257436 Oct 16 01:20:07.951559 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1885/3942] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:07 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:08.672860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:08.673671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:08.691456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:08.691978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:08.696299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:08.699410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:08.699954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:08.701098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:08.702116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:08.702620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:08.722210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:08.723101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:08.727123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:08.728648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:08.730155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:08.732505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:09.194037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:09.208642 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85568949-eed1-46ad-beff-b61a35590079 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.539546 Oct 16 01:20:09.209500 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2058/3943] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:08 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:09.221752 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:09.236540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:09.241393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:09.250383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:09.250884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:09.252190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:09.252915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:09.255688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:09.255862 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-04b2f34b-f284-465b-9cef-866dee600381 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.559405 Oct 16 01:20:09.257423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:09.267946 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1886/3944] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:08 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:09.284096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:09.287535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:09.303221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:09.305030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:09.306129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:09.308556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:09.312190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:09.313047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:09.470992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:09.488941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:09.490366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:09.494886 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7cf8b34-4d4b-41de-b642-957cc56aa90b tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.281078 Oct 16 01:20:09.495673 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2059/3945] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:09 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:09.550283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:09.580742 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-36c37420-ce44-485d-963b-fdbc367b9af6 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.308684 Oct 16 01:20:09.581495 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1887/3946] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:09 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:09.698878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b01377dd-fc71-4d9a-867f-07094be1881a req-8041f9a1-3682-45f9-8a38-b1f662582220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d1f550-2adf-4b77-a41f-72c5320740bd", "tag": "e1b13035-db19-496e-8563-0bd48f698b99"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:09.720231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b01377dd-fc71-4d9a-867f-07094be1881a req-8041f9a1-3682-45f9-8a38-b1f662582220 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:09.720709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b01377dd-fc71-4d9a-867f-07094be1881a req-8041f9a1-3682-45f9-8a38-b1f662582220 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:09.721140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b01377dd-fc71-4d9a-867f-07094be1881a req-8041f9a1-3682-45f9-8a38-b1f662582220 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:09.749413 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b01377dd-fc71-4d9a-867f-07094be1881a req-8041f9a1-3682-45f9-8a38-b1f662582220 service nova] Creating event network-changed:e1b13035-db19-496e-8563-0bd48f698b99 for instance 15d1f550-2adf-4b77-a41f-72c5320740bd on n-h1-master-1 Oct 16 01:20:09.756260 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b01377dd-fc71-4d9a-867f-07094be1881a req-8041f9a1-3682-45f9-8a38-b1f662582220 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060616 Oct 16 01:20:09.757612 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2060/3947] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:10.201259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1b3147a3-3c39-4080-b757-9155824895b7 req-606eebcf-2036-4ac6-8d71-3b64bf8412f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccaf194-81ee-440c-bdcb-eefc6002de8a", "name": "network-vif-plugged", "status": "completed", "tag": "3262819b-c017-4deb-b10a-9e74c47f7ca0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:10.221570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b3147a3-3c39-4080-b757-9155824895b7 req-606eebcf-2036-4ac6-8d71-3b64bf8412f9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.224127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b3147a3-3c39-4080-b757-9155824895b7 req-606eebcf-2036-4ac6-8d71-3b64bf8412f9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.224929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b3147a3-3c39-4080-b757-9155824895b7 req-606eebcf-2036-4ac6-8d71-3b64bf8412f9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.238605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:10.239839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:10.246786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.247658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.248299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.249264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.249930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.250559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.276409 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1b3147a3-3c39-4080-b757-9155824895b7 req-606eebcf-2036-4ac6-8d71-3b64bf8412f9 service nova] Creating event network-vif-plugged:3262819b-c017-4deb-b10a-9e74c47f7ca0 for instance dccaf194-81ee-440c-bdcb-eefc6002de8a on n-h1-master-1 Oct 16 01:20:10.297578 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1b3147a3-3c39-4080-b757-9155824895b7 req-606eebcf-2036-4ac6-8d71-3b64bf8412f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097901 Oct 16 01:20:10.299108 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1888/3948] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:20:10.317487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:10.318713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:10.360855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.364160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.365626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.367540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.390389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.394458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.477383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:10.493953 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad2696dd-02d6-4d22-a7a4-8ca2c0d2c1ab tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.260948 Oct 16 01:20:10.495228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2061/3949] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:10 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:10.531475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:10.535898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:10.561533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.564517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.566117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.569210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.573584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.574309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.756012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:10.770404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:10.776098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:10.781342 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-08394ebd-3090-44c3-b59d-d59caa50ed04 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.263014 Oct 16 01:20:10.782587 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2062/3950] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:10 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:10.815648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:10.816275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:10.830530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.831065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.831509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.832253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:10.832703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:10.833132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:10.845941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:10.854702 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-368efb33-c4fd-4b27-ad04-e0bd6acebef5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.553282 Oct 16 01:20:10.855340 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1889/3951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:10 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:11.066727 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:11.079133 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e592c1f-1ce9-4e0d-905b-a2f8bb0cb223 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.280666 Oct 16 01:20:11.080475 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2063/3952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:10 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:11.521895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:11.522519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:11.548232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:11.550362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:11.551050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:11.552128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:11.552938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:11.553824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:11.768479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:11.780327 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df3293a6-393d-40e3-8a9b-aacf4ff121f9 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.262477 Oct 16 01:20:11.783052 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1890/3953] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:11 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:11.814438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:11.815080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:11.828040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:11.828383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:11.828818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:11.829531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:11.829980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:11.831518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:11.880377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:11.881223 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:11.899211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:11.906043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:11.913283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:11.914536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:11.915302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:11.915888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:11.996463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:12.009070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:12.012471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:12.014657 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-12b50217-1ec7-4ae5-8e27-aaa9888efc93 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.204236 Oct 16 01:20:12.029005 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2064/3954] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:11 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:12.102994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:12.104042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:12.114471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:12.116969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:12.117481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:12.121191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:12.122530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:12.123131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:12.164178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:12.179004 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4250a2f8-2573-45fa-a5e5-f3b193738935 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.302257 Oct 16 01:20:12.179966 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1891/3955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:11 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:12.340812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-25caca2b-54eb-430b-b90c-2d2c828fa1bc req-ffc1e446-3b68-4f4c-9be8-136b841510f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299", "name": "network-vif-plugged", "status": "completed", "tag": "08313485-f159-4a8e-9a64-8cd1ceaeb548"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:12.365361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-25caca2b-54eb-430b-b90c-2d2c828fa1bc req-ffc1e446-3b68-4f4c-9be8-136b841510f8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:12.365878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-25caca2b-54eb-430b-b90c-2d2c828fa1bc req-ffc1e446-3b68-4f4c-9be8-136b841510f8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:12.366291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-25caca2b-54eb-430b-b90c-2d2c828fa1bc req-ffc1e446-3b68-4f4c-9be8-136b841510f8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:12.403764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-25caca2b-54eb-430b-b90c-2d2c828fa1bc req-ffc1e446-3b68-4f4c-9be8-136b841510f8 service nova] Creating event network-vif-plugged:08313485-f159-4a8e-9a64-8cd1ceaeb548 for instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 on n-h2-master-1 Oct 16 01:20:12.424249 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-25caca2b-54eb-430b-b90c-2d2c828fa1bc req-ffc1e446-3b68-4f4c-9be8-136b841510f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087664 Oct 16 01:20:12.430468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:12.431459 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1892/3956] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:20:12.445019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-656b73c9-dfb2-4d22-b8f0-f0ee36cf4a69 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.346261 Oct 16 01:20:12.447353 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2065/3957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:12 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:12.811921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:12.812651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:12.827995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:12.828504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:12.828949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:12.829665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:12.830133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:12.830566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.046363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:13.046868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:13.048484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:13.055949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4d3ee35-b657-456e-ae87-1fd51987b05e tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.255393 Oct 16 01:20:13.068618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:13.069857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:13.070179 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1893/3958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:12 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:13.070294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.075030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:13.075613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:13.076061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.160005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:13.172287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:13.174131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:13.175822 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-37ccfed5-c57d-40f3-9359-64aa039d995d tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.135601 Oct 16 01:20:13.176966 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2066/3959] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:13 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:20:13.204239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:13.204977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:13.217892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:13.218536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:13.219040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.219773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:13.220809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:13.221248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.415093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:13.424184 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-07a41422-70ec-47b7-9fc9-5e6327dc980f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1323 microversion: 2.1 time: 0.224614 Oct 16 01:20:13.425353 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1894/3960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:13 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1323 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:13.472361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:13.473016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:13.485431 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:13.491547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:13.492441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:13.494458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.496716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:13.499224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:13.499895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.540066 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:13.702132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:13.711908 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1a62d267-9f02-4d5c-8007-18fe3025fedd tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.243532 Oct 16 01:20:13.712920 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2067/3961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:13 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:13.756964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:13.758497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:13.769174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:13.770100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:13.771513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.772712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:13.773438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:13.774304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:13.804340 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ea9e84f9-52aa-4464-91ba-1d6ed1388f12 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/ips" status: 200 len: 150 microversion: 2.1 time: 0.052133 Oct 16 01:20:13.804931 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1895/3962] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:20:13 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:14.083855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:14.085135 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:14.088606 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:14.104433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:14.105931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:14.107520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:14.109261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:14.123482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:14.129499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:14.206182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:14.206719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:14.232100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:14.232921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:14.234905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:14.236046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:14.239654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:14.240422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:14.633918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:14.645193 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0843ac6-ee72-48c1-81cd-38c8c86e4201 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.566237 Oct 16 01:20:14.645797 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2068/3963] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:14 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:14.664749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:14.665372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:14.677388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:14.677898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:14.678581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:14.684878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:14.685664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:14.686321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:14.852853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:14.872400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:14.874254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:14.875682 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7f615f9e-db4c-42ae-9d81-6e000cdbef12 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.676562 Oct 16 01:20:14.887555 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1896/3964] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:14 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:20:14.909276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-32cc7462-672c-4884-b357-c4dcaf9d27de req-73ec1e6f-4510-4702-a915-2f0629b94683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14741b1e-ac5b-4f37-9575-ee65bb41addb", "name": "network-vif-plugged", "status": "completed", "tag": "7c041d71-b92f-4cec-b647-f4b6aa4fc79a"}, {"server_uuid": "14741b1e-ac5b-4f37-9575-ee65bb41addb", "name": "network-vif-plugged", "status": "completed", "tag": "f0d5dbb0-d61e-43e2-a01a-96037acc9322"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:14.928663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-32cc7462-672c-4884-b357-c4dcaf9d27de req-73ec1e6f-4510-4702-a915-2f0629b94683 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:14.929329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-32cc7462-672c-4884-b357-c4dcaf9d27de req-73ec1e6f-4510-4702-a915-2f0629b94683 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:14.929930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-32cc7462-672c-4884-b357-c4dcaf9d27de req-73ec1e6f-4510-4702-a915-2f0629b94683 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:14.959025 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-32cc7462-672c-4884-b357-c4dcaf9d27de req-73ec1e6f-4510-4702-a915-2f0629b94683 service nova] Creating event network-vif-plugged:7c041d71-b92f-4cec-b647-f4b6aa4fc79a for instance 14741b1e-ac5b-4f37-9575-ee65bb41addb on n-h2-master-1 Oct 16 01:20:14.959807 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-32cc7462-672c-4884-b357-c4dcaf9d27de req-73ec1e6f-4510-4702-a915-2f0629b94683 service nova] Creating event network-vif-plugged:f0d5dbb0-d61e-43e2-a01a-96037acc9322 for instance 14741b1e-ac5b-4f37-9575-ee65bb41addb on n-h2-master-1 Oct 16 01:20:14.971834 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-32cc7462-672c-4884-b357-c4dcaf9d27de req-73ec1e6f-4510-4702-a915-2f0629b94683 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082903 Oct 16 01:20:14.975337 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1897/3965] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:14.996696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:14.997598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:15.004769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:15.008704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:15.009313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:15.010199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:15.010821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:15.023710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:15.029559 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:15.224537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:15.234073 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f490b10f-9d05-4c37-8e1d-34fd15b43bf5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 200 len: 1517 microversion: 2.1 time: 0.583829 Oct 16 01:20:15.238343 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2069/3966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:14 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 1517 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:15.266314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:15.268902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:15.285263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:15.286025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:15.286836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:15.287998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:15.288827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:15.289628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:15.410030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:15.433323 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a413cb30-5ece-43ad-9222-2f7de95811bb tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.456511 Oct 16 01:20:15.434061 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1898/3967] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:14 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:15.596459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:15.609978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2701de12-d1a0-49d4-b972-2fd92ac5b568 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da" status: 200 len: 1516 microversion: 2.1 time: 0.348012 Oct 16 01:20:15.610798 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2070/3968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:15 2022] GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da => generated 1516 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:15.639745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:15.640876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:15.651178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:15.651940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:15.654482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:15.658149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:15.658945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:15.660001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:15.677350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:15.678652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:15.694063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:15.695507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:15.698626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:15.702522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:15.705602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:15.706365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:15.990216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:16.006188 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4ac32169-251a-46b3-a9e8-0de6e32934c5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 200 len: 1516 microversion: 2.1 time: 0.377261 Oct 16 01:20:16.007439 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1899/3969] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:15 2022] GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 1516 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:16.024582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:16.025615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:16.048876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.052393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.052847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.053849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.056658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.057849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.243747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:16.258358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:16.259704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:16.261167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:16.262776 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c9890302-0b26-430a-86cf-09beb3daf7a1 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1604 microversion: 2.42 time: 0.252787 Oct 16 01:20:16.274510 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1900/3970] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:16 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:16.277856 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f39bc2d4-0069-4433-b7f0-260e41c9e1ea tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1333 microversion: 2.1 time: 0.606252 Oct 16 01:20:16.285966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:16.288428 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2071/3971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:15 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1333 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:16.288736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:16.306671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.308012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.308822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.309849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.310509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.311159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.349899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:20:16.462521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:16.463456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:16.486878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.487414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.488173 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd3af206-98da-480a-8e32-ecd4e57481aa tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 204 len: 0 microversion: 2.1 time: 0.211985 Oct 16 01:20:16.490568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.492392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.493582 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1901/3972] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:20:16 2022] DELETE /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:20:16.494016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.495547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.508680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:16.511035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:16.527982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.528809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.530522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.536044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.536712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.537457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.773922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:16.784727 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-26915186-6a4a-4525-9185-1a8a28e47c4f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.327000 Oct 16 01:20:16.805500 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2072/3973] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:16 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:16.852988 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:16.863600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-71d0bb14-26f5-4064-bdeb-d2926645b32f tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 200 len: 1522 microversion: 2.1 time: 0.365073 Oct 16 01:20:16.872508 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1902/3974] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:16 2022] GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:16.907556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3b25722-0f4e-454a-bcdd-ed745047db4e"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:16.910692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:16.917392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.918134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.919023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.919936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:16.920402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:16.920992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:16.995464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ba04bb94-f9e2-49fe-b2de-2012ca9c9579 req-4c64f5e4-b8d5-4756-9992-a1d4c148217d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d1f550-2adf-4b77-a41f-72c5320740bd", "name": "network-vif-plugged", "status": "completed", "tag": "e1b13035-db19-496e-8563-0bd48f698b99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:17.012120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ba04bb94-f9e2-49fe-b2de-2012ca9c9579 req-4c64f5e4-b8d5-4756-9992-a1d4c148217d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.012618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ba04bb94-f9e2-49fe-b2de-2012ca9c9579 req-4c64f5e4-b8d5-4756-9992-a1d4c148217d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.013432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ba04bb94-f9e2-49fe-b2de-2012ca9c9579 req-4c64f5e4-b8d5-4756-9992-a1d4c148217d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.031422 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ba04bb94-f9e2-49fe-b2de-2012ca9c9579 req-4c64f5e4-b8d5-4756-9992-a1d4c148217d service nova] Creating event network-vif-plugged:e1b13035-db19-496e-8563-0bd48f698b99 for instance 15d1f550-2adf-4b77-a41f-72c5320740bd on n-h1-master-1 Oct 16 01:20:17.037319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ba04bb94-f9e2-49fe-b2de-2012ca9c9579 req-4c64f5e4-b8d5-4756-9992-a1d4c148217d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045546 Oct 16 01:20:17.038260 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1903/3975] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:17.314140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:17.315504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:17.325336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.326230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.326901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.327792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.328405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.328984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.572731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:17.580960 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-33b7871f-bd60-440c-bfbd-450761c1b5b7 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1668 microversion: 2.1 time: 0.280263 Oct 16 01:20:17.581554 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1904/3976] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:17 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1668 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:17.594396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:17.595599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:17.609766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.610314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.611032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.611738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.612493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.612999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.655196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.655689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.656127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.656591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lazy-loading 'fault' on Instance uuid 3c682283-1fc6-456b-921a-c8644cbba345 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:20:17.703160 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:17.713136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:17.715378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b3edfc62e747a8a21e76bfde79f40e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3078012968784295bc15ee359b50fd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:17.717519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ecc21a9d-b3c1-4af3-bd6b-3b107b2184fb tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 200 len: 1609 microversion: 2.42 time: 0.133871 Oct 16 01:20:17.718095 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1905/3977] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:17 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 1609 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:17.722643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:17.723153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:17.740767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.741554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.742084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.742903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.743572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.744043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.776499 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30ba27d5-afca-4234-a0ec-be58a140cc3a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb/ips" status: 200 len: 179 microversion: 2.1 time: 0.057236 Oct 16 01:20:17.778120 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1906/3978] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:20:17 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb/ips => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:17.791238 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:17.791238 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:17.799647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.800163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.800613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.801331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.801795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.802349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.833812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:20:17.949882 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85049b10-51f3-4c70-aca3-772a7a93ead3 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 204 len: 0 microversion: 2.1 time: 0.163105 Oct 16 01:20:17.951926 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1907/3979] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:20:17 2022] DELETE /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:20:17.958833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:17.960093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:17.969090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.970290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.971105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:17.972254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:17.973115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:17.974132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:18.198640 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:18.220003 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-61ea2a81-0025-423e-a3ec-223c377b8d87 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.265659 Oct 16 01:20:18.232340 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1908/3980] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:17 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:18.253968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:18.254835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:18.261423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:18.262189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:18.262806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:18.263721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:18.264348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:18.264943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:18.608958 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1576fb10-21ba-46ce-bb82-067186489e0c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.705274 Oct 16 01:20:18.609652 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2073/3981] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:20:16 2022] POST /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments => generated 194 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:18.637986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:18.643049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:18.668252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:18.669562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:18.670026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:18.670776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:18.673864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:18.675605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:18.689498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:18.705874 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0f76395b-845e-40d8-8ba4-982ba1781e76 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 200 len: 1522 microversion: 2.1 time: 0.457109 Oct 16 01:20:18.706492 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1909/3982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:18 2022] GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:18.745906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:18.746670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:18.757289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:18.757792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:18.759454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:18.761352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:18.765671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:18.766251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:18.820483 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] HTTP exception thrown: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Request method failure captured: Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 HTTP/1.1 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1quK-88EgkiO5TBGBFLexlyfjK3lnmLX325Ggj72F7L-6iKiTPDlkvN-zbjPEiELnwkNs8ueigB6RLjPPoANNYKyI_fyeKizzx-MxBjbiSHiqz-elga_F-TWJ-2TELJqVTUm8-ANJFAqjSUYsFmKH2uOPGcyOhZRn8PMlNta08fIiM Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.42 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3078012968784295bc15ee359b50fd67 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3078012968784295bc15ee359b50fd67", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3078012968784295bc15ee359b50fd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3078012968784295bc15ee359b50fd67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3078012968784295bc15ee359b50fd67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3078012968784295bc15ee359b50fd67 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TaggedBootDevicesTest_v242-765513709-project Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 49b3edfc62e747a8a21e76bfde79f40e Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TaggedBootDevicesTest_v242-765513709-project Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3c682283-1fc6-456b-921a-c8644cbba345'} Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:18.826516 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:18.830503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Returning 404 to user: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:18.833619 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e592e086-7c38-4bff-80b2-f21ba0f724fe tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 404 len: 111 microversion: 2.42 time: 0.092248 Oct 16 01:20:18.836619 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1910/3983] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:18 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:20:18.851381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9275e752-0a68-40d4-9198-921ad57cb52a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '.version_select at 0x7fd652830310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:18.901317 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9275e752-0a68-40d4-9198-921ad57cb52a tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132386502" status: 204 len: 0 microversion: 2.42 time: 0.059067 Oct 16 01:20:18.903480 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1911/3984] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:20:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132386502 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:20:18.996576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:19.008579 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0f34bd0-7959-4498-8181-2c38f1d70420 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1674 microversion: 2.1 time: 0.397487 Oct 16 01:20:19.009791 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2074/3985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:18 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1674 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:19.260140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:19.260771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:19.281985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:19.282516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:19.282999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:19.285343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:19.285829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:19.286276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:19.613710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:19.621872 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4e8d10df-d56d-4b26-98a4-97ef2706d0aa tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1325 microversion: 2.1 time: 0.365890 Oct 16 01:20:19.625828 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1912/3986] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:19 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1325 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:19.730342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:19.731733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:19.760872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:19.761393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:19.762358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:19.763118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:19.763598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:19.764035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:20.041686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:20.043059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:20.059599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:20.063657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:20.078313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:20.079965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:20.080715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:20.081934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:20.555579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:20.579777 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0978bafa-b8ef-4484-9ca5-6e4004b017a3 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 200 len: 1522 microversion: 2.1 time: 0.853703 Oct 16 01:20:20.598207 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2075/3987] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:19 2022] GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 1522 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:20.661988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:20.667239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:20.704845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:20.705799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:20.706634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:20.707685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:20.708974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:20.709665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:20.904402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:20.906756 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:20.916366 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-25229333-b7be-43d8-921c-f1c40d75673a tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1674 microversion: 2.1 time: 0.886329 Oct 16 01:20:20.917090 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1913/3988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:20 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1674 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:21.159943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:21.188487 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-28456568-d474-49af-a461-85c1a30c6579 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1523 microversion: 2.1 time: 0.533030 Oct 16 01:20:21.192678 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2076/3989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:20 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1523 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:21.220040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:21.226652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b9b6e855-27aa-4aa1-a230-566bf0ee3f14 req-69ac04b0-be61-4a8b-9800-e081a44ec0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dccaf194-81ee-440c-bdcb-eefc6002de8a", "name": "network-vif-deleted", "tag": "3262819b-c017-4deb-b10a-9e74c47f7ca0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:21.227622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:21.263743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.282910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.290208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.293425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b9b6e855-27aa-4aa1-a230-566bf0ee3f14 req-69ac04b0-be61-4a8b-9800-e081a44ec0ae service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.295292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.295906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.300936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.304959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b9b6e855-27aa-4aa1-a230-566bf0ee3f14 req-69ac04b0-be61-4a8b-9800-e081a44ec0ae service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.309015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b9b6e855-27aa-4aa1-a230-566bf0ee3f14 req-69ac04b0-be61-4a8b-9800-e081a44ec0ae service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.362594 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b9b6e855-27aa-4aa1-a230-566bf0ee3f14 req-69ac04b0-be61-4a8b-9800-e081a44ec0ae service nova] Creating event network-vif-deleted:3262819b-c017-4deb-b10a-9e74c47f7ca0 for instance dccaf194-81ee-440c-bdcb-eefc6002de8a on n-h1-master-1 Oct 16 01:20:21.377372 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b9b6e855-27aa-4aa1-a230-566bf0ee3f14 req-69ac04b0-be61-4a8b-9800-e081a44ec0ae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155092 Oct 16 01:20:21.388394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2077/3990] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:20:21.426516 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] HTTP exception thrown: Action 999 not found Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Request method failure captured: Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd/os-instance-actions/999 HTTP/1.1 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1xBPHGAoufg_m9PLjI-9EDo1zgIZOptOR_Co2nxoI588MD0a6ebZEyN0BNTlTDErfe5H1elKIPiUYJ7Zb51SXoEGckpbw4GqKBU0FfL467nmP-yzs01UCcwggMhlR2dp4iVcamQTsZaOY4Up6LfcohaEzBpkSrLgwUn80LXxbcQ8G8 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3accb70d34644a70a56bab34c8ef57bf Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3accb70d34644a70a56bab34c8ef57bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3accb70d34644a70a56bab34c8ef57bf Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-InstanceActionsNegativeTestJSON-1011219157-project Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 8ab02499c2b64768878fa1d06909e682 Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1011219157-project Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: exception: Action 999 not found Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': '15d1f550-2adf-4b77-a41f-72c5320740bd', 'id': '999'} Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 16 01:20:21.432793 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:21.438445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Returning 404 to user: Action 999 not found {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:21.453546 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4abaf94-aaf0-4337-a2d3-f701b05384e0 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.240675 Oct 16 01:20:21.456158 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1914/3991] 10.222.0.39 () {58 vars in 1308 bytes} [Sun Oct 16 01:20:21 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd/os-instance-actions/999 => generated 66 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:20:21.467288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de12bf78-bdf2-4b27-9641-156834cce8ee tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '.version_select at 0x7fd6526c6280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:21.467948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de12bf78-bdf2-4b27-9641-156834cce8ee tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: a485e25e-6459-4fb4-b04c-eb4114ab582a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:21.483129 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-de12bf78-bdf2-4b27-9641-156834cce8ee tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] HTTP exception thrown: Instance a485e25e-6459-4fb4-b04c-eb4114ab582a could not be found. Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de12bf78-bdf2-4b27-9641-156834cce8ee tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Request method failure captured: Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/a485e25e-6459-4fb4-b04c-eb4114ab582a/os-instance-actions HTTP/1.1 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1xBPHGAoufg_m9PLjI-9EDo1zgIZOptOR_Co2nxoI588MD0a6ebZEyN0BNTlTDErfe5H1elKIPiUYJ7Zb51SXoEGckpbw4GqKBU0FfL467nmP-yzs01UCcwggMhlR2dp4iVcamQTsZaOY4Up6LfcohaEzBpkSrLgwUn80LXxbcQ8G8 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3accb70d34644a70a56bab34c8ef57bf Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3accb70d34644a70a56bab34c8ef57bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3accb70d34644a70a56bab34c8ef57bf Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-InstanceActionsNegativeTestJSON-1011219157-project Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 8ab02499c2b64768878fa1d06909e682 Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1011219157-project Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: exception: Instance a485e25e-6459-4fb4-b04c-eb4114ab582a could not be found. Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': 'a485e25e-6459-4fb4-b04c-eb4114ab582a'} Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a485e25e-6459-4fb4-b04c-eb4114ab582a could not be found. Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:21.485347 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a485e25e-6459-4fb4-b04c-eb4114ab582a could not be found. Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a485e25e-6459-4fb4-b04c-eb4114ab582a could not be found. Oct 16 01:20:21.490777 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:21.494116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de12bf78-bdf2-4b27-9641-156834cce8ee tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Returning 404 to user: Instance a485e25e-6459-4fb4-b04c-eb4114ab582a could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:21.495225 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de12bf78-bdf2-4b27-9641-156834cce8ee tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/a485e25e-6459-4fb4-b04c-eb4114ab582a/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.033073 Oct 16 01:20:21.500066 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2078/3992] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Oct 16 01:20:21 2022] GET /compute/v2.1/servers/a485e25e-6459-4fb4-b04c-eb4114ab582a/os-instance-actions => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:20:21.507157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:21.508191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:21.519617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.520574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.525666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.529471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.530264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.531084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.583745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:20:21.604490 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:21.605101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:21.619312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.620801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.622819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.623814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.625412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.626136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.722620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.723534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.724291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.724976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lazy-loading 'fault' on Instance uuid dccaf194-81ee-440c-bdcb-eefc6002de8a {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:20:21.768624 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1a5b7c40-3937-4a7b-b2e5-27d94248e0cc tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "DELETE /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 204 len: 0 microversion: 2.1 time: 0.264977 Oct 16 01:20:21.770758 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1915/3993] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:20:21 2022] DELETE /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:20:21.789753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:21.792953 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:21.810359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.812653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.813136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.813931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:21.816879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:21.817385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:21.983177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:21.994949 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0ab6589-a0dc-41fa-a6e7-3faaaccf975c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 200 len: 1313 microversion: 2.1 time: 0.394258 Oct 16 01:20:22.001018 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2079/3994] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:21 2022] GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:22.036933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:22.037519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:22.057220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:22.057724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:22.058165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:22.059491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:22.059954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:22.066400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:22.519827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:22.537330 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-18d98c90-c261-49e4-8e57-7874b2ec39ed tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1529 microversion: 2.1 time: 0.752700 Oct 16 01:20:22.541345 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1916/3995] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:21 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1529 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:22.652349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:22.662255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-212dffd1-dd9d-4b30-a7f5-3cf306cf37a6 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1653 microversion: 2.1 time: 0.641976 Oct 16 01:20:22.666426 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2080/3996] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:22 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1653 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:23.025635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:23.026744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:23.041020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:23.053406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:23.055061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:23.057800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:23.058313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:23.059458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:23.158842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:23.159707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:23.160735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:23.174534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lazy-loading 'fault' on Instance uuid dccaf194-81ee-440c-bdcb-eefc6002de8a {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:20:23.320306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:23.334341 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d41bfe5c-72a1-4c0a-a3b6-2b8610790679 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 200 len: 1313 microversion: 2.1 time: 0.312202 Oct 16 01:20:23.341195 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1917/3997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:23 2022] GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:23.539885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a2888b6d-78ae-4081-a948-4a0138f6086f req-268a3194-480f-4baf-8415-206aed1464c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14741b1e-ac5b-4f37-9575-ee65bb41addb", "name": "network-vif-deleted", "tag": "7c041d71-b92f-4cec-b647-f4b6aa4fc79a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:23.563670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:23.565471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:23.573517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:23.577431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a2888b6d-78ae-4081-a948-4a0138f6086f req-268a3194-480f-4baf-8415-206aed1464c6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:23.578389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:23.579123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:23.579895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a2888b6d-78ae-4081-a948-4a0138f6086f req-268a3194-480f-4baf-8415-206aed1464c6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:23.580911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:23.581599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a2888b6d-78ae-4081-a948-4a0138f6086f req-268a3194-480f-4baf-8415-206aed1464c6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:23.582372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:23.585841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:23.621557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a2888b6d-78ae-4081-a948-4a0138f6086f req-268a3194-480f-4baf-8415-206aed1464c6 service nova] Creating event network-vif-deleted:7c041d71-b92f-4cec-b647-f4b6aa4fc79a for instance 14741b1e-ac5b-4f37-9575-ee65bb41addb on n-h2-master-1 Oct 16 01:20:23.641009 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a2888b6d-78ae-4081-a948-4a0138f6086f req-268a3194-480f-4baf-8415-206aed1464c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104871 Oct 16 01:20:23.647653 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2081/3998] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:23.694412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:23.695900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:23.702829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:23.703674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:23.719978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:23.721273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:23.721983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:23.722637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:24.081870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:24.104080 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-43e4ddf0-3076-428d-a159-5db3050fe04f tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1529 microversion: 2.1 time: 0.545090 Oct 16 01:20:24.105562 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1918/3999] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:23 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1529 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:24.108233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:24.119805 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d15eebc7-9a3d-4369-8386-45aa6ec8ad40 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1653 microversion: 2.1 time: 0.429655 Oct 16 01:20:24.135086 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2082/4000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:23 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1653 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:24.362123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:24.365347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:24.380080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:24.380576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:24.381013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:24.381731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:24.382809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:24.382809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:24.419765 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] HTTP exception thrown: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Request method failure captured: Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a HTTP/1.1 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wq_So1gvMBnHSlSa32ExPnat4uHMTt5s9C9XFChQdDpAZpBD1skRVb_p8tukdMu7yFNsB8TIsiXcK76TixWjzTBTeUTE_5DBK_sSxjtcNJbLlpDi8mcDVMmRYSUy8nt6BIBuZJMWd-17Av_WMeZCe0lSacxSGieR-v09JUtA-WSDU Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0426937b803f46279c2cb410ba6c5de4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e73ffbd1e84f3a9d1bc147f47b3abe Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: exception: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'dccaf194-81ee-440c-bdcb-eefc6002de8a'} Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.424604 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:24.429403 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.429403 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:24.429403 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:24.429403 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:24.429403 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:24.429403 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:24.429403 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:24.429403 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.432895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Returning 404 to user: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:24.434172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c2401b4d-21b8-4525-bb6b-e4abf59de29d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 404 len: 111 microversion: 2.1 time: 0.076238 Oct 16 01:20:24.435171 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1919/4001] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:24 2022] GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:20:24.446571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:24.454150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:24.456553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:20:24.466231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:24.467934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:24.468581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:24.470119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:24.470890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:24.471526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:24.638550 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f628d103-f3f8-448a-b48a-6db850973676 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.198481 Oct 16 01:20:24.644087 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2083/4002] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Oct 16 01:20:24 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:20:24.651800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d596c07d-6993-4221-aa97-76b739ec7313 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d596c07d-6993-4221-aa97-76b739ec7313 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Request method failure captured: Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wq_So1gvMBnHSlSa32ExPnat4uHMTt5s9C9XFChQdDpAZpBD1skRVb_p8tukdMu7yFNsB8TIsiXcK76TixWjzTBTeUTE_5DBK_sSxjtcNJbLlpDi8mcDVMmRYSUy8nt6BIBuZJMWd-17Av_WMeZCe0lSacxSGieR-v09JUtA-WSDU Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0426937b803f46279c2cb410ba6c5de4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e73ffbd1e84f3a9d1bc147f47b3abe Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 16 01:20:24.657351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 16 01:20:24.662044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:24.665581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d596c07d-6993-4221-aa97-76b739ec7313 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:24.677517 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d596c07d-6993-4221-aa97-76b739ec7313 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.029466 Oct 16 01:20:24.682686 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1920/4003] 10.222.0.39 () {58 vars in 1182 bytes} [Sun Oct 16 01:20:24 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:20:24.691207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:24.701551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:24.708291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'deleted': False, 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:20:24.725308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:24.725806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:24.727134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:24.728284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:24.728780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:24.729214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:24.806763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:20:24.876748 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd5f827c-d1ba-4880-ba6f-57d4ff448b41 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.192667 Oct 16 01:20:24.879550 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2084/4004] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:20:24 2022] GET /compute/v2.1/servers => generated 683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:20:24.893594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:24.907318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:24.908120 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.servers [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Removing options 'limit' from query {{(pid=120546) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 16 01:20:24.919662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'deleted': False, 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:20:24.955099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:24.955589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:24.956027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:24.956746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:24.957197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:24.957623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:25.102537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:20:25.135494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:25.138026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:25.157674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:25.158402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:25.161807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:25.171812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:25.173717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:25.177156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:25.191170 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:25.238191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac32b85f-6736-4d19-a11f-0ca12703106c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.351658 Oct 16 01:20:25.240792 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1921/4005] 10.222.0.39 () {58 vars in 1144 bytes} [Sun Oct 16 01:20:24 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:25.253438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:25.254301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:25.268681 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:25.271946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:25.273025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:25.274756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:25.277995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:25.278653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:25.280810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:25.360088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:25.360856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:25.361529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:25.362136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lazy-loading 'fault' on Instance uuid 14741b1e-ac5b-4f37-9575-ee65bb41addb {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:20:25.687382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf0ec54a3f54abd90ece8de2aa70ffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d22602edce34f6390374c40afcfd113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:25.704011 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-00b9ae55-4640-40a5-9c08-8d5fb261ab19 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 200 len: 1302 microversion: 2.1 time: 0.454620 Oct 16 01:20:25.705011 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1922/4006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:25 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 1302 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:25.716470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4390bccc-91d6-43dd-89bc-0cde0806f8e7 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4390bccc-91d6-43dd-89bc-0cde0806f8e7 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Request method failure captured: Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wq_So1gvMBnHSlSa32ExPnat4uHMTt5s9C9XFChQdDpAZpBD1skRVb_p8tukdMu7yFNsB8TIsiXcK76TixWjzTBTeUTE_5DBK_sSxjtcNJbLlpDi8mcDVMmRYSUy8nt6BIBuZJMWd-17Av_WMeZCe0lSacxSGieR-v09JUtA-WSDU Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0426937b803f46279c2cb410ba6c5de4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e73ffbd1e84f3a9d1bc147f47b3abe Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi '-1' Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 16 01:20:25.723988 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 16 01:20:25.727752 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.733857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4390bccc-91d6-43dd-89bc-0cde0806f8e7 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:25.736504 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4390bccc-91d6-43dd-89bc-0cde0806f8e7 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.029985 Oct 16 01:20:25.740178 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1923/4007] 10.222.0.39 () {58 vars in 1142 bytes} [Sun Oct 16 01:20:25 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:20:25.755204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4eba056a-71ad-4f87-a3af-00b825f35cb5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4eba056a-71ad-4f87-a3af-00b825f35cb5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Request method failure captured: Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wq_So1gvMBnHSlSa32ExPnat4uHMTt5s9C9XFChQdDpAZpBD1skRVb_p8tukdMu7yFNsB8TIsiXcK76TixWjzTBTeUTE_5DBK_sSxjtcNJbLlpDi8mcDVMmRYSUy8nt6BIBuZJMWd-17Av_WMeZCe0lSacxSGieR-v09JUtA-WSDU Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0426937b803f46279c2cb410ba6c5de4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e73ffbd1e84f3a9d1bc147f47b3abe Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: action_args: {} Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'testing' Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 16 01:20:25.765802 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 16 01:20:25.769851 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:25.778510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4eba056a-71ad-4f87-a3af-00b825f35cb5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:25.781108 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4eba056a-71ad-4f87-a3af-00b825f35cb5 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.034710 Oct 16 01:20:25.787263 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1924/4008] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:20:25 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:20:25.798300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35b1ea0e-3c2e-44f5-ba1a-bdb7641043a1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:25.817028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35b1ea0e-3c2e-44f5-ba1a-bdb7641043a1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:25.821137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35b1ea0e-3c2e-44f5-ba1a-bdb7641043a1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:20:25.838583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.servers [None req-35b1ea0e-3c2e-44f5-ba1a-bdb7641043a1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Flavor 'non_existing_flavor' could not be found {{(pid=120546) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 16 01:20:25.846190 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35b1ea0e-3c2e-44f5-ba1a-bdb7641043a1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.057254 Oct 16 01:20:25.851373 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1925/4009] 10.222.0.39 () {58 vars in 1178 bytes} [Sun Oct 16 01:20:25 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:20:25.862823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:25.872817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:25.880099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:20:25.896570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:25.897416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:25.899510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:25.900517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:25.904668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:25.914572 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e4d7a4e-e4b0-47b5-9cef-be33bcf61379 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1529 microversion: 2.1 time: 0.783853 Oct 16 01:20:25.915995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:25.917135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:25.923915 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2085/4010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:25 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1529 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:26.007515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5c72654c-3dc6-4910-a6f0-ef6db54d48ef req-acd24d50-6279-47cf-8c94-ca6d53a51e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14741b1e-ac5b-4f37-9575-ee65bb41addb", "name": "network-vif-deleted", "tag": "f0d5dbb0-d61e-43e2-a01a-96037acc9322"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:26.036939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5c72654c-3dc6-4910-a6f0-ef6db54d48ef req-acd24d50-6279-47cf-8c94-ca6d53a51e00 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.041895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5c72654c-3dc6-4910-a6f0-ef6db54d48ef req-acd24d50-6279-47cf-8c94-ca6d53a51e00 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.042554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5c72654c-3dc6-4910-a6f0-ef6db54d48ef req-acd24d50-6279-47cf-8c94-ca6d53a51e00 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.107328 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5c72654c-3dc6-4910-a6f0-ef6db54d48ef req-acd24d50-6279-47cf-8c94-ca6d53a51e00 service nova] Creating event network-vif-deleted:f0d5dbb0-d61e-43e2-a01a-96037acc9322 for instance 14741b1e-ac5b-4f37-9575-ee65bb41addb on n-h2-master-1 Oct 16 01:20:26.132742 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5c72654c-3dc6-4910-a6f0-ef6db54d48ef req-acd24d50-6279-47cf-8c94-ca6d53a51e00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129332 Oct 16 01:20:26.133826 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2086/4011] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:20:26.187246 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8fa2e7ab-e9c5-4fbf-816f-7bb8120983ad tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.331771 Oct 16 01:20:26.188296 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1926/4012] 10.222.0.39 () {58 vars in 1174 bytes} [Sun Oct 16 01:20:25 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:20:26.201275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:26.214354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:26.218740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:20:26.232981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.233474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.233909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.234629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.235356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.235793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.422977 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abc16611-b139-47a8-a802-6596f36f5677 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.226235 Oct 16 01:20:26.424123 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2087/4013] 10.222.0.39 () {58 vars in 1184 bytes} [Sun Oct 16 01:20:26 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:20:26.436369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:26.446217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:26.463391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'deleted': False, 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:20:26.482535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.483082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.483528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.484271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.484733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.485164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.586776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:20:26.678476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:26.697403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.700612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.702342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.732472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:26.733203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:26.753902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.754409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.754849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.755590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.756053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.756477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.795020 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] HTTP exception thrown: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Request method failure captured: Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb HTTP/1.1 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1vbNBdhJ3iRrLhJ7pPUF1TN375lDQAuTPfgm7lICO2Q1F0Biy4VuDlGALPWWmbRzUUUv48BQe74HJm9fFvRKWxJajzQkH6vvFEfwo4hiJ06MqrXHTBKKZ2Jb6Z6Zkvt5X-N-Viy2I5TSRS1uTdaAoJv9Efy_HreGK9Z5yGdlZohLag Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d22602edce34f6390374c40afcfd113", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d22602edce34f6390374c40afcfd113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1cf0ec54a3f54abd90ece8de2aa70ffc Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '14741b1e-ac5b-4f37-9575-ee65bb41addb'} Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:26.796719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Returning 404 to user: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2110b400-e9d2-4989-9d5b-b8f325e43bd4 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 404 len: 111 microversion: 2.1 time: 0.069964 Oct 16 01:20:26.800361 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2088/4014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:26 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:20:26.949969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:26.951502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:26.962329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.963976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.971417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:26.972991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:26.973791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:26.974735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:27.210491 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef48c9fe-9626-4971-9ddb-80ced05f9056 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.778178 Oct 16 01:20:27.211611 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1927/4015] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:20:26 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:27.241753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-427d6e5a-0d61-4cdc-b534-48363f31e288 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:27.250444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-427d6e5a-0d61-4cdc-b534-48363f31e288 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:27.272351 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-427d6e5a-0d61-4cdc-b534-48363f31e288 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.033903 Oct 16 01:20:27.284540 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1928/4016] 10.222.0.39 () {58 vars in 1178 bytes} [Sun Oct 16 01:20:27 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:20:27.296118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:27.309787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab02499c2b64768878fa1d06909e682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3accb70d34644a70a56bab34c8ef57bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:27.316920 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:27.320622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Searching by: {'deleted': False, 'project_id': '0426937b803f46279c2cb410ba6c5de4'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:20:27.327858 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-014dd92b-a51b-4b27-8747-77edff8d009b tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 200 len: 1487 microversion: 2.1 time: 0.379673 Oct 16 01:20:27.350365 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2089/4017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:26 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 1487 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:27.386521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:27.387825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:27.389962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:27.391031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:27.392267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:27.395006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:27.490430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:20:27.600744 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-93f2d908-e662-4d10-8c45-18753018cb5c tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.314937 Oct 16 01:20:27.609760 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1929/4018] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:20:27 2022] GET /compute/v2.1/servers => generated 683 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:27.624352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:27.630432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:27.670544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:27.676639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:27.689747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:27.693772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:27.695165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:27.696186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:27.798959 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] HTTP exception thrown: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Request method failure captured: Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a HTTP/1.1 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1wq_So1gvMBnHSlSa32ExPnat4uHMTt5s9C9XFChQdDpAZpBD1skRVb_p8tukdMu7yFNsB8TIsiXcK76TixWjzTBTeUTE_5DBK_sSxjtcNJbLlpDi8mcDVMmRYSUy8nt6BIBuZJMWd-17Av_WMeZCe0lSacxSGieR-v09JUtA-WSDU Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0426937b803f46279c2cb410ba6c5de4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d5e73ffbd1e84f3a9d1bc147f47b3abe Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: exception: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'dccaf194-81ee-440c-bdcb-eefc6002de8a'} Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:27.814146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:27.817897 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:27.826227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Returning 404 to user: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:27.833977 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f32b03ef-d657-4d9a-8340-b60fa190a4b4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 404 len: 111 microversion: 2.1 time: 0.207858 Oct 16 01:20:27.834603 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2090/4019] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:20:27 2022] DELETE /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:20:27.844228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:27.845363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:27.859932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:27.862134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:27.862769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:27.864721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:27.867771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:27.868437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:27.918182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:20:28.109845 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1db8acd0-6812-468a-afb8-573d0714e36d tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da" status: 204 len: 0 microversion: 2.1 time: 0.270633 Oct 16 01:20:28.110976 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1930/4020] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:20:27 2022] DELETE /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:20:28.121245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:28.122342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:28.149160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.165056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.171804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.172758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.173096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.173687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.213293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5080d0f0-c591-4782-8fa1-48a1c60e5da5 req-52161298-1d58-47c3-8226-5dd4e9ab0a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d1f550-2adf-4b77-a41f-72c5320740bd", "name": "network-vif-deleted", "tag": "e1b13035-db19-496e-8563-0bd48f698b99"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:28.233827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5080d0f0-c591-4782-8fa1-48a1c60e5da5 req-52161298-1d58-47c3-8226-5dd4e9ab0a5e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.234588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5080d0f0-c591-4782-8fa1-48a1c60e5da5 req-52161298-1d58-47c3-8226-5dd4e9ab0a5e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.235411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5080d0f0-c591-4782-8fa1-48a1c60e5da5 req-52161298-1d58-47c3-8226-5dd4e9ab0a5e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.261827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:20:28.264496 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5080d0f0-c591-4782-8fa1-48a1c60e5da5 req-52161298-1d58-47c3-8226-5dd4e9ab0a5e service nova] Creating event network-vif-deleted:e1b13035-db19-496e-8563-0bd48f698b99 for instance 15d1f550-2adf-4b77-a41f-72c5320740bd on n-h1-master-1 Oct 16 01:20:28.276083 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5080d0f0-c591-4782-8fa1-48a1c60e5da5 req-52161298-1d58-47c3-8226-5dd4e9ab0a5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066761 Oct 16 01:20:28.277819 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1931/4021] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:28.364741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:28.366059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] [instance: 15d1f550-2adf-4b77-a41f-72c5320740bd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:28.396817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.400192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.406130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.407110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.407614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.408196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.413777 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:28.429886 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] HTTP exception thrown: Instance 15d1f550-2adf-4b77-a41f-72c5320740bd could not be found. Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Request method failure captured: Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd HTTP/1.1 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1xBPHGAoufg_m9PLjI-9EDo1zgIZOptOR_Co2nxoI588MD0a6ebZEyN0BNTlTDErfe5H1elKIPiUYJ7Zb51SXoEGckpbw4GqKBU0FfL467nmP-yzs01UCcwggMhlR2dp4iVcamQTsZaOY4Up6LfcohaEzBpkSrLgwUn80LXxbcQ8G8 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3accb70d34644a70a56bab34c8ef57bf Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3accb70d34644a70a56bab34c8ef57bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3accb70d34644a70a56bab34c8ef57bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3accb70d34644a70a56bab34c8ef57bf Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1011219157 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-InstanceActionsNegativeTestJSON-1011219157-project Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 8ab02499c2b64768878fa1d06909e682 Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1011219157-project Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 15d1f550-2adf-4b77-a41f-72c5320740bd could not be found. Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '15d1f550-2adf-4b77-a41f-72c5320740bd'} Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d1f550-2adf-4b77-a41f-72c5320740bd could not be found. Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d1f550-2adf-4b77-a41f-72c5320740bd could not be found. Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.433000 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d1f550-2adf-4b77-a41f-72c5320740bd could not be found. Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] Returning 404 to user: Instance 15d1f550-2adf-4b77-a41f-72c5320740bd could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6e653fc4-6687-48dc-a06f-fd4913046169 tempest-InstanceActionsNegativeTestJSON-1011219157 tempest-InstanceActionsNegativeTestJSON-1011219157-project] 10.222.0.39 "GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd" status: 404 len: 111 microversion: 2.1 time: 0.080190 Oct 16 01:20:28.440496 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1932/4022] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:28 2022] GET /compute/v2.1/servers/15d1f550-2adf-4b77-a41f-72c5320740bd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:20:28.502900 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc756c97-cb0d-41c0-8a2c-e2a5200fe37a tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 204 len: 0 microversion: 2.1 time: 0.385862 Oct 16 01:20:28.504306 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2091/4023] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:20:28 2022] DELETE /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:20:28.513035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:28.513797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: dccaf194-81ee-440c-bdcb-eefc6002de8a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:28.525134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.525773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.526668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.531045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.531609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.534097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.580302 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] HTTP exception thrown: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Request method failure captured: Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a HTTP/1.1 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wq_So1gvMBnHSlSa32ExPnat4uHMTt5s9C9XFChQdDpAZpBD1skRVb_p8tukdMu7yFNsB8TIsiXcK76TixWjzTBTeUTE_5DBK_sSxjtcNJbLlpDi8mcDVMmRYSUy8nt6BIBuZJMWd-17Av_WMeZCe0lSacxSGieR-v09JUtA-WSDU Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0426937b803f46279c2cb410ba6c5de4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e73ffbd1e84f3a9d1bc147f47b3abe Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: exception: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'dccaf194-81ee-440c-bdcb-eefc6002de8a'} Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.583939 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.587392 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Returning 404 to user: Instance dccaf194-81ee-440c-bdcb-eefc6002de8a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:28.588928 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1a78435-2f28-422b-938c-2bb9ab81f5a4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a" status: 404 len: 111 microversion: 2.1 time: 0.080250 Oct 16 01:20:28.599490 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:28.600023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:28.608677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.609333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.609769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.610465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.610938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.611362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.612517 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1933/4024] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:28 2022] GET /compute/v2.1/servers/dccaf194-81ee-440c-bdcb-eefc6002de8a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:20:28.785759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:28.800164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:28.818436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.819484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.820287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.833001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.834539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.835598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.862225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] HTTP exception thrown: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Request method failure captured: Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 HTTP/1.1 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1quK-88EgkiO5TBGBFLexlyfjK3lnmLX325Ggj72F7L-6iKiTPDlkvN-zbjPEiELnwkNs8ueigB6RLjPPoANNYKyI_fyeKizzx-MxBjbiSHiqz-elga_F-TWJ-2TELJqVTUm8-ANJFAqjSUYsFmKH2uOPGcyOhZRn8PMlNta08fIiM Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.42 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3078012968784295bc15ee359b50fd67 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3078012968784295bc15ee359b50fd67", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3078012968784295bc15ee359b50fd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3078012968784295bc15ee359b50fd67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3078012968784295bc15ee359b50fd67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3078012968784295bc15ee359b50fd67 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TaggedBootDevicesTest_v242-765513709-project Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 49b3edfc62e747a8a21e76bfde79f40e Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TaggedBootDevicesTest_v242-765513709-project Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3c682283-1fc6-456b-921a-c8644cbba345'} Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:28.865408 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:28.869829 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:28.873052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Returning 404 to user: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:28.874805 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-287f80a2-95b6-4adc-8c22-c6f87ea6e3d4 tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 404 len: 111 microversion: 2.42 time: 0.106437 Oct 16 01:20:28.875900 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1934/4025] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:20:28 2022] DELETE /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:20:28.884608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:28.885583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] [instance: 3c682283-1fc6-456b-921a-c8644cbba345] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:28.912452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.920247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.924401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:28.925631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:28.928455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:28.931372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:29.010061 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] HTTP exception thrown: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Request method failure captured: Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 HTTP/1.1 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1quK-88EgkiO5TBGBFLexlyfjK3lnmLX325Ggj72F7L-6iKiTPDlkvN-zbjPEiELnwkNs8ueigB6RLjPPoANNYKyI_fyeKizzx-MxBjbiSHiqz-elga_F-TWJ-2TELJqVTUm8-ANJFAqjSUYsFmKH2uOPGcyOhZRn8PMlNta08fIiM Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.42 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3078012968784295bc15ee359b50fd67 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3078012968784295bc15ee359b50fd67", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3078012968784295bc15ee359b50fd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3078012968784295bc15ee359b50fd67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3078012968784295bc15ee359b50fd67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3078012968784295bc15ee359b50fd67 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-765513709 Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TaggedBootDevicesTest_v242-765513709-project Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 49b3edfc62e747a8a21e76bfde79f40e Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TaggedBootDevicesTest_v242-765513709-project Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3c682283-1fc6-456b-921a-c8644cbba345'} Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:29.022682 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] Returning 404 to user: Instance 3c682283-1fc6-456b-921a-c8644cbba345 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:29.028874 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fbd6ea26-fc6a-44c8-bb09-b9673ea814ee tempest-TaggedBootDevicesTest_v242-765513709 tempest-TaggedBootDevicesTest_v242-765513709-project] 10.222.0.39 "GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345" status: 404 len: 111 microversion: 2.42 time: 0.144379 Oct 16 01:20:29.030327 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1935/4026] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:28 2022] GET /compute/v2.1/servers/3c682283-1fc6-456b-921a-c8644cbba345 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:20:29.797164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:29.813935 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f4883722-d2ed-4a07-b80f-e009a89f85ed tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da" status: 200 len: 1522 microversion: 2.1 time: 1.219188 Oct 16 01:20:29.827467 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2092/4027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:28 2022] GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da => generated 1522 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:30.848322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:30.849786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:30.870397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:30.871685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:30.874352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:30.876666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:30.877909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:30.882574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:31.463391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:31.473878 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-957ae61e-a7f1-441b-9385-4f532e8b3126 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da" status: 200 len: 1522 microversion: 2.1 time: 0.634843 Oct 16 01:20:31.482833 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1936/4028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:30 2022] GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:32.499269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:32.499944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:32.515043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:32.519640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:32.520474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:32.522709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:32.523735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:32.524569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:33.074634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:33.088904 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aecfa04e-b7ba-4951-9c87-02eee6b76512 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da" status: 200 len: 1522 microversion: 2.1 time: 0.588817 Oct 16 01:20:33.093808 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2093/4029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:32 2022] GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:33.690059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:33.690687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:33.711130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:33.715309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:33.718765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:33.721182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:33.722857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:33.728897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:33.795583 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] HTTP exception thrown: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Request method failure captured: Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb HTTP/1.1 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1vbNBdhJ3iRrLhJ7pPUF1TN375lDQAuTPfgm7lICO2Q1F0Biy4VuDlGALPWWmbRzUUUv48BQe74HJm9fFvRKWxJajzQkH6vvFEfwo4hiJ06MqrXHTBKKZ2Jb6Z6Zkvt5X-N-Viy2I5TSRS1uTdaAoJv9Efy_HreGK9Z5yGdlZohLag Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d22602edce34f6390374c40afcfd113", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d22602edce34f6390374c40afcfd113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1cf0ec54a3f54abd90ece8de2aa70ffc Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '14741b1e-ac5b-4f37-9575-ee65bb41addb'} Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:33.807172 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.812782 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.819884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Returning 404 to user: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:33.821191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-601bbbb5-83ca-4a20-ac5e-d1df52b75c5b tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 404 len: 111 microversion: 2.1 time: 0.135659 Oct 16 01:20:33.825890 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1937/4030] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:20:33 2022] DELETE /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:20:33.831031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:33.838977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 14741b1e-ac5b-4f37-9575-ee65bb41addb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:33.870009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:33.871567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:33.873026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:33.874094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:33.875628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:33.877396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:33.898333 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] HTTP exception thrown: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Request method failure captured: Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb HTTP/1.1 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1vbNBdhJ3iRrLhJ7pPUF1TN375lDQAuTPfgm7lICO2Q1F0Biy4VuDlGALPWWmbRzUUUv48BQe74HJm9fFvRKWxJajzQkH6vvFEfwo4hiJ06MqrXHTBKKZ2Jb6Z6Zkvt5X-N-Viy2I5TSRS1uTdaAoJv9Efy_HreGK9Z5yGdlZohLag Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d22602edce34f6390374c40afcfd113", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d22602edce34f6390374c40afcfd113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1cf0ec54a3f54abd90ece8de2aa70ffc Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '14741b1e-ac5b-4f37-9575-ee65bb41addb'} Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:33.901493 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.905559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.905559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:33.905559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:33.905559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:33.905559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:33.905559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. Oct 16 01:20:33.905559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.908988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Returning 404 to user: Instance 14741b1e-ac5b-4f37-9575-ee65bb41addb could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:33.910140 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2db4e0ef-de38-4bce-8110-44c0129c7818 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb" status: 404 len: 111 microversion: 2.1 time: 0.083675 Oct 16 01:20:33.911459 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2094/4031] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:33 2022] GET /compute/v2.1/servers/14741b1e-ac5b-4f37-9575-ee65bb41addb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:20:33.920179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:33.920950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:33.941430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:33.941924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:33.942379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:33.943141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:33.943678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:33.944030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:33.978437 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] HTTP exception thrown: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Request method failure captured: Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc HTTP/1.1 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1vbNBdhJ3iRrLhJ7pPUF1TN375lDQAuTPfgm7lICO2Q1F0Biy4VuDlGALPWWmbRzUUUv48BQe74HJm9fFvRKWxJajzQkH6vvFEfwo4hiJ06MqrXHTBKKZ2Jb6Z6Zkvt5X-N-Viy2I5TSRS1uTdaAoJv9Efy_HreGK9Z5yGdlZohLag Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d22602edce34f6390374c40afcfd113", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d22602edce34f6390374c40afcfd113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1cf0ec54a3f54abd90ece8de2aa70ffc Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '8833ae34-0f31-4b6e-89f9-9b33f4377cbc'} Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:33.982796 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:33.987382 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:33.991811 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Returning 404 to user: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:33.995135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76c1cbc3-08d4-4e8f-810b-a9f05fed396f tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 404 len: 111 microversion: 2.1 time: 0.080008 Oct 16 01:20:33.996006 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1938/4032] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:20:33 2022] DELETE /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:20:34.006539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:34.007586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] [instance: 8833ae34-0f31-4b6e-89f9-9b33f4377cbc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:34.021168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:34.021810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:34.024431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:34.025311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:34.027612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:34.029735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:34.065089 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] HTTP exception thrown: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Request method failure captured: Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc HTTP/1.1 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1vbNBdhJ3iRrLhJ7pPUF1TN375lDQAuTPfgm7lICO2Q1F0Biy4VuDlGALPWWmbRzUUUv48BQe74HJm9fFvRKWxJajzQkH6vvFEfwo4hiJ06MqrXHTBKKZ2Jb6Z6Zkvt5X-N-Viy2I5TSRS1uTdaAoJv9Efy_HreGK9Z5yGdlZohLag Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1d22602edce34f6390374c40afcfd113", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1d22602edce34f6390374c40afcfd113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1d22602edce34f6390374c40afcfd113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 1d22602edce34f6390374c40afcfd113 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersTestMultiNic-2077507435 Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1cf0ec54a3f54abd90ece8de2aa70ffc Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersTestMultiNic-2077507435-project Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8833ae34-0f31-4b6e-89f9-9b33f4377cbc'} Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:34.068087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:34.072552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:34.072552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:34.072552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:34.072552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:34.072552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:34.072552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. Oct 16 01:20:34.072552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:34.076066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] Returning 404 to user: Instance 8833ae34-0f31-4b6e-89f9-9b33f4377cbc could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:34.078851 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-62fe3ec2-0c5f-49cd-9c31-c036a12bf9b8 tempest-ServersTestMultiNic-2077507435 tempest-ServersTestMultiNic-2077507435-project] 10.222.0.39 "GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc" status: 404 len: 111 microversion: 2.1 time: 0.078076 Oct 16 01:20:34.080917 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2095/4033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:33 2022] GET /compute/v2.1/servers/8833ae34-0f31-4b6e-89f9-9b33f4377cbc => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:20:34.120429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:34.122138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:34.134603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:34.135522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:34.137133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:34.139846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:34.142302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:34.143200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:34.863543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-8812ddf9-3d7a-4db9-b10b-d43a0b24d68e req-f988ebe4-c715-4ea6-a45a-7a617dce7075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299", "name": "network-vif-deleted", "tag": "08313485-f159-4a8e-9a64-8cd1ceaeb548"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:34.878947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8812ddf9-3d7a-4db9-b10b-d43a0b24d68e req-f988ebe4-c715-4ea6-a45a-7a617dce7075 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:34.880275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8812ddf9-3d7a-4db9-b10b-d43a0b24d68e req-f988ebe4-c715-4ea6-a45a-7a617dce7075 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:34.881172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8812ddf9-3d7a-4db9-b10b-d43a0b24d68e req-f988ebe4-c715-4ea6-a45a-7a617dce7075 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:34.921864 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-8812ddf9-3d7a-4db9-b10b-d43a0b24d68e req-f988ebe4-c715-4ea6-a45a-7a617dce7075 service nova] Creating event network-vif-deleted:08313485-f159-4a8e-9a64-8cd1ceaeb548 for instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 on n-h2-master-1 Oct 16 01:20:34.935572 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-8812ddf9-3d7a-4db9-b10b-d43a0b24d68e req-f988ebe4-c715-4ea6-a45a-7a617dce7075 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080060 Oct 16 01:20:34.937068 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2096/4034] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:35.223471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:35.244292 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-60de47a1-82d1-476b-9a86-bcfa2fcb01f4 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da" status: 200 len: 1480 microversion: 2.1 time: 1.126862 Oct 16 01:20:35.245916 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1939/4035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:34 2022] GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da => generated 1480 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:36.275711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:36.278134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:36.282696 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:36.309577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:36.310076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:36.310517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:36.315155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:36.315639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:36.316077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:36.354887 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:36.448192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:36.450231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:36.451138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:36.453231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lazy-loading 'fault' on Instance uuid ad438ca6-c331-4557-aa3d-9d9846ec87da {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:20:36.770345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e73ffbd1e84f3a9d1bc147f47b3abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0426937b803f46279c2cb410ba6c5de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:36.801434 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7418c9a3-984e-4cc2-94ff-a1edf57bb9d1 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da" status: 200 len: 1313 microversion: 2.1 time: 0.533257 Oct 16 01:20:36.801882 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2097/4036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:36 2022] GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:37.116867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2b9eb6cf-6f7e-4507-a9b7-61b6d65b154d req-f4fab7ab-9824-43df-9500-b914359b174a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad438ca6-c331-4557-aa3d-9d9846ec87da", "name": "network-vif-deleted", "tag": "b777e3a4-5f24-46e7-81b2-6c3af4bd4640"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:37.133024 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:37.135219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68424a94-97d1-460e-8ba4-3343079fa915 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: .version_select at 0x7fd65273cdc0>, body: {"keypair": {"name": "tempest-keypair-913309052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs05pvUv2gRNA3RnSKWon6wVa6/SK9iVl5hSYswRky1sfMNeIn5blf+mIFzdOhOYky4uHmc141MGNStx+qLxnPokslTe9d2Rmot3vY1JWfpeGpk9DFXvIh646X0yeQnhQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:37.153186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cf-6f7e-4507-a9b7-61b6d65b154d req-f4fab7ab-9824-43df-9500-b914359b174a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:37.153685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cf-6f7e-4507-a9b7-61b6d65b154d req-f4fab7ab-9824-43df-9500-b914359b174a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:37.158883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2b9eb6cf-6f7e-4507-a9b7-61b6d65b154d req-f4fab7ab-9824-43df-9500-b914359b174a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:37.179913 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-68424a94-97d1-460e-8ba4-3343079fa915 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for project e664ea80daaf450886978f25b2d9e373. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:20:37.205406 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2b9eb6cf-6f7e-4507-a9b7-61b6d65b154d req-f4fab7ab-9824-43df-9500-b914359b174a service nova] Creating event network-vif-deleted:b777e3a4-5f24-46e7-81b2-6c3af4bd4640 for instance ad438ca6-c331-4557-aa3d-9d9846ec87da on n-h2-master-1 Oct 16 01:20:37.212085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-68424a94-97d1-460e-8ba4-3343079fa915 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for user d5e97960c4eb488b900951e0898f34c8 and project e664ea80daaf450886978f25b2d9e373. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:20:37.212892 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2b9eb6cf-6f7e-4507-a9b7-61b6d65b154d req-f4fab7ab-9824-43df-9500-b914359b174a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104532 Oct 16 01:20:37.213510 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1940/4037] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:20:37.292203 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68424a94-97d1-460e-8ba4-3343079fa915 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161347 Oct 16 01:20:37.293732 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2098/4038] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:20:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:20:37.831361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:37.832079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: ad438ca6-c331-4557-aa3d-9d9846ec87da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:37.856151 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:37.863735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:37.870308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:37.870822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:37.873101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:37.873605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:37.874050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:37.920840 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] HTTP exception thrown: Instance ad438ca6-c331-4557-aa3d-9d9846ec87da could not be found. Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Request method failure captured: Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da HTTP/1.1 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wq_So1gvMBnHSlSa32ExPnat4uHMTt5s9C9XFChQdDpAZpBD1skRVb_p8tukdMu7yFNsB8TIsiXcK76TixWjzTBTeUTE_5DBK_sSxjtcNJbLlpDi8mcDVMmRYSUy8nt6BIBuZJMWd-17Av_WMeZCe0lSacxSGieR-v09JUtA-WSDU Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0426937b803f46279c2cb410ba6c5de4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e73ffbd1e84f3a9d1bc147f47b3abe Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ad438ca6-c331-4557-aa3d-9d9846ec87da could not be found. Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ad438ca6-c331-4557-aa3d-9d9846ec87da'} Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad438ca6-c331-4557-aa3d-9d9846ec87da could not be found. Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad438ca6-c331-4557-aa3d-9d9846ec87da could not be found. Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:37.927103 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad438ca6-c331-4557-aa3d-9d9846ec87da could not be found. Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Returning 404 to user: Instance ad438ca6-c331-4557-aa3d-9d9846ec87da could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:37.935234 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1de0ca61-bd4d-435d-adf5-04c4ca3e8248 tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da" status: 404 len: 111 microversion: 2.1 time: 0.106179 Oct 16 01:20:37.935854 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1941/4039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:37 2022] GET /compute/v2.1/servers/ad438ca6-c331-4557-aa3d-9d9846ec87da => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:20:37.941957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:37.942584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] [instance: 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:37.963344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:37.963861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:37.964907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:37.965757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:37.980875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:37.981792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:38.019645 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] HTTP exception thrown: Instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 could not be found. Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Request method failure captured: Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 HTTP/1.1 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1wq_So1gvMBnHSlSa32ExPnat4uHMTt5s9C9XFChQdDpAZpBD1skRVb_p8tukdMu7yFNsB8TIsiXcK76TixWjzTBTeUTE_5DBK_sSxjtcNJbLlpDi8mcDVMmRYSUy8nt6BIBuZJMWd-17Av_WMeZCe0lSacxSGieR-v09JUtA-WSDU Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0426937b803f46279c2cb410ba6c5de4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0426937b803f46279c2cb410ba6c5de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 0426937b803f46279c2cb410ba6c5de4 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1624257462 Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d5e73ffbd1e84f3a9d1bc147f47b3abe Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ListServersNegativeTestJSON-1624257462-project Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 could not be found. Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299'} Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 could not be found. Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 could not be found. Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:38.023744 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:20:38.028572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:38.028572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:20:38.028572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:20:38.028572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:20:38.028572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:20:38.028572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:20:38.028572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 could not be found. Oct 16 01:20:38.028572 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:20:38.031033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] Returning 404 to user: Instance 6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:20:38.033701 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa7da9c7-1d52-4475-83e8-3e00f62f761e tempest-ListServersNegativeTestJSON-1624257462 tempest-ListServersNegativeTestJSON-1624257462-project] 10.222.0.39 "GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299" status: 404 len: 111 microversion: 2.1 time: 0.096130 Oct 16 01:20:38.034904 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2099/4040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:37 2022] GET /compute/v2.1/servers/6e7d6c2f-b4a0-4e90-86a9-154d5ec0c299 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:20:38.502689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:38.503230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:38.510771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:38.511631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:38.512268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:38.513367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:38.513977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:38.514686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:38.546840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:20:38.711709 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9f82cead-8fbd-4e15-8e2e-284c245ffd4e tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 204 len: 0 microversion: 2.32 time: 0.584338 Oct 16 01:20:38.712861 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1942/4041] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:20:38 2022] DELETE /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:20:38.723465 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:38.724716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:38.735531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:38.738752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:38.739396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:38.742149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:38.742987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:38.746653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:40.860530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:40.875996 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:40.880358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:40.881894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60892f7d-5665-4b5c-8681-41ad561f63c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2958 microversion: 2.32 time: 2.164115 Oct 16 01:20:40.892312 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2100/4042] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:38 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2958 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:20:41.920141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:41.921474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:41.946574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:41.947106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:41.947544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:41.948248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:41.948897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:41.949322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:43.030970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:43.056572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:43.062581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:43.066495 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-457e6d89-e467-4046-89c4-d8e405b6f0bc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2958 microversion: 2.32 time: 1.151399 Oct 16 01:20:43.069881 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1943/4043] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:41 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2958 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:44.100579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:44.102055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:44.125087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:44.126788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:44.128778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:44.130657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:44.139910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:44.142429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:46.555582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:46.576086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:46.577798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:46.579791 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2caea98-2c5f-4899-b950-7ccb88081322 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2937 microversion: 2.32 time: 2.483464 Oct 16 01:20:46.598961 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2101/4044] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:44 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2937 bytes in 2488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:46.656507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1dfaf639-2f86-46b4-b629-d3520939d910 req-bae209f9-fded-40d5-96e1-85984d0c8ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-unplugged", "status": "completed", "tag": "6226c3c9-8fe3-4a03-a63f-47872bcfc9d2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:46.705014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1dfaf639-2f86-46b4-b629-d3520939d910 req-bae209f9-fded-40d5-96e1-85984d0c8ea3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:46.707621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1dfaf639-2f86-46b4-b629-d3520939d910 req-bae209f9-fded-40d5-96e1-85984d0c8ea3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:46.708162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1dfaf639-2f86-46b4-b629-d3520939d910 req-bae209f9-fded-40d5-96e1-85984d0c8ea3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:46.739289 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1dfaf639-2f86-46b4-b629-d3520939d910 req-bae209f9-fded-40d5-96e1-85984d0c8ea3 service nova] Creating event network-vif-unplugged:6226c3c9-8fe3-4a03-a63f-47872bcfc9d2 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:20:46.755992 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1dfaf639-2f86-46b4-b629-d3520939d910 req-bae209f9-fded-40d5-96e1-85984d0c8ea3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106967 Oct 16 01:20:46.757192 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1944/4045] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:47.173193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1090122193", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52e8b52a-a014-46fd-b3eb-a7709906aae7"}], "security_groups": [{"name": "tempest-securitygroup--144313405"}], "key_name": "tempest-keypair-913309052", "user_data": "}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:47.235366 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:47.527999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] validate_networks() for [('52e8b52a-a014-46fd-b3eb-a7709906aae7', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:20:47.618482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:47.619467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:47.639767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:47.640427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:47.641080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:47.642788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:47.643405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:47.644224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:48.614254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:48.626204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:48.640286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:48.641858 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ca3125f-5796-48d6-a659-8c428d5b4f91 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2916 microversion: 2.32 time: 1.029911 Oct 16 01:20:48.654950 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1945/4046] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:47 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2916 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:48.847453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-71b2bc03-c945-402a-abd5-e417747a9d52 req-3e633c7d-51bf-4d54-89a0-e061ce289624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-unplugged", "status": "completed", "tag": "c8ad3925-dc7f-4b61-a13a-cc7ae0c226c4"}, {"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-unplugged", "status": "completed", "tag": "79104e9d-c9a5-4a7e-a71d-9b185dcbe67f"}, {"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-unplugged", "status": "completed", "tag": "bdeecbcc-2073-44c7-b6bc-319fee13943b"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:48.884308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71b2bc03-c945-402a-abd5-e417747a9d52 req-3e633c7d-51bf-4d54-89a0-e061ce289624 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:48.885077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71b2bc03-c945-402a-abd5-e417747a9d52 req-3e633c7d-51bf-4d54-89a0-e061ce289624 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:48.885629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71b2bc03-c945-402a-abd5-e417747a9d52 req-3e633c7d-51bf-4d54-89a0-e061ce289624 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:48.928031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-71b2bc03-c945-402a-abd5-e417747a9d52 req-3e633c7d-51bf-4d54-89a0-e061ce289624 service nova] Creating event network-vif-unplugged:c8ad3925-dc7f-4b61-a13a-cc7ae0c226c4 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:20:48.939080 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-71b2bc03-c945-402a-abd5-e417747a9d52 req-3e633c7d-51bf-4d54-89a0-e061ce289624 service nova] Creating event network-vif-unplugged:79104e9d-c9a5-4a7e-a71d-9b185dcbe67f for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:20:48.939722 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-71b2bc03-c945-402a-abd5-e417747a9d52 req-3e633c7d-51bf-4d54-89a0-e061ce289624 service nova] Creating event network-vif-unplugged:bdeecbcc-2073-44c7-b6bc-319fee13943b for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:20:48.956865 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-71b2bc03-c945-402a-abd5-e417747a9d52 req-3e633c7d-51bf-4d54-89a0-e061ce289624 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.113307 Oct 16 01:20:48.958699 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1946/4047] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:20:49.681005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:49.682656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:49.703352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:49.704117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:49.705977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:49.719900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:49.724309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:49.725043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:50.923704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:20:50.924209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:20:50.927215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:20:50.927708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:20:50.942041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:20:50.993313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:50.999371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:51.006402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:51.008745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:51.013812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:51.015120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:51.114719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for project e664ea80daaf450886978f25b2d9e373. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:20:51.145338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for user d5e97960c4eb488b900951e0898f34c8 and project e664ea80daaf450886978f25b2d9e373. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:20:51.202570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:20:51.205484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:20:51.354069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eca9f17f-8f43-4398-ba3f-f7fc63007638 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.183578 Oct 16 01:20:51.355511 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2102/4048] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:20:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 4190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:20:51.362029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5d23c17f-c5a8-42fa-8fec-851ad7dce2e5 req-c788422d-eb63-48fe-b0d7-e9f80dfedbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-deleted", "tag": "6ae41fd0-83d8-42e9-b4e5-8d61d0a332d2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:51.399544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d23c17f-c5a8-42fa-8fec-851ad7dce2e5 req-c788422d-eb63-48fe-b0d7-e9f80dfedbee service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:51.400317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d23c17f-c5a8-42fa-8fec-851ad7dce2e5 req-c788422d-eb63-48fe-b0d7-e9f80dfedbee service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:51.401895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d23c17f-c5a8-42fa-8fec-851ad7dce2e5 req-c788422d-eb63-48fe-b0d7-e9f80dfedbee service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:51.417611 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5d23c17f-c5a8-42fa-8fec-851ad7dce2e5 req-c788422d-eb63-48fe-b0d7-e9f80dfedbee service nova] Creating event network-vif-deleted:6ae41fd0-83d8-42e9-b4e5-8d61d0a332d2 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:20:51.435749 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5d23c17f-c5a8-42fa-8fec-851ad7dce2e5 req-c788422d-eb63-48fe-b0d7-e9f80dfedbee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077139 Oct 16 01:20:51.442845 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2103/4049] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:51.465567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ecdcc901-95f5-45b8-96cb-2289b04bf321 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:51.474359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ecdcc901-95f5-45b8-96cb-2289b04bf321 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:51.670681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ecdcc901-95f5-45b8-96cb-2289b04bf321 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:51.680337 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ecdcc901-95f5-45b8-96cb-2289b04bf321 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1241 microversion: 2.1 time: 0.234104 Oct 16 01:20:51.698878 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2104/4050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:51 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1241 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:51.730569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:51.741457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:51.754151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:51.756249 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d5cb812-41a0-46a6-8a87-e610a10d9e84 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2869 microversion: 2.32 time: 2.080929 Oct 16 01:20:51.757104 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1947/4051] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:49 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2869 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:20:52.738331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:52.744635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:52.790630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:52.791422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:52.817193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:52.822505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:52.824979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:52.825592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:52.826250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:52.827095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:52.827505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:52.828196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:52.828637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:52.830941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:52.837055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:52.837606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:53.113914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:53.149377 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-642f167a-9f03-4039-b34e-c3814bff9054 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1237 microversion: 2.1 time: 0.425380 Oct 16 01:20:53.150544 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2105/4052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:52 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1237 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:53.374307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:53.395881 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:53.405978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:53.411126 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bb9f766-eb18-4f9b-afbb-52ed7241a403 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2535 microversion: 2.32 time: 0.623937 Oct 16 01:20:53.429584 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1948/4053] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:52 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2535 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:53.735408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9de0d2ee-dcdd-4cd2-aeba-b1eca4774287 req-ff913d11-84a2-4e2b-a8f2-0cf0d208e952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-deleted", "tag": "c8ad3925-dc7f-4b61-a13a-cc7ae0c226c4"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:53.772508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9de0d2ee-dcdd-4cd2-aeba-b1eca4774287 req-ff913d11-84a2-4e2b-a8f2-0cf0d208e952 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:53.772508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9de0d2ee-dcdd-4cd2-aeba-b1eca4774287 req-ff913d11-84a2-4e2b-a8f2-0cf0d208e952 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:53.772508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9de0d2ee-dcdd-4cd2-aeba-b1eca4774287 req-ff913d11-84a2-4e2b-a8f2-0cf0d208e952 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:53.811151 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9de0d2ee-dcdd-4cd2-aeba-b1eca4774287 req-ff913d11-84a2-4e2b-a8f2-0cf0d208e952 service nova] Creating event network-vif-deleted:c8ad3925-dc7f-4b61-a13a-cc7ae0c226c4 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:20:53.818191 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9de0d2ee-dcdd-4cd2-aeba-b1eca4774287 req-ff913d11-84a2-4e2b-a8f2-0cf0d208e952 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086732 Oct 16 01:20:53.819658 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2106/4054] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:54.176181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:54.178719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:54.197724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:54.200286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:54.203365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:54.204745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:54.206667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:54.207443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:54.393332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:54.401598 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-091b5511-cf81-4ff7-a36e-12953e59f23e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1299 microversion: 2.1 time: 0.230741 Oct 16 01:20:54.402856 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1949/4055] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:54 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:54.447470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:54.449135 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:54.458750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:54.459649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:54.460298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:54.463397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:54.474183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:54.474900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:54.976468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:54.986520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:54.988235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:54.989598 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff9c4450-6fe1-498f-9c67-5191cabdf00f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2375 microversion: 2.32 time: 0.547591 Oct 16 01:20:54.990442 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2107/4056] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:54 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2375 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:55.430480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:55.431114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:55.439603 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:55.441453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:55.445504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:55.447399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:55.451937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:55.452618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:55.454691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:55.581981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:55.602026 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-04b6b21f-1a8a-4f15-860b-98277802c199 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1299 microversion: 2.1 time: 0.174879 Oct 16 01:20:55.605387 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1950/4057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:55 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:20:55.864908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-67faa71f-fc04-4f61-8101-077fe9132403 req-92c1ab28-530f-415c-9510-67f4453165d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-deleted", "tag": "79104e9d-c9a5-4a7e-a71d-9b185dcbe67f"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:55.912988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-67faa71f-fc04-4f61-8101-077fe9132403 req-92c1ab28-530f-415c-9510-67f4453165d8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:55.913808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-67faa71f-fc04-4f61-8101-077fe9132403 req-92c1ab28-530f-415c-9510-67f4453165d8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:55.914622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-67faa71f-fc04-4f61-8101-077fe9132403 req-92c1ab28-530f-415c-9510-67f4453165d8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:55.920647 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:55.936054 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-67faa71f-fc04-4f61-8101-077fe9132403 req-92c1ab28-530f-415c-9510-67f4453165d8 service nova] Creating event network-vif-deleted:79104e9d-c9a5-4a7e-a71d-9b185dcbe67f for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:20:55.962047 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-67faa71f-fc04-4f61-8101-077fe9132403 req-92c1ab28-530f-415c-9510-67f4453165d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107644 Oct 16 01:20:55.962990 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2108/4058] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:56.021275 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:56.021797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:56.033540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:56.035193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:56.037355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:56.040058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:56.040729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:56.042473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:56.629216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:56.629963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:56.656634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:56.661326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:56.662390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:56.663510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:56.671670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:56.672296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:56.811742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:56.829118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:56.832286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:56.836293 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a63f2c6-538f-456e-b1b3-390992236f98 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2614 microversion: 2.32 time: 0.818858 Oct 16 01:20:56.856032 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1951/4059] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:56 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2614 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:56.932495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:56.942181 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1535f7b9-df09-4ec4-b8d5-7659feda144f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1299 microversion: 2.1 time: 0.320045 Oct 16 01:20:56.942797 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2109/4060] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:56 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1299 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:57.869246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:57.871005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:57.904206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:57.904854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:57.905549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:57.906336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:57.906861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:57.907551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:57.967023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:57.967023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:57.983346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:57.985278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:57.986163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:57.990881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:57.993562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:57.994438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:58.704429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:58.707130 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:20:58.720677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:58.728786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:58.730544 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f03bc001-c081-4578-9c7a-586e4877035d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 2614 microversion: 2.32 time: 0.865291 Oct 16 01:20:58.735831 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1952/4061] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:57 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 2614 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:20:58.755804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a99b5646-f637-4268-a7c2-4248a1c77c76 req-764c0de1-62bf-4e60-95cc-9c9dab515970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-deleted", "tag": "bdeecbcc-2073-44c7-b6bc-319fee13943b"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:20:58.781629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a99b5646-f637-4268-a7c2-4248a1c77c76 req-764c0de1-62bf-4e60-95cc-9c9dab515970 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:58.782372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a99b5646-f637-4268-a7c2-4248a1c77c76 req-764c0de1-62bf-4e60-95cc-9c9dab515970 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:58.783028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a99b5646-f637-4268-a7c2-4248a1c77c76 req-764c0de1-62bf-4e60-95cc-9c9dab515970 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:58.824967 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a99b5646-f637-4268-a7c2-4248a1c77c76 req-764c0de1-62bf-4e60-95cc-9c9dab515970 service nova] Creating event network-vif-deleted:bdeecbcc-2073-44c7-b6bc-319fee13943b for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:20:58.846059 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a99b5646-f637-4268-a7c2-4248a1c77c76 req-764c0de1-62bf-4e60-95cc-9c9dab515970 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102100 Oct 16 01:20:58.847022 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1953/4062] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:20:59.203763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:20:59.216779 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0b5c4c04-3f50-42db-8dc1-2d885e5ee785 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 1.254744 Oct 16 01:20:59.217380 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2110/4063] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:20:57 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:20:59.773816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:20:59.774888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:20:59.805245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:59.807091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:59.809705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:20:59.812067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:20:59.815247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:20:59.819335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:00.084736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:00.110873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:00.112355 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:00.113572 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a55eef4-e4a9-4f7b-b8d9-83e436d09758 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.353902 Oct 16 01:21:00.114146 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1954/4064] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:20:59 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:00.245084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:00.246268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:00.269318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:00.270567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:00.271047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:00.271786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:00.274739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:00.275318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:00.989316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c34e0a6a-6bc4-4d0e-b8b8-51d1bbe4dded req-d1eaa2ae-5ea4-4bb1-a90e-375d34f7369b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3857ab8b-c66f-4628-8e54-51092247f966", "name": "network-vif-deleted", "tag": "6226c3c9-8fe3-4a03-a63f-47872bcfc9d2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:01.031232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c34e0a6a-6bc4-4d0e-b8b8-51d1bbe4dded req-d1eaa2ae-5ea4-4bb1-a90e-375d34f7369b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:01.034550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c34e0a6a-6bc4-4d0e-b8b8-51d1bbe4dded req-d1eaa2ae-5ea4-4bb1-a90e-375d34f7369b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:01.035319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c34e0a6a-6bc4-4d0e-b8b8-51d1bbe4dded req-d1eaa2ae-5ea4-4bb1-a90e-375d34f7369b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:01.070963 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:01.078393 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c34e0a6a-6bc4-4d0e-b8b8-51d1bbe4dded req-d1eaa2ae-5ea4-4bb1-a90e-375d34f7369b service nova] Creating event network-vif-deleted:6226c3c9-8fe3-4a03-a63f-47872bcfc9d2 for instance 3857ab8b-c66f-4628-8e54-51092247f966 on n-h2-master-1 Oct 16 01:21:01.100997 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c34e0a6a-6bc4-4d0e-b8b8-51d1bbe4dded req-d1eaa2ae-5ea4-4bb1-a90e-375d34f7369b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117636 Oct 16 01:21:01.103909 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1955/4065] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:21:01.150966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:01.151774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:01.173401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:01.178977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:01.181167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:01.182131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:01.184786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:01.185821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:01.241133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:01.257396 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-33259b6b-f490-480f-aa12-e164f5159079 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 1.011604 Oct 16 01:21:01.280595 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2111/4066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:00 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:01.532988 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:01.560373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:01.567463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:01.569228 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd1d18c3-db1e-4c0f-8f08-45f795ba6c78 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.424223 Oct 16 01:21:01.574747 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1956/4067] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:01 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:02.287638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:02.288347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:02.291669 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:02.310880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:02.312862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:02.313392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:02.315286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:02.316527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:02.317715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:02.608030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:02.609027 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:02.626615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:02.627329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:02.628394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:02.629303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:02.631216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:02.635112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:03.565967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:03.581353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13c99ec8-4828-49c6-aa8b-4e7ead988df4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 1.297055 Oct 16 01:21:03.602702 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2112/4068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:02 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:03.766605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0ae8b256-19b3-453b-b340-e0217f39cac2 req-272aa3a7-557b-4074-893a-79201d7cb5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a7fde5-97e2-4522-a0ae-d0dc4840c4e7", "tag": "b08bba39-0150-4cba-9513-e18882e63c64"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:03.788076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0ae8b256-19b3-453b-b340-e0217f39cac2 req-272aa3a7-557b-4074-893a-79201d7cb5a6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:03.793047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0ae8b256-19b3-453b-b340-e0217f39cac2 req-272aa3a7-557b-4074-893a-79201d7cb5a6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:03.794431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0ae8b256-19b3-453b-b340-e0217f39cac2 req-272aa3a7-557b-4074-893a-79201d7cb5a6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:03.827685 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0ae8b256-19b3-453b-b340-e0217f39cac2 req-272aa3a7-557b-4074-893a-79201d7cb5a6 service nova] Creating event network-changed:b08bba39-0150-4cba-9513-e18882e63c64 for instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 on n-h1-master-1 Oct 16 01:21:03.843020 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0ae8b256-19b3-453b-b340-e0217f39cac2 req-272aa3a7-557b-4074-893a-79201d7cb5a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079517 Oct 16 01:21:03.844402 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2113/4069] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:03.934810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:03.955405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:03.957219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:03.958471 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f0ea88ac-3aab-4e13-b1a7-f8b47f8d6cce tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 1.365643 Oct 16 01:21:03.979521 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1957/4070] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:02 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:21:04.567842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1749187164", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:04.611156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:04.611968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:04.624423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:04.627334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:04.627903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:04.628739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:04.634185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:04.634775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:04.677410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] validate_networks() for [('901ba43b-4c2b-46ff-b843-85ea6b7c9f5c', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:21:05.081786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:05.097207 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a9ac2e87-60f9-46cf-97ca-e0f3121e5ccd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 0.489872 Oct 16 01:21:05.108493 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1958/4071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:04 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:05.116814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:05.120162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:05.134166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:05.136742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:05.140387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:05.142616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:05.144079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:05.146177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:05.490184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:05.505688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:05.519198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:05.522113 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-55a5890b-67a5-43f8-8425-cdf63e44ac55 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.411426 Oct 16 01:21:05.523118 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1959/4072] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:05 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:06.136270 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:06.136969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:06.155347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:06.156012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:06.157964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:06.158720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:06.159207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:06.159635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:06.732549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:21:06.732549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:21:06.732549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:21:06.733763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:21:06.733763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:21:06.735833 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:06.758211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:06.758707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:06.759169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:06.759896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:06.764083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:06.772848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:06.832917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Getting quotas for project 07213ca67c6a4616babc77d721d2cae5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:21:06.839704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Getting quotas for user 7e7cdaa2d85d4ce698950075b98d5eb8 and project 07213ca67c6a4616babc77d721d2cae5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:21:06.866832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:21:06.878633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:21:06.974000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:06.983441 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bd0a0a54-e9e7-4a8a-bca1-b3b7ce7633b6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 0.851598 Oct 16 01:21:06.995862 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1960/4073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:06 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:07.007025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:07.015128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:07.053252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:07.054463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:07.059136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:07.060403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:07.063481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:07.067826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:07.105965 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3ded1cb9-c95d-4346-a15a-42c179123c03 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.837098 Oct 16 01:21:07.110668 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2114/4074] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:21:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:21:07.124203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9deaa9db-d796-4a13-8d6d-aa33512574dc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:07.126737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9deaa9db-d796-4a13-8d6d-aa33512574dc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:07.455121 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:07.472506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:07.497582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:07.520974 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f395f149-cdae-4a78-b4c8-c28217e7b316 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.522144 Oct 16 01:21:07.522426 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1961/4075] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:06 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:07.913185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9deaa9db-d796-4a13-8d6d-aa33512574dc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:07.926332 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9deaa9db-d796-4a13-8d6d-aa33512574dc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1222 microversion: 2.1 time: 0.808669 Oct 16 01:21:07.938665 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2115/4076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:07 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1222 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:08.019916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:08.025152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:08.066889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:08.067452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:08.067905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:08.068646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:08.069101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:08.069528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:08.145876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2062593399", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:08.295531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] validate_networks() for [('901ba43b-4c2b-46ff-b843-85ea6b7c9f5c', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:21:09.483359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:09.496398 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3cc16f2b-0128-4230-91c3-78acb3772cfc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 1.480263 Oct 16 01:21:09.503848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1962/4077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:08 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:09.536723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:09.537419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:09.577925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:09.578632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:09.579277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:09.580151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:09.580766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:09.583590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:10.119265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:10.155209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:10.155209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:10.155209 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-78ab9867-bd64-40ba-bbe9-ef3a0d0b249d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.649739 Oct 16 01:21:10.157000 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1963/4078] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:09 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:10.536334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:10.537150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:10.567777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:10.568553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:10.569244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:10.570564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:10.571270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:10.572086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:11.154280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:21:11.155014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:21:11.155872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:21:11.156505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:21:11.157334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:21:11.197020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:11.199655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:11.200408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:11.203389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:11.208331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:11.209308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:11.319846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Getting quotas for project 07213ca67c6a4616babc77d721d2cae5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:21:11.343137 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Getting quotas for user 7e7cdaa2d85d4ce698950075b98d5eb8 and project 07213ca67c6a4616babc77d721d2cae5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:21:11.380615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:21:11.382800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:21:11.496420 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3febb0b9-7af1-4cec-86f5-47a8e7ddfadf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.355304 Oct 16 01:21:11.500658 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2116/4079] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:21:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 3360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:21:11.511408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:11.514626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:11.530669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:11.531373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:11.535037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:11.535967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:11.537737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:11.538417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:11.894900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:11.907812 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9834f21-936b-4b25-b596-5924fb1304db tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 1.379478 Oct 16 01:21:11.911456 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1964/4080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:10 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:11.923075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-93dc5e0f-735a-421e-a98b-e8308aaaaf02 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:11.926082 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-93dc5e0f-735a-421e-a98b-e8308aaaaf02 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:11.965477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:11.977387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:11.988669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:11.989938 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cc9b2c8-9766-4a16-be5b-9a3dd409a4aa tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.488229 Oct 16 01:21:11.995634 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2117/4081] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:11 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:12.033884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-93dc5e0f-735a-421e-a98b-e8308aaaaf02 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:12.042790 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-93dc5e0f-735a-421e-a98b-e8308aaaaf02 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1222 microversion: 2.1 time: 0.128787 Oct 16 01:21:12.043418 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1965/4082] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:11 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:12.906403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9706775d-f57b-4246-8076-f26eda831f64 req-19c7218f-6abf-4586-8554-7ceef86132f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a7fde5-97e2-4522-a0ae-d0dc4840c4e7", "name": "network-vif-plugged", "status": "completed", "tag": "b08bba39-0150-4cba-9513-e18882e63c64"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:12.938910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:12.939556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:12.973522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:12.974076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:12.977154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:12.981154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:12.986298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9706775d-f57b-4246-8076-f26eda831f64 req-19c7218f-6abf-4586-8554-7ceef86132f7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:12.987265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:12.987805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:12.989949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9706775d-f57b-4246-8076-f26eda831f64 req-19c7218f-6abf-4586-8554-7ceef86132f7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:12.990454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9706775d-f57b-4246-8076-f26eda831f64 req-19c7218f-6abf-4586-8554-7ceef86132f7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:13.035114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9706775d-f57b-4246-8076-f26eda831f64 req-19c7218f-6abf-4586-8554-7ceef86132f7 service nova] Creating event network-vif-plugged:b08bba39-0150-4cba-9513-e18882e63c64 for instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 on n-h1-master-1 Oct 16 01:21:13.050411 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9706775d-f57b-4246-8076-f26eda831f64 req-19c7218f-6abf-4586-8554-7ceef86132f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280680 Oct 16 01:21:13.051064 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2118/4083] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:13.067223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:13.071623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:13.088227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:13.090651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:13.092049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:13.093505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:13.094144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:13.094738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:13.469489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:13.503651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:13.504617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:13.507206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4814f790-2e02-436f-af1c-1ca108b849cc tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.452475 Oct 16 01:21:13.511958 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2119/4084] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:13 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:13.561305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:13.569016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:13.597538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:13.598425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:13.599158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:13.601114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:13.603019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:13.603834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:13.794750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:13.804242 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d8b5c78c-79ca-4cd6-bacf-65f9dcc8efc1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1282 microversion: 2.1 time: 0.270019 Oct 16 01:21:13.810217 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2120/4085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:13 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:13.814714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:13.824691 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-036d850e-e831-47e8-8c83-919b0458a309 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 0.892290 Oct 16 01:21:13.837282 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1966/4086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:12 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:14.537124 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:14.541812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:14.584214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:14.585802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:14.586481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:14.588057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:14.589309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:14.590187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:14.811138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:14.834278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:14.835235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:14.844241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:14.852796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:14.856315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:14.860357 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7dec9860-fc04-4c16-9616-04d3573faa8d tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.328116 Oct 16 01:21:14.861276 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2121/4087] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:14 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:14.862149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:14.868932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:14.877169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:14.878009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:14.881926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:14.882794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:14.900641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:14.923569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:14.924800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:14.927530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:14.928402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:14.929235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:14.934263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:15.287360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:15.303965 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bee00957-a191-49bd-9fa4-3c39ade76cb3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1280 microversion: 2.1 time: 0.471779 Oct 16 01:21:15.312113 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1967/4088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:14 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1280 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:15.624021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:15.633200 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-02ee2056-0d90-4a5b-b91c-6a4eebdad23b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1366 microversion: 2.1 time: 0.763016 Oct 16 01:21:15.639894 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2122/4089] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:14 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1366 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:15.889230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:15.890575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:15.901551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:15.902386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:15.913379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:15.914507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:15.915386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:15.916056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:16.104437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:16.115274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:16.123507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:16.132307 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f80736b8-9fce-4d3a-b20f-dc790086b828 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.246903 Oct 16 01:21:16.133645 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1968/4090] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:15 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:16.330329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:16.331448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:16.350967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:16.351872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:16.352558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:16.353507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:16.355280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:16.355976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:16.576644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:16.601398 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b865ca05-d48f-40ab-a5fb-247789e2492b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1280 microversion: 2.1 time: 0.274801 Oct 16 01:21:16.603778 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2123/4091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:16 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:16.674470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:16.676687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:16.705230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:16.705756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:16.706571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:16.707374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:16.708205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:16.708867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:17.645870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-55b52112-c9bd-4e38-a6d7-f4adbef0d364 req-85636bb1-8bcb-45a3-8ee9-7380b5a3992c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3", "tag": "595c74cb-9d14-4532-89c6-65f21df76a64"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:17.662401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-55b52112-c9bd-4e38-a6d7-f4adbef0d364 req-85636bb1-8bcb-45a3-8ee9-7380b5a3992c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:17.662861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-55b52112-c9bd-4e38-a6d7-f4adbef0d364 req-85636bb1-8bcb-45a3-8ee9-7380b5a3992c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:17.663316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-55b52112-c9bd-4e38-a6d7-f4adbef0d364 req-85636bb1-8bcb-45a3-8ee9-7380b5a3992c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:17.685506 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-55b52112-c9bd-4e38-a6d7-f4adbef0d364 req-85636bb1-8bcb-45a3-8ee9-7380b5a3992c service nova] Creating event network-changed:595c74cb-9d14-4532-89c6-65f21df76a64 for instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 on n-h2-master-1 Oct 16 01:21:17.696779 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-55b52112-c9bd-4e38-a6d7-f4adbef0d364 req-85636bb1-8bcb-45a3-8ee9-7380b5a3992c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.688897 Oct 16 01:21:17.697398 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2124/4092] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:21:17.705622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:17.706529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:17.713470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:17.714530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:17.715381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:17.716268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:17.716877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:17.717479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:18.347957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:18.353169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:18.365558 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e884aed-2c8c-4ae8-8043-7a3fefeebb9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1556 microversion: 2.1 time: 1.705163 Oct 16 01:21:18.368694 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1969/4093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:16 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1556 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:18.390949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:18.391516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:18.392314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:18.395007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:18.396738 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f207392-9362-4c6a-a226-db9c990c579b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.695289 Oct 16 01:21:18.398187 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2125/4094] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:17 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:18.404646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:18.405408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:18.405685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:18.405901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:18.406330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:18.407074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:18.407523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:18.408117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:18.414039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:18.424365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:18.425927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:18.427037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:18.427762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:18.428417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:19.508131 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-16ded5e1-4ad9-4da5-8812-74edc11fb43f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.108472 Oct 16 01:21:19.510317 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2126/4095] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:21:18 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7/os-interface => generated 284 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:19.516956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:19.517782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:19.542562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:19.544657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:19.547513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:19.548594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:19.550667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:19.562136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:19.980353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:19.996818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:19.999107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:20.002433 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ae1312d1-0ca1-4cd5-bfb1-876d4a7a0a89 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.490383 Oct 16 01:21:20.007332 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2127/4096] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:19 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:20.026826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:20.048883 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82d699a5-f60f-4031-bfe7-955c6f6efd73 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 1.678415 Oct 16 01:21:20.049870 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1970/4097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:18 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:21.038111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:21.039298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:21.065633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:21.066138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:21.068822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:21.069583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:21.070288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:21.074937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:21.078319 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:21.079106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:21.097142 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:21.098187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:21.098898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:21.100164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:21.101022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:21.101704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:21.282902 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:21.331026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:21.345711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:21.352047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:21.360955 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f984f927-1289-4fbc-b221-6fab711e7586 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.326885 Oct 16 01:21:21.363505 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2128/4098] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:21 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:21.366189 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=14 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:21.380637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d20f1f66-e9f3-4cff-b840-5d588ad37493 req-554b255e-b1cb-495f-84ef-a3c4ea141404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37681f89-f769-4371-9f0f-b51aed53f622", "tag": "f1fac4ee-7e70-46bf-9a5f-83c662e5ceb5"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:21.419425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d20f1f66-e9f3-4cff-b840-5d588ad37493 req-554b255e-b1cb-495f-84ef-a3c4ea141404 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:21.425398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d20f1f66-e9f3-4cff-b840-5d588ad37493 req-554b255e-b1cb-495f-84ef-a3c4ea141404 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:21.426212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d20f1f66-e9f3-4cff-b840-5d588ad37493 req-554b255e-b1cb-495f-84ef-a3c4ea141404 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:21.468374 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d20f1f66-e9f3-4cff-b840-5d588ad37493 req-554b255e-b1cb-495f-84ef-a3c4ea141404 service nova] Creating event network-changed:f1fac4ee-7e70-46bf-9a5f-83c662e5ceb5 for instance 37681f89-f769-4371-9f0f-b51aed53f622 on n-h1-master-1 Oct 16 01:21:21.481405 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d20f1f66-e9f3-4cff-b840-5d588ad37493 req-554b255e-b1cb-495f-84ef-a3c4ea141404 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115979 Oct 16 01:21:21.482391 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2129/4099] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:21.738447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:21.767579 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:21.789483 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df92fdb8-ad96-4ba7-a05d-76ee0946b101 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.716518 Oct 16 01:21:21.793383 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1971/4100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:21 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:22.391912 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-240265046", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "80782a8b-359e-4c99-bfc4-19cb8408a888"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:22.393966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:22.394584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:22.398296 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:22.405031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:22.405524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:22.405963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:22.406673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:22.419424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:22.420149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:22.508923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] validate_networks() for [('80782a8b-359e-4c99-bfc4-19cb8408a888', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:21:22.552722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:22.598452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:22.615813 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:22.617083 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-02f4425b-1b5c-41cc-81d9-a58dbe468b59 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.227804 Oct 16 01:21:22.617669 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1972/4101] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:22 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:21:22.824135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:22.824847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:22.834357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:22.840171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:22.840953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:22.842055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:22.842745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:22.843589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:23.493712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:23.505994 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-254864c7-faf9-468f-bfe4-d992ae9dbd65 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.690672 Oct 16 01:21:23.522559 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1973/4102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:22 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:23.646176 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:23.647063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:23.662711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:23.663591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:23.664284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:23.668354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:23.669216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:23.669815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:23.818057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:21:23.819319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:21:23.820563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:21:23.821163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:21:23.821743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:21:23.839951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:23.840836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:23.841550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:23.842819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:23.843473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:23.844053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:23.871674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:21:23.879761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for user a3ac1408c91c4db59f4639abdca2c98f and project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:21:23.884538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:23.897886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:21:23.899740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:23.901047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:21:23.922802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:23.924516 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-65d8c85e-8095-493f-838d-135fed1d72c9 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.282858 Oct 16 01:21:23.925246 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1974/4103] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:23 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:21:24.037919 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-636e3ccb-b2b6-4c22-9b11-fc83b754ca15 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.896720 Oct 16 01:21:24.047455 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2130/4104] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:21:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:21:24.051706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6ca98d83-4cc2-44c1-8f15-65b291f9e197 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:24.052484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6ca98d83-4cc2-44c1-8f15-65b291f9e197 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:24.253854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6ca98d83-4cc2-44c1-8f15-65b291f9e197 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:24.267201 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6ca98d83-4cc2-44c1-8f15-65b291f9e197 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1214 microversion: 2.1 time: 0.217723 Oct 16 01:21:24.285366 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1975/4105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:24 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:24.439658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-761768428", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "59078b1c-8237-4616-985d-45f425e0d59f"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:24.530285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:24.532390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:24.552733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:24.554225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:24.554225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:24.559104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] validate_networks() for [('59078b1c-8237-4616-985d-45f425e0d59f', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:21:24.569518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:24.570023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:24.570471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:25.237447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:25.258486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce41c939-da79-4507-8d82-78cbd4f7cf05 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.731224 Oct 16 01:21:25.264416 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1976/4106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:24 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:25.286674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:25.289141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:25.306051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:25.306561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:25.307789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:25.308528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:25.309087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:25.309523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:25.610826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:25.623004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:25.624465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:25.629513 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37c0daa1-546f-40f2-b95d-d534447ebec1 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.357912 Oct 16 01:21:25.635158 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1977/4107] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:25 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:25.653612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:25.656224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:25.680723 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=60 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:25.688833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:25.694559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:25.697108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:25.701328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:25.706334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:25.708576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:26.072309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:26.081732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-635499f8-eb0b-4f80-80d1-7609218dc519 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1210 microversion: 2.1 time: 0.444573 Oct 16 01:21:26.097551 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1978/4108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:25 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1210 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:26.116113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ce2fa2fd-c30a-46f8-bbed-78aa6d402847 req-b4bfb18b-503e-45c2-a328-91c01bee02a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a7fde5-97e2-4522-a0ae-d0dc4840c4e7", "tag": "b08bba39-0150-4cba-9513-e18882e63c64"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:26.173562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ce2fa2fd-c30a-46f8-bbed-78aa6d402847 req-b4bfb18b-503e-45c2-a328-91c01bee02a2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:26.174050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ce2fa2fd-c30a-46f8-bbed-78aa6d402847 req-b4bfb18b-503e-45c2-a328-91c01bee02a2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:26.184312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ce2fa2fd-c30a-46f8-bbed-78aa6d402847 req-b4bfb18b-503e-45c2-a328-91c01bee02a2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:26.238826 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ce2fa2fd-c30a-46f8-bbed-78aa6d402847 req-b4bfb18b-503e-45c2-a328-91c01bee02a2 service nova] Creating event network-changed:b08bba39-0150-4cba-9513-e18882e63c64 for instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 on n-h1-master-1 Oct 16 01:21:26.263494 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ce2fa2fd-c30a-46f8-bbed-78aa6d402847 req-b4bfb18b-503e-45c2-a328-91c01bee02a2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156119 Oct 16 01:21:26.267786 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1979/4109] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:26.290260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:26.294103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:26.320103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:26.320607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:26.321060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:26.327057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:26.327758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:26.328216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:26.383253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:21:26.383740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:21:26.384144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:21:26.384554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:21:26.384967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:21:26.402006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:26.402437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:26.402882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:26.415422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:26.418309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:26.419587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:26.537643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Getting quotas for project 46e1305700024ba791659001cdce0542. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:21:26.580029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Getting quotas for user 0de7257c0cb54a7cb3d55edbeec5682a and project 46e1305700024ba791659001cdce0542. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:21:26.645810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:21:26.648087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:21:26.691355 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:26.710191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d3b99f3a-02f6-4d30-8f2e-015e9c173553 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.424067 Oct 16 01:21:26.728774 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1980/4110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:26 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:26.748771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:26.751963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:26.773638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:26.774592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:26.776843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:26.779529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:26.780245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:26.782620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:26.828256 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e5d842e-1250-4a30-b087-f8e2119e070a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.533540 Oct 16 01:21:26.834287 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2131/4111] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:21:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:21:26.865871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-330ebc63-5d5c-4540-92c5-a90ace46ad6e tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:26.870829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-330ebc63-5d5c-4540-92c5-a90ace46ad6e tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:26.928553 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:26.953281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:26.961377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:26.968367 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0feb0bfe-b0ae-45e2-a0be-7703537cdd95 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.230506 Oct 16 01:21:26.972786 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1981/4112] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:26 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:27.129119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:27.129962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:27.147941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:27.151839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:27.153022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:27.156023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:27.160895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:27.163495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:28.175874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:28.178404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-330ebc63-5d5c-4540-92c5-a90ace46ad6e tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:28.191862 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-330ebc63-5d5c-4540-92c5-a90ace46ad6e tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1215 microversion: 2.1 time: 1.353294 Oct 16 01:21:28.192575 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2132/4113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:26 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1215 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:28.201655 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b61851c-90a3-428e-a6d7-f8f4efedb5ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1272 microversion: 2.1 time: 1.081351 Oct 16 01:21:28.211007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:28.212144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:28.220842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1982/4114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:27 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1272 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:28.223295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:28.230754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:28.231577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:28.232573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:28.233271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:28.233920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:28.234498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:28.235986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:28.243965 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:28.255642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:28.259624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:28.262839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:28.266576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:28.267321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:28.267768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:28.631983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:28.666807 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:28.676461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:28.677894 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01bfe0e2-1684-4ae4-a92b-8a82def73268 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.455968 Oct 16 01:21:28.682186 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1983/4115] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:28 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:28.710072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-02682003-c7ef-41ad-9590-c76cc51031a8 req-33a940ae-9c3c-48df-832c-f3b173f5c874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3", "name": "network-vif-plugged", "status": "completed", "tag": "595c74cb-9d14-4532-89c6-65f21df76a64"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:28.739222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-02682003-c7ef-41ad-9590-c76cc51031a8 req-33a940ae-9c3c-48df-832c-f3b173f5c874 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:28.739711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-02682003-c7ef-41ad-9590-c76cc51031a8 req-33a940ae-9c3c-48df-832c-f3b173f5c874 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:28.740158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-02682003-c7ef-41ad-9590-c76cc51031a8 req-33a940ae-9c3c-48df-832c-f3b173f5c874 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:28.777527 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-02682003-c7ef-41ad-9590-c76cc51031a8 req-33a940ae-9c3c-48df-832c-f3b173f5c874 service nova] Creating event network-vif-plugged:595c74cb-9d14-4532-89c6-65f21df76a64 for instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 on n-h2-master-1 Oct 16 01:21:28.797832 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-02682003-c7ef-41ad-9590-c76cc51031a8 req-33a940ae-9c3c-48df-832c-f3b173f5c874 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114192 Oct 16 01:21:28.800699 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1984/4116] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:28.820714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:28.840646 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bb195044-4d3f-4e35-8888-dbf07f485af2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.645372 Oct 16 01:21:28.841947 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2133/4117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:28 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:29.220760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:29.221472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:29.228251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:29.229683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:29.231023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:29.231529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:29.231969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:29.232692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:29.233156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:29.233580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:29.237082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:29.237686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:29.238221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:29.239042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:29.239581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:29.243383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:29.331524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:29.342057 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ee28410d-073e-4c26-ac3a-e3d10f7b5755 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1267 microversion: 2.1 time: 0.126924 Oct 16 01:21:29.343255 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1985/4118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:29 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:29.402773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:29.412430 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-885518a2-6d32-44d8-9ba1-c82180db3ad6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1272 microversion: 2.1 time: 0.187877 Oct 16 01:21:29.413707 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2134/4119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:29 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:29.734795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:29.737503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:29.762026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:29.764150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:29.765103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:29.767128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:29.769779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:29.771436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:29.868436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:29.869303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:29.872616 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:29.891059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:29.894281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:29.895680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:29.899898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:29.901810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:29.909482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:29.909871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:29.927962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:29.933115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:29.934054 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32456897-b2cd-4c1f-8fa6-ea2e18ee14b2 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1604 microversion: 2.32 time: 0.225504 Oct 16 01:21:29.944617 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1986/4120] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:29 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:30.188668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:30.230664 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e9a93e42-3a2f-40eb-b6fa-348d047614e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.367946 Oct 16 01:21:30.233103 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2135/4121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:29 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:30.367444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:30.367859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:30.384699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:30.388871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:30.389080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:30.390013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:30.391586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:30.395886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:30.438525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:30.439560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:30.463339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:30.463339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:30.463339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:30.468855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:30.469374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:30.469874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:30.593173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:30.631850 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed04a56e-dea9-4722-9282-4133134ac264 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1273 microversion: 2.1 time: 0.251303 Oct 16 01:21:30.644729 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1987/4122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:30 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:30.903714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:30.917567 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2191b674-45c5-478b-8fd3-d04999b5c605 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 0.482377 Oct 16 01:21:30.924125 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2136/4123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:30 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:30.965769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:30.966476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:30.985032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:30.985769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:30.986407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:30.987445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:30.988453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:30.989282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:31.066865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:31.070822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:31.071912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:31.072519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lazy-loading 'fault' on Instance uuid 3857ab8b-c66f-4628-8e54-51092247f966 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:21:31.199278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:31.210885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:31.211866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0213371a83f4a85bacc0ecdec5b2535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50faaea815f44af798f20a9977157801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:31.222022 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-375a3cc7-db14-4ebf-8f5f-d6bfa5d4a9d6 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 200 len: 1371 microversion: 2.32 time: 0.259962 Oct 16 01:21:31.238771 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1988/4124] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:30 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:21:31.253887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:31.254507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:31.266422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:31.266981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:31.267402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:31.268118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:31.268593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:31.269029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:31.426529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:31.438772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e92613c8-0b05-42cf-a41a-77d80a9d46e1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.188642 Oct 16 01:21:31.441318 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2137/4125] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:31 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:31.656099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:31.657328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:31.664276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:31.664975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:31.665619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:31.667017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:31.667788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:31.668674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:31.817189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:31.833088 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-28091686-723b-405b-9e07-e28a110cfb0d tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1273 microversion: 2.1 time: 0.180669 Oct 16 01:21:31.834048 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1989/4126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:31 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:31.944925 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:31.945546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:31.967457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:31.967968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:31.968412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:31.969133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:31.969600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:31.970030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:32.251418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:32.252045 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:32.274292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:32.274804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:32.283280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:32.284146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:32.284650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:32.285098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:32.351662 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] HTTP exception thrown: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Request method failure captured: Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 HTTP/1.1 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1rgxsKjQBjDv01q63WU2rGW1eR0_UDh8orVDHInSLI_HOYYuKZezHDfAdSSARqyhcf7sGsVpCJ6KPkLTw6XtvSOJ0MPMoi4TqmKrvMcbqFRDZJzMgzFhka5zP8Miy8Jd3fSQ_5Tz-FYFBVPCVHLN7i-C_r_Rw9wPfR1kk8hqYu5gKM Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.32 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 50faaea815f44af798f20a9977157801 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_50faaea815f44af798f20a9977157801", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/50faaea815f44af798f20a9977157801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/50faaea815f44af798f20a9977157801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/50faaea815f44af798f20a9977157801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 50faaea815f44af798f20a9977157801 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TaggedBootDevicesTest-2033600218-project Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d0213371a83f4a85bacc0ecdec5b2535 Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TaggedBootDevicesTest-2033600218-project Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3857ab8b-c66f-4628-8e54-51092247f966'} Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:32.353664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Returning 404 to user: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:21:32.358810 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82bc454c-492b-4461-a552-5eae83c9a6ef tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 404 len: 111 microversion: 2.32 time: 0.109615 Oct 16 01:21:32.362796 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1990/4127] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:32 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:21:32.367595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:32.381362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ec8a914d-ad64-44a5-ac83-71f1f4e9fe32 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '.version_select at 0x7fd64e4a9ee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:32.391814 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13aaac6f-5d6c-4192-8b35-472a57d9b407 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 0.449192 Oct 16 01:21:32.393922 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2138/4128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:31 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:32.434669 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ec8a914d-ad64-44a5-ac83-71f1f4e9fe32 tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-490641971" status: 204 len: 0 microversion: 2.32 time: 0.064672 Oct 16 01:21:32.444231 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1991/4129] 10.222.0.39 () {60 vars in 1259 bytes} [Sun Oct 16 01:21:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-490641971 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:21:32.465196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:32.466273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:32.480119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:32.484143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:32.484818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:32.485848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:32.488559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:32.489992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:32.823091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:32.838258 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-53710650-64e6-4c55-965e-723c07a0880c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.376790 Oct 16 01:21:32.841064 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2139/4130] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:32 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:32.863591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:32.864283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:32.878248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:32.881193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:32.881860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:32.882759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:32.884905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:32.885518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:32.896624 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:32.940870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ce056ef0-6dab-49bc-ab76-6b43e0ce029f req-d5cf34af-6c41-408e-a2d0-be38433776b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37681f89-f769-4371-9f0f-b51aed53f622", "name": "network-vif-plugged", "status": "completed", "tag": "f1fac4ee-7e70-46bf-9a5f-83c662e5ceb5"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:32.957490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ce056ef0-6dab-49bc-ab76-6b43e0ce029f req-d5cf34af-6c41-408e-a2d0-be38433776b4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:32.988514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ce056ef0-6dab-49bc-ab76-6b43e0ce029f req-d5cf34af-6c41-408e-a2d0-be38433776b4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:32.988998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ce056ef0-6dab-49bc-ab76-6b43e0ce029f req-d5cf34af-6c41-408e-a2d0-be38433776b4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:33.012258 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ce056ef0-6dab-49bc-ab76-6b43e0ce029f req-d5cf34af-6c41-408e-a2d0-be38433776b4 service nova] Creating event network-vif-plugged:f1fac4ee-7e70-46bf-9a5f-83c662e5ceb5 for instance 37681f89-f769-4371-9f0f-b51aed53f622 on n-h1-master-1 Oct 16 01:21:33.026325 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ce056ef0-6dab-49bc-ab76-6b43e0ce029f req-d5cf34af-6c41-408e-a2d0-be38433776b4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090081 Oct 16 01:21:33.027175 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2140/4131] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:33.159074 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:33.175416 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d1bdc90-cc3d-4d2e-a803-ce9324216ef9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.316339 Oct 16 01:21:33.191053 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1992/4132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:32 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:33.429548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:33.433047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:33.449272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:33.450173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:33.451179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:33.452508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:33.453412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:33.454348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:33.552725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0a361a8e-6333-4584-97a7-0f174c21bd17 req-d7cae2a0-f258-4f00-a651-81dcebc58a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a195d226-a688-446c-baad-0350c08f9abb", "tag": "ff467ec6-cb6e-4d8d-b814-a0a904f4e55d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:33.580351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a361a8e-6333-4584-97a7-0f174c21bd17 req-d7cae2a0-f258-4f00-a651-81dcebc58a3d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:33.580512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a361a8e-6333-4584-97a7-0f174c21bd17 req-d7cae2a0-f258-4f00-a651-81dcebc58a3d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:33.593355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0a361a8e-6333-4584-97a7-0f174c21bd17 req-d7cae2a0-f258-4f00-a651-81dcebc58a3d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:33.609879 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0a361a8e-6333-4584-97a7-0f174c21bd17 req-d7cae2a0-f258-4f00-a651-81dcebc58a3d service nova] Creating event network-changed:ff467ec6-cb6e-4d8d-b814-a0a904f4e55d for instance a195d226-a688-446c-baad-0350c08f9abb on n-h2-master-1 Oct 16 01:21:33.615437 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0a361a8e-6333-4584-97a7-0f174c21bd17 req-d7cae2a0-f258-4f00-a651-81dcebc58a3d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070097 Oct 16 01:21:33.616054 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1993/4133] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:33.757580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:33.767591 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7028c0c5-8830-40fd-af69-70b1f36e848a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 0.356249 Oct 16 01:21:33.768282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2141/4134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:33 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:33.864332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:33.865815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:33.876745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:33.877522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:33.878020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:33.878937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:33.886479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:33.887205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:34.079277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:34.099409 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ee98ad3-465d-491e-833f-05f5e6055265 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1322 microversion: 2.1 time: 0.240096 Oct 16 01:21:34.115605 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1994/4135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:33 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:34.205189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:34.207087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:34.224749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:34.225478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:34.226123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:34.227067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:34.228142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:34.231176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:34.349351 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:34.488912 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:34.505054 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77dcd825-7211-472b-9605-670e4e0b62ca tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.307317 Oct 16 01:21:34.506071 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2142/4136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:34 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:34.584366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1000249553", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "445d87be-29b8-4491-9329-9561c9a40cb8"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:34.670427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] validate_networks() for [('445d87be-29b8-4491-9329-9561c9a40cb8', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:21:34.794343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:34.794988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:34.819096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:34.819880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:34.821186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:34.828169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:34.829211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:34.833217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.333577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:35.351933 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8311ab81-6215-47c6-9052-f9106fcf0038 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 0.561977 Oct 16 01:21:35.365294 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2143/4137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:34 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:35.377537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:35.383584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:35.390696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:35.392489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:35.393181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.394117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:35.394599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:35.395085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.419631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:21:35.420870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:21:35.421578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:21:35.422200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:21:35.422849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:21:35.448230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:35.449021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:35.451733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.453006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:35.456718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:35.457656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.528518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Getting quotas for project 0379a874918747449f5bbe24b6016495. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:21:35.548595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Getting quotas for user cad50112141243a6a27812344e12cfec and project 0379a874918747449f5bbe24b6016495. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:21:35.570585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:21:35.586730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:21:35.621311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:35.631565 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-950fa451-08bd-46b0-91c1-a7cd008d9855 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1515 microversion: 2.1 time: 0.263376 Oct 16 01:21:35.634517 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2144/4138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:35 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:35.653018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:35.654044 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:35.673045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:35.673554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:35.674203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.675323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:35.675747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:35.676184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.688010 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c07f188-dc93-428c-a559-d817eec1f474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360180 Oct 16 01:21:35.694692 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1995/4139] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:21:35.701634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:35.705472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:35.733084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:35.735496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:35.737398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.738304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:35.739463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:35.742199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:35.781940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lazy-loading 'flavor' on Instance uuid 37681f89-f769-4371-9f0f-b51aed53f622 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:21:35.969392 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-08282d4d-8ba2-4392-8b21-dfe10416d7e4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622/action" status: 200 len: 32 microversion: 2.1 time: 0.272967 Oct 16 01:21:35.972091 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1996/4140] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:21:35 2022] POST /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622/action => generated 32 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:21:35.985215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1966820354", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "445d87be-29b8-4491-9329-9561c9a40cb8"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:35.992928 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:36.032423 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f03c732-7e0a-4e00-8d5e-5fa205da6ff9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.393867 Oct 16 01:21:36.035179 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2145/4141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:35 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:36.049808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-cce4bca1-592a-4ae0-bf11-7def030d44f5 req-92ab6234-05f7-4264-9775-afb6ea04d243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46993253-7d2a-4785-a960-6e813ab337ba", "tag": "8554723d-b993-4402-8844-1adb053a47b7"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:36.080084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] validate_networks() for [('445d87be-29b8-4491-9329-9561c9a40cb8', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:21:36.094502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cce4bca1-592a-4ae0-bf11-7def030d44f5 req-92ab6234-05f7-4264-9775-afb6ea04d243 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:36.097372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cce4bca1-592a-4ae0-bf11-7def030d44f5 req-92ab6234-05f7-4264-9775-afb6ea04d243 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:36.098040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cce4bca1-592a-4ae0-bf11-7def030d44f5 req-92ab6234-05f7-4264-9775-afb6ea04d243 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:36.130541 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-cce4bca1-592a-4ae0-bf11-7def030d44f5 req-92ab6234-05f7-4264-9775-afb6ea04d243 service nova] Creating event network-changed:8554723d-b993-4402-8844-1adb053a47b7 for instance 46993253-7d2a-4785-a960-6e813ab337ba on n-h1-master-1 Oct 16 01:21:36.143623 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-cce4bca1-592a-4ae0-bf11-7def030d44f5 req-92ab6234-05f7-4264-9775-afb6ea04d243 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103012 Oct 16 01:21:36.146165 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2146/4142] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:36.161005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:36.168732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:36.189826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:36.195650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:36.196406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:36.204713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:36.205621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:36.206279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:36.464313 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:37.063745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:37.085664 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-362d043e-be05-48a0-b3bc-b21681e016ee tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.923203 Oct 16 01:21:37.087716 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2147/4143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:36 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:37.102116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:37.102868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:37.124714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:37.133469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:37.136729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:37.137727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:37.138438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:37.139159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:37.457278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:21:37.457841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:21:37.458411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:21:37.458956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:21:37.459481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:21:37.476020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:37.478994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:37.479754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:37.485118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:37.485990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:37.487436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:37.532214 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Getting quotas for project 0379a874918747449f5bbe24b6016495. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:21:37.537773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Getting quotas for user cad50112141243a6a27812344e12cfec and project 0379a874918747449f5bbe24b6016495. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:21:37.565670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:21:37.569427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:21:37.645103 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b81e08d-fb6b-4095-8f69-6917ad0b87fd tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.670239 Oct 16 01:21:37.645788 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1997/4144] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:21:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:21:37.658622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:37.660182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:37.675812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:37.676322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:37.676769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:37.677493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:37.677950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:37.682564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:38.128237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:38.138550 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ee4a751-4f72-4eed-8dec-4a3b69a90bf6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 1.040336 Oct 16 01:21:38.148021 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2148/4145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:37 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:38.160400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2079476423", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "451", "networks": [{"uuid": "445d87be-29b8-4491-9329-9561c9a40cb8"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:38.194321 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=14 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:38.292067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] validate_networks() for [('445d87be-29b8-4491-9329-9561c9a40cb8', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:21:38.518477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:38.534881 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cded66a7-21e4-45ba-9253-7cc8c17d45e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.886736 Oct 16 01:21:38.552313 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1998/4146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:37 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:38.566033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:38.567240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:38.576464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:38.577285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:38.578026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:38.580277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:38.581061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:38.581713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:38.910131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:38.918975 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-18366651-c925-4421-a3bb-fa5ec50ede0f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.359438 Oct 16 01:21:38.924391 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 1999/4147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:38 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:39.176975 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:39.177699 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:39.187706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:39.190897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:39.191669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:39.197352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:39.199099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:39.199890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:39.771862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:39.780677 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6c79c9e4-d652-435a-91c7-76c8870e585f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 0.607747 Oct 16 01:21:39.795874 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2000/4148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:39 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:39.802393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:39.803421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:39.811807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:39.812485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:39.813086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:39.814176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:39.814802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:39.815413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:40.329344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:21:40.330532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:21:40.331190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:21:40.331755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:21:40.332340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:21:40.353700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:40.356085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:40.357437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:40.360567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:40.362092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:40.362759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:40.401711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Getting quotas for project 0379a874918747449f5bbe24b6016495. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:21:40.419429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Getting quotas for user cad50112141243a6a27812344e12cfec and project 0379a874918747449f5bbe24b6016495. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:21:40.434680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:21:40.439156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:21:40.528680 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ab9d728-95a2-4ce4-9547-65be31be4def tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.379353 Oct 16 01:21:40.529621 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2149/4149] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:21:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:21:40.547793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:40.554843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:40.567971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:40.571909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:40.572639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:40.573572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:40.576650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:40.577610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:40.629842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:40.647153 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a0b8101d-5a5b-41ec-8409-9f039f4c52ad tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.849981 Oct 16 01:21:40.647755 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2001/4150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:39 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:40.664305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3f3fc59-fe5c-426e-a92d-872c8e916117 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:40.665310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f3f3fc59-fe5c-426e-a92d-872c8e916117 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:40.821329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f3f3fc59-fe5c-426e-a92d-872c8e916117 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:40.831204 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3f3fc59-fe5c-426e-a92d-872c8e916117 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1221 microversion: 2.1 time: 0.182011 Oct 16 01:21:40.832059 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2002/4151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:40 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:40.859759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:40.860677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:40.868680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:40.869541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:40.870167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:40.871319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:40.871944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:40.872539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:41.296678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:41.305871 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fb092bd4-ead3-4327-9abf-bbc948c87b3c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.765031 Oct 16 01:21:41.316089 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2150/4152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:40 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:41.684764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:41.685456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:41.696949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:41.698359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:41.700471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:41.701381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:41.704784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:41.712938 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f2ccd108-f267-4ac9-816a-ebd7627478ff tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 0.879629 Oct 16 01:21:41.714876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:41.723664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:41.724649 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2003/4153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:40 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:41.859326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cb845750-24b4-431f-af04-1deda083cc99 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:41.859964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cb845750-24b4-431f-af04-1deda083cc99 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:42.110519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cb845750-24b4-431f-af04-1deda083cc99 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:42.123014 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cb845750-24b4-431f-af04-1deda083cc99 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1221 microversion: 2.1 time: 0.269005 Oct 16 01:21:42.124318 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2004/4154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:41 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1221 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:42.341140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:42.342202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:42.356181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:42.357045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:42.361923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:42.363096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:42.363775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:42.364429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:42.501881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:42.504375 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:42.518061 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58b71277-ec68-4ee9-9e01-e47ff6d6b8bd tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.841478 Oct 16 01:21:42.518989 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2151/4155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:41 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:42.616572 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9bec181c-f651-43fb-8fc3-d7d0d230f70f req-acaaafac-1f6e-4317-a23c-2e3b3e637b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a195d226-a688-446c-baad-0350c08f9abb", "name": "network-vif-plugged", "status": "completed", "tag": "ff467ec6-cb6e-4d8d-b814-a0a904f4e55d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:42.640252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9bec181c-f651-43fb-8fc3-d7d0d230f70f req-acaaafac-1f6e-4317-a23c-2e3b3e637b04 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:42.640741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9bec181c-f651-43fb-8fc3-d7d0d230f70f req-acaaafac-1f6e-4317-a23c-2e3b3e637b04 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:42.641447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9bec181c-f651-43fb-8fc3-d7d0d230f70f req-acaaafac-1f6e-4317-a23c-2e3b3e637b04 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:42.669095 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9bec181c-f651-43fb-8fc3-d7d0d230f70f req-acaaafac-1f6e-4317-a23c-2e3b3e637b04 service nova] Creating event network-vif-plugged:ff467ec6-cb6e-4d8d-b814-a0a904f4e55d for instance a195d226-a688-446c-baad-0350c08f9abb on n-h2-master-1 Oct 16 01:21:42.677169 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9bec181c-f651-43fb-8fc3-d7d0d230f70f req-acaaafac-1f6e-4317-a23c-2e3b3e637b04 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063969 Oct 16 01:21:42.680520 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2152/4156] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:21:42.759563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:42.763529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:42.765175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:42.781501 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d48de049-80c1-4268-b9e8-9357328bfbe7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.444598 Oct 16 01:21:42.782178 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2005/4157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:42 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:42.793506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:42.794346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:42.795085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:42.796258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:42.796925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:42.797636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.020620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:43.031004 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f567ea4-64b5-4055-9cf5-ff01d9e6f0f0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 0.281140 Oct 16 01:21:43.033097 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2153/4158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:42 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:43.149014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:43.150463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:43.159435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.160641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.161322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.162345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.163045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.163688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.282733 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:43.295025 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-285d547d-b035-4bdb-b6af-740608cd0d5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1281 microversion: 2.1 time: 0.151830 Oct 16 01:21:43.296481 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2006/4159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:43 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:43.545668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:43.546804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:43.555010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.558662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.560058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.561150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.561836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.562470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.726617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-414e831b-96f6-42b2-b405-9536c1c53fde req-a3787ead-c5ed-4c81-902e-1547102afbca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6863bb2e-6117-4467-8b3e-4354485f29c2", "tag": "a5464ed4-d0ba-484e-8385-e7403fcd3a5d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:43.740016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-414e831b-96f6-42b2-b405-9536c1c53fde req-a3787ead-c5ed-4c81-902e-1547102afbca service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.740498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-414e831b-96f6-42b2-b405-9536c1c53fde req-a3787ead-c5ed-4c81-902e-1547102afbca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.740928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-414e831b-96f6-42b2-b405-9536c1c53fde req-a3787ead-c5ed-4c81-902e-1547102afbca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.752629 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-414e831b-96f6-42b2-b405-9536c1c53fde req-a3787ead-c5ed-4c81-902e-1547102afbca service nova] Creating event network-changed:a5464ed4-d0ba-484e-8385-e7403fcd3a5d for instance 6863bb2e-6117-4467-8b3e-4354485f29c2 on n-h2-master-1 Oct 16 01:21:43.757445 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-414e831b-96f6-42b2-b405-9536c1c53fde req-a3787ead-c5ed-4c81-902e-1547102afbca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227214 Oct 16 01:21:43.758048 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2154/4160] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:21:43.820303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:43.828450 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:43.829357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:43.831959 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a92c6989-c764-4dc8-b30b-f996e9d9b944 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.291793 Oct 16 01:21:43.840229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.841096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.841568 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2007/4161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:43 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:43.843059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.845105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.846895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.848629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.862591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:43.863141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:43.871317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.871812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.872434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.873378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.874002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.874900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.891328 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] HTTP exception thrown: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Request method failure captured: Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 HTTP/1.1 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1rgxsKjQBjDv01q63WU2rGW1eR0_UDh8orVDHInSLI_HOYYuKZezHDfAdSSARqyhcf7sGsVpCJ6KPkLTw6XtvSOJ0MPMoi4TqmKrvMcbqFRDZJzMgzFhka5zP8Miy8Jd3fSQ_5Tz-FYFBVPCVHLN7i-C_r_Rw9wPfR1kk8hqYu5gKM Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.32 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 50faaea815f44af798f20a9977157801 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_50faaea815f44af798f20a9977157801", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/50faaea815f44af798f20a9977157801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/50faaea815f44af798f20a9977157801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/50faaea815f44af798f20a9977157801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 50faaea815f44af798f20a9977157801 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TaggedBootDevicesTest-2033600218-project Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d0213371a83f4a85bacc0ecdec5b2535 Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TaggedBootDevicesTest-2033600218-project Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3857ab8b-c66f-4628-8e54-51092247f966'} Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:21:43.893399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.898214 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.900162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Returning 404 to user: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:21:43.901489 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce28a667-1429-46bc-9313-4d89cbac771b tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 404 len: 111 microversion: 2.32 time: 0.058200 Oct 16 01:21:43.902332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2008/4162] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:21:43 2022] DELETE /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:21:43.912090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:43.912700 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] [instance: 3857ab8b-c66f-4628-8e54-51092247f966] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:43.919177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.919673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.920112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.920801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:43.921290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:43.921715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:43.937519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] HTTP exception thrown: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Request method failure captured: Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 HTTP/1.1 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1rgxsKjQBjDv01q63WU2rGW1eR0_UDh8orVDHInSLI_HOYYuKZezHDfAdSSARqyhcf7sGsVpCJ6KPkLTw6XtvSOJ0MPMoi4TqmKrvMcbqFRDZJzMgzFhka5zP8Miy8Jd3fSQ_5Tz-FYFBVPCVHLN7i-C_r_Rw9wPfR1kk8hqYu5gKM Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.32 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 50faaea815f44af798f20a9977157801 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_50faaea815f44af798f20a9977157801", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/50faaea815f44af798f20a9977157801"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/50faaea815f44af798f20a9977157801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/50faaea815f44af798f20a9977157801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 50faaea815f44af798f20a9977157801 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2033600218 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TaggedBootDevicesTest-2033600218-project Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d0213371a83f4a85bacc0ecdec5b2535 Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TaggedBootDevicesTest-2033600218-project Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3857ab8b-c66f-4628-8e54-51092247f966'} Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.939132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:43.943770 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.943770 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:43.943770 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:43.943770 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:43.943770 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:21:43.943770 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:21:43.943770 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. Oct 16 01:21:43.943770 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:43.944528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] Returning 404 to user: Instance 3857ab8b-c66f-4628-8e54-51092247f966 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:21:43.946243 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2a0c4ee9-b8ba-46fb-8a47-699d57073c0f tempest-TaggedBootDevicesTest-2033600218 tempest-TaggedBootDevicesTest-2033600218-project] 10.222.0.39 "GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966" status: 404 len: 111 microversion: 2.32 time: 0.037775 Oct 16 01:21:43.950723 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2009/4163] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:21:43 2022] GET /compute/v2.1/servers/3857ab8b-c66f-4628-8e54-51092247f966 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:21:44.060361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:44.061674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:44.082691 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:44.090758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:44.091446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:44.091895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:44.092702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:44.093297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:44.093781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:44.412166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:44.428839 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e30250b5-b950-4825-baf1-316b606d7b61 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.606414 Oct 16 01:21:44.446941 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2155/4164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:43 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:44.446941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e60fa15b-256f-4055-8545-1ab81a9b040e req-b8623e97-4e3c-40bc-9f27-76e2ac8f9a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a", "tag": "d77bdfbb-e596-4fda-88fc-87f52a1edfd9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:44.473118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e60fa15b-256f-4055-8545-1ab81a9b040e req-b8623e97-4e3c-40bc-9f27-76e2ac8f9a30 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:44.474133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e60fa15b-256f-4055-8545-1ab81a9b040e req-b8623e97-4e3c-40bc-9f27-76e2ac8f9a30 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:44.474954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e60fa15b-256f-4055-8545-1ab81a9b040e req-b8623e97-4e3c-40bc-9f27-76e2ac8f9a30 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:44.502124 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e60fa15b-256f-4055-8545-1ab81a9b040e req-b8623e97-4e3c-40bc-9f27-76e2ac8f9a30 service nova] Creating event network-changed:d77bdfbb-e596-4fda-88fc-87f52a1edfd9 for instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a on n-h1-master-1 Oct 16 01:21:44.509127 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e60fa15b-256f-4055-8545-1ab81a9b040e req-b8623e97-4e3c-40bc-9f27-76e2ac8f9a30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074039 Oct 16 01:21:44.510369 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2156/4165] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:44.517711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:44.519206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:44.536373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:44.538013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:44.541225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:44.544861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:44.545678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:44.546305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:44.681817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:44.693645 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ee1c1263-e6ba-4641-8bc3-4ef22978e725 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1279 microversion: 2.1 time: 0.181573 Oct 16 01:21:44.695335 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2157/4166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:44 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:44.765408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c143ffa7-a303-462e-95be-559361e82bd8 req-2353192d-0a54-49ca-8d70-caede93cbbdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46993253-7d2a-4785-a960-6e813ab337ba", "name": "network-vif-plugged", "status": "completed", "tag": "8554723d-b993-4402-8844-1adb053a47b7"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:44.778266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:44.782599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c143ffa7-a303-462e-95be-559361e82bd8 req-2353192d-0a54-49ca-8d70-caede93cbbdd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:44.783221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c143ffa7-a303-462e-95be-559361e82bd8 req-2353192d-0a54-49ca-8d70-caede93cbbdd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:44.783749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c143ffa7-a303-462e-95be-559361e82bd8 req-2353192d-0a54-49ca-8d70-caede93cbbdd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:44.801216 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c143ffa7-a303-462e-95be-559361e82bd8 req-2353192d-0a54-49ca-8d70-caede93cbbdd service nova] Creating event network-vif-plugged:8554723d-b993-4402-8844-1adb053a47b7 for instance 46993253-7d2a-4785-a960-6e813ab337ba on n-h1-master-1 Oct 16 01:21:44.803646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f85853d4-9a39-4424-8a38-1f55b50ff52d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1314 microversion: 2.1 time: 0.750887 Oct 16 01:21:44.804526 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2010/4167] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:44 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:44.812634 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c143ffa7-a303-462e-95be-559361e82bd8 req-2353192d-0a54-49ca-8d70-caede93cbbdd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090878 Oct 16 01:21:44.817956 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2158/4168] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:44.863885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:44.864521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:44.876799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:44.877304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:44.877750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:44.878469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:44.878945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:44.885720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:45.306246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:45.322101 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-309f53bf-d068-43a8-8dbe-2eb2874c3418 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.463820 Oct 16 01:21:45.337501 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2011/4169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:44 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:45.461330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:45.462666 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:45.494516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:45.497192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:45.498491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:45.502843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:45.503605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:45.505454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:45.717541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:45.718534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:45.726862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:45.727623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:45.728370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:45.729795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:45.732737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:45.733370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:45.761901 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:45.901479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:45.915818 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-acb9f4b0-ee5c-4d08-a0e6-82d063f3da71 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.460384 Oct 16 01:21:45.934016 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2159/4170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:45 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:45.934016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:45.934016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:45.937262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:45.938011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:45.938876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:45.940222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:45.940773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:45.941444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.085541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:46.094875 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23f31195-b033-4d24-9ada-b5e921ae1165 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1321 microversion: 2.1 time: 0.381620 Oct 16 01:21:46.095692 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2012/4171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:45 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:46.364301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:46.364914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:46.376106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:46.376861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:46.377503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.378434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:46.379133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:46.379773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.393100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:46.406899 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a601fab3-7ce0-4a64-8188-60a2e4317e6b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1501 microversion: 2.1 time: 0.485904 Oct 16 01:21:46.408420 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2160/4172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:45 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1501 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:46.439700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:46.440210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:46.451855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:46.454357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:46.454847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.456640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:46.457575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:46.459545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.515448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:21:46.645189 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff40fa73-6632-47da-b1b1-a33515b262ed tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 204 len: 0 microversion: 2.1 time: 0.209170 Oct 16 01:21:46.646167 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2161/4173] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:21:46 2022] DELETE /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:21:46.654752 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:46.655497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:46.662066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:46.662575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:46.663042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.663766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:46.664232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:46.664663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.885784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:46.901792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c1b370a7-ad66-40a9-96f0-6fb1490742c4 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.541166 Oct 16 01:21:46.904732 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2013/4174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:46 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:46.942545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:46.943913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:46.955538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:46.957670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:46.959637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.962333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:46.965050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:46.966417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:46.967738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:46.976074 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-28bc06f7-be23-4c5d-8161-25910cbc17f1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1507 microversion: 2.1 time: 0.325544 Oct 16 01:21:46.980335 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2162/4175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:46 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:47.117737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:47.118367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:47.125342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:47.126145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:47.126587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:47.127335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:47.129728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:47.131018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:47.468216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:47.483352 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-983d68e5-0326-4620-b7a7-a1f6c88ae713 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.545057 Oct 16 01:21:47.484774 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2014/4176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:46 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:47.502534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6264a210-5008-4b6c-b7a0-b6302bb45dd4 req-954fb1f1-ffe5-4f66-aadc-cb0eaed82ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d837e62-c843-4830-9163-a52cfa469137", "tag": "cb66fc4a-d81e-44c7-94bb-c15c30ac8361"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:47.521059 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:47.527348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6264a210-5008-4b6c-b7a0-b6302bb45dd4 req-954fb1f1-ffe5-4f66-aadc-cb0eaed82ff3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:47.528536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6264a210-5008-4b6c-b7a0-b6302bb45dd4 req-954fb1f1-ffe5-4f66-aadc-cb0eaed82ff3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:47.529272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6264a210-5008-4b6c-b7a0-b6302bb45dd4 req-954fb1f1-ffe5-4f66-aadc-cb0eaed82ff3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:47.552958 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6264a210-5008-4b6c-b7a0-b6302bb45dd4 req-954fb1f1-ffe5-4f66-aadc-cb0eaed82ff3 service nova] Creating event network-changed:cb66fc4a-d81e-44c7-94bb-c15c30ac8361 for instance 8d837e62-c843-4830-9163-a52cfa469137 on n-h2-master-1 Oct 16 01:21:47.567795 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6264a210-5008-4b6c-b7a0-b6302bb45dd4 req-954fb1f1-ffe5-4f66-aadc-cb0eaed82ff3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080790 Oct 16 01:21:47.569478 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2015/4177] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:47.934376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:47.935431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:47.943413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:47.944294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:47.944949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:47.945914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:47.946584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:47.947623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:48.335041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:48.347653 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2130c002-316f-43bb-bd00-7b17965cb3b8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1321 microversion: 2.1 time: 1.233753 Oct 16 01:21:48.365404 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2163/4178] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:47 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1321 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:48.365404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:48.365404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:48.375453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:48.376342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:48.377063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:48.378656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:48.379622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:48.380286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:48.702187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:48.712800 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0fda5bf6-623d-4e49-81f2-6b0c6d3feee7 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1315 microversion: 2.1 time: 0.783655 Oct 16 01:21:48.714795 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2016/4179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:47 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:48.724787 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:48.728445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:48.738591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:48.739523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:48.740184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:48.741107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:48.742362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:48.743037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:48.881356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:48.895054 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8da73771-6348-427c-8953-7da73b898cd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1507 microversion: 2.1 time: 0.537279 Oct 16 01:21:48.901796 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2164/4180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:48 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1507 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:49.096075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:49.097159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:49.114785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.120010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.121546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.124561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.128298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.130003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.137052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:49.145764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4145a1f2-d86e-45b3-b9c2-f0eae5c26f57 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.429590 Oct 16 01:21:49.170184 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2017/4181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:48 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:49.217378 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1fec6106-9f35-438b-afd4-669f07078047 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7/ips" status: 200 len: 150 microversion: 2.1 time: 0.126509 Oct 16 01:21:49.218732 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2165/4182] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:21:49 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7/ips => generated 150 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:21:49.234395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3b25722-0f4e-454a-bcdd-ed745047db4e"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:49.237267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:49.254163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.255044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.255698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.256650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.257321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.257958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.377799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:49.379713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:49.393192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.395524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.396169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.397716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.399973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.403565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.462705 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Invalid volume: volume a3b25722-0f4e-454a-bcdd-ed745047db4e is already attached to instances: 5f39da51-b797-405f-8c98-c4d962123c45 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7/os-volume_attachments HTTP/1.1 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 74 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: {"volumeAttachment": {"volumeId": "a3b25722-0f4e-454a-bcdd-ed745047db4e"}} Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid volume: volume a3b25722-0f4e-454a-bcdd-ed745047db4e is already attached to instances: 5f39da51-b797-405f-8c98-c4d962123c45 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': '01a7fde5-97e2-4522-a0ae-d0dc4840c4e7', 'body': {'volumeAttachment': {'volumeId': 'a3b25722-0f4e-454a-bcdd-ed745047db4e'}}} Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a3b25722-0f4e-454a-bcdd-ed745047db4e is already attached to instances: 5f39da51-b797-405f-8c98-c4d962123c45 Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:21:49.470031 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a3b25722-0f4e-454a-bcdd-ed745047db4e is already attached to instances: 5f39da51-b797-405f-8c98-c4d962123c45 Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a3b25722-0f4e-454a-bcdd-ed745047db4e is already attached to instances: 5f39da51-b797-405f-8c98-c4d962123c45 Oct 16 01:21:49.474061 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:49.474989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 400 to user: Invalid volume: volume a3b25722-0f4e-454a-bcdd-ed745047db4e is already attached to instances: 5f39da51-b797-405f-8c98-c4d962123c45 {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:21:49.478953 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f00c278c-3e4c-42d9-bb38-1908baa41f92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.249735 Oct 16 01:21:49.480172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2018/4183] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:21:49 2022] POST /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7/os-volume_attachments => generated 174 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:21:49.490186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:49.499551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:49.508628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.509132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.509720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.511120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.511582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.512007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.551449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:21:49.789635 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-942695e2-455e-425e-a084-a6cdb91aa503 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 204 len: 0 microversion: 2.1 time: 0.303408 Oct 16 01:21:49.791565 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2019/4184] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:21:49 2022] DELETE /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:21:49.799551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-35bbad9d-2c59-408d-97d2-7bc4e1fd166d req-8adc5264-d81b-4427-8d78-e5b9204facc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a195d226-a688-446c-baad-0350c08f9abb", "name": "network-vif-deleted", "tag": "ff467ec6-cb6e-4d8d-b814-a0a904f4e55d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:49.837691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35bbad9d-2c59-408d-97d2-7bc4e1fd166d req-8adc5264-d81b-4427-8d78-e5b9204facc3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.838216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35bbad9d-2c59-408d-97d2-7bc4e1fd166d req-8adc5264-d81b-4427-8d78-e5b9204facc3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.838656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-35bbad9d-2c59-408d-97d2-7bc4e1fd166d req-8adc5264-d81b-4427-8d78-e5b9204facc3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.884037 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-35bbad9d-2c59-408d-97d2-7bc4e1fd166d req-8adc5264-d81b-4427-8d78-e5b9204facc3 service nova] Creating event network-vif-deleted:ff467ec6-cb6e-4d8d-b814-a0a904f4e55d for instance a195d226-a688-446c-baad-0350c08f9abb on n-h2-master-1 Oct 16 01:21:49.895496 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-35bbad9d-2c59-408d-97d2-7bc4e1fd166d req-8adc5264-d81b-4427-8d78-e5b9204facc3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101764 Oct 16 01:21:49.896035 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2020/4185] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:49.914434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:49.915437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:49.932771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.933318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.933766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:49.939493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:49.940533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:49.940988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.007389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:50.027666 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2d88746d-3c86-498c-b636-310dc2822d4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1321 microversion: 2.1 time: 0.655289 Oct 16 01:21:50.031008 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2166/4186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:49 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1321 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:50.050086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:50.051201 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:50.066616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.068473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.068927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.069658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.070110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.070544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.379621 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:50.428865 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:50.468577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:50.479633 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a1e5e5f7-2980-4dac-ae2f-d47e99f0490f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1502 microversion: 2.1 time: 0.579870 Oct 16 01:21:50.494941 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2021/4187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:49 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1502 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:50.505139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:50.505139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:50.519027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.519634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.521876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.523101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.524470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.530051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.597007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.597007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.597361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.598195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lazy-loading 'fault' on Instance uuid a195d226-a688-446c-baad-0350c08f9abb {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:21:50.648287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:50.669468 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:50.669696 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6060bc38-ccda-4578-97f4-03457c569d22 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1681 microversion: 2.1 time: 0.636431 Oct 16 01:21:50.670531 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2167/4188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:50 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1681 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:50.678612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:50.681401 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7ced2b2-a1cd-45fb-b908-bed3329f894f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 200 len: 1304 microversion: 2.1 time: 0.194371 Oct 16 01:21:50.682449 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2022/4189] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:50 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:50.686144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:50.698975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.699741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.701750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-176d29aa-f135-4128-b91b-ddec8c5c1377 req-0f4c483e-9cc8-47ea-8868-eb2788dd8bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a", "name": "network-vif-plugged", "status": "completed", "tag": "d77bdfbb-e596-4fda-88fc-87f52a1edfd9"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:50.702450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.703384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.704011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.715359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.727574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-176d29aa-f135-4128-b91b-ddec8c5c1377 req-0f4c483e-9cc8-47ea-8868-eb2788dd8bfd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.728130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-176d29aa-f135-4128-b91b-ddec8c5c1377 req-0f4c483e-9cc8-47ea-8868-eb2788dd8bfd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.729798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-176d29aa-f135-4128-b91b-ddec8c5c1377 req-0f4c483e-9cc8-47ea-8868-eb2788dd8bfd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.743486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-176d29aa-f135-4128-b91b-ddec8c5c1377 req-0f4c483e-9cc8-47ea-8868-eb2788dd8bfd service nova] Creating event network-vif-plugged:d77bdfbb-e596-4fda-88fc-87f52a1edfd9 for instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a on n-h1-master-1 Oct 16 01:21:50.748987 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-176d29aa-f135-4128-b91b-ddec8c5c1377 req-0f4c483e-9cc8-47ea-8868-eb2788dd8bfd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065027 Oct 16 01:21:50.749959 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2023/4190] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:50.759719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:50.760591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:50.767669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.768457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.769081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.770121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.770822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.771472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.863206 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a34a7e60-e769-4316-bdc3-dd651271e3f1 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "DELETE /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.107818 Oct 16 01:21:50.865103 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2024/4191] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Oct 16 01:21:50 2022] DELETE /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba/os-server-password => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:21:50.875162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:50.876018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:50.884009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.885692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.886360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.887361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.888625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.889267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.922663 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce8fe204-b96d-4b74-aaa9-aabc0a33606f tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.051913 Oct 16 01:21:50.928510 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2025/4192] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:21:50 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba/os-server-password => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:21:50.936231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:50.936745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:50.945137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.945629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.946065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.946819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:50.947309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:50.949171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:50.981036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:21:50.989986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:50.999421 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-796fa33d-7d34-4f83-8417-6eb95d78363a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.327625 Oct 16 01:21:51.001437 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2168/4193] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:50 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:51.055531 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:51.061010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:51.062158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:51.086752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:51.089898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:51.092450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:51.095113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:51.097263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:51.097742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:51.181937 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b94b2cd-107b-41cc-82e4-5c6c8882280a tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "DELETE /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 204 len: 0 microversion: 2.1 time: 0.250602 Oct 16 01:21:51.186442 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2026/4194] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:21:50 2022] DELETE /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:21:51.203765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:51.204946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:51.213870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:51.214833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:51.215517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:51.216523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:51.217218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:51.217892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:51.498503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:51.502357 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:51.567075 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d9a8fd0-a14b-4927-856c-9514adc7b5e5 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1321 microversion: 2.1 time: 0.467737 Oct 16 01:21:51.567810 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2169/4195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:51 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:51.651433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:51.663488 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a1b11a5-4123-42be-911a-eec7804a65e9 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1508 microversion: 2.1 time: 0.467514 Oct 16 01:21:51.668453 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2027/4196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:51 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1508 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:51.696273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:51.697183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:51.704217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:51.705062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:51.705716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:51.706668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:51.707515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:51.707913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:51.708413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:51.708530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:51.722534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:51.723297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:51.724046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:51.725322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:51.726188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:51.726629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:51.752922 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb HTTP/1.1 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a195d226-a688-446c-baad-0350c08f9abb'} Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:51.754662 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22498c47-9b77-4f74-b624-4fd28366eeb4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 404 len: 111 microversion: 2.1 time: 0.053471 Oct 16 01:21:51.759661 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2028/4197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:51 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:21:51.976033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-7355661", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "80782a8b-359e-4c99-bfc4-19cb8408a888"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:52.038748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] validate_networks() for [('80782a8b-359e-4c99-bfc4-19cb8408a888', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:21:52.120378 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=16 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:52.195346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:52.213295 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a80a535-4d63-4367-8c3d-1c434e538dc2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1681 microversion: 2.1 time: 0.521160 Oct 16 01:21:52.233779 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2170/4198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:51 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1681 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:52.241504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:52.242327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:52.250056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:52.250799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:52.251446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:52.252364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:52.253005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:52.253601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:52.954007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:52.990753 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a26d6ee-90b4-45ae-9d99-e8a713c7b7d2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.754001 Oct 16 01:21:52.992258 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2171/4199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:52 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:53.000315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:53.001460 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:53.009719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:53.011252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:53.011882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:53.013430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:53.013539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:53.013930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:53.470051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:53.480608 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0848ffc-8971-4f48-96c0-7ebc9986cc3e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1321 microversion: 2.1 time: 0.486934 Oct 16 01:21:53.486601 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2172/4200] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:52 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:53.491576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:53.508421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:53.518951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:53.523777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:53.524043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:53.525044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:53.526265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:53.527501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:53.676601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:21:53.677358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:21:53.677918 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:21:53.678510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:21:53.679631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:21:53.701042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:53.701886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:53.703570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:53.705218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:53.707311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:53.709575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:53.820752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:21:53.836591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for user a3ac1408c91c4db59f4639abdca2c98f and project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:21:53.933735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:21:53.941118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:21:54.066356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:54.078994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2fe1856e-3aa7-4478-bab1-1b9eb240fb29 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1508 microversion: 2.1 time: 0.591090 Oct 16 01:21:54.079605 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2173/4201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:53 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1508 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:54.092450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2ab0db11-9fea-40b2-b0da-c9b6b2f5f642 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120088 Oct 16 01:21:54.093598 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2029/4202] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:21:54.112140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-31c4316a-d920-45fd-a11c-6c2e654b3df2 req-3b97eabe-2e90-40e6-a586-2324d5aa4bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6863bb2e-6117-4467-8b3e-4354485f29c2", "name": "network-vif-plugged", "status": "completed", "tag": "a5464ed4-d0ba-484e-8385-e7403fcd3a5d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:54.128358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:54.128999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:54.148371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-31c4316a-d920-45fd-a11c-6c2e654b3df2 req-3b97eabe-2e90-40e6-a586-2324d5aa4bda service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:54.148660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:54.149102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-31c4316a-d920-45fd-a11c-6c2e654b3df2 req-3b97eabe-2e90-40e6-a586-2324d5aa4bda service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:54.149248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:54.149593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:54.150147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-31c4316a-d920-45fd-a11c-6c2e654b3df2 req-3b97eabe-2e90-40e6-a586-2324d5aa4bda service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:54.150727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:54.156469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:54.167651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:54.192123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-31c4316a-d920-45fd-a11c-6c2e654b3df2 req-3b97eabe-2e90-40e6-a586-2324d5aa4bda service nova] Creating event network-vif-plugged:a5464ed4-d0ba-484e-8385-e7403fcd3a5d for instance 6863bb2e-6117-4467-8b3e-4354485f29c2 on n-h2-master-1 Oct 16 01:21:54.203302 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-31c4316a-d920-45fd-a11c-6c2e654b3df2 req-3b97eabe-2e90-40e6-a586-2324d5aa4bda service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108009 Oct 16 01:21:54.206282 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2030/4203] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:54.229838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:54.230909 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:54.238498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:54.239289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:54.239880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:54.240999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:54.241678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:54.244317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:54.718015 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:54.735050 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73389594-a807-4f73-a807-47edb20998c2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.524973 Oct 16 01:21:54.738304 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2031/4204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:54 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:54.765668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7d54d0d-45eb-4b7f-bcde-71b537821701 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:54.770719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7d54d0d-45eb-4b7f-bcde-71b537821701 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:54.931248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:54.953856 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-31b952c9-6a0a-4b18-853c-80117b4bf2ef tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1681 microversion: 2.1 time: 0.863966 Oct 16 01:21:54.954986 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2174/4205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:54 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1681 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:54.976908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:54.981603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:54.989852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7d54d0d-45eb-4b7f-bcde-71b537821701 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:54.993191 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:21:54.996563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:54.997396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:54.998330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:54.999547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:55.000232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:55.000550 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7d54d0d-45eb-4b7f-bcde-71b537821701 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1212 microversion: 2.1 time: 0.261003 Oct 16 01:21:55.001454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:55.003020 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2032/4206] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:54 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1212 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:55.107714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:55.109185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:55.131390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:55.132173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:55.132613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:55.133339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:55.133816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:55.137628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:55.268564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:55.278782 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a242d706-c629-4deb-a956-692b88752643 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1466 microversion: 2.1 time: 0.179035 Oct 16 01:21:55.279420 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2033/4207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:55 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1466 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:55.313883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-94be2647-459b-4252-947b-8548a849582e req-998b66c9-a60c-4b22-af43-07cd3cd95d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46993253-7d2a-4785-a960-6e813ab337ba", "name": "network-vif-deleted", "tag": "8554723d-b993-4402-8844-1adb053a47b7"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:55.356059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-94be2647-459b-4252-947b-8548a849582e req-998b66c9-a60c-4b22-af43-07cd3cd95d70 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:55.356542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-94be2647-459b-4252-947b-8548a849582e req-998b66c9-a60c-4b22-af43-07cd3cd95d70 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:55.356992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-94be2647-459b-4252-947b-8548a849582e req-998b66c9-a60c-4b22-af43-07cd3cd95d70 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:55.393464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:55.404766 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7919151a-e16c-4189-96c3-8bbe8ee308e9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1321 microversion: 2.1 time: 0.443979 Oct 16 01:21:55.426661 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2175/4208] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:54 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:55.427298 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-94be2647-459b-4252-947b-8548a849582e req-998b66c9-a60c-4b22-af43-07cd3cd95d70 service nova] Creating event network-vif-deleted:8554723d-b993-4402-8844-1adb053a47b7 for instance 46993253-7d2a-4785-a960-6e813ab337ba on n-h1-master-1 Oct 16 01:21:55.440296 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-94be2647-459b-4252-947b-8548a849582e req-998b66c9-a60c-4b22-af43-07cd3cd95d70 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136424 Oct 16 01:21:55.441951 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2034/4209] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:55.764372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:55.765284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:55.778762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:55.782770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:55.783371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:55.787141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:55.787774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:55.788322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:55.984922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:55.985916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:56.008881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.012857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.017909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.018832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.019357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.019805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.160712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:56.175829 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ecd0a0a4-a9e2-46bd-aed0-e5b732dcf188 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.414891 Oct 16 01:21:56.179846 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2176/4210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:55 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:56.204194 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:56.209767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:56.225259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.239640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.240431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.241420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.242176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.243241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.279978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:56.305433 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd75035c-0066-486f-9715-72b321ee5d93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1326 microversion: 2.1 time: 0.326457 Oct 16 01:21:56.308151 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2035/4211] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:55 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1326 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:56.325429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:56.326729 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:56.336265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:56.344788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.345632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.346295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.347725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.348359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.348521 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10ee55bf-db1a-4a28-a7af-9cffc5af1703 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1264 microversion: 2.1 time: 0.166511 Oct 16 01:21:56.349187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.349374 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2177/4212] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:56 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:56.428766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:56.430498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:56.439126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.439823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.440571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.441483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.442255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.443274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.456002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.458623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.459220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.459805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lazy-loading 'fault' on Instance uuid 46993253-7d2a-4785-a960-6e813ab337ba {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:21:56.676773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0de7257c0cb54a7cb3d55edbeec5682a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e1305700024ba791659001cdce0542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:56.699551 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cb77fb61-dbee-4416-9036-0ce8c98b99ce tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 200 len: 1305 microversion: 2.1 time: 0.389759 Oct 16 01:21:56.700245 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2036/4213] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:56 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 1305 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:56.752826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0252e51b-d4e1-4b2c-91e2-7752ffbcb3b8 req-6772da05-603b-4e24-888b-a007dd88c9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d837e62-c843-4830-9163-a52cfa469137", "name": "network-vif-plugged", "status": "completed", "tag": "cb66fc4a-d81e-44c7-94bb-c15c30ac8361"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:56.777401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0252e51b-d4e1-4b2c-91e2-7752ffbcb3b8 req-6772da05-603b-4e24-888b-a007dd88c9a3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:56.778188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0252e51b-d4e1-4b2c-91e2-7752ffbcb3b8 req-6772da05-603b-4e24-888b-a007dd88c9a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:56.778850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0252e51b-d4e1-4b2c-91e2-7752ffbcb3b8 req-6772da05-603b-4e24-888b-a007dd88c9a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:56.799043 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0252e51b-d4e1-4b2c-91e2-7752ffbcb3b8 req-6772da05-603b-4e24-888b-a007dd88c9a3 service nova] Creating event network-vif-plugged:cb66fc4a-d81e-44c7-94bb-c15c30ac8361 for instance 8d837e62-c843-4830-9163-a52cfa469137 on n-h2-master-1 Oct 16 01:21:56.805913 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0252e51b-d4e1-4b2c-91e2-7752ffbcb3b8 req-6772da05-603b-4e24-888b-a007dd88c9a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056756 Oct 16 01:21:56.807795 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2037/4214] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:21:56.904276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:56.923874 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-010be441-6fac-4151-a7cf-36c11093bf26 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1321 microversion: 2.1 time: 0.499378 Oct 16 01:21:56.928629 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2178/4215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:56 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:57.206382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:57.208078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:57.239463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.239964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.240404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.241116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.241574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.250834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.334440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:57.335525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:57.352364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.357707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.359241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.362797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.364180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.368277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.485280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.485967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.488233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.495428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lazy-loading 'fault' on Instance uuid 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:21:57.609561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:57.642015 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3c13c849-0b2e-4e4d-8871-b798102c2930 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 200 len: 1331 microversion: 2.1 time: 0.305634 Oct 16 01:21:57.643154 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2179/4216] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:57 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 1331 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:57.658105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:57.659680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:57.677420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.683198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.683905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.688684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.690065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.690672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.717073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:57.728359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-60a667af-63db-4057-9818-f784f34c95b3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.527882 Oct 16 01:21:57.729009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2038/4217] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:57 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:21:57.752242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-decd2c36-a254-4a16-b205-46d5bdcdc49e req-d297ca0d-6bba-4b37-b863-e9c829fb9d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a7fde5-97e2-4522-a0ae-d0dc4840c4e7", "name": "network-vif-deleted", "tag": "b08bba39-0150-4cba-9513-e18882e63c64"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:21:57.774680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-decd2c36-a254-4a16-b205-46d5bdcdc49e req-d297ca0d-6bba-4b37-b863-e9c829fb9d56 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.775182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-decd2c36-a254-4a16-b205-46d5bdcdc49e req-d297ca0d-6bba-4b37-b863-e9c829fb9d56 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.776169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-decd2c36-a254-4a16-b205-46d5bdcdc49e req-d297ca0d-6bba-4b37-b863-e9c829fb9d56 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.821423 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-decd2c36-a254-4a16-b205-46d5bdcdc49e req-d297ca0d-6bba-4b37-b863-e9c829fb9d56 service nova] Creating event network-vif-deleted:b08bba39-0150-4cba-9513-e18882e63c64 for instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 on n-h1-master-1 Oct 16 01:21:57.836316 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-decd2c36-a254-4a16-b205-46d5bdcdc49e req-d297ca0d-6bba-4b37-b863-e9c829fb9d56 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095649 Oct 16 01:21:57.836921 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2039/4218] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:21:57.854454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:57.855276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] [instance: 46993253-7d2a-4785-a960-6e813ab337ba] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:57.868999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.869564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.873092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.873955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.874438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.874870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.908915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:57.927206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-28e0a7d6-331b-4369-865a-50fbc41d7694 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1282 microversion: 2.1 time: 0.282201 Oct 16 01:21:57.927820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2180/4219] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:57 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1282 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:57.948427 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] HTTP exception thrown: Instance 46993253-7d2a-4785-a960-6e813ab337ba could not be found. Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Request method failure captured: Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba HTTP/1.1 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yTWGBz_HozuSIu0e9G869hzCqHrT5UQEc7YrMdyyCK56_YuiaWLgC4DVJqK1hOJpFc6eFUxJo10C6TUC9OoQYn-b71fxMrhXP3TFf6zsohfzuLmiOXfNf7Zrp0HaAIhzuCaO2WNUlChonfshalKXSPgmvRQGIrl1-H2CeWI7jfh7I Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 46e1305700024ba791659001cdce0542 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerPasswordTestJSON-154250018 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_46e1305700024ba791659001cdce0542", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/46e1305700024ba791659001cdce0542"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/46e1305700024ba791659001cdce0542"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/46e1305700024ba791659001cdce0542"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerPasswordTestJSON-154250018 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 46e1305700024ba791659001cdce0542 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerPasswordTestJSON-154250018 Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerPasswordTestJSON-154250018-project Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 0de7257c0cb54a7cb3d55edbeec5682a Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerPasswordTestJSON-154250018-project Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 46993253-7d2a-4785-a960-6e813ab337ba could not be found. Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '46993253-7d2a-4785-a960-6e813ab337ba'} Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46993253-7d2a-4785-a960-6e813ab337ba could not be found. Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46993253-7d2a-4785-a960-6e813ab337ba could not be found. Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:57.965075 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46993253-7d2a-4785-a960-6e813ab337ba could not be found. Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] Returning 404 to user: Instance 46993253-7d2a-4785-a960-6e813ab337ba could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:21:57.970183 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4d76a1c-37f3-4082-aa18-19c41dee2978 tempest-ServerPasswordTestJSON-154250018 tempest-ServerPasswordTestJSON-154250018-project] 10.222.0.39 "GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba" status: 404 len: 111 microversion: 2.1 time: 0.128267 Oct 16 01:21:57.974801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:57.974801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:57.975140 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2040/4220] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:57 2022] GET /compute/v2.1/servers/46993253-7d2a-4785-a960-6e813ab337ba => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:21:57.990962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.991585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.992047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:57.992801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:57.996541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:57.997071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:58.527794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:58.536638 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2f9f432f-a189-42b3-b856-bef6e4cf0b48 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1321 microversion: 2.1 time: 0.584633 Oct 16 01:21:58.541586 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2181/4221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:57 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:58.671854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:58.672658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:58.688304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:58.689710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:58.690402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:58.696695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:58.697992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:58.699127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:58.730054 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 HTTP/1.1 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '01a7fde5-97e2-4522-a0ae-d0dc4840c4e7'} Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:21:58.732056 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:58.736595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:21:58.736595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:21:58.736595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:21:58.736595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:21:58.736595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:21:58.736595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:21:58.736595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:21:58.739220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:21:58.741899 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d37260f5-92f8-4b9f-a706-c9f66b70ef44 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 404 len: 111 microversion: 2.1 time: 0.073356 Oct 16 01:21:58.747486 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2041/4222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:58 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:21:58.754330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-41b31c6c-e925-4207-a800-06daecb93b92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '.version_select at 0x7fd64dee8f70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:58.769131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:58.772515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:58.787943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:58.790494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:58.792944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:58.795785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:58.796449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:58.797883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:58.801850 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-41b31c6c-e925-4207-a800-06daecb93b92 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913309052" status: 202 len: 0 microversion: 2.1 time: 0.052399 Oct 16 01:21:58.804908 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2182/4223] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:21:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913309052 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:21:58.958513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:58.959190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:58.975466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:58.975956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:58.976402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:58.977122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:58.977585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:58.978016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:59.444848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:59.459034 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f849817-7b34-4e19-9805-c3eeb5b3e18b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.697232 Oct 16 01:21:59.460010 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2042/4224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:58 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:21:59.568933 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:21:59.569935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:21:59.592072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:59.594842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:59.595605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:59.600316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:21:59.601959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:21:59.602908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:21:59.621936 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:21:59.637968 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0dd60768-0810-45af-8471-cdb51a14321d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1312 microversion: 2.1 time: 0.683959 Oct 16 01:21:59.638633 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2183/4225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:58 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1312 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:00.383508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:00.402534 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5337b908-bdd4-4e28-86a1-9ce4c0d2df35 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1513 microversion: 2.1 time: 0.840132 Oct 16 01:22:00.430474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:00.431414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:00.437134 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2043/4226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:21:59 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1513 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:00.440006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:00.444062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:00.444738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:00.445640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:00.451607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:00.452405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:00.488316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:00.489177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:00.499149 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:00.501535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:00.502384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:00.505792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:00.507434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:00.508165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:00.508833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:01.611431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:01.624158 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d9be6220-3571-445b-9ffb-0b582cf9157a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 1.141049 Oct 16 01:22:01.625077 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2044/4227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:00 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:01.630969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:01.631846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:01.643785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:01.644784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:01.645979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:01.646870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:01.648183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:01.648786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:01.826786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:01.844262 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-745be79b-faf8-4fd6-a09b-a1616c40a303 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1513 microversion: 2.1 time: 1.416951 Oct 16 01:22:01.864946 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2184/4228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:00 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1513 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:01.871226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5331158f-a212-4f00-91b9-02850e6d40be req-8d4f4463-6aa6-49b7-8bd6-298e8add94a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57546d04-76c2-4d2d-9c2c-0a5f736417e7", "tag": "8302be85-eee6-453d-bb4a-b5b4db76078e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:01.883192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5331158f-a212-4f00-91b9-02850e6d40be req-8d4f4463-6aa6-49b7-8bd6-298e8add94a4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:01.884640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5331158f-a212-4f00-91b9-02850e6d40be req-8d4f4463-6aa6-49b7-8bd6-298e8add94a4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:01.886228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5331158f-a212-4f00-91b9-02850e6d40be req-8d4f4463-6aa6-49b7-8bd6-298e8add94a4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:01.908816 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5331158f-a212-4f00-91b9-02850e6d40be req-8d4f4463-6aa6-49b7-8bd6-298e8add94a4 service nova] Creating event network-changed:8302be85-eee6-453d-bb4a-b5b4db76078e for instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 on n-h2-master-1 Oct 16 01:22:01.914376 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5331158f-a212-4f00-91b9-02850e6d40be req-8d4f4463-6aa6-49b7-8bd6-298e8add94a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048059 Oct 16 01:22:01.915200 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2185/4229] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:01.925527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:01.926497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:01.937000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:01.937826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:01.938484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:01.939444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:01.940096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:01.940708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:02.044289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lazy-loading 'services' on Instance uuid 5f39da51-b797-405f-8c98-c4d962123c45 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:22:02.146314 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58409da9-ed71-4f0d-b81c-3a2533e31cf7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments/a3b25722-0f4e-454a-bcdd-ed745047db4e" status: 202 len: 0 microversion: 2.1 time: 0.224857 Oct 16 01:22:02.151401 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2186/4230] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:22:01 2022] DELETE /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments/a3b25722-0f4e-454a-bcdd-ed745047db4e => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:22:02.167492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:02.171890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:02.173409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:02.181622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:02.182324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:02.183062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:02.183614 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b193467f-651e-4c24-98ad-f942a54ae055 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1312 microversion: 2.1 time: 0.556729 Oct 16 01:22:02.184381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:02.184536 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2045/4231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:01 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1312 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:02.185151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:02.185692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:02.192239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:02.194797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:02.201380 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:02.214164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:02.216496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:02.217208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:02.219078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:02.219841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:02.220449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:02.280276 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-91154e77-0d62-4b69-a158-7c561ff8c164 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094054 Oct 16 01:22:02.281641 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2046/4232] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:22:02 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:02.648462 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:02.649123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:02.662285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:02.662783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:02.663252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:02.663968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:02.664436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:02.671531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:02.844331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:02.852945 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1c276611-4848-43db-8648-993733aef754 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 200 len: 1513 microversion: 2.1 time: 0.699810 Oct 16 01:22:02.867472 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2187/4233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:02 2022] GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 1513 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:02.878728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:02.883949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:02.885715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:02.908598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:02.909097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:02.909437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:02.914333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:02.914817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:02.915473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:03.040009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:03.124969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:03.131824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:03.132517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:03.133117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:03.268442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:03.280360 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d197b79-eafe-4a6f-b7b7-9a600e319633 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.636040 Oct 16 01:22:03.287307 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2047/4234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:02 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:03.298705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:03.302937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:03.316038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:03.316717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:03.317323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:03.318552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:03.319679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:03.320280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:03.710210 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0c759bd9-2a7c-49c5-986e-9d0ca997c32d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.835853 Oct 16 01:22:03.716129 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2188/4235] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Oct 16 01:22:02 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:03.726955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:03.733999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:03.748213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:03.748941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:03.749396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:03.750138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:03.750599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:03.751062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:03.780463 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:03.802026 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1bb03c17-b7fb-46df-b0f6-0a7eefbcf553 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084417 Oct 16 01:22:03.803292 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2189/4236] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:22:03 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:03.810125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:03.824117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:03.825387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1000249553', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:03.832480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:03.833297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:03.833934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:03.834906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:03.835611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:03.836284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:03.973074 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:04.084113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:04.092180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:04.092820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:04.093386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:04.398744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:04.401724 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:04.416569 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa1920c5-c24b-4fe7-8eb5-9e26397ca5d0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1312 microversion: 2.1 time: 1.127197 Oct 16 01:22:04.417843 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2048/4237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:03 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1312 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:04.422540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:04.423455 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:04.431113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:04.432416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:04.433072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:04.434233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:04.434848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:04.435513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:04.680322 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e088c89-f93c-47ca-848c-5d404b87405b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1000249553" status: 200 len: 1516 microversion: 2.1 time: 0.875596 Oct 16 01:22:04.680870 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2190/4238] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:22:03 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1000249553 => generated 1516 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:04.705474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:04.710328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:04.711265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:04.717434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:04.717997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:04.718524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:04.719372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:04.719901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:04.720399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:04.820506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:04.898729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:04.907109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:04.907922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:04.908581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:04.995128 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:05.105512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:05.130677 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-48ba654b-90c8-46dc-9a22-f4a5d4aa1271 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.711591 Oct 16 01:22:05.139518 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2049/4239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:04 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:05.152335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:05.157362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:05.174074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.174651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.175120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.176602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.177767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.178211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.216969 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a09b1523-b5fe-4618-9795-16813b50ab4d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4522 microversion: 2.1 time: 0.515626 Oct 16 01:22:05.231651 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2191/4240] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Oct 16 01:22:04 2022] GET /compute/v2.1/servers/detail?status=active => generated 4522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:05.250027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:05.250777 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be646cbf-523c-4728-8f51-8566a7350560 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109876 Oct 16 01:22:05.255054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:05.256946 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2050/4241] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:22:05 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:05.261355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.compute.servers [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Removing options 'limit' from query {{(pid=120545) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 16 01:22:05.262152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:05.270642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.271175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.271591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.275030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.278074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.279498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.356489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:05.373342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.373832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.374261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.445209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:05.445844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:05.455857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.456362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.456810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.457525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.457998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.458433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.708696 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fadf4c0f-0ff7-46de-9b60-e73bc2bc459b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.463209 Oct 16 01:22:05.709285 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2192/4242] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:22:05 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:05.735959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:05.742384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:05.748888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:05.760610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.764143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.764713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.767905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.768612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.769309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.839106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:05.890990 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6693201-d433-4d8f-bee7-38204a5a4f93 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.159632 Oct 16 01:22:05.891572 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2193/4243] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:22:05 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:05.917644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:05.922467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:05.923162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.compute.servers [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Removing options 'limit' from query {{(pid=120545) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 16 01:22:05.923968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:05.929695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.930384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.931009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.931965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:05.932613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:05.933229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:05.961917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:06.064810 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d8884005-bbcd-4ee7-94f0-0284e88ff68f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.149743 Oct 16 01:22:06.079633 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2194/4244] 10.222.0.39 () {58 vars in 1150 bytes} [Sun Oct 16 01:22:05 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:06.089677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:06.099182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:06.101543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:06.120307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.121587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.122551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.124149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.125208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.126188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.203535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:06.235676 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5d5ec98a-8d19-4f93-9bba-977923a25110 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.153960 Oct 16 01:22:06.237504 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2195/4245] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:22:06 2022] GET /compute/v2.1/servers => generated 1012 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:06.245101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:06.247084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:06.262663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.263469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.264222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.265105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.265734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.266339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.315039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:06.329549 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30e038b0-df27-432c-9c3e-2b2b40ab9d85 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1312 microversion: 2.1 time: 0.891714 Oct 16 01:22:06.333260 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2051/4246] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:05 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1312 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:06.340331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:06.346444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:06.347352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:06.388485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.389393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.390046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.390985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.391658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.392277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.575853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:06.665197 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f972ed7-92c5-4350-bdc9-446cc40db1db tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.330506 Oct 16 01:22:06.666730 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2052/4247] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:22:06 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:06.672354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:06.674894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:06.682787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.683535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.684318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.685193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.685861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.686503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.729195 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1a3970cb-11a3-4cfc-9f27-79d10bc0b581 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060772 Oct 16 01:22:06.730358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2053/4248] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:22:06 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:06.737936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:06.746543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:06.747036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.servers [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Removing options 'limit' from query {{(pid=120546) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 16 01:22:06.747703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:06.755253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.756252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.757107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.758055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.758549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.759002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.794482 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e451f4ee-985c-4e48-a326-fca393fda98c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.061938 Oct 16 01:22:06.802685 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2054/4249] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Oct 16 01:22:06 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:06.803404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:06.812152 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ab2d1384-80f1-4832-aafc-6d8bde5e0235 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.571931 Oct 16 01:22:06.816225 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2196/4250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:06 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:06.818750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:06.831230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:06.832281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1000249553', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:06.840214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.840471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.841013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.841893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:06.842185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:06.842583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:06.987795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:07.087189 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e2be4fc-157b-4b6c-b2d0-ca5d148c86d7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1000249553" status: 200 len: 346 microversion: 2.1 time: 0.275590 Oct 16 01:22:07.089142 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2055/4251] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:22:06 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1000249553 => generated 346 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:07.102091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0b381bd1-8103-4560-af9c-0d9cb60a3ed7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:07.120313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b381bd1-8103-4560-af9c-0d9cb60a3ed7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:07.120826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b381bd1-8103-4560-af9c-0d9cb60a3ed7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:07.121261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0b381bd1-8103-4560-af9c-0d9cb60a3ed7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:07.176826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0b381bd1-8103-4560-af9c-0d9cb60a3ed7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Going to try to stop instance {{(pid=120545) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:22:07.281818 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0b381bd1-8103-4560-af9c-0d9cb60a3ed7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "POST /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2/action" status: 202 len: 0 microversion: 2.1 time: 0.183149 Oct 16 01:22:07.283901 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2197/4252] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:22:07 2022] POST /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:22:07.292350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:07.293194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:07.302766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:07.303711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:07.306380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:07.309200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:07.309854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:07.311615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:07.379859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:07.380567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:07.393586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:07.396882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:07.397507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:07.400731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:07.401511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:07.405137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:07.898866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:07.928961 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98516961-f3cd-4af7-8c43-47f976622150 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 0.641128 Oct 16 01:22:07.929827 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2056/4253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:07 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:07.965573 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:07.973994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9c80ab70-c65b-4a32-af84-651f37a3db6d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1312 microversion: 2.1 time: 0.598788 Oct 16 01:22:07.980708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:07.981484 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2198/4254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:07 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1312 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:07.985508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:07.990471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:07.999728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:08.013140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:08.015649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:08.016340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:08.016889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:08.017279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:08.017400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:08.018081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:08.018549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:08.019083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:08.019796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:08.029776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:08.031430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:08.141942 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef2027c7-3abe-4943-9acf-de10dee4e6d8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188145 Oct 16 01:22:08.142648 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2057/4255] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:22:07 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:08.394312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:08.403789 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:08.415354 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a6dac1fa-ecdd-41b9-b1d5-6801c200c7cc tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.422807 Oct 16 01:22:08.427909 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2199/4256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:07 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:08.608324 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-01b431a8-9664-4902-bcad-01cdc1d5b585 req-682ebe3c-5342-4156-96b7-2e3b8755a1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57546d04-76c2-4d2d-9c2c-0a5f736417e7", "name": "network-vif-plugged", "status": "completed", "tag": "8302be85-eee6-453d-bb4a-b5b4db76078e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:08.628587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-01b431a8-9664-4902-bcad-01cdc1d5b585 req-682ebe3c-5342-4156-96b7-2e3b8755a1f3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:08.632922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-01b431a8-9664-4902-bcad-01cdc1d5b585 req-682ebe3c-5342-4156-96b7-2e3b8755a1f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:08.635937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-01b431a8-9664-4902-bcad-01cdc1d5b585 req-682ebe3c-5342-4156-96b7-2e3b8755a1f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:08.664605 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-01b431a8-9664-4902-bcad-01cdc1d5b585 req-682ebe3c-5342-4156-96b7-2e3b8755a1f3 service nova] Creating event network-vif-plugged:8302be85-eee6-453d-bb4a-b5b4db76078e for instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 on n-h2-master-1 Oct 16 01:22:08.685082 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-01b431a8-9664-4902-bcad-01cdc1d5b585 req-682ebe3c-5342-4156-96b7-2e3b8755a1f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075028 Oct 16 01:22:08.692254 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2058/4257] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:08.967450 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:08.969143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:08.993585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:08.994756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:08.995106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:09.009485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:09.011017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:09.023632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:09.025468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:09.025977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:09.026420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:09.035569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:09.036092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:09.045342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:09.048987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:09.049727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:09.889991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:09.902503 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6a87685-5b65-4ed4-9fb8-106f64657c5d tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 0.947118 Oct 16 01:22:09.905259 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2200/4258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:08 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:09.917812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:09.925475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:09.940783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:09.942047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:09.944702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:09.945824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:09.949263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:09.950029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:10.032200 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-223090d3-37f8-49ae-b6a3-9048b1217ea0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122048 Oct 16 01:22:10.038510 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2201/4259] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:22:09 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:22:10.050885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:10.064009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:10.064391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9dc65c6-424a-4276-8e3c-dacc69d9afb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1312 microversion: 2.1 time: 1.058828 Oct 16 01:22:10.064985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:10.071831 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2059/4260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:09 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1312 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:10.085794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:10.086354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:10.086727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:10.090371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:10.091075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:10.091311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:10.144359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:10.144876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:10.156268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:10.158683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:10.159805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:10.164249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:10.167278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:10.168189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:10.222181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:22:10.400044 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:10.411489 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ff87f3c-f3f0-43d4-a582-186f099ed903 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.372490 Oct 16 01:22:10.412740 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2202/4261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:10 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:10.437322 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e18539d7-c947-4f40-9656-3d3741146d86 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 204 len: 0 microversion: 2.1 time: 0.296307 Oct 16 01:22:10.441757 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2060/4262] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:22:10 2022] DELETE /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:22:10.450032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:10.451077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:10.459673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:10.460178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:10.460625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:10.464188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:10.464595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:10.473422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:10.871372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:10.898246 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b0fb46ec-f516-4980-b885-cd9547506405 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1683 microversion: 2.1 time: 0.453023 Oct 16 01:22:10.899024 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2203/4263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:10 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1683 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:10.934004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:10.934805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:10.945268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:10.953401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:10.954021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:10.954843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:10.955525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:10.956028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:11.093423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:11.096167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:11.111967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:11.112678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:11.113285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:11.114182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:11.114809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:11.115429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:11.458070 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:11.469449 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e799b32e-d497-46de-ad48-c4385862f761 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 0.540506 Oct 16 01:22:11.471334 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2061/4264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:10 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:11.477358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:11.478026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:11.509497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:11.512550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:11.513779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:11.514700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:11.515362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:11.515792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:11.739490 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:11.753859 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a639f3bd-f1ac-4886-a33d-84281ef60c8d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1499 microversion: 2.1 time: 0.666578 Oct 16 01:22:11.754448 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2204/4265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:11 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1499 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:11.923411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:11.924033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:11.940271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:11.940770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:11.941206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:11.941921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:11.942445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:11.942882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:12.155141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:12.172030 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8e0bf78-edd9-45f0-baf3-281bc710f974 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.699430 Oct 16 01:22:12.172649 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2062/4266] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:11 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:12.464943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:12.481067 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7d5743b-3526-4872-b174-b89f1313a5f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1683 microversion: 2.1 time: 0.562350 Oct 16 01:22:12.481659 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2205/4267] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:11 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1683 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:12.498683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:12.499339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:12.514480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:12.514987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:12.515414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:12.516507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:12.517119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:12.517702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:13.213144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:13.213924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:13.221340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:13.226719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:13.227848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:13.230113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:13.232218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:13.232900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:13.295503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:13.308352 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d391c67b-e5f0-4c18-8e91-546306600738 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 0.816039 Oct 16 01:22:13.319005 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2063/4268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:12 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:13.519093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:13.519777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:13.527394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:13.531561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:13.532007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:13.532736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:13.533183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:13.543418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:13.548704 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:14.133763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:14.153245 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6db0752-5e3f-4f94-93d9-920b578f2d46 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1521 microversion: 2.1 time: 0.944112 Oct 16 01:22:14.155098 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2206/4269] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:13 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1521 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:14.246425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:14.254274 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c811a0ac-c415-40cb-bf9b-2269ce0052f4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1683 microversion: 2.1 time: 0.739280 Oct 16 01:22:14.254860 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2064/4270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:13 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1683 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:14.337670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:14.339239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:14.350039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:14.351308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:14.351931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:14.356655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:14.357425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:14.358176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:14.459461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77f6b0a1-e414-477e-b1ff-93ea6d40cf65 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1191709966", "availability_zone": "foo_zone"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:14.465578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.aggregate [None req-77f6b0a1-e414-477e-b1ff-93ea6d40cf65 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Generated uuid e46e601b-1672-4df3-badc-272b98b825e8 for aggregate {{(pid=120545) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 16 01:22:14.531611 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77f6b0a1-e414-477e-b1ff-93ea6d40cf65 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.374697 Oct 16 01:22:14.534572 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2207/4271] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Oct 16 01:22:14 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:14.548293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-731fa118-77ab-41e8-9d3c-85e03c4b56e2 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:14.601691 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-731fa118-77ab-41e8-9d3c-85e03c4b56e2 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.057500 Oct 16 01:22:14.602738 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2208/4272] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:22:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:14.615746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d4c00da-bd31-4009-8671-c6959e6dea45 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:14.641767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d4c00da-bd31-4009-8671-c6959e6dea45 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:14.641767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d4c00da-bd31-4009-8671-c6959e6dea45 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:14.641767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d4c00da-bd31-4009-8671-c6959e6dea45 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:14.641767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d4c00da-bd31-4009-8671-c6959e6dea45 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:14.641767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d4c00da-bd31-4009-8671-c6959e6dea45 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:14.641767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d4c00da-bd31-4009-8671-c6959e6dea45 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:14.707729 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d4c00da-bd31-4009-8671-c6959e6dea45 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.089017 Oct 16 01:22:14.709193 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2209/4273] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Oct 16 01:22:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:14.720052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40010e62-7c89-48f2-b6aa-a09465e06f0c"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:14.722571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:14.737201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:14.737783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:14.739550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:14.740507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:14.743039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:14.743730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:14.996633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:15.013924 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-411891c7-d886-49b9-bf8c-6d8d26498064 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 0.681494 Oct 16 01:22:15.023514 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2065/4274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:14 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:15.034664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-46e20824-1fd4-4ec7-b0df-1fdaae73daa3 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:15.110409 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-46e20824-1fd4-4ec7-b0df-1fdaae73daa3 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.085440 Oct 16 01:22:15.129534 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2066/4275] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Oct 16 01:22:15 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:15.148626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-be13d2c7-da56-415c-8159-3e8aa2b930b5 req-8b447eac-5a5c-48e9-a41e-814eb6f400da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f39da51-b797-405f-8c98-c4d962123c45", "name": "network-vif-deleted", "tag": "15cdae2a-120b-4511-8163-93980f8cde06"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:15.196131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-be13d2c7-da56-415c-8159-3e8aa2b930b5 req-8b447eac-5a5c-48e9-a41e-814eb6f400da service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:15.199138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-be13d2c7-da56-415c-8159-3e8aa2b930b5 req-8b447eac-5a5c-48e9-a41e-814eb6f400da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:15.203451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-be13d2c7-da56-415c-8159-3e8aa2b930b5 req-8b447eac-5a5c-48e9-a41e-814eb6f400da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:15.228390 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-be13d2c7-da56-415c-8159-3e8aa2b930b5 req-8b447eac-5a5c-48e9-a41e-814eb6f400da service nova] Creating event network-vif-deleted:15cdae2a-120b-4511-8163-93980f8cde06 for instance 5f39da51-b797-405f-8c98-c4d962123c45 on n-h1-master-1 Oct 16 01:22:15.247028 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-be13d2c7-da56-415c-8159-3e8aa2b930b5 req-8b447eac-5a5c-48e9-a41e-814eb6f400da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105941 Oct 16 01:22:15.248720 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2067/4276] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:15.255250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-115ce097-ee4e-4a65-97df-234cb4141a42 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:15.277847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115ce097-ee4e-4a65-97df-234cb4141a42 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:15.280007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115ce097-ee4e-4a65-97df-234cb4141a42 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:15.280748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-115ce097-ee4e-4a65-97df-234cb4141a42 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:15.356681 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:15.418277 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd9990e1-ea48-4686-9355-43e848bc3d21 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.706669 Oct 16 01:22:15.424635 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2210/4277] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:22:14 2022] POST /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:15.448268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:15.453352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:15.476801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:15.477472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:15.477757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:15.478530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:15.480705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:15.482243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:15.940429 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-115ce097-ee4e-4a65-97df-234cb4141a42 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.689858 Oct 16 01:22:15.942906 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2068/4278] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:22:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:15.959185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:15.973257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:15.974149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:15.979397 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ef447c7d-54e9-404b-a2f7-b75eb2cfafd2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1501 microversion: 2.1 time: 0.540777 Oct 16 01:22:15.987262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:15.990484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:15.991366 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2211/4279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:15 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1501 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:15.991947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:15.993278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:15.997140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:15.998319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:16.008998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e769c5a4-3ed3-4290-a20e-60b94267d671 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:16.023577 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:16.026235 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e769c5a4-3ed3-4290-a20e-60b94267d671 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.033054 Oct 16 01:22:16.031244 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2212/4280] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:22:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:16.036045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:16.036646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:16.061204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:16.061993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:16.063056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:16.066660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:16.067519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:16.068171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:16.081352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:16.084840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:16.088866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:16.090800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lazy-loading 'fault' on Instance uuid 5f39da51-b797-405f-8c98-c4d962123c45 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:22:16.252682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:16.263133 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-83b034f3-5605-4544-9ecd-af2a9d2aa359 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 200 len: 1336 microversion: 2.1 time: 0.317979 Oct 16 01:22:16.263829 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2069/4281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:15 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 1336 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:16.268647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d60ad47a-ecda-4512-98e9-0f214d293085 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1661483745", "availability_zone": "foo_zone"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:16.375497 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d60ad47a-ecda-4512-98e9-0f214d293085 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.110217 Oct 16 01:22:16.376737 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2070/4282] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Oct 16 01:22:16 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:16.383149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:16.385460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:16.393855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:16.394879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:16.395763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:16.399435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:16.401916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:16.402807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:16.891362 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:17.060906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:17.073781 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-78b528a6-4295-4cfb-a2a0-8e21e965baf4 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 0.694962 Oct 16 01:22:17.074395 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2071/4283] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:16 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:17.104977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:17.107387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22367ffa-0a66-4fc5-aa20-a35c6838369e tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:17.122486 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1dcc8540-1bd9-4e85-86d5-146a3dc71566 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1516 microversion: 2.1 time: 1.087866 Oct 16 01:22:17.127515 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2213/4284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:16 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1516 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:17.157398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0b8fb3a-3a4a-4427-bda6-6da03dd0de1e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:17.158612 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22367ffa-0a66-4fc5-aa20-a35c6838369e tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.060737 Oct 16 01:22:17.159290 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2072/4285] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:22:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:17.162042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f0b8fb3a-3a4a-4427-bda6-6da03dd0de1e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: e7d5e678-3f22-4cb1-9afd-068b10c6281f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:17.174411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3544c7a8-25d5-44e8-8cdf-040d1819dec7 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:17.176381 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f0b8fb3a-3a4a-4427-bda6-6da03dd0de1e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Instance e7d5e678-3f22-4cb1-9afd-068b10c6281f could not be found. Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0b8fb3a-3a4a-4427-bda6-6da03dd0de1e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/e7d5e678-3f22-4cb1-9afd-068b10c6281f/action HTTP/1.1 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 14 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: {"rescue": {}} Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e7d5e678-3f22-4cb1-9afd-068b10c6281f could not be found. Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e7d5e678-3f22-4cb1-9afd-068b10c6281f', 'body': {'rescue': {}}} Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d5e678-3f22-4cb1-9afd-068b10c6281f could not be found. Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d5e678-3f22-4cb1-9afd-068b10c6281f could not be found. Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.184755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:17.189399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:17.189399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:17.189399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:17.189399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:17.189399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d5e678-3f22-4cb1-9afd-068b10c6281f could not be found. Oct 16 01:22:17.189399 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.189860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3544c7a8-25d5-44e8-8cdf-040d1819dec7 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.018095 Oct 16 01:22:17.189860 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2073/4286] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:22:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:22:17.190795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0b8fb3a-3a4a-4427-bda6-6da03dd0de1e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 404 to user: Instance e7d5e678-3f22-4cb1-9afd-068b10c6281f could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:17.191760 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0b8fb3a-3a4a-4427-bda6-6da03dd0de1e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/e7d5e678-3f22-4cb1-9afd-068b10c6281f/action" status: 404 len: 111 microversion: 2.1 time: 0.043528 Oct 16 01:22:17.195061 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2214/4287] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:22:17 2022] POST /compute/v2.1/servers/e7d5e678-3f22-4cb1-9afd-068b10c6281f/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:22:17.205593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:17.208482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:17.223117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c89bb6d-f130-4bc6-8379-0b1d58d979c3 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-master-1"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:17.231526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:17.232330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:17.232942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:17.234046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:17.235045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:17.235480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:17.246478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c89bb6d-f130-4bc6-8379-0b1d58d979c3 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:17.249627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c89bb6d-f130-4bc6-8379-0b1d58d979c3 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:17.250312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c89bb6d-f130-4bc6-8379-0b1d58d979c3 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:17.380676 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-450a3140-f6bf-4824-b116-398b0657a7da tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action" status: 202 len: 0 microversion: 2.1 time: 0.178796 Oct 16 01:22:17.383112 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2215/4288] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:22:17 2022] POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:22:17.390438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:17.391515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:17.400874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:17.401877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:17.403552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:17.404772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:17.405782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:17.407242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:17.430360 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 HTTP/1.1 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5f39da51-b797-405f-8c98-c4d962123c45'} Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:17.445075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.450326 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:17.450326 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:17.450326 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:17.450326 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:17.450326 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:17.450326 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:22:17.450326 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:17.459535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:17.460926 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4cba9335-cd81-434f-a9a7-e9b787d450f0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 404 len: 111 microversion: 2.1 time: 0.076234 Oct 16 01:22:17.462499 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2216/4289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:17 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:22:17.463947 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:17.469674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:17.471188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:17.476369 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0c89bb6d-f130-4bc6-8379-0b1d58d979c3 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.282758 Oct 16 01:22:17.480618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:17.483184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:17.484199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:17.485656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:17.486392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:17.486541 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2074/4290] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Oct 16 01:22:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:22:17.487170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:17.491953 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-390bba7e-8bcf-4cfe-bb3a-ba7f2d144755 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '.version_select at 0x7fd64e1bcdc0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:17.521949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-390bba7e-8bcf-4cfe-bb3a-ba7f2d144755 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652602376" status: 202 len: 0 microversion: 2.1 time: 0.033610 Oct 16 01:22:17.523303 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2075/4291] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:22:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652602376 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:22:17.535804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2ca11cd-4b7f-42c8-ae02-b2664119cb17 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:17.591092 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2ca11cd-4b7f-42c8-ae02-b2664119cb17 tempest-TestAggregatesBasicOps-1702688525 tempest-TestAggregatesBasicOps-1702688525-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.066494 Oct 16 01:22:17.592825 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2076/4292] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:22:17 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 16 01:22:17.881076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:17.902255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8cfba100-b85c-43f7-a2f1-38d83a7b4138 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1521 microversion: 2.1 time: 0.436460 Oct 16 01:22:17.903566 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2217/4293] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:17 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:18.103112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:18.105904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:18.116169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:18.119598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:18.120331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:18.123167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:18.123911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:18.129268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:18.586463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:18.597574 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-630624db-9397-435b-a9b1-da82c578768e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 0.498035 Oct 16 01:22:18.610947 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2077/4294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:18 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:18.929037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:18.930098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:18.953403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:18.957302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:18.957861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:18.960680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:18.961552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:18.965949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:19.627303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:19.627924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:19.641466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:19.644173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:19.646032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:19.651589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:19.652337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:19.653904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:20.005989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:20.014992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ccbbc48d-e9d9-4978-be13-68a6e5f75c49 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1501 microversion: 2.1 time: 1.090976 Oct 16 01:22:20.020949 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2218/4295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:18 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1501 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:20.060486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:20.065159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:20.081664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:20.084896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:20.085801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:20.087045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:20.088192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:20.088858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:20.129923 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:20.156116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lazy-loading 'flavor' on Instance uuid 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:22:20.177829 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Cannot 'rescue' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state paused Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action HTTP/1.1 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 14 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: {"rescue": {}} Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'rescue' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state paused Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3', 'body': {'rescue': {}}} Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 in vm_state paused. Cannot rescue while the instance is in this state. Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state paused Oct 16 01:22:20.188550 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state paused Oct 16 01:22:20.192530 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:20.196487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 409 to user: Cannot 'rescue' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state paused {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:20.198110 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-36028de0-7357-4e84-95d7-209a7d91e64a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action" status: 409 len: 144 microversion: 2.1 time: 0.152242 Oct 16 01:22:20.202673 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2219/4296] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:22:20 2022] POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action => generated 144 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:22:20.212385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:20.213273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:20.219792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:20.220663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:20.221401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:20.222410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:20.223203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:20.223848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:20.321318 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2fadefe2-7553-494b-ae0f-4dc780bdd0f5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action" status: 202 len: 0 microversion: 2.1 time: 0.116607 Oct 16 01:22:20.326492 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2220/4297] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:22:20 2022] POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:22:20.333011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:20.334076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:20.342955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:20.344316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:20.345335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:20.347483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:20.348445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:20.349816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:21.501282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:21.518140 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8b23d92-ccfc-4550-8c7b-ed6a58d4c655 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 1.890746 Oct 16 01:22:21.519053 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2078/4298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:19 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:21.680273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:21.690220 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c2b12aa-4ef4-4356-a62e-281f681195e2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1508 microversion: 2.1 time: 1.362118 Oct 16 01:22:21.695109 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2221/4299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:20 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1508 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:21.706798 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7234e8cf-64c0-4948-9cba-4c05512dbd90 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: .version_select at 0x7fd64d7a44c0>, body: {"keypair": {"name": "tempest-keypair-439365635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzz4ZchTc3wKtAPI+ceRa1dc3sn4ulMbSdPL8o8P0QvQSpr1ExeAOwwGD5UEsCCffpeD/SKf28JmABocHdIh8/71zsFATE7kaEoZWyECZ3veo1Fz2e8yGSQ0p4DPqfxbg=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:21.748091 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7234e8cf-64c0-4948-9cba-4c05512dbd90 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for project e664ea80daaf450886978f25b2d9e373. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:22:21.755732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7234e8cf-64c0-4948-9cba-4c05512dbd90 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for user d5e97960c4eb488b900951e0898f34c8 and project e664ea80daaf450886978f25b2d9e373. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:22:21.786854 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7234e8cf-64c0-4948-9cba-4c05512dbd90 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.086714 Oct 16 01:22:21.788089 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2079/4300] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:22:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:22.542902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:22.551272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:22.580023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:22.608960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:22.608960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:22.608960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:22.608960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:22.608960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:22.720987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:22.721604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:22.740530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:22.741026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:22.741802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:22.742707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:22.743648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:22.744283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:23.801448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:23.812289 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f57dec4-81b7-42b1-ba57-20527f48d2a9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 1.274003 Oct 16 01:22:23.815482 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2222/4301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:22 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:23.991579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:24.027285 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d09f9a8a-32ad-42e5-a819-92232fc3b8ab tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1516 microversion: 2.1 time: 1.307125 Oct 16 01:22:24.028795 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2080/4302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:22 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1516 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:24.839794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:24.841496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:24.847826 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:24.869020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:24.871715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:24.872510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:24.877016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:24.879647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:24.881806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:25.725604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-133222626", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52e8b52a-a014-46fd-b3eb-a7709906aae7"}], "security_groups": [{"name": "tempest-securitygroup--2102342111"}], "key_name": "tempest-keypair-439365635", "user_data": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:25.956379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] validate_networks() for [('52e8b52a-a014-46fd-b3eb-a7709906aae7', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:22:26.173460 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:26.186559 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-942cc043-41a2-4b0a-b0b9-a8dccbd6f9cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 1.350356 Oct 16 01:22:26.187963 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2223/4303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:24 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:27.341265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:22:27.341888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:22:27.342136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:22:27.342538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:22:27.342955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:22:27.354189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:27.354877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:27.355525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:27.356587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:27.357199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:27.357783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:27.381145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for project e664ea80daaf450886978f25b2d9e373. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:22:27.389554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for user d5e97960c4eb488b900951e0898f34c8 and project e664ea80daaf450886978f25b2d9e373. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:22:27.409200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:22:27.413115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:22:27.520040 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8dc551a2-ccdf-462d-8458-88caa3eb9993 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.798401 Oct 16 01:22:27.523459 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2081/4304] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:22:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:22:27.534616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:27.552747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:27.582861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:27.584632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:27.585985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:27.586749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:27.587244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:27.587916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:27.792921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-251116685", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:27.897970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] validate_networks() for [('c823a5ff-2110-4a77-95b2-4f3653a870f1', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:22:28.580103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:28.591768 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ae494421-bf92-4e9c-bedd-03458dc19e08 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1523 microversion: 2.1 time: 1.065351 Oct 16 01:22:28.592891 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2082/4305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:27 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1523 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:28.602116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:28.607311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:28.620581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:28.621079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:28.621522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:28.622226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:28.626047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:28.626737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:28.668820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lazy-loading 'flavor' on Instance uuid 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:22:28.790357 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4bfa8c37-5ce3-456a-9cc6-d44ecff9e096 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action" status: 200 len: 32 microversion: 2.1 time: 0.193941 Oct 16 01:22:28.791782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2083/4306] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:22:28 2022] POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:22:28.797326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:28.798350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:28.805246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:28.805728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:28.806671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:28.807783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:28.808405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:28.809120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:28.893569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:28.904694 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a145654-589d-478f-a2bd-0eb74a0c2f06 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1292 microversion: 2.1 time: 0.111562 Oct 16 01:22:28.905960 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2084/4307] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:28 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:28.924031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:28.925174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:28.940187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:28.941132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:28.941870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:28.942958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:28.943398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:28.944252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:29.442829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:22:29.444581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:22:29.446060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:22:29.446722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:22:29.448249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:22:29.463880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:29.464797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:29.466890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:29.468210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:29.468911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:29.469855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:29.496994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Getting quotas for project fc93a361db0a42c0ac90b82d20b91cff. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:22:29.507190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Getting quotas for user 85cb1d720ba24d7f908a93fffe29427b and project fc93a361db0a42c0ac90b82d20b91cff. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:22:29.530397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:22:29.534425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:22:29.608327 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa814a45-d18f-4caa-84d1-164a8f95fb6f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.414966 Oct 16 01:22:29.609334 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2224/4308] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:22:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:22:29.627761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:29.628627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:29.652433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:29.669091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:29.669843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:29.670454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:29.671356 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-771a3fce-63a1-4e5a-af85-daf6936924cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.763934 Oct 16 01:22:29.672397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:29.673232 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2085/4309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:28 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:29.673934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:29.674525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:29.690342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8068d759-6e93-410a-81ca-a56fa4da84a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:29.691101 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8068d759-6e93-410a-81ca-a56fa4da84a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:29.905678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8068d759-6e93-410a-81ca-a56fa4da84a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:29.914452 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8068d759-6e93-410a-81ca-a56fa4da84a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1216 microversion: 2.1 time: 0.237023 Oct 16 01:22:29.917111 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2086/4310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:29 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1216 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:29.946185 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:29.950101 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:29.964764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:29.968971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:29.969632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:29.971999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:29.974388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:29.976428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:30.143187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:30.157168 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-089bce64-3ce7-448d-bd19-c0977977d29c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1298 microversion: 2.1 time: 0.219813 Oct 16 01:22:30.164009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2087/4311] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:29 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:30.206445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:30.216338 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e428012c-37f4-4307-8afe-520c8561b474 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1500 microversion: 2.1 time: 0.597714 Oct 16 01:22:30.216973 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2225/4312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:29 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1500 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:30.240869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:30.247658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:30.248885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:30.256405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:30.257147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:30.257849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:30.258777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:30.260014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:30.260839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:30.477690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:30.550288 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:30.596759 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a40b3c79-c4d3-43a3-acc4-ad8f2e15e78a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.359947 Oct 16 01:22:30.611767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d1706b6-c804-439b-b1f5-304b302bf2b9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:30.617911 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2088/4313] 10.222.0.39 () {58 vars in 1154 bytes} [Sun Oct 16 01:22:30 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:30.621095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d1706b6-c804-439b-b1f5-304b302bf2b9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:30.621839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d1706b6-c804-439b-b1f5-304b302bf2b9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:30.622485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d1706b6-c804-439b-b1f5-304b302bf2b9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:30.663409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4d1706b6-c804-439b-b1f5-304b302bf2b9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Going to try to start instance {{(pid=120545) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 01:22:30.705441 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:30.707769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:30.732842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:30.737759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:30.738505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:30.741742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:30.745353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:30.745931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:30.778436 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d1706b6-c804-439b-b1f5-304b302bf2b9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "POST /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2/action" status: 202 len: 0 microversion: 2.1 time: 0.166442 Oct 16 01:22:30.780488 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2226/4314] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:22:30 2022] POST /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:22:30.794436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:30.797308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:30.815639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:30.816128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:30.816569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:30.817292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:30.823901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:30.827647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:31.242092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:31.254315 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bc9baaee-2dac-46b8-a5d2-96a353464d21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.560858 Oct 16 01:22:31.267311 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2089/4315] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:30 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:31.280181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:31.281273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:31.289254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:31.290078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:31.290814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:31.291788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:31.292586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:31.293220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:31.445487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:31.461148 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a32d136-44b6-4c39-af1b-fc7eed541a4f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1509 microversion: 2.1 time: 0.674499 Oct 16 01:22:31.462201 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2227/4316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:30 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1509 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:31.480748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:31.481752 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:31.491269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:31.492025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:31.492647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:31.499146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:31.499753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:31.500250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:31.519765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:31.535747 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-65c26ebe-87a9-4bc7-81d5-2810dfc011f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1268 microversion: 2.1 time: 0.266755 Oct 16 01:22:31.537123 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2090/4317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:31 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1268 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:31.917589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:31.932275 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-615868aa-a3de-4372-976f-22b4167ebf47 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1366 microversion: 2.1 time: 0.468302 Oct 16 01:22:31.934477 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2228/4318] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:31 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:32.290949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:32.292330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:32.311320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:32.312703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:32.313519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:32.315162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:32.315731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:32.316256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:32.490342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:32.492117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:32.521311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:32.522021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:32.522416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:32.523191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:32.523655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:32.524088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:32.837271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:32.844057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:32.846608 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cbddf2f2-89d4-4d67-86a8-913fd862f60d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.562992 Oct 16 01:22:32.847732 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2091/4319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:32 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:32.852577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:32.853436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:32.859687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:32.860415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:32.861037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:32.861925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:32.862563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:32.863192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:32.867536 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-01365a36-3d6a-4a8c-bc64-b5352122e190 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1509 microversion: 2.1 time: 0.381486 Oct 16 01:22:32.874954 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2229/4320] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:32 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:32.877236 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:32.878009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:32.885316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:32.886163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:32.895422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:32.896617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:32.897292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:32.897931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:32.946021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:22:33.029079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:33.059513 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-744d473e-daa0-4e28-8e82-c2996103234f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1274 microversion: 2.1 time: 0.210095 Oct 16 01:22:33.074887 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2092/4321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:32 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1274 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:33.074887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:33.076977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:33.094116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:33.094624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:33.096217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:33.098396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:33.098819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:33.101361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:33.148816 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-518813d2-e70b-4941-ba23-06afcf54b0a1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 204 len: 0 microversion: 2.1 time: 0.278706 Oct 16 01:22:33.151111 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2230/4322] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:22:32 2022] DELETE /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:22:33.177851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:33.178634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:33.194125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:33.194640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:33.195124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:33.195845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:33.196309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:33.196764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:33.843169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:33.852284 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4ebf61de-f483-4baa-897c-21aaa1cc79f1 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1366 microversion: 2.1 time: 0.789078 Oct 16 01:22:33.855630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2093/4323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:33 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1366 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:33.874129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d05afcb8-a99d-4433-9c36-ed879392a384 req-2517ac4e-4840-4fe9-a319-ec5a9a5405e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b35480-ba38-4c33-bfa8-e63c3eafbeec", "tag": "22ac8bf9-7ba3-4496-838e-9f0b26eada5a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:33.897805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d05afcb8-a99d-4433-9c36-ed879392a384 req-2517ac4e-4840-4fe9-a319-ec5a9a5405e9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:33.898527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d05afcb8-a99d-4433-9c36-ed879392a384 req-2517ac4e-4840-4fe9-a319-ec5a9a5405e9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:33.899896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d05afcb8-a99d-4433-9c36-ed879392a384 req-2517ac4e-4840-4fe9-a319-ec5a9a5405e9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:33.916159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:33.922121 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d05afcb8-a99d-4433-9c36-ed879392a384 req-2517ac4e-4840-4fe9-a319-ec5a9a5405e9 service nova] Creating event network-changed:22ac8bf9-7ba3-4496-838e-9f0b26eada5a for instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec on n-h1-master-1 Oct 16 01:22:33.927242 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1ab40f00-94a4-4088-8653-ef6c637aef87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1551 microversion: 2.1 time: 0.766443 Oct 16 01:22:33.929489 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2231/4324] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:33 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1551 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:33.939478 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d05afcb8-a99d-4433-9c36-ed879392a384 req-2517ac4e-4840-4fe9-a319-ec5a9a5405e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072177 Oct 16 01:22:33.939478 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2094/4325] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:33.942675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:33.943582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:33.954609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:33.955267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:33.955828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:33.956655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:33.957446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:33.958088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:33.961790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:33.964651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:34.000109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:34.001091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:34.001740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:34.002733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:34.003425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:34.004054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:34.312369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:34.329206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:34.345767 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-32269476-2c1d-4c64-9015-4a04ef8274ac tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1509 microversion: 2.1 time: 0.399916 Oct 16 01:22:34.346798 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2232/4326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:33 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:34.351074 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f20424e0-c7c8-4913-84c5-f4ee0daddb5f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.413993 Oct 16 01:22:34.354722 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2095/4327] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:33 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:34.361021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:34.361792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:34.375563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:34.376309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:34.377182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:34.378054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:34.378675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:34.379342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:34.411734 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:34.471162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:34.481028 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba3bbaaa-24be-421a-a8c1-da59a46e8c17 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1274 microversion: 2.1 time: 0.132954 Oct 16 01:22:34.481628 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2233/4328] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:34 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:34.882648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:34.883302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:34.890256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:34.890738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:34.891198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:34.892091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:34.892723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:34.893349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:34.958145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:34.959083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:34.984795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:34.986720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:34.987274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:34.988032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:34.988494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:34.988918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:35.267119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:35.286989 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-68368175-a27c-463c-a476-daffe66b1101 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1366 microversion: 2.1 time: 0.408917 Oct 16 01:22:35.288321 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2096/4329] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:34 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:35.370133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:35.371164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:35.387946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:35.388670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:35.389602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:35.390315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:35.390948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:35.391531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:35.475283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:35.488649 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-73c46dba-c05e-439b-b566-0de2751ab90a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1551 microversion: 2.1 time: 0.535045 Oct 16 01:22:35.502947 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2234/4330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:34 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1551 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:35.508730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:35.510224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:35.517072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:35.517887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:35.518560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:35.520727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:35.521569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:35.522203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:35.935379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:35.943755 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9bdb5f98-59e4-4ec4-a8c0-134c69000bfb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1509 microversion: 2.1 time: 0.578131 Oct 16 01:22:35.948252 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2097/4331] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:35 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1509 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:35.969899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:35.970849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:35.977556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:35.979209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:35.979890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:35.980833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:35.981522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:35.982157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:36.020579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:36.032178 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8feac627-1e66-451b-aabc-bcd810ab9dbe tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.541252 Oct 16 01:22:36.039893 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2235/4332] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:35 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:36.281986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:36.299238 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bc20300e-fb65-436f-82d2-0c5e1d2a7e3f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.338718 Oct 16 01:22:36.301070 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2098/4333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:35 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:36.320956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:36.321556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:36.332300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:36.332547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:36.332954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:36.333664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:36.334123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:36.339054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:36.350070 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-66887274-6888-498a-8953-71573c2545a2 req-5ec43c1d-b2ce-40d6-937d-0788fe08c944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57546d04-76c2-4d2d-9c2c-0a5f736417e7", "name": "network-vif-deleted", "tag": "8302be85-eee6-453d-bb4a-b5b4db76078e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:36.379803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-66887274-6888-498a-8953-71573c2545a2 req-5ec43c1d-b2ce-40d6-937d-0788fe08c944 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:36.380289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-66887274-6888-498a-8953-71573c2545a2 req-5ec43c1d-b2ce-40d6-937d-0788fe08c944 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:36.380720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-66887274-6888-498a-8953-71573c2545a2 req-5ec43c1d-b2ce-40d6-937d-0788fe08c944 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:36.404995 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-66887274-6888-498a-8953-71573c2545a2 req-5ec43c1d-b2ce-40d6-937d-0788fe08c944 service nova] Creating event network-vif-deleted:8302be85-eee6-453d-bb4a-b5b4db76078e for instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 on n-h2-master-1 Oct 16 01:22:36.416546 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-66887274-6888-498a-8953-71573c2545a2 req-5ec43c1d-b2ce-40d6-937d-0788fe08c944 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069426 Oct 16 01:22:36.418746 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2099/4334] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:36.524190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:36.530095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:36.545676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:36.547124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:36.547821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:36.548690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:36.552368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:36.554441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:36.613469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:36.624002 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c25ce950-aa2a-4b4c-97b8-24cbd539bf93 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1366 microversion: 2.1 time: 0.306993 Oct 16 01:22:36.630746 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2236/4335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:36 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:36.674328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:36.689527 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c8c940a-cd74-4d97-95a9-bf645ba7202e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1343 microversion: 2.1 time: 0.178260 Oct 16 01:22:36.690449 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2100/4336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:36 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1343 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:36.976365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:36.977759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:36.989859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:36.990492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:36.991062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:36.992467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:36.993037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:36.994774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.058104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:37.058709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:37.068865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.069654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.076722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.077757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.078496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.079223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.254073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:37.267382 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff77ee4e-0fa6-4b5c-9f3f-379ac1e62cf8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1513 microversion: 2.1 time: 0.297253 Oct 16 01:22:37.267983 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2237/4337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:36 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1513 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:37.294942 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:37.301662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:37.302327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.compute.servers [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Removing options 'limit' from query {{(pid=120545) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 16 01:22:37.303419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:37.305306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.305956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.308308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.309231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.309867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.310465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.312072 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-84c6abe4-9f57-4936-a3c6-8aa5593d262f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.021957 Oct 16 01:22:37.327251 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2238/4338] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Oct 16 01:22:37 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:22:37.329415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:37.330083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:37.336473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.336965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.338251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.338960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.339437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.339867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.505207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:37.521010 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35eead71-89c2-4d35-8810-f798adbc500b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.467119 Oct 16 01:22:37.536149 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2101/4339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:37 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:37.551624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:37.554610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:37.569794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.570577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.571199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.572273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.573050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.573700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.617214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:37.632356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cdcde01f-4773-451e-b4eb-890a5cc899f7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.307171 Oct 16 01:22:37.649273 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2239/4340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:37 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:37.654871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:37.655515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:37.662159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.662670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.663142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.663847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.664309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.664741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.898247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:37.912749 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8233408f-3484-4ec2-a9c3-39107044d462 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1513 microversion: 2.1 time: 0.371152 Oct 16 01:22:37.913893 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2102/4341] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:37 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1513 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:37.925402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:37.926375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:37.941331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.944877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.945573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:37.946892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:37.947595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:37.950534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:38.090394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:38.120343 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-08028c96-c8cb-48b2-aa0f-9ed289e701af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1343 microversion: 2.1 time: 0.202400 Oct 16 01:22:38.122898 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2103/4342] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:37 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:38.135184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:38.144649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:38.171762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:38.176300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:38.177023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:38.183757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:38.184469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:38.184634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:38.185180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:38.201237 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e424b38-94f0-4c36-b8cc-0715e81ad921 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1366 microversion: 2.1 time: 0.547016 Oct 16 01:22:38.202078 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2240/4343] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:37 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1366 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:38.454764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3dc923bd-bbbe-433c-bd7e-e3b799d23ddb req-3132addc-101d-4bf4-a360-a5eb64d011c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438", "tag": "ebf526f4-6d18-4e21-9c38-4219f2d56da2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:38.493219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3dc923bd-bbbe-433c-bd7e-e3b799d23ddb req-3132addc-101d-4bf4-a360-a5eb64d011c4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:38.498637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3dc923bd-bbbe-433c-bd7e-e3b799d23ddb req-3132addc-101d-4bf4-a360-a5eb64d011c4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:38.499231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3dc923bd-bbbe-433c-bd7e-e3b799d23ddb req-3132addc-101d-4bf4-a360-a5eb64d011c4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:38.532272 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3dc923bd-bbbe-433c-bd7e-e3b799d23ddb req-3132addc-101d-4bf4-a360-a5eb64d011c4 service nova] Creating event network-changed:ebf526f4-6d18-4e21-9c38-4219f2d56da2 for instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 on n-h2-master-1 Oct 16 01:22:38.546204 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3dc923bd-bbbe-433c-bd7e-e3b799d23ddb req-3132addc-101d-4bf4-a360-a5eb64d011c4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103548 Oct 16 01:22:38.547142 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2241/4344] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:38.569665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:38.570595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:38.584649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:38.586676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:38.587946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:38.592151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:38.592816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:38.593446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:38.593576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:38.612589 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-387d21c0-4f0b-456b-a0c8-5b58d88c3c73 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 200 len: 1513 microversion: 2.1 time: 0.478942 Oct 16 01:22:38.615267 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2104/4345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:38 2022] GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 1513 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:38.646619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:38.647486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:38.656859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:38.658104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:38.658689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:38.659646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:38.660255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:38.660829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.054554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:39.064458 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9f484a31-99b3-4c90-b800-3ebfea1aac7e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1513 microversion: 2.1 time: 0.423870 Oct 16 01:22:39.068313 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2105/4346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:38 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:39.079048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:39.079668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:39.090203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.090693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.091286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.091838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.092543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.093136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.119662 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:39.142401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:39.150824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c8e513fd-878c-43d1-b11c-6b882cd0c136 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.602086 Oct 16 01:22:39.159599 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2242/4347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:38 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:39.164801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:39.170852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:39.178064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:39.314084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.314970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.315645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.316657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.317396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.318055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.420640 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:39.438688 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c68c24a0-5f67-436a-8a57-977d951cf2c1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.367913 Oct 16 01:22:39.457255 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2106/4348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:39 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:39.468552 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:39.471330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:39.483436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.495154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.495947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.496896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.497534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.498121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.544650 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:39.550017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:39.646518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:39.658248 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfc1e8f9-a9fb-4646-b7f8-e9bdc72cb8a4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1343 microversion: 2.1 time: 0.199624 Oct 16 01:22:39.679352 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2107/4349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:39 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:39.685568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:39.690252 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:39.694891 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2647b879-6791-43e7-8710-68578c825994 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.533049 Oct 16 01:22:39.696250 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2243/4350] 10.222.0.39 () {58 vars in 1154 bytes} [Sun Oct 16 01:22:39 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:39.704392 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:39.708610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.710550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.711234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.712276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:39.713103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.713566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.713992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.714281 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:39.722334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.723230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.723907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.724861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:39.725563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:39.726216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:39.913873 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=12 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:40.012117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:40.023653 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-18b4c58a-88a4-4cbb-b4fa-dd85e62fc16b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1366 microversion: 2.1 time: 0.342601 Oct 16 01:22:40.026531 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2108/4351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:39 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:40.035819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e7be3d48-b0bd-47da-b0c6-f9924c1c55ec req-612e3ac7-2c52-444c-8d14-d7a215ab7077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b35480-ba38-4c33-bfa8-e63c3eafbeec", "name": "network-vif-plugged", "status": "completed", "tag": "22ac8bf9-7ba3-4496-838e-9f0b26eada5a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:40.061030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e7be3d48-b0bd-47da-b0c6-f9924c1c55ec req-612e3ac7-2c52-444c-8d14-d7a215ab7077 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.061658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e7be3d48-b0bd-47da-b0c6-f9924c1c55ec req-612e3ac7-2c52-444c-8d14-d7a215ab7077 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.062193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e7be3d48-b0bd-47da-b0c6-f9924c1c55ec req-612e3ac7-2c52-444c-8d14-d7a215ab7077 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.085826 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e7be3d48-b0bd-47da-b0c6-f9924c1c55ec req-612e3ac7-2c52-444c-8d14-d7a215ab7077 service nova] Creating event network-vif-plugged:22ac8bf9-7ba3-4496-838e-9f0b26eada5a for instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec on n-h1-master-1 Oct 16 01:22:40.095508 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e7be3d48-b0bd-47da-b0c6-f9924c1c55ec req-612e3ac7-2c52-444c-8d14-d7a215ab7077 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065185 Oct 16 01:22:40.098852 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2109/4352] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:40.106404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:40.115496 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97834134-10c8-4e3e-91b7-d639c208766c tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1513 microversion: 2.1 time: 0.407282 Oct 16 01:22:40.133802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2244/4353] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:39 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:40.146280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:40.147161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:40.158660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.166522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.167200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.168052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.168639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.169175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.192871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:40.193653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:40.205542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.206418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.207143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.208439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.209130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.209779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.324671 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:40.483775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:40.498497 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1039a11a-d540-4030-a862-ecb46e8b7492 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 200 len: 1513 microversion: 2.1 time: 0.356509 Oct 16 01:22:40.499530 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2110/4354] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:40 2022] GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:40.523904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:40.530142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:40.543637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.544447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.545106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.551475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:40.558499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.560684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.566027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.568928 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-852f3193-39b0-4a57-ae47-6e6cb7b9737c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.379781 Oct 16 01:22:40.572856 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2245/4355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:40 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:40.588096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:40.588944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:40.599730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.600231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.600875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.601752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:40.602396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:40.603671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:40.971729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:40.984305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:40.985051 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-20623c9e-fa5b-4835-8218-1dd242b7bf81 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1513 microversion: 2.1 time: 0.408915 Oct 16 01:22:40.995679 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2246/4356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:40 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:41.002063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:41.002682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:41.014764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-13f0b825-6bec-4112-8370-3a3e44008c51 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.513942 Oct 16 01:22:41.017018 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2111/4357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:40 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:41.023143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:41.034532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.036492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:41.037991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.038386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.039164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.039649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.040071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.040243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:41.056808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.057730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.059458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.060493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.063859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.064553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.144749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:41.187419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:41.204237 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-690eedbd-784e-48eb-a6ea-751acb4acb33 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1343 microversion: 2.1 time: 0.199144 Oct 16 01:22:41.205526 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2247/4358] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:40 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:41.211591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:41.222007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:41.231672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.246592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.247286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.248389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.249052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.249699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.254229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:41.277343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.280138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.280807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.809205 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ef8dada-16eb-4c08-8e59-d574895c2944 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 4522 microversion: 2.1 time: 0.790756 Oct 16 01:22:41.823796 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2112/4359] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:22:41 2022] GET /compute/v2.1/servers/detail => generated 4522 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:41.840503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:41.841253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:41.863995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:41.876169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.878733 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-56f00ee2-32b7-4907-a29c-dccc966602f7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1366 microversion: 2.1 time: 0.670893 Oct 16 01:22:41.879448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.896442 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2248/4360] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:41 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1366 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:41.897742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.901392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:41.906897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:41.910428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:41.914886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:41.925039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:41.932958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:42.120479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.120977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.121467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.122728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.123225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.123677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.178576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:42.186502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:42.188729 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed6a20e8-c4fe-4563-89f4-ab46a88c4890 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.363593 Oct 16 01:22:42.199859 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2113/4361] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:41 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:42.220557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:42.224128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:42.234368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.234954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.235543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.236343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.236881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.238099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.250491 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-53169350-ea0d-461a-9254-43904a052194 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1012 microversion: 2.1 time: 0.344689 Oct 16 01:22:42.266158 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2249/4362] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:22:41 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1012 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:42.271884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:42.272396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:42.279606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.280097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.280536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.281891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.282355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.282778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.436149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:42.443455 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:42.449635 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2c0dbf22-9b0d-4e9d-b7d7-62862a01d43f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1343 microversion: 2.1 time: 0.182245 Oct 16 01:22:42.455227 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2250/4363] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:42 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1343 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:42.464684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:42.476346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:42.481103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:42.495830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.496584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.497287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.498389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.499095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.500000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.502341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:42.519170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3cc88ee0-b6a3-4445-8ec5-292b82addb46 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.309349 Oct 16 01:22:42.521424 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2114/4364] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:42 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:42.621948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:42.741906 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-809e2c6a-7b40-4de7-8087-30438349985f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.285270 Oct 16 01:22:42.745847 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2251/4365] 10.222.0.39 () {58 vars in 1212 bytes} [Sun Oct 16 01:22:42 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:42.759267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:42.768235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:42.770238 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:42.786871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.787394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.787826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.788539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.788986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.789403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.910438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:42.911810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:42.925777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.926600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.927237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.929618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:42.930747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:42.935330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:42.950213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:43.141531 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c2c8923-9f82-4f64-ba95-652c732d7012 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.387041 Oct 16 01:22:43.148902 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2115/4366] 10.222.0.39 () {58 vars in 1196 bytes} [Sun Oct 16 01:22:42 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:43.167690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:43.172886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:43.173574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'name': '1000249553', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:43.191374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.192215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.192316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.192999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.193651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.194285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.208502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:43.220619 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-94e3aa96-7de9-48ab-bc8d-f96133948aaa tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1557 microversion: 2.1 time: 0.314729 Oct 16 01:22:43.222174 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2252/4367] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:42 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1557 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:43.230156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:43.231131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:43.237695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.238469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.239117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.240542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.241170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.241768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.318681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:43.443431 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd99ddb3-6b8e-46a8-b73e-dd3b3c7b71e8 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?name=1000249553" status: 200 len: 346 microversion: 2.1 time: 0.291226 Oct 16 01:22:43.444602 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2116/4368] 10.222.0.39 () {58 vars in 1156 bytes} [Sun Oct 16 01:22:43 2022] GET /compute/v2.1/servers?name=1000249553 => generated 346 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:43.452759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:43.453796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:43.460875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.461645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.462589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.464109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.464734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.465390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.611679 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c64e595c-03cb-4f57-96bb-993884193b5d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165657 Oct 16 01:22:43.612649 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2117/4369] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:22:43 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:43.616006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:43.617986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:43.623584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:43.624257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:43.625667 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-03a461df-592e-46b2-accb-a261dad1c47e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.402234 Oct 16 01:22:43.626249 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2253/4370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:43 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:43.631848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:43.632543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:43.651689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.652500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.653109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.653971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.654582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.655181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.667701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.668200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.668634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.669369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.669823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.670243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.693198 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:43.695253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:43.696220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:43.698280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:43.699060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lazy-loading 'fault' on Instance uuid 57546d04-76c2-4d2d-9c2c-0a5f736417e7 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:22:43.771940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:43.784849 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cfbc63b-58f1-446c-9304-eb0a4ab63c12 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 200 len: 1348 microversion: 2.1 time: 0.156635 Oct 16 01:22:43.787507 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2254/4371] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:43 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 1348 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:43.868959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:44.225829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1536837402", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:44.320539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] validate_networks() for [('b537ca24-2fa6-42e3-9c39-1819b5b52d86', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:22:44.427633 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a1db2e75-036d-44d7-87a4-20d944ee243b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.813746 Oct 16 01:22:44.429159 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2118/4372] 10.222.0.39 () {58 vars in 1154 bytes} [Sun Oct 16 01:22:43 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:44.441915 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:44.443453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:44.464563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:44.465576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:44.467266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:44.468730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:44.469373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:44.469934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:44.872401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:44.889589 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e609f451-32e2-4056-8036-ec4eac78597b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.457495 Oct 16 01:22:44.891808 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2119/4373] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:44 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:44.908167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:44.916251 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:44.917944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-100024955', 'deleted': False, 'project_id': '0379a874918747449f5bbe24b6016495'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:22:44.924610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:44.925680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:44.927904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:44.928962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:44.929613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:44.930600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.065210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:22:45.128434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:22:45.129012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:22:45.129495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:22:45.129910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:22:45.139118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:22:45.159461 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6047e4a1-40e4-4f8d-a358-6b0e1935798f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-100024955" status: 200 len: 346 microversion: 2.1 time: 0.264573 Oct 16 01:22:45.160286 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2120/4374] 10.222.0.39 () {58 vars in 1228 bytes} [Sun Oct 16 01:22:44 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-100024955 => generated 346 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:45.168784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.169679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.170372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.172101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.175904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.176529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.177975 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:45.180358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:45.204724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.206345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.207161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.208733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.209404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.210428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.215773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Getting quotas for project f6ebbc8c81b34f09ae5df924df3097b6. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:22:45.222770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Getting quotas for user 2368cc38b0d74026b9414edfc10e7be6 and project f6ebbc8c81b34f09ae5df924df3097b6. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:22:45.236537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:22:45.239716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:22:45.301580 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5fd0dc28-8ad1-4019-b2c2-426bc628750e tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509201 Oct 16 01:22:45.302885 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2255/4375] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:22:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:22:45.308740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:45.310035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:45.318691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.319545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.320463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.322722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.323518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.324197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.358542 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 HTTP/1.1 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '57546d04-76c2-4d2d-9c2c-0a5f736417e7'} Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:45.361450 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.366465 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:45.366465 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:45.366465 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:45.366465 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:45.366465 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:45.366465 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.366465 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.369962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:45.371121 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bee62ad9-4d31-4900-b989-b9edf0c95c8c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 404 len: 111 microversion: 2.1 time: 0.067058 Oct 16 01:22:45.372241 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2256/4376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:45 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:22:45.377030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:45.378374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:45.387383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.388172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.388846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.389791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.390485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.391412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.423451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:22:45.530341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:45.531660 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49a749cb-7f79-4a94-a835-6b43c2ac5ff9 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 204 len: 0 microversion: 2.1 time: 0.155519 Oct 16 01:22:45.533203 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2257/4377] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:22:45 2022] DELETE /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:22:45.537575 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:45.549740 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4ca092c5-7e29-44a5-8542-0167eaf04843 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.378136 Oct 16 01:22:45.561141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-da8fc345-8928-4952-bd06-37b44b49bafc req-fd2cf0ec-41e2-4864-beaf-20eecae89347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b35480-ba38-4c33-bfa8-e63c3eafbeec", "tag": "22ac8bf9-7ba3-4496-838e-9f0b26eada5a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:45.568412 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2121/4378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:45 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:45.574554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b04fa42f-4099-4db9-a103-17884e8800b7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:45.575212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b04fa42f-4099-4db9-a103-17884e8800b7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:45.602346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-da8fc345-8928-4952-bd06-37b44b49bafc req-fd2cf0ec-41e2-4864-beaf-20eecae89347 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.607025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-da8fc345-8928-4952-bd06-37b44b49bafc req-fd2cf0ec-41e2-4864-beaf-20eecae89347 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.608288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-da8fc345-8928-4952-bd06-37b44b49bafc req-fd2cf0ec-41e2-4864-beaf-20eecae89347 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.650269 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-da8fc345-8928-4952-bd06-37b44b49bafc req-fd2cf0ec-41e2-4864-beaf-20eecae89347 service nova] Creating event network-changed:22ac8bf9-7ba3-4496-838e-9f0b26eada5a for instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec on n-h1-master-1 Oct 16 01:22:45.656501 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-da8fc345-8928-4952-bd06-37b44b49bafc req-fd2cf0ec-41e2-4864-beaf-20eecae89347 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107155 Oct 16 01:22:45.657727 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2258/4379] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:45.679779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:45.684195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:45.684335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b04fa42f-4099-4db9-a103-17884e8800b7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:45.693421 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b04fa42f-4099-4db9-a103-17884e8800b7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1224 microversion: 2.1 time: 0.124372 Oct 16 01:22:45.694380 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2122/4380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:45 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:45.700603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.704728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.706058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.707717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.710024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.710470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:45.711181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.713631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:45.733243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.734097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.744798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.748437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.748437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.748841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.768653 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7/os-volume_attachments HTTP/1.1 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': '57546d04-76c2-4d2d-9c2c-0a5f736417e7'} Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:22:45.770756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:22:45.775429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:45.777118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:45.778336 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ce50f8b-2c05-4368-a3e9-09f05251f126 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.082860 Oct 16 01:22:45.779463 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2123/4381] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:22:45 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7/os-volume_attachments => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:22:45.919263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:45.920462 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:45.930443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.934534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.935256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:45.937006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:45.938671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:45.939518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:46.075960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:46.088484 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-835d18ed-366a-40ef-9283-561147cd22cc tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1519 microversion: 2.1 time: 0.419585 Oct 16 01:22:46.089081 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2259/4382] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:45 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:46.114083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-702f3ce5-a549-4c2c-98c4-f7520d1f39ea req-3a303930-3a86-4796-b0a0-7abea8e4fe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438", "name": "network-vif-plugged", "status": "completed", "tag": "ebf526f4-6d18-4e21-9c38-4219f2d56da2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:46.144816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-702f3ce5-a549-4c2c-98c4-f7520d1f39ea req-3a303930-3a86-4796-b0a0-7abea8e4fe77 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:46.145052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-702f3ce5-a549-4c2c-98c4-f7520d1f39ea req-3a303930-3a86-4796-b0a0-7abea8e4fe77 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:46.160393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-702f3ce5-a549-4c2c-98c4-f7520d1f39ea req-3a303930-3a86-4796-b0a0-7abea8e4fe77 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:46.180080 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-702f3ce5-a549-4c2c-98c4-f7520d1f39ea req-3a303930-3a86-4796-b0a0-7abea8e4fe77 service nova] Creating event network-vif-plugged:ebf526f4-6d18-4e21-9c38-4219f2d56da2 for instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 on n-h2-master-1 Oct 16 01:22:46.193891 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-702f3ce5-a549-4c2c-98c4-f7520d1f39ea req-3a303930-3a86-4796-b0a0-7abea8e4fe77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096637 Oct 16 01:22:46.198051 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2260/4383] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:46.211055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-633212725", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "80782a8b-359e-4c99-bfc4-19cb8408a888"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:46.299361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:46.308989 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b2c262f-4fb2-476e-8788-4355e1cddf7d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.394402 Oct 16 01:22:46.310020 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2124/4384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:45 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:46.313224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] validate_networks() for [('80782a8b-359e-4c99-bfc4-19cb8408a888', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:22:46.582662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:46.584283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:46.604092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:46.604864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:46.605470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:46.606327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:46.606896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:46.607695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.182464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:47.196008 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b76486e6-350a-4492-b9c2-721123d6ea98 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.619537 Oct 16 01:22:47.213298 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2125/4385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:46 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:47.219170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:47.220055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:47.226999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:47.228572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:47.229348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.230324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:47.231062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:47.231715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.368748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:47.380284 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8769836d-9bb7-4290-923e-fef3a087041f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1276 microversion: 2.1 time: 0.165425 Oct 16 01:22:47.382206 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2126/4386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:47 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:47.388743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:47.397910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:47.415508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:47.419639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:47.420400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.426016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:47.426829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:47.427541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.768140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:22:47.768644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:22:47.769029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:22:47.769443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:22:47.769853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:22:47.780598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:47.781078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:47.781699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.782639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:47.783051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:47.783797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:47.784426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.791875 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fcf6130-2d4b-4788-81af-4c139b4fd519 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1519 microversion: 2.1 time: 0.407809 Oct 16 01:22:47.793503 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2127/4387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:47 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1519 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:47.798389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:47.799460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:47.805678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:22:47.806749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:47.807400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:47.808215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.809432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:47.809999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:47.810590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:47.812833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for user a3ac1408c91c4db59f4639abdca2c98f and project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:22:47.826636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:22:47.829106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: d28cc0f7-b36b-4d02-9b64-3a02ed241f30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:22:47.883003 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b296d050-ac75-4888-9929-6b80142a9bb8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682649 Oct 16 01:22:47.884515 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2261/4388] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:22:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:22:47.896404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-87e0bae6-ff66-4c19-a0b1-20d47e34e97f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:47.897045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-87e0bae6-ff66-4c19-a0b1-20d47e34e97f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: d28cc0f7-b36b-4d02-9b64-3a02ed241f30] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:47.971691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-87e0bae6-ff66-4c19-a0b1-20d47e34e97f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:47.986981 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-87e0bae6-ff66-4c19-a0b1-20d47e34e97f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30" status: 200 len: 1214 microversion: 2.1 time: 0.094792 Oct 16 01:22:47.987536 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2262/4389] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:47 2022] GET /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:48.004382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:48.011164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f1ff5e1-05c9-4dab-a27c-7547edddf84f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:48.011939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f1ff5e1-05c9-4dab-a27c-7547edddf84f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: d28cc0f7-b36b-4d02-9b64-3a02ed241f30] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:48.016739 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f88baed4-9644-4cfb-808b-177aa431ea2c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.221919 Oct 16 01:22:48.033490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2128/4390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:47 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:48.045743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f1ff5e1-05c9-4dab-a27c-7547edddf84f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: d28cc0f7-b36b-4d02-9b64-3a02ed241f30] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:22:48.221796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:48.222475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:48.233181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:48.234840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:48.235335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:48.236067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:48.238072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:48.239873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:48.460236 n-d-master-1 devstack@n-api.service[120545]: INFO nova.scheduler.client.report [None req-1f1ff5e1-05c9-4dab-a27c-7547edddf84f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Deleted allocations for instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 Oct 16 01:22:48.470068 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-1f1ff5e1-05c9-4dab-a27c-7547edddf84f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: d28cc0f7-b36b-4d02-9b64-3a02ed241f30] Instance Mapping does not exist while attempting local delete cleanup. Oct 16 01:22:48.471650 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f1ff5e1-05c9-4dab-a27c-7547edddf84f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30" status: 204 len: 0 microversion: 2.1 time: 0.465087 Oct 16 01:22:48.472755 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2263/4391] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:22:48 2022] DELETE /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:22:48.479031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:48.480359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:48.488260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:48.489138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:48.490546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:48.494755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:48.496333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:48.497142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:48.574854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:48.583402 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d1651808-d38d-4350-96d4-c95e99c43ade tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.365794 Oct 16 01:22:48.592372 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2129/4392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:48 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:48.598104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f523cabd-17c3-45b3-ab82-428cbbdf54f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:48.599108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f523cabd-17c3-45b3-ab82-428cbbdf54f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: d28cc0f7-b36b-4d02-9b64-3a02ed241f30] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:48.606056 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f523cabd-17c3-45b3-ab82-428cbbdf54f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f523cabd-17c3-45b3-ab82-428cbbdf54f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30 HTTP/1.1 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: exception: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'd28cc0f7-b36b-4d02-9b64-3a02ed241f30'} Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:48.607910 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:48.613024 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:48.613024 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:48.613024 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:48.613024 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:22:48.613024 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:48.613024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f523cabd-17c3-45b3-ab82-428cbbdf54f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:48.613024 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f523cabd-17c3-45b3-ab82-428cbbdf54f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30" status: 404 len: 111 microversion: 2.1 time: 0.015640 Oct 16 01:22:48.620387 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2130/4393] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:48 2022] GET /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:22:48.623217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:48.631649 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-03edb1bc-a547-4513-8421-456540b801aa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1282 microversion: 2.1 time: 0.157719 Oct 16 01:22:48.632753 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2264/4394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:48 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:48.695715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-211806060", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "80782a8b-359e-4c99-bfc4-19cb8408a888"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:48.761248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] validate_networks() for [('80782a8b-359e-4c99-bfc4-19cb8408a888', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:22:48.817081 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:48.817780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:48.824434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:48.839364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:48.840024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:48.840880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:48.841445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:48.841952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:48.985845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:48.995878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b22bd5f3-8fb9-4805-9400-b43506f23288 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1477 microversion: 2.1 time: 0.182657 Oct 16 01:22:48.997212 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2265/4395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:48 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1477 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:49.009754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d65ddd94-2ab7-48b5-be6d-3833ef6378e5 req-8558ab1e-bc2c-40f4-9782-80c480711410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d837e62-c843-4830-9163-a52cfa469137", "name": "network-vif-deleted", "tag": "cb66fc4a-d81e-44c7-94bb-c15c30ac8361"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:49.024153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d65ddd94-2ab7-48b5-be6d-3833ef6378e5 req-8558ab1e-bc2c-40f4-9782-80c480711410 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.025551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d65ddd94-2ab7-48b5-be6d-3833ef6378e5 req-8558ab1e-bc2c-40f4-9782-80c480711410 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.026617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d65ddd94-2ab7-48b5-be6d-3833ef6378e5 req-8558ab1e-bc2c-40f4-9782-80c480711410 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.041449 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d65ddd94-2ab7-48b5-be6d-3833ef6378e5 req-8558ab1e-bc2c-40f4-9782-80c480711410 service nova] Creating event network-vif-deleted:cb66fc4a-d81e-44c7-94bb-c15c30ac8361 for instance 8d837e62-c843-4830-9163-a52cfa469137 on n-h2-master-1 Oct 16 01:22:49.047650 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d65ddd94-2ab7-48b5-be6d-3833ef6378e5 req-8558ab1e-bc2c-40f4-9782-80c480711410 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048946 Oct 16 01:22:49.052776 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2266/4396] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:49.063129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:49.067283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:49.084022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.087564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.088327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.091318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.096793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.097513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.414653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:49.423064 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e18e385-b716-40b0-9d33-ab04eb48ec48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1316 microversion: 2.1 time: 0.368724 Oct 16 01:22:49.427527 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2267/4397] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:49 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:49.584071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:22:49.584573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:22:49.585078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:22:49.585633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:22:49.586115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:22:49.596783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.597386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.598053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.599018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.599876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.600537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.611569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:49.612199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:49.623815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.624166 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:22:49.624332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.624758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.628174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.628663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.629101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.631522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for user a3ac1408c91c4db59f4639abdca2c98f and project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:22:49.646067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:22:49.648501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:22:49.706316 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01ad736e-50d6-4176-a14b-6e98d74ed159 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014449 Oct 16 01:22:49.707743 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2131/4398] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:22:49.718583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:49.720659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:49.727860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.728669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.729288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.730452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:49.731424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:49.732210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:49.957675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:49.976829 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3728b0d0-3445-4357-be0c-b43842447413 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.362315 Oct 16 01:22:49.979882 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2268/4399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:49 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:49.991158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0082238e-e67b-41a2-9cab-bd23ca63fbab tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:49.991785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0082238e-e67b-41a2-9cab-bd23ca63fbab tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:50.099166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0082238e-e67b-41a2-9cab-bd23ca63fbab tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:50.099656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:50.109360 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2aa2126e-0962-4f6b-89f5-493fe6c17332 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1324 microversion: 2.1 time: 0.400239 Oct 16 01:22:50.109952 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2132/4400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:49 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:50.116508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:50.117117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:50.123518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:50.124005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:50.124446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:50.125151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:50.125607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:50.126035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:50.135020 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0082238e-e67b-41a2-9cab-bd23ca63fbab tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1214 microversion: 2.1 time: 0.151757 Oct 16 01:22:50.137532 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2269/4401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:49 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:50.176619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:50.177886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:50.178536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:50.179330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lazy-loading 'fault' on Instance uuid 8d837e62-c843-4830-9163-a52cfa469137 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:22:50.227481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:50.239397 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8473133d-e8a3-4fb0-89f3-3b3afa1909d0 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 200 len: 1311 microversion: 2.1 time: 0.127060 Oct 16 01:22:50.240643 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2133/4402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:50 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:50.452562 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:50.453191 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:50.465342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:50.466244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:50.467360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:50.469290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:50.469999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:50.470656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:50.644590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:50.653605 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-924e6a0b-a312-4d94-b349-3d50ad3d9eaa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.206948 Oct 16 01:22:50.654194 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2270/4403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:50 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:50.831848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1667992472", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:50.919946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] validate_networks() for [('c823a5ff-2110-4a77-95b2-4f3653a870f1', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:22:51.004181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:51.004781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:51.017657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.021537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.022063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.022804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.023308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.023743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.424400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:51.434957 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de4c61a3-5146-42b0-b958-3cdaf72af6b0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1502 microversion: 2.1 time: 0.436777 Oct 16 01:22:51.460004 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2271/4404] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:50 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1502 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:51.474639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:51.479247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:51.487248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.487750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.488244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.488966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.489616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.490275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.497578 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:51.559350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:22:51.560090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:22:51.560789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:22:51.561565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:22:51.562194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:22:51.620927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.621655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.623374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.624288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.624767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.625207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.651789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Getting quotas for project fc93a361db0a42c0ac90b82d20b91cff. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:22:51.658597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Getting quotas for user 85cb1d720ba24d7f908a93fffe29427b and project fc93a361db0a42c0ac90b82d20b91cff. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:22:51.680132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:22:51.683724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:22:51.800454 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81806d23-5d0e-45b1-8a75-335eb39bcf06 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982871 Oct 16 01:22:51.802360 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2134/4405] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:22:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:22:51.810146 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:51.811741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:51.829927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:51.860529 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff38752a-a3af-4271-8d5e-8b70ecddbdcb tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1324 microversion: 2.1 time: 0.397567 Oct 16 01:22:51.862153 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2272/4406] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:51 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:51.865438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.868130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.869498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.871741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.872823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.875176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.881796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:51.882799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 8d837e62-c843-4830-9163-a52cfa469137] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:51.912271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.913164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.913837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.916115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.922059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.923291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.955402 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] HTTP exception thrown: Instance 8d837e62-c843-4830-9163-a52cfa469137 could not be found. Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Request method failure captured: Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 HTTP/1.1 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yeWXkGTq2gqdxs59lxkcclMfo_vKVUTzL4UeW1ZNKyzJg3RVZvCbEvutvP89oBBpV6iuuMW4K80noeOWU0cfBv64qAGtmh6MK0FXKFh0pStFNzpVifysmVDDCVXnA7AgDPIZudk5qrm47NF2yqCGWpcUhoUqM5BWDoEGx7PcWN-DY Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 0379a874918747449f5bbe24b6016495 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0379a874918747449f5bbe24b6016495", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0379a874918747449f5bbe24b6016495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0379a874918747449f5bbe24b6016495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0379a874918747449f5bbe24b6016495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 0379a874918747449f5bbe24b6016495 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ListServerFiltersTestJSON-446774426-project Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: cad50112141243a6a27812344e12cfec Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ListServerFiltersTestJSON-446774426-project Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 8d837e62-c843-4830-9163-a52cfa469137 could not be found. Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8d837e62-c843-4830-9163-a52cfa469137'} Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d837e62-c843-4830-9163-a52cfa469137 could not be found. Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d837e62-c843-4830-9163-a52cfa469137 could not be found. Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:51.958518 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:51.963275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:51.963275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:51.963275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:51.963275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:51.963275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:51.963275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d837e62-c843-4830-9163-a52cfa469137 could not be found. Oct 16 01:22:51.963275 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:51.967914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Returning 404 to user: Instance 8d837e62-c843-4830-9163-a52cfa469137 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:51.970111 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-73edbabf-7927-467b-8711-9c0c8abac64e tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137" status: 404 len: 111 microversion: 2.1 time: 0.101978 Oct 16 01:22:51.971262 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2273/4407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:51 2022] GET /compute/v2.1/servers/8d837e62-c843-4830-9163-a52cfa469137 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:22:51.977594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0208213d-f272-4163-bc90-c16e0b8b91c1"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:51.980735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:51.990762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.991551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.992224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:51.993339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:51.994108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:51.994767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.033020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:52.053686 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98770cd7-81f2-42e2-8347-6e3bd71a5366 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1274 microversion: 2.1 time: 0.240915 Oct 16 01:22:52.057016 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2135/4408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:51 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:52.064689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f44db131-92af-4237-b5b9-a9e7204340ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:52.065928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f44db131-92af-4237-b5b9-a9e7204340ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:52.073739 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Cannot 'attach_volume' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state rescued Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/os-volume_attachments HTTP/1.1 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 74 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: {"volumeAttachment": {"volumeId": "0208213d-f272-4163-bc90-c16e0b8b91c1"}} Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'attach_volume' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state rescued Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': '0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3', 'body': {'volumeAttachment': {'volumeId': '0208213d-f272-4163-bc90-c16e0b8b91c1'}}} Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 16 01:22:52.082328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state rescued Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state rescued Oct 16 01:22:52.087252 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:22:52.091710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 409 to user: Cannot 'attach_volume' instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 while it is in vm_state rescued {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:52.092836 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a1b9a1d4-4a05-47ee-b4c5-316bf695a4d5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.120354 Oct 16 01:22:52.097070 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2274/4409] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:22:51 2022] POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/os-volume_attachments => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:22:52.109843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:52.110888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:52.130951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.131838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.132556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.133507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.137610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.138590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.151050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f44db131-92af-4237-b5b9-a9e7204340ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:52.161545 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f44db131-92af-4237-b5b9-a9e7204340ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1217 microversion: 2.1 time: 0.100309 Oct 16 01:22:52.162870 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2136/4410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:52 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:52.168507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f411049c-d3c2-4313-bb01-011f20def94d req-9e397a79-7f83-4d59-9c98-1e04706ab734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa596808-df63-4252-911b-59c75f785ede", "tag": "ddbd80d6-018e-4339-874b-e870e3103cbd"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:52.179777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f411049c-d3c2-4313-bb01-011f20def94d req-9e397a79-7f83-4d59-9c98-1e04706ab734 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.181716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f411049c-d3c2-4313-bb01-011f20def94d req-9e397a79-7f83-4d59-9c98-1e04706ab734 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.182434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f411049c-d3c2-4313-bb01-011f20def94d req-9e397a79-7f83-4d59-9c98-1e04706ab734 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.203755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:22:52.206433 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f411049c-d3c2-4313-bb01-011f20def94d req-9e397a79-7f83-4d59-9c98-1e04706ab734 service nova] Creating event network-changed:ddbd80d6-018e-4339-874b-e870e3103cbd for instance fa596808-df63-4252-911b-59c75f785ede on n-h1-master-1 Oct 16 01:22:52.213922 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f411049c-d3c2-4313-bb01-011f20def94d req-9e397a79-7f83-4d59-9c98-1e04706ab734 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049237 Oct 16 01:22:52.214865 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2137/4411] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:52.222740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:52.223807 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:52.232349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.234046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.235128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.236932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.238150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.238840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.323576 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3330d89d-9f8a-4ff7-a87d-ddf4da329cc7 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 204 len: 0 microversion: 2.1 time: 0.224779 Oct 16 01:22:52.324721 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2275/4412] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:22:52 2022] DELETE /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:22:52.339920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:52.343588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:52.362183 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c3b46d9-2019-4c3b-9d32-91fe4f81113d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action" status: 202 len: 0 microversion: 2.1 time: 0.145424 Oct 16 01:22:52.363695 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2138/4413] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:22:52 2022] POST /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:22:52.364562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.365074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.365516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.373954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:52.375134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:52.384773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.393022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.393781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.394289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.394942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.395705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.395830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.396461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.396898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.679103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:52.695346 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-baff67d0-a746-4679-a0ce-44ce47867564 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 200 len: 1519 microversion: 2.1 time: 0.365206 Oct 16 01:22:52.696234 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2276/4414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:52 2022] GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 1519 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:52.857251 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:52.873498 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5dcdd42b-16ef-4961-aef0-a0aa272af9b4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1510 microversion: 2.1 time: 0.505456 Oct 16 01:22:52.874282 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2139/4415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:52 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1510 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:52.901270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:52.901896 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:52.905235 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:52.912034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.912585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.913632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:52.914356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:52.914816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:52.915864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:53.083599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:53.084212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:53.093781 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:53.095306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:53.096045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:53.096233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:53.097616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:53.098292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:53.098845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:53.338768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:53.350293 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b3b9959b-9b62-47d5-b1b3-a9273665568e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1272 microversion: 2.1 time: 0.270488 Oct 16 01:22:53.356135 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2140/4416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:53 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:53.361507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:53.366535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:53.374625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:53.375532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:53.376148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:53.377129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:53.377791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:53.378371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:53.487422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:53.496028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:53.498970 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-854eca7d-a76e-472d-a5dc-438837e72975 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1221 microversion: 2.1 time: 0.141618 Oct 16 01:22:53.506356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4fe89a02-356c-41dc-8b9a-f1774c2efd31 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1324 microversion: 2.1 time: 0.608720 Oct 16 01:22:53.506356 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2277/4417] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:52 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1324 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:22:53.507606 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2141/4418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:53 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1221 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:53.725085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:53.726109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:53.733575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:53.734472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:53.735185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:53.736141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:53.736693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:53.737347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:53.920346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:53.924271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:53.941103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:53.952020 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e7da410-2a0d-4aea-ad49-8341f61c7d4b tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 200 len: 1519 microversion: 2.1 time: 0.231293 Oct 16 01:22:53.952504 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2278/4419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:53 2022] GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:53.956860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:53.957606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:53.958208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:53.959128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:53.960128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:53.960560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:54.119556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:54.127431 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:54.133442 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c81806d0-1954-4ee1-b8d7-0ecdd246b7a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1510 microversion: 2.1 time: 0.235085 Oct 16 01:22:54.147197 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2142/4420] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:53 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:54.374789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:54.375751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:54.385061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:54.385792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:54.386450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:54.387505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:54.388204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:54.388847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:54.480523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:54.496669 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-839d57e1-7516-47dd-a416-7bc3ab177331 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1272 microversion: 2.1 time: 0.123536 Oct 16 01:22:54.500109 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2279/4421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:54 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:54.531548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:54.532058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:54.537846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:54.538537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:54.549445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:54.549950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:54.550397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:54.551148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:54.551605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:54.559618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:54.563153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:54.565336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:54.566104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:54.567782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:54.568516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:54.569171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:54.713157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:54.735729 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c403ed0-3e33-4096-8592-7a151337d0d8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1277 microversion: 2.1 time: 0.210858 Oct 16 01:22:54.737229 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2143/4422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:54 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:54.839440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:54.848201 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ddafaccf-4776-4256-8e8b-c4842388c911 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1324 microversion: 2.1 time: 0.320501 Oct 16 01:22:54.863789 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2280/4423] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:54 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:54.976638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:54.977914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:54.991906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:54.992660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:54.993783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:54.997054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:54.997736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:54.998343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:55.158115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:55.158693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:55.176779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:55.177283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:55.177726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:55.178439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:55.187735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:55.188460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:55.635128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:55.645235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:55.653524 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4b88ee06-7f44-4ea8-98c7-d52089c0364a tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 200 len: 1519 microversion: 2.1 time: 0.680366 Oct 16 01:22:55.654820 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7c13df1f-853d-42b0-8821-a864bc101ded tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1510 microversion: 2.1 time: 0.500844 Oct 16 01:22:55.655338 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2144/4424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:54 2022] GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 1519 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:55.659555 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2281/4425] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:55 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:55.666893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-07eee704-8b41-451a-bf02-257e2fff8458 req-da9d0904-7ab1-428d-ac02-3f2f361d5830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a", "name": "network-vif-deleted", "tag": "d77bdfbb-e596-4fda-88fc-87f52a1edfd9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:55.671373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:55.672056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:55.684394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-07eee704-8b41-451a-bf02-257e2fff8458 req-da9d0904-7ab1-428d-ac02-3f2f361d5830 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:55.685267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-07eee704-8b41-451a-bf02-257e2fff8458 req-da9d0904-7ab1-428d-ac02-3f2f361d5830 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:55.685931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-07eee704-8b41-451a-bf02-257e2fff8458 req-da9d0904-7ab1-428d-ac02-3f2f361d5830 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:55.688456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:55.689047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:55.689503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:55.690666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:55.691610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:55.692071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:55.705659 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-07eee704-8b41-451a-bf02-257e2fff8458 req-da9d0904-7ab1-428d-ac02-3f2f361d5830 service nova] Creating event network-vif-deleted:d77bdfbb-e596-4fda-88fc-87f52a1edfd9 for instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a on n-h1-master-1 Oct 16 01:22:55.713480 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-07eee704-8b41-451a-bf02-257e2fff8458 req-da9d0904-7ab1-428d-ac02-3f2f361d5830 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052329 Oct 16 01:22:55.714785 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2282/4426] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:55.765571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:55.766633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:55.781186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:55.781697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:55.782144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:55.791596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:55.792202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:55.792842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:55.984784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:55.998313 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10e82f43-6162-4261-8739-5fec44bed75c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1275 microversion: 2.1 time: 0.236689 Oct 16 01:22:55.998949 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2283/4427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:55 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:56.012601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:56.013216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:56.022287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:56.023247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:56.024259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:56.025465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:56.026188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:56.026905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:56.253763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:56.267418 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1182f0b-4540-4db6-9bbd-c81675401a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1314 microversion: 2.1 time: 0.610012 Oct 16 01:22:56.268990 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2145/4428] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:55 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:56.305565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:56.316198 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8429c5d9-cc67-49c5-9b98-4e23c6d19a20 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1324 microversion: 2.1 time: 0.316199 Oct 16 01:22:56.330572 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2284/4429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:55 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:56.706665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:56.708669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:56.711063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:56.712546 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:56.748536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:56.751245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:56.754411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:56.755719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:56.760640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:56.760866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:56.761329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:56.764072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:56.766687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:56.767764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:56.768465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:56.769132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:56.857902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:56.860100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:56.861988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:56.865633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lazy-loading 'fault' on Instance uuid aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:22:57.248654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:57.267703 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc8aca8b-f043-439e-884d-5749c18b6154 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 200 len: 1311 microversion: 2.1 time: 0.569941 Oct 16 01:22:57.270206 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2285/4430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:56 2022] GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 1311 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:57.278653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:57.280671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:57.326674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:57.327272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:57.327715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:57.332033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:57.333190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:57.335707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:57.431738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:57.441405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-027769b4-55a6-4a7e-ab32-27e5f6b88e76 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1516 microversion: 2.1 time: 0.751623 Oct 16 01:22:57.447801 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2146/4431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:56 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1516 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:57.456011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:57.457041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:57.474152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:57.478968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:57.479800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:57.480794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:57.483573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:57.484702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:57.803761 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:57.938701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:57.948113 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be512fd1-02b7-42ab-87f1-5d00e9a93339 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1317 microversion: 2.1 time: 0.676301 Oct 16 01:22:57.953632 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2286/4432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:57 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1317 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:57.984039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:57.984649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:58.003097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.003823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.004536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.005610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.006314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.007029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.041812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:58.049950 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2b77c298-4328-446f-a216-824500056827 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1314 microversion: 2.1 time: 0.600918 Oct 16 01:22:58.050548 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2147/4433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:57 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:58.090674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0dfb1e24-bf85-4e9e-ad1c-5480138ddd26 req-f3362bbc-2c8c-41d0-bef8-6e193b88f40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbc1403e-9703-433b-9e7e-05ad0d3b0531", "tag": "b9b158fc-bd22-4695-9f8a-a020d575b313"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:58.120160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0dfb1e24-bf85-4e9e-ad1c-5480138ddd26 req-f3362bbc-2c8c-41d0-bef8-6e193b88f40c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.120704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0dfb1e24-bf85-4e9e-ad1c-5480138ddd26 req-f3362bbc-2c8c-41d0-bef8-6e193b88f40c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.121162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0dfb1e24-bf85-4e9e-ad1c-5480138ddd26 req-f3362bbc-2c8c-41d0-bef8-6e193b88f40c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.164311 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0dfb1e24-bf85-4e9e-ad1c-5480138ddd26 req-f3362bbc-2c8c-41d0-bef8-6e193b88f40c service nova] Creating event network-changed:b9b158fc-bd22-4695-9f8a-a020d575b313 for instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 on n-h2-master-1 Oct 16 01:22:58.175089 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0dfb1e24-bf85-4e9e-ad1c-5480138ddd26 req-f3362bbc-2c8c-41d0-bef8-6e193b88f40c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088540 Oct 16 01:22:58.175724 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2148/4434] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:22:58.298835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:58.299728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:58.312336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.312849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.313284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.314012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.314477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.315015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.342289 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] HTTP exception thrown: Instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a could not be found. Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Request method failure captured: Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a HTTP/1.1 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yeWXkGTq2gqdxs59lxkcclMfo_vKVUTzL4UeW1ZNKyzJg3RVZvCbEvutvP89oBBpV6iuuMW4K80noeOWU0cfBv64qAGtmh6MK0FXKFh0pStFNzpVifysmVDDCVXnA7AgDPIZudk5qrm47NF2yqCGWpcUhoUqM5BWDoEGx7PcWN-DY Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0379a874918747449f5bbe24b6016495 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0379a874918747449f5bbe24b6016495", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0379a874918747449f5bbe24b6016495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0379a874918747449f5bbe24b6016495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0379a874918747449f5bbe24b6016495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0379a874918747449f5bbe24b6016495 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ListServerFiltersTestJSON-446774426-project Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: cad50112141243a6a27812344e12cfec Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ListServerFiltersTestJSON-446774426-project Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: exception: Instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a could not be found. Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a'} Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a could not be found. Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a could not be found. Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:22:58.351860 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a could not be found. Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Returning 404 to user: Instance aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fe2ae837-fe22-4d0f-868a-8227967725ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a" status: 404 len: 111 microversion: 2.1 time: 0.059545 Oct 16 01:22:58.357695 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2149/4435] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:58 2022] GET /compute/v2.1/servers/aa3c7fd6-e2f0-42f9-bb8f-0d9b7068f24a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:22:58.364950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:58.365459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:58.387340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.387851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.388490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.389385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.390016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.390768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.453116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:22:58.569846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:58.580732 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7ee7b0b-24ed-462d-ac23-f727f1799aaa tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1324 microversion: 2.1 time: 0.600432 Oct 16 01:22:58.581656 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2287/4436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:57 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1324 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:58.624341 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e0685640-c8bf-4be7-a943-3c0537434352 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 204 len: 0 microversion: 2.1 time: 0.262767 Oct 16 01:22:58.630385 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2150/4437] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:22:58 2022] DELETE /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:22:58.636514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:58.637142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:58.644641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.645141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.650185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.656988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.657496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.657950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.700743 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:22:58.764790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-25c8961c-8b63-44e7-8113-9af9d46c4b81 req-a299e62d-54ea-4488-b181-f0bd806ca91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6514e50b-9489-47f4-89c6-db0bb9bc99a9", "tag": "5e638a8a-6c4a-4d54-ad53-be3e4a633c7a"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:58.782317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-25c8961c-8b63-44e7-8113-9af9d46c4b81 req-a299e62d-54ea-4488-b181-f0bd806ca91e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:58.786274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-25c8961c-8b63-44e7-8113-9af9d46c4b81 req-a299e62d-54ea-4488-b181-f0bd806ca91e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:58.786994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-25c8961c-8b63-44e7-8113-9af9d46c4b81 req-a299e62d-54ea-4488-b181-f0bd806ca91e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:58.811792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-25c8961c-8b63-44e7-8113-9af9d46c4b81 req-a299e62d-54ea-4488-b181-f0bd806ca91e service nova] Creating event network-changed:5e638a8a-6c4a-4d54-ad53-be3e4a633c7a for instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 on n-h1-master-1 Oct 16 01:22:58.825861 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-25c8961c-8b63-44e7-8113-9af9d46c4b81 req-a299e62d-54ea-4488-b181-f0bd806ca91e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066507 Oct 16 01:22:58.827304 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2151/4438] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:58.984949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:58.987416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:59.027093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:59.030025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:59.031155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:59.032100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:59.036253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:59.041265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:59.359575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:59.368275 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58e06c6d-81a0-4404-ae66-419256ef529f tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1519 microversion: 2.1 time: 0.736615 Oct 16 01:22:59.387181 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2288/4439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:58 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1519 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:59.392414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:59.393224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:59.400164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:59.401043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:59.401723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:59.402651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:59.403381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:59.404047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:59.490516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:59.498600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d77a75b6-8a41-4371-86cb-3cbeabd6c43c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1317 microversion: 2.1 time: 0.518776 Oct 16 01:22:59.499232 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2152/4440] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:58 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:59.503842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-29dd3c7c-b5fb-4c6a-a665-68b47ae703e6 req-8917a5c9-2ea3-4c98-bce6-e39084dfc07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa596808-df63-4252-911b-59c75f785ede", "name": "network-vif-plugged", "status": "completed", "tag": "ddbd80d6-018e-4339-874b-e870e3103cbd"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:59.514688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-29dd3c7c-b5fb-4c6a-a665-68b47ae703e6 req-8917a5c9-2ea3-4c98-bce6-e39084dfc07e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:59.515463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-29dd3c7c-b5fb-4c6a-a665-68b47ae703e6 req-8917a5c9-2ea3-4c98-bce6-e39084dfc07e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:59.516067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-29dd3c7c-b5fb-4c6a-a665-68b47ae703e6 req-8917a5c9-2ea3-4c98-bce6-e39084dfc07e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:59.528913 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-29dd3c7c-b5fb-4c6a-a665-68b47ae703e6 req-8917a5c9-2ea3-4c98-bce6-e39084dfc07e service nova] Creating event network-vif-plugged:ddbd80d6-018e-4339-874b-e870e3103cbd for instance fa596808-df63-4252-911b-59c75f785ede on n-h1-master-1 Oct 16 01:22:59.534122 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-29dd3c7c-b5fb-4c6a-a665-68b47ae703e6 req-8917a5c9-2ea3-4c98-bce6-e39084dfc07e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Oct 16 01:22:59.535030 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2153/4441] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:59.546968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4831c2ac-5e8e-4291-831b-0bdd95f8aafb tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'create', calling method: .version_select at 0x7fd64daaac10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-455576843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvXwO6SoOJey+7lodcDg8lCb632YszyYh0adsKLc1otr3UhiW5MiSZ0g3kaDNEG2k5BV0U9UMEGJrKhOzAE/9T/Zsbd+Q9sVxFhPat8XvDBEem1OfKwZheqYEu2RSa9Fw=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:22:59.567681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4831c2ac-5e8e-4291-831b-0bdd95f8aafb tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for project 0d53034488714fc8980132211d0d5c0b. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:22:59.575698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4831c2ac-5e8e-4291-831b-0bdd95f8aafb tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for user 88d5c0890ae64fd6aa7e7e547e9bf736 and project 0d53034488714fc8980132211d0d5c0b. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:22:59.604697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4831c2ac-5e8e-4291-831b-0bdd95f8aafb tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.065036 Oct 16 01:22:59.605976 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2154/4442] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:22:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:22:59.614138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:22:59.615151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:22:59.623659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:59.624383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:59.625010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:59.625889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:22:59.626511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:22:59.627569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:22:59.655570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:59.668246 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7e781dd-8409-40cb-a12b-f1459bcd1167 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1314 microversion: 2.1 time: 0.279743 Oct 16 01:22:59.676631 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2289/4443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:59 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:22:59.860079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:22:59.869963 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4e40e516-7ee6-4eab-b9c4-960785dad02c tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1324 microversion: 2.1 time: 0.262594 Oct 16 01:22:59.870573 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2155/4444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:22:59 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:00.090372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3f6b7937-1619-4548-a561-f8e506f27a41 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'create', calling method: .version_select at 0x7fd64e0ed4c0>, body: {"keypair": {"name": "tempest-keypair-1472889101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpSusiV3ynfyyV97HZwe274bQu3uEBLsfA9rsFW5wCK7dRltwrHuytlTRd6I/uyMdKICtk5pA20gazgXF5eIP6Vndh4P343EGoRgrMJSFEWqbZ0oKlFdqRAiJpJ17pbAg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:00.106607 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=18 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:00.117327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3f6b7937-1619-4548-a561-f8e506f27a41 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Getting quotas for project 07213ca67c6a4616babc77d721d2cae5. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:23:00.124715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-3f6b7937-1619-4548-a561-f8e506f27a41 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Getting quotas for user 7e7cdaa2d85d4ce698950075b98d5eb8 and project 07213ca67c6a4616babc77d721d2cae5. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:23:00.164247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3f6b7937-1619-4548-a561-f8e506f27a41 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079125 Oct 16 01:23:00.165776 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2290/4445] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:23:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:00.393736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:00.394354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:00.405032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:00.405609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:00.406054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:00.406774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:00.407294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:00.407716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:00.522743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:00.525554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:00.533115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:00.533959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:00.534677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:00.535531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:00.536003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:00.536454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:00.748171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:00.757269 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f15ee3d8-385d-489e-a38a-75484e5f5018 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1519 microversion: 2.1 time: 0.367559 Oct 16 01:23:00.758573 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2156/4446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:00 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:00.765612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:00.766543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:00.775510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:00.776309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:00.777056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:00.778275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:00.779299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:00.779951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:00.804583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:00.818304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c8331e74-c636-41f3-a70b-9900d63920f6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1317 microversion: 2.1 time: 0.299514 Oct 16 01:23:00.819458 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2291/4447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:00 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:00.894528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:00.895183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:00.902023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:00.902796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:00.903488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:00.904554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:00.905322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:00.906149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:01.001673 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:01.023147 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a1e28640-9df5-4efb-a2cb-4957d2e0a65c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1314 microversion: 2.1 time: 0.261968 Oct 16 01:23:01.023728 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2157/4448] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:00 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:01.088697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1658949073", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "abe05c27-cfb0-42bc-b848-ac7e18d68ede"}], "key_name": "tempest-TestNetworkBasicOps-455576843", "security_groups": [{"name": "tempest-secgroup-smoke-729454047"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:01.123168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:01.129128 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30eefec2-6f91-4705-b634-d6564cd2e5d4 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1324 microversion: 2.1 time: 0.237726 Oct 16 01:23:01.142384 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2292/4449] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:00 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1324 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:01.268754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] validate_networks() for [('abe05c27-cfb0-42bc-b848-ac7e18d68ede', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:23:01.638835 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=14 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:01.782628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:01.783338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:01.789490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:01.790644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:01.791552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:01.791987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:01.792655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:01.793092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.360432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:02.369673 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0c08d9a5-a02b-4b6a-9ec8-9588e599f000 tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1519 microversion: 2.1 time: 0.590943 Oct 16 01:23:02.370496 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2293/4450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:01 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1519 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:02.391710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:02.392319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:02.398678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:02.400111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:02.400948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.401871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:02.402569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:02.403234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.440358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:23:02.440944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:23:02.443556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:23:02.444140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:23:02.444569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:23:02.455035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:02.455776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:02.456447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.457735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:02.458417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:02.458854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.481276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for project 0d53034488714fc8980132211d0d5c0b. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:23:02.487918 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for user 88d5c0890ae64fd6aa7e7e547e9bf736 and project 0d53034488714fc8980132211d0d5c0b. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:23:02.501193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:23:02.503649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:23:02.579966 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a03ea17-bda4-45f1-8979-fa3fb89429c5 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.494836 Oct 16 01:23:02.587490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2158/4451] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:23:02.593987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:02.595071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:02.604192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:02.604930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:02.605632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.606594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:02.607418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:02.608186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.748539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:02.789598 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cf39d2e-fa99-4d83-885f-1a1bba722b8b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1317 microversion: 2.1 time: 0.404137 Oct 16 01:23:02.790571 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2294/4452] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:02 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:02.808398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:02.809020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:02.820059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:02.820554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:02.821002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.822267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:02.827144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:02.830527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:02.882108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:02.895002 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a98c9fd-2d8b-4319-9431-f41d29c3f596 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1314 microversion: 2.1 time: 0.305932 Oct 16 01:23:02.895953 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2159/4453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:02 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:02.906323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6c0caa93-7c07-4184-9364-8fa3a1f414d6 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:02.913576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6c0caa93-7c07-4184-9364-8fa3a1f414d6 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:03.032298 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6c0caa93-7c07-4184-9364-8fa3a1f414d6 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:03.049661 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6c0caa93-7c07-4184-9364-8fa3a1f414d6 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1248 microversion: 2.1 time: 0.147119 Oct 16 01:23:03.050476 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2160/4454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:02 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1248 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:03.060540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-3075e18d-a98b-4359-9de9-684258b4b4cb req-0c223c7a-9d0e-417a-b9f5-e015be2b65aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6863bb2e-6117-4467-8b3e-4354485f29c2", "name": "network-vif-deleted", "tag": "a5464ed4-d0ba-484e-8385-e7403fcd3a5d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:03.085424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3075e18d-a98b-4359-9de9-684258b4b4cb req-0c223c7a-9d0e-417a-b9f5-e015be2b65aa service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:03.085915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3075e18d-a98b-4359-9de9-684258b4b4cb req-0c223c7a-9d0e-417a-b9f5-e015be2b65aa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:03.086459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3075e18d-a98b-4359-9de9-684258b4b4cb req-0c223c7a-9d0e-417a-b9f5-e015be2b65aa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:03.125053 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-3075e18d-a98b-4359-9de9-684258b4b4cb req-0c223c7a-9d0e-417a-b9f5-e015be2b65aa service nova] Creating event network-vif-deleted:a5464ed4-d0ba-484e-8385-e7403fcd3a5d for instance 6863bb2e-6117-4467-8b3e-4354485f29c2 on n-h2-master-1 Oct 16 01:23:03.130600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-3075e18d-a98b-4359-9de9-684258b4b4cb req-0c223c7a-9d0e-417a-b9f5-e015be2b65aa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078299 Oct 16 01:23:03.134865 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2161/4455] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:03.184307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:03.192386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e7cc725-b0cc-4b96-b64c-1cb9d8169313 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1521 microversion: 2.1 time: 0.396487 Oct 16 01:23:03.207462 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2295/4456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:02 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:03.284728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcc1f90f-6402-4e11-8312-61205413c62d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1237548263", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcc1f90f-6402-4e11-8312-61205413c62d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Request method failure captured: Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 243 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zjZXg7FLcFLc0mrHZ4-c58d6vXwV8jja-n2VAjlvjz-JYRPLNYmPp1Ocl1DH4Xbix-LUl_Gd4aheYaQTqivnjAoICLVXvk-EXqtpol07z_lJYFGO69sg-e1CkfqCn4pog-HJW7CrobWkFOow7n_4Y2Y0DZf5zgF33kn7eDOEQEfe8 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6ebbc8c81b34f09ae5df924df3097b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2368cc38b0d74026b9414edfc10e7be6 Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1237548263", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1237548263', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'b537ca24-2fa6-42e3-9c39-1819b5b52d86'}]}}} Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:03.289708 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcc1f90f-6402-4e11-8312-61205413c62d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:03.295124 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bcc1f90f-6402-4e11-8312-61205413c62d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011685 Oct 16 01:23:03.296813 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2162/4457] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:03 2022] POST /compute/v2.1/servers => generated 175 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:03.306021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad54fdb0-9298-4d16-975e-b0686fc9ada7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:03.306690 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad54fdb0-9298-4d16-975e-b0686fc9ada7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: 648f3780-62d7-4f7c-a475-d284317e61fd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:03.319945 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ad54fdb0-9298-4d16-975e-b0686fc9ada7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] HTTP exception thrown: Instance 648f3780-62d7-4f7c-a475-d284317e61fd could not be found. Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad54fdb0-9298-4d16-975e-b0686fc9ada7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Request method failure captured: Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/648f3780-62d7-4f7c-a475-d284317e61fd/metadata HTTP/1.1 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zjZXg7FLcFLc0mrHZ4-c58d6vXwV8jja-n2VAjlvjz-JYRPLNYmPp1Ocl1DH4Xbix-LUl_Gd4aheYaQTqivnjAoICLVXvk-EXqtpol07z_lJYFGO69sg-e1CkfqCn4pog-HJW7CrobWkFOow7n_4Y2Y0DZf5zgF33kn7eDOEQEfe8 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6ebbc8c81b34f09ae5df924df3097b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2368cc38b0d74026b9414edfc10e7be6 Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 648f3780-62d7-4f7c-a475-d284317e61fd could not be found. Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': '648f3780-62d7-4f7c-a475-d284317e61fd'} Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 648f3780-62d7-4f7c-a475-d284317e61fd could not be found. Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 648f3780-62d7-4f7c-a475-d284317e61fd could not be found. Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.326127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.331060 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:03.331060 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:03.331060 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 648f3780-62d7-4f7c-a475-d284317e61fd could not be found. Oct 16 01:23:03.331060 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.332342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad54fdb0-9298-4d16-975e-b0686fc9ada7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Returning 404 to user: Instance 648f3780-62d7-4f7c-a475-d284317e61fd could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:03.333180 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad54fdb0-9298-4d16-975e-b0686fc9ada7 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/648f3780-62d7-4f7c-a475-d284317e61fd/metadata" status: 404 len: 111 microversion: 2.1 time: 0.031424 Oct 16 01:23:03.334478 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2296/4458] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:23:03 2022] GET /compute/v2.1/servers/648f3780-62d7-4f7c-a475-d284317e61fd/metadata => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:03.396756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:03.397860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:03.413728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:03.414404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:03.416334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:03.416794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:03.417458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:03.417941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:03.460107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:03.461314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:03.462829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:03.463617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lazy-loading 'fault' on Instance uuid 6863bb2e-6117-4467-8b3e-4354485f29c2 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:23:03.487451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b19b2456-809e-4b80-8c34-83ce10db8374 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1515826344", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b19b2456-809e-4b80-8c34-83ce10db8374 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Request method failure captured: Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 499 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zjZXg7FLcFLc0mrHZ4-c58d6vXwV8jja-n2VAjlvjz-JYRPLNYmPp1Ocl1DH4Xbix-LUl_Gd4aheYaQTqivnjAoICLVXvk-EXqtpol07z_lJYFGO69sg-e1CkfqCn4pog-HJW7CrobWkFOow7n_4Y2Y0DZf5zgF33kn7eDOEQEfe8 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6ebbc8c81b34f09ae5df924df3097b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2368cc38b0d74026b9414edfc10e7be6 Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1515826344", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1515826344', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b537ca24-2fa6-42e3-9c39-1819b5b52d86'}]}}} Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 16 01:23:03.497388 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.500625 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.504357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b19b2456-809e-4b80-8c34-83ce10db8374 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:03.505248 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b19b2456-809e-4b80-8c34-83ce10db8374 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.022005 Oct 16 01:23:03.511213 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2297/4459] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:03 2022] POST /compute/v2.1/servers => generated 687 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:23:03.522126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3bcea660-dc23-45d5-80d4-344afb23116f req-6b0c6e88-982d-483c-b69b-0270a29eb614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6514e50b-9489-47f4-89c6-db0bb9bc99a9", "name": "network-vif-plugged", "status": "completed", "tag": "5e638a8a-6c4a-4d54-ad53-be3e4a633c7a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:03.541905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3bcea660-dc23-45d5-80d4-344afb23116f req-6b0c6e88-982d-483c-b69b-0270a29eb614 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:03.546771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3bcea660-dc23-45d5-80d4-344afb23116f req-6b0c6e88-982d-483c-b69b-0270a29eb614 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:03.547577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3bcea660-dc23-45d5-80d4-344afb23116f req-6b0c6e88-982d-483c-b69b-0270a29eb614 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:03.559925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad50112141243a6a27812344e12cfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0379a874918747449f5bbe24b6016495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:03.577022 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6306b1d1-9c3b-491d-bf68-edf33f1443ef tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 200 len: 1311 microversion: 2.1 time: 0.183446 Oct 16 01:23:03.578279 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2163/4460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:03 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 1311 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:03.582002 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3bcea660-dc23-45d5-80d4-344afb23116f req-6b0c6e88-982d-483c-b69b-0270a29eb614 service nova] Creating event network-vif-plugged:5e638a8a-6c4a-4d54-ad53-be3e4a633c7a for instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 on n-h1-master-1 Oct 16 01:23:03.593502 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3bcea660-dc23-45d5-80d4-344afb23116f req-6b0c6e88-982d-483c-b69b-0270a29eb614 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077118 Oct 16 01:23:03.594675 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2298/4461] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:03.610866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a7caaa5-63de-48f3-a4f6-52e67676644f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-301998333", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a7caaa5-63de-48f3-a4f6-52e67676644f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Request method failure captured: Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 499 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zjZXg7FLcFLc0mrHZ4-c58d6vXwV8jja-n2VAjlvjz-JYRPLNYmPp1Ocl1DH4Xbix-LUl_Gd4aheYaQTqivnjAoICLVXvk-EXqtpol07z_lJYFGO69sg-e1CkfqCn4pog-HJW7CrobWkFOow7n_4Y2Y0DZf5zgF33kn7eDOEQEfe8 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6ebbc8c81b34f09ae5df924df3097b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2368cc38b0d74026b9414edfc10e7be6 Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-301998333", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-301998333', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b537ca24-2fa6-42e3-9c39-1819b5b52d86'}]}}} Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 16 01:23:03.616177 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.620678 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.623382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2094736388", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "901ba43b-4c2b-46ff-b843-85ea6b7c9f5c"}], "security_groups": [{"name": "tempest-securitygroup--815474394"}], "key_name": "tempest-keypair-1472889101", "user_data": "}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:03.623493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a7caaa5-63de-48f3-a4f6-52e67676644f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:03.623493 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a7caaa5-63de-48f3-a4f6-52e67676644f tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012732 Oct 16 01:23:03.623493 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2164/4462] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:03 2022] POST /compute/v2.1/servers => generated 689 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:03.676516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d271b50-a464-440d-918e-0a61e31b1238 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-961072801", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d271b50-a464-440d-918e-0a61e31b1238 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Request method failure captured: Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 753 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zjZXg7FLcFLc0mrHZ4-c58d6vXwV8jja-n2VAjlvjz-JYRPLNYmPp1Ocl1DH4Xbix-LUl_Gd4aheYaQTqivnjAoICLVXvk-EXqtpol07z_lJYFGO69sg-e1CkfqCn4pog-HJW7CrobWkFOow7n_4Y2Y0DZf5zgF33kn7eDOEQEfe8 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6ebbc8c81b34f09ae5df924df3097b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2368cc38b0d74026b9414edfc10e7be6 Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-961072801", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-961072801', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b537ca24-2fa6-42e3-9c39-1819b5b52d86'}]}}} Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:03.687621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:03.691429 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:03.695067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.695067 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.695067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d271b50-a464-440d-918e-0a61e31b1238 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:03.695067 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d271b50-a464-440d-918e-0a61e31b1238 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.017918 Oct 16 01:23:03.695067 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2165/4463] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:03 2022] POST /compute/v2.1/servers => generated 1197 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 16 01:23:03.769516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60408210-8a98-41be-b347-e128b67b4926 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1675108070", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60408210-8a98-41be-b347-e128b67b4926 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Request method failure captured: Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 1266 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zjZXg7FLcFLc0mrHZ4-c58d6vXwV8jja-n2VAjlvjz-JYRPLNYmPp1Ocl1DH4Xbix-LUl_Gd4aheYaQTqivnjAoICLVXvk-EXqtpol07z_lJYFGO69sg-e1CkfqCn4pog-HJW7CrobWkFOow7n_4Y2Y0DZf5zgF33kn7eDOEQEfe8 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6ebbc8c81b34f09ae5df924df3097b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2368cc38b0d74026b9414edfc10e7be6 Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1675108070", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b537ca24-2fa6-42e3-9c39-1819b5b52d86"}]}} Oct 16 01:23:03.781080 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1675108070', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b537ca24-2fa6-42e3-9c39-1819b5b52d86'}]}}} Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.787503 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:03.788744 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:03.793137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 16 01:23:03.793137 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.793137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60408210-8a98-41be-b347-e128b67b4926 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:03.793137 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-60408210-8a98-41be-b347-e128b67b4926 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.040142 Oct 16 01:23:03.793676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] validate_networks() for [('901ba43b-4c2b-46ff-b843-85ea6b7c9f5c', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:23:03.794124 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2166/4464] 10.222.0.39 () {60 vars in 1148 bytes} [Sun Oct 16 01:23:03 2022] POST /compute/v2.1/servers => generated 2221 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 16 01:23:03.797832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25208cbf-29f6-4fb9-97ed-3f82d37be981 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:03.798387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-25208cbf-29f6-4fb9-97ed-3f82d37be981 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: ca542c02-ea75-4183-9a84-03f54cbfcb19] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:03.813659 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-25208cbf-29f6-4fb9-97ed-3f82d37be981 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] HTTP exception thrown: Instance ca542c02-ea75-4183-9a84-03f54cbfcb19 could not be found. Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25208cbf-29f6-4fb9-97ed-3f82d37be981 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Request method failure captured: Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/ca542c02-ea75-4183-9a84-03f54cbfcb19/metadata/test2 HTTP/1.1 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zjZXg7FLcFLc0mrHZ4-c58d6vXwV8jja-n2VAjlvjz-JYRPLNYmPp1Ocl1DH4Xbix-LUl_Gd4aheYaQTqivnjAoICLVXvk-EXqtpol07z_lJYFGO69sg-e1CkfqCn4pog-HJW7CrobWkFOow7n_4Y2Y0DZf5zgF33kn7eDOEQEfe8 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6ebbc8c81b34f09ae5df924df3097b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2368cc38b0d74026b9414edfc10e7be6 Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ca542c02-ea75-4183-9a84-03f54cbfcb19 could not be found. Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': 'ca542c02-ea75-4183-9a84-03f54cbfcb19', 'id': 'test2'} Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca542c02-ea75-4183-9a84-03f54cbfcb19 could not be found. Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca542c02-ea75-4183-9a84-03f54cbfcb19 could not be found. Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:03.815477 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:03.821059 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:03.821059 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:03.821059 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca542c02-ea75-4183-9a84-03f54cbfcb19 could not be found. Oct 16 01:23:03.821059 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:03.821059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25208cbf-29f6-4fb9-97ed-3f82d37be981 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Returning 404 to user: Instance ca542c02-ea75-4183-9a84-03f54cbfcb19 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:03.821059 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-25208cbf-29f6-4fb9-97ed-3f82d37be981 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/ca542c02-ea75-4183-9a84-03f54cbfcb19/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.023145 Oct 16 01:23:03.827356 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2167/4465] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Oct 16 01:23:03 2022] GET /compute/v2.1/servers/ca542c02-ea75-4183-9a84-03f54cbfcb19/metadata/test2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:23:03.838582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:03.839331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:03.866782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:03.869684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:03.875392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:03.876288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:03.876875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:03.877397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:03.904995 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:04.101950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:04.111479 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51ac0abe-e11a-4d08-b073-b726907043c8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1317 microversion: 2.1 time: 0.282527 Oct 16 01:23:04.112042 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2168/4466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:03 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:04.117136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:04.117743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:04.135135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.136017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.136659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.137847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.138638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.139384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.167351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:23:04.246468 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c7fd62f-632b-4daf-b6d2-8ae8c4311bef tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 204 len: 0 microversion: 2.1 time: 0.132873 Oct 16 01:23:04.247745 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2169/4467] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:23:04 2022] DELETE /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:23:04.253428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:04.254474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:04.261401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.261893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.262331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.263067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.263529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.263967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.457691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:23:04.458106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:23:04.458789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:23:04.459232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:23:04.459644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:23:04.473760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:04.481158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.481885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.482324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.483087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.483605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.484031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.484988 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd46c008-8962-4ef9-8d37-692c36873a91 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1314 microversion: 2.1 time: 0.235266 Oct 16 01:23:04.485619 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2170/4468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:04 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:04.498818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:04.499853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:04.507701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.508612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.509253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.510165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.510706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.511384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.518483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Getting quotas for project 07213ca67c6a4616babc77d721d2cae5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:23:04.525061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Getting quotas for user 7e7cdaa2d85d4ce698950075b98d5eb8 and project 07213ca67c6a4616babc77d721d2cae5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:23:04.540802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:23:04.548332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:23:04.604162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:04.616616 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7bd894f8-d135-4dff-bcff-8d1dec29b7f4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1308 microversion: 2.1 time: 0.129593 Oct 16 01:23:04.618031 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8364b809-2e16-4c18-a398-b8a34e4dabd7 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.008014 Oct 16 01:23:04.619529 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2171/4469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:04 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:04.621299 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2299/4470] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:23:04.642002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:04.642504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] [instance: 6863bb2e-6117-4467-8b3e-4354485f29c2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:04.644129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:04.644902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:04.655823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.658736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.659195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.659722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.660230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.660443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.660990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.661170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:04.661515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.661953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.662138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:04.662738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:04.692156 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] HTTP exception thrown: Instance 6863bb2e-6117-4467-8b3e-4354485f29c2 could not be found. Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Request method failure captured: Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 HTTP/1.1 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yeWXkGTq2gqdxs59lxkcclMfo_vKVUTzL4UeW1ZNKyzJg3RVZvCbEvutvP89oBBpV6iuuMW4K80noeOWU0cfBv64qAGtmh6MK0FXKFh0pStFNzpVifysmVDDCVXnA7AgDPIZudk5qrm47NF2yqCGWpcUhoUqM5BWDoEGx7PcWN-DY Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 0379a874918747449f5bbe24b6016495 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0379a874918747449f5bbe24b6016495", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0379a874918747449f5bbe24b6016495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0379a874918747449f5bbe24b6016495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0379a874918747449f5bbe24b6016495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 0379a874918747449f5bbe24b6016495 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-446774426 Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ListServerFiltersTestJSON-446774426-project Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: cad50112141243a6a27812344e12cfec Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ListServerFiltersTestJSON-446774426-project Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6863bb2e-6117-4467-8b3e-4354485f29c2 could not be found. Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6863bb2e-6117-4467-8b3e-4354485f29c2'} Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6863bb2e-6117-4467-8b3e-4354485f29c2 could not be found. Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6863bb2e-6117-4467-8b3e-4354485f29c2 could not be found. Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:04.694683 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:04.699330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:04.699330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:04.699330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:04.699330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:04.699330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:04.699330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6863bb2e-6117-4467-8b3e-4354485f29c2 could not be found. Oct 16 01:23:04.699330 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:04.700203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] Returning 404 to user: Instance 6863bb2e-6117-4467-8b3e-4354485f29c2 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:04.701064 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80a38922-d6d6-41bd-a1dc-be70eaef8beb tempest-ListServerFiltersTestJSON-446774426 tempest-ListServerFiltersTestJSON-446774426-project] 10.222.0.39 "GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2" status: 404 len: 111 microversion: 2.1 time: 0.078991 Oct 16 01:23:04.701819 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2300/4471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:04 2022] GET /compute/v2.1/servers/6863bb2e-6117-4467-8b3e-4354485f29c2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:04.721339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7059b8a4-6646-4dbe-b845-50169744b13e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:04.721960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7059b8a4-6646-4dbe-b845-50169744b13e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:04.814551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7059b8a4-6646-4dbe-b845-50169744b13e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:04.827209 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7059b8a4-6646-4dbe-b845-50169744b13e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1246 microversion: 2.1 time: 0.124190 Oct 16 01:23:04.828880 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2301/4472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:04 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:04.917669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:04.927155 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cb7afdf2-5676-4167-96e4-ad5925f3c3e0 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1527 microversion: 2.1 time: 0.306561 Oct 16 01:23:04.937643 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2172/4473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:04 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1527 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:05.135946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:05.136754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:05.154385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.156294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.156880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.159420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.160026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.162362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.415149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:05.424507 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-56831364-febe-426c-bfa2-6bf30a99a873 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1317 microversion: 2.1 time: 0.293549 Oct 16 01:23:05.441864 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2302/4474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:05 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:05.510088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:05.510844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:05.516944 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:05.521830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.522332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.522781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.523551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.524016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.524996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.646898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:05.647796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:05.660304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.662101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.663774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.664529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.665104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.665549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.824270 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:05.839807 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39c8efb5-298c-4c6d-a6f3-b13a85820594 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1314 microversion: 2.1 time: 0.335352 Oct 16 01:23:05.840987 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2173/4475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:05 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:05.852135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:05.853527 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:05.865835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.866338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.866955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.867525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.867992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.869181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.934205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:05.949081 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff6c8cd0-647f-4283-ab84-89e2909b71ed tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1373 microversion: 2.1 time: 0.305479 Oct 16 01:23:05.952875 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2303/4476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:05 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1373 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:05.959071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:05.959071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:05.972952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:05.982747 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6f0de1b0-8f95-48ab-aae6-f9e2d47ea474 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1250 microversion: 2.1 time: 0.134393 Oct 16 01:23:05.987140 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2174/4477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:05 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1250 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:05.987290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.987290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.987290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:05.988436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:05.989434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:05.995862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:06.103127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c168c670-6635-4f8a-bd62-7ebcfa8f3eb1 req-ec900dbe-65d9-46ce-90bf-399a97bac4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc1403e-9703-433b-9e7e-05ad0d3b0531", "name": "network-vif-plugged", "status": "completed", "tag": "b9b158fc-bd22-4695-9f8a-a020d575b313"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:06.119212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c168c670-6635-4f8a-bd62-7ebcfa8f3eb1 req-ec900dbe-65d9-46ce-90bf-399a97bac4fc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:06.120202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c168c670-6635-4f8a-bd62-7ebcfa8f3eb1 req-ec900dbe-65d9-46ce-90bf-399a97bac4fc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:06.121219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c168c670-6635-4f8a-bd62-7ebcfa8f3eb1 req-ec900dbe-65d9-46ce-90bf-399a97bac4fc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:06.145820 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c168c670-6635-4f8a-bd62-7ebcfa8f3eb1 req-ec900dbe-65d9-46ce-90bf-399a97bac4fc service nova] Creating event network-vif-plugged:b9b158fc-bd22-4695-9f8a-a020d575b313 for instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 on n-h2-master-1 Oct 16 01:23:06.154307 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c168c670-6635-4f8a-bd62-7ebcfa8f3eb1 req-ec900dbe-65d9-46ce-90bf-399a97bac4fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058131 Oct 16 01:23:06.155771 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2175/4478] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:06.336666 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:06.350972 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2c2abad5-fb80-480e-bbd0-2dbb4def90e1 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1527 microversion: 2.1 time: 0.397637 Oct 16 01:23:06.351790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2304/4479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:05 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1527 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:06.451638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:06.452704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:06.460519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:06.461439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:06.463078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:06.464055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:06.464739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:06.465513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:06.745220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:06.756834 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4b21ff96-c581-4d4c-b1ec-64752d13f537 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1506 microversion: 2.1 time: 0.309583 Oct 16 01:23:06.758111 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2176/4480] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:06 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:06.782778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:06.783506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:06.793056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:06.794023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:06.795296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:06.797197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:06.798030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:06.798562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:06.831766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:23:06.866607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:06.867569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:06.876204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:06.877469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:06.879129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:06.880696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:06.881260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:06.885274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:06.983390 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-053e492e-6b86-4ce7-93f4-bd6c019c4aaf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 204 len: 0 microversion: 2.1 time: 0.204541 Oct 16 01:23:06.984113 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2305/4481] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:23:06 2022] DELETE /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:23:07.006380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:07.011332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:07.029100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.030286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.030996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.032278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.032967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.033616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.311073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:07.320865 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6392aa07-de76-4e39-aa6b-f9791e4d5d80 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1314 microversion: 2.1 time: 0.458510 Oct 16 01:23:07.322509 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2177/4482] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:06 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:07.327657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:07.328418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:07.336370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.337115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.338080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.339014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.339483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.339917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.447239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:07.456688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c4fc0cf5-8c95-4e12-aebd-4f342bee2b75 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1373 microversion: 2.1 time: 0.471126 Oct 16 01:23:07.457564 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2306/4483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:06 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1373 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:07.464236 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:07.465186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:07.473452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.474271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.475219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.477205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.478064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.478663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.575861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:07.584814 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-16e61c3f-aebe-4f04-9d2b-de4c89b7e9f1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1306 microversion: 2.1 time: 0.126211 Oct 16 01:23:07.585409 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2307/4484] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:07 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1306 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:07.591285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9a665bd8-053e-4548-a17e-f3717c02dfd1 req-2554a60c-34e0-4f8f-89ef-2aa320481fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa596808-df63-4252-911b-59c75f785ede", "name": "network-vif-deleted", "tag": "ddbd80d6-018e-4339-874b-e870e3103cbd"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:07.600634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a665bd8-053e-4548-a17e-f3717c02dfd1 req-2554a60c-34e0-4f8f-89ef-2aa320481fca service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.601117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a665bd8-053e-4548-a17e-f3717c02dfd1 req-2554a60c-34e0-4f8f-89ef-2aa320481fca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.601555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a665bd8-053e-4548-a17e-f3717c02dfd1 req-2554a60c-34e0-4f8f-89ef-2aa320481fca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.613693 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9a665bd8-053e-4548-a17e-f3717c02dfd1 req-2554a60c-34e0-4f8f-89ef-2aa320481fca service nova] Creating event network-vif-deleted:ddbd80d6-018e-4339-874b-e870e3103cbd for instance fa596808-df63-4252-911b-59c75f785ede on n-h1-master-1 Oct 16 01:23:07.618575 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9a665bd8-053e-4548-a17e-f3717c02dfd1 req-2554a60c-34e0-4f8f-89ef-2aa320481fca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032009 Oct 16 01:23:07.619228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2308/4485] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:07.624393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ee1e947d-1268-4fcd-a139-f557bbc5be24 req-3374bcc4-a6cc-48d5-a9ff-280e250a7d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642a16e0-6927-432c-9a1c-65b4dab274a4", "tag": "ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:07.625666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:07.634135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef80b180-0775-4112-b2f3-1032bf0ff21b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1512 microversion: 2.1 time: 0.309922 Oct 16 01:23:07.634408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee1e947d-1268-4fcd-a139-f557bbc5be24 req-3374bcc4-a6cc-48d5-a9ff-280e250a7d0c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.634868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee1e947d-1268-4fcd-a139-f557bbc5be24 req-3374bcc4-a6cc-48d5-a9ff-280e250a7d0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.635422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee1e947d-1268-4fcd-a139-f557bbc5be24 req-3374bcc4-a6cc-48d5-a9ff-280e250a7d0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.636013 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2178/4486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:07 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:07.641705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:07.642460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:07.648910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.650036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.650573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.651465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:07.651995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:07.652492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:07.664598 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ee1e947d-1268-4fcd-a139-f557bbc5be24 req-3374bcc4-a6cc-48d5-a9ff-280e250a7d0c service nova] Creating event network-changed:ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9 for instance 642a16e0-6927-432c-9a1c-65b4dab274a4 on n-h2-master-1 Oct 16 01:23:07.669475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ee1e947d-1268-4fcd-a139-f557bbc5be24 req-3374bcc4-a6cc-48d5-a9ff-280e250a7d0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048911 Oct 16 01:23:07.670430 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2309/4487] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:07.754726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:07.764256 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d5c98a4b-8619-4eae-82b0-76b0da6ff477 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1485 microversion: 2.1 time: 0.126955 Oct 16 01:23:07.764928 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2179/4488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:07 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1485 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:08.346750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:08.348022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:08.355368 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:08.357166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:08.357850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:08.358304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:08.359017 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:08.359815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:08.360405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:08.482239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:08.483066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:08.498362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:08.501059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:08.501903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:08.505262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:08.506049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:08.506971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:08.633873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:08.638522 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:08.644514 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6bd35fc1-dce2-4520-8b8c-dcf1b986e4c9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1500 microversion: 2.1 time: 0.302778 Oct 16 01:23:08.645912 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2310/4489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:08 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1500 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:08.668574 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:08.669311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:08.679938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:08.681038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:08.681648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:08.682549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:08.683282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:08.683923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:08.872353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:08.882557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-14857c28-16d4-4d36-bf8b-bec1f3fc06cb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1304 microversion: 2.1 time: 0.235399 Oct 16 01:23:08.883190 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2311/4490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:08 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1304 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:08.899220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:08.901109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:08.911638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:08.912134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:08.912668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:08.913475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:08.913977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:08.914434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.096903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:09.107291 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7b89c76c-5a30-475d-9ee9-cc30ac01a412 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1373 microversion: 2.1 time: 0.629613 Oct 16 01:23:09.124702 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2180/4491] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:08 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1373 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:09.130279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:09.131221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:09.141522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.142455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.143096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.144008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.145288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.146413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.266319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8c2362c-4fb5-4cc8-ad00-71bf4e220d77 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531/action" status: 202 len: 0 microversion: 2.1 time: 0.139613 Oct 16 01:23:09.271430 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2181/4492] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:09 2022] POST /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:23:09.278366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:09.279326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:09.287642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:09.287918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.288421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.289022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.289954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.290971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.291909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.296675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7af729b0-7a36-4541-9e2e-50865539fa5c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1512 microversion: 2.1 time: 0.411888 Oct 16 01:23:09.297248 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2312/4493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:08 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:09.306874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:09.314407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:09.327337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.331440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.332120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.334758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.335435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.340297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.350685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.351547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.352195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.353036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lazy-loading 'fault' on Instance uuid fa596808-df63-4252-911b-59c75f785ede {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:23:09.596863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2368cc38b0d74026b9414edfc10e7be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebbc8c81b34f09ae5df924df3097b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:09.600612 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:09.607076 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7359c1d6-bf46-463f-b6ba-dec5e2be742d tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 200 len: 1314 microversion: 2.1 time: 0.333933 Oct 16 01:23:09.607929 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2182/4494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:09 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:09.910113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:09.910829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:09.918008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.936206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.936757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:09.937732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:09.938280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:09.938842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:10.124266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:10.136499 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c1d007d1-38f7-4854-9f20-94d554abbebc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1505 microversion: 2.1 time: 0.834048 Oct 16 01:23:10.137467 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2313/4495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:09 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:10.170564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:10.174100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:10.182868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:10.183786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:10.184483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:10.185311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:10.185838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:10.186330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:10.435094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:10.444203 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5571b072-fe79-4cb6-8c47-ef79e1c3625c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1371 microversion: 2.1 time: 0.537882 Oct 16 01:23:10.445248 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2183/4496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:09 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1371 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:10.450232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:10.451204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:10.458341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:10.459167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:10.460006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:10.460947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:10.461634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:10.462327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:10.637281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:10.653625 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81007a70-d983-418a-aa75-c8eb2fd08736 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1470 microversion: 2.1 time: 0.207024 Oct 16 01:23:10.654799 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2184/4497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:10 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:10.660037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5a1e07be-dbf1-4cdc-9eec-0ef824198a59 req-42b80cec-4683-42f0-91b4-7b20f733420c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53610cf8-c016-4fa4-bd6e-178818cc4ab3", "tag": "9a29f124-7a82-45e3-890b-8e5e29092482"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:10.690830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5a1e07be-dbf1-4cdc-9eec-0ef824198a59 req-42b80cec-4683-42f0-91b4-7b20f733420c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:10.691652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5a1e07be-dbf1-4cdc-9eec-0ef824198a59 req-42b80cec-4683-42f0-91b4-7b20f733420c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:10.692261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5a1e07be-dbf1-4cdc-9eec-0ef824198a59 req-42b80cec-4683-42f0-91b4-7b20f733420c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:10.710138 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5a1e07be-dbf1-4cdc-9eec-0ef824198a59 req-42b80cec-4683-42f0-91b4-7b20f733420c service nova] Creating event network-changed:9a29f124-7a82-45e3-890b-8e5e29092482 for instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 on n-h1-master-1 Oct 16 01:23:10.725652 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5a1e07be-dbf1-4cdc-9eec-0ef824198a59 req-42b80cec-4683-42f0-91b4-7b20f733420c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069311 Oct 16 01:23:10.730420 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2185/4498] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:10.744623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:10.745348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] [instance: fa596808-df63-4252-911b-59c75f785ede] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:10.754487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:10.755014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:10.755457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:10.756169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:10.760884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:10.761829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:10.784622 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] HTTP exception thrown: Instance fa596808-df63-4252-911b-59c75f785ede could not be found. Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Request method failure captured: Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede HTTP/1.1 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zjZXg7FLcFLc0mrHZ4-c58d6vXwV8jja-n2VAjlvjz-JYRPLNYmPp1Ocl1DH4Xbix-LUl_Gd4aheYaQTqivnjAoICLVXvk-EXqtpol07z_lJYFGO69sg-e1CkfqCn4pog-HJW7CrobWkFOow7n_4Y2Y0DZf5zgF33kn7eDOEQEfe8 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f6ebbc8c81b34f09ae5df924df3097b6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f6ebbc8c81b34f09ae5df924df3097b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f6ebbc8c81b34f09ae5df924df3097b6 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-784084582 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2368cc38b0d74026b9414edfc10e7be6 Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-784084582-project Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: exception: Instance fa596808-df63-4252-911b-59c75f785ede could not be found. Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'fa596808-df63-4252-911b-59c75f785ede'} Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa596808-df63-4252-911b-59c75f785ede could not be found. Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa596808-df63-4252-911b-59c75f785ede could not be found. Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:10.788937 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa596808-df63-4252-911b-59c75f785ede could not be found. Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] Returning 404 to user: Instance fa596808-df63-4252-911b-59c75f785ede could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7494fc64-e40e-459b-90bf-055d27e13a81 tempest-ServerMetadataNegativeTestJSON-784084582 tempest-ServerMetadataNegativeTestJSON-784084582-project] 10.222.0.39 "GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede" status: 404 len: 111 microversion: 2.1 time: 0.059291 Oct 16 01:23:10.793875 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2186/4499] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:10 2022] GET /compute/v2.1/servers/fa596808-df63-4252-911b-59c75f785ede => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:11.164680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:11.167171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:11.177416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.178266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.178706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.179437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.179896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.181207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.197552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:11.206843 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-caae903c-26e2-4da8-b5dd-06f0246bda82 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1373 microversion: 2.1 time: 1.067923 Oct 16 01:23:11.207482 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2314/4500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:10 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1373 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:11.221480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5ff7e581-abcc-4db0-8f8d-39fcf2d5d001 req-784975ec-f26a-48ec-8fd9-acbbcdeb5454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6514e50b-9489-47f4-89c6-db0bb9bc99a9", "name": "network-vif-deleted", "tag": "5e638a8a-6c4a-4d54-ad53-be3e4a633c7a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:11.233344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ff7e581-abcc-4db0-8f8d-39fcf2d5d001 req-784975ec-f26a-48ec-8fd9-acbbcdeb5454 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.235190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ff7e581-abcc-4db0-8f8d-39fcf2d5d001 req-784975ec-f26a-48ec-8fd9-acbbcdeb5454 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.235693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ff7e581-abcc-4db0-8f8d-39fcf2d5d001 req-784975ec-f26a-48ec-8fd9-acbbcdeb5454 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.252522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5ff7e581-abcc-4db0-8f8d-39fcf2d5d001 req-784975ec-f26a-48ec-8fd9-acbbcdeb5454 service nova] Creating event network-vif-deleted:5e638a8a-6c4a-4d54-ad53-be3e4a633c7a for instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 on n-h1-master-1 Oct 16 01:23:11.258237 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5ff7e581-abcc-4db0-8f8d-39fcf2d5d001 req-784975ec-f26a-48ec-8fd9-acbbcdeb5454 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047153 Oct 16 01:23:11.259155 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2315/4501] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:11.474687 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:11.475633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:11.482462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.483306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.483822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.484649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.485176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.485672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.656961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:11.665490 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-973a084d-5052-4dea-ae8e-a7ae04dd8457 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1485 microversion: 2.1 time: 0.505794 Oct 16 01:23:11.683622 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2187/4502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:11 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1485 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:11.683622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:11.683622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:11.687873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.688382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.688815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.689507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.689960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.690419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.832421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:11.843992 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-594ef340-6a51-42be-98d4-562f31da0898 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 200 len: 1470 microversion: 2.1 time: 0.167884 Oct 16 01:23:11.844957 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2188/4503] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:11 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:11.851454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:11.851957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:11.859552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.860068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.860513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.861423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:11.861893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:11.862562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:11.892287 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:23:11.931416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:11.948118 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac9d2691-caff-41c3-b682-97e07e7fe586 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1371 microversion: 2.1 time: 0.478668 Oct 16 01:23:11.963902 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2316/4504] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:11 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1371 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:11.992151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1365746-4eb0-4459-b0df-027e7c3e52d1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 204 len: 0 microversion: 2.1 time: 0.144037 Oct 16 01:23:11.995314 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2189/4505] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:23:11 2022] DELETE /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:23:12.004564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:12.005670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:12.013048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:12.013812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:12.014410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:12.015310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:12.016044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:12.016635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:12.235666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:12.236451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:12.244121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:12.244915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:12.246164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:12.247135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:12.248367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:12.248951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:12.471021 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:12.558374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:12.570520 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b2f7d82e-7f11-45d9-a1f8-a31bc477c0b0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1491 microversion: 2.1 time: 0.570627 Oct 16 01:23:12.572268 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2317/4506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:11 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1491 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:12.866738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:12.867609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:12.874819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:12.875435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:12.875868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:12.876559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:12.877011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:12.877554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:12.891831 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 HTTP/1.1 Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6514e50b-9489-47f4-89c6-db0bb9bc99a9'} Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:12.893706 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49d0fa9a-6198-461d-a9fb-35d891b59c56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 404 len: 111 microversion: 2.1 time: 0.032562 Oct 16 01:23:12.898793 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2318/4507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:12 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:23:12.904400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:12.905007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:12.912465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:12.912956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:12.913389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:12.914088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:12.914547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:12.915504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:13.039209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:13.042264 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=30 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:13.050034 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f82f4cec-b201-47d2-9759-f29187568c54 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1373 microversion: 2.1 time: 0.818728 Oct 16 01:23:13.050725 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2190/4508] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:12 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1373 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:13.055818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:13.057383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:13.063689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:13.064408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:13.065057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:13.066231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:13.066943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:13.067590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:13.421825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:13.435203 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fd4d084f-fe2f-4c7c-8d14-401491c292f5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.534328 Oct 16 01:23:13.436148 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2319/4509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:12 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:13.569312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-634fda2b-0e89-4cb8-8b72-985692aa7b8c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-634fda2b-0e89-4cb8-8b72-985692aa7b8c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 163 Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": 12345, "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 12345 Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:13.574025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 16 01:23:13.578483 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:13.580198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:13.581575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-634fda2b-0e89-4cb8-8b72-985692aa7b8c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:13.582648 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-634fda2b-0e89-4cb8-8b72-985692aa7b8c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.018091 Oct 16 01:23:13.583606 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2320/4510] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:13 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:23:13.585013 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be16e7b5-ecea-4447-8831-5a0b98d7f894 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1371 microversion: 2.1 time: 0.532935 Oct 16 01:23:13.585590 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2191/4511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:13 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:13.594780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:13.595674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:13.603311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:13.603504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:13.603881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:13.604042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:13.604437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:13.605218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:13.605778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:13.606545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:13.610372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:13.610870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:13.611370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:13.612079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:13.612544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:13.613140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:14.166759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:14.170147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:14.175011 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ee16b2a-8713-4124-8f24-d3ca03fae54f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.585775 Oct 16 01:23:14.175779 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2321/4512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:13 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:14.182202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-cd1782a5-d789-401f-8ce9-c31e3236113b req-e215a79b-24ae-4555-8f6d-c241f1b94c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642a16e0-6927-432c-9a1c-65b4dab274a4", "name": "network-vif-plugged", "status": "completed", "tag": "ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:14.192592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cd1782a5-d789-401f-8ce9-c31e3236113b req-e215a79b-24ae-4555-8f6d-c241f1b94c00 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:14.193080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cd1782a5-d789-401f-8ce9-c31e3236113b req-e215a79b-24ae-4555-8f6d-c241f1b94c00 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:14.193527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cd1782a5-d789-401f-8ce9-c31e3236113b req-e215a79b-24ae-4555-8f6d-c241f1b94c00 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:14.206357 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-cd1782a5-d789-401f-8ce9-c31e3236113b req-e215a79b-24ae-4555-8f6d-c241f1b94c00 service nova] Creating event network-vif-plugged:ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9 for instance 642a16e0-6927-432c-9a1c-65b4dab274a4 on n-h2-master-1 Oct 16 01:23:14.207284 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8d8b4ec-c5be-4fc9-9479-dc2b31762a55 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1491 microversion: 2.1 time: 0.616089 Oct 16 01:23:14.207920 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2192/4513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:13 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1491 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:14.213459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:14.214072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:14.224213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:14.225339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:14.225968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:14.227015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:14.228226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:14.228743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:14.228962 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-cd1782a5-d789-401f-8ce9-c31e3236113b req-e215a79b-24ae-4555-8f6d-c241f1b94c00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051792 Oct 16 01:23:14.230841 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2322/4514] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:14.238356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:14.239229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:14.246658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:14.247186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:14.247820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:14.248699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:14.249308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:14.250006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:14.505255 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:14.818856 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:14.924582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:14.933669 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ea68f7a0-c8d5-4fa3-b3f5-b6c370cdb7d8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1373 microversion: 2.1 time: 0.723790 Oct 16 01:23:14.934619 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2193/4515] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:14 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1373 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:14.953673 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:14.954653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:14.963723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:14.964604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:14.966258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:14.967359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:14.968045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:14.968908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:14.999828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:15.020903 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d0ae77f7-fbb2-4393-80b2-a21f16b54e6e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.777990 Oct 16 01:23:15.025985 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2323/4516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:14 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:15.234260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:15.236033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:15.248156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:15.250571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:15.251435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:15.253708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:15.255859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:15.256865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:15.563581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:15.577149 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1b799696-8c19-4730-973f-ec6f940d9393 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1371 microversion: 2.1 time: 0.639213 Oct 16 01:23:15.579238 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2194/4517] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:14 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1371 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:15.632514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:15.646866 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bc4dacb6-15a3-4717-9380-eeec09d06f2e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1491 microversion: 2.1 time: 0.415293 Oct 16 01:23:15.649968 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2324/4518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:15 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1491 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:15.976502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:15.978695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:15.992815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:15.994866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:15.996243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:15.999808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.002446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.003174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:16.046751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-537d5e92-761b-4ec2-9eb2-dec09be56514 req-0288f5dd-3763-4260-ba9b-f3c7d54bf9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbc1403e-9703-433b-9e7e-05ad0d3b0531", "name": "network-vif-deleted", "tag": "b9b158fc-bd22-4695-9f8a-a020d575b313"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:16.088335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-537d5e92-761b-4ec2-9eb2-dec09be56514 req-0288f5dd-3763-4260-ba9b-f3c7d54bf9f0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.095537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-537d5e92-761b-4ec2-9eb2-dec09be56514 req-0288f5dd-3763-4260-ba9b-f3c7d54bf9f0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.096131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-537d5e92-761b-4ec2-9eb2-dec09be56514 req-0288f5dd-3763-4260-ba9b-f3c7d54bf9f0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:16.131893 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-537d5e92-761b-4ec2-9eb2-dec09be56514 req-0288f5dd-3763-4260-ba9b-f3c7d54bf9f0 service nova] Creating event network-vif-deleted:b9b158fc-bd22-4695-9f8a-a020d575b313 for instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 on n-h2-master-1 Oct 16 01:23:16.146120 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-537d5e92-761b-4ec2-9eb2-dec09be56514 req-0288f5dd-3763-4260-ba9b-f3c7d54bf9f0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103033 Oct 16 01:23:16.148052 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2325/4519] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:16.250656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-79d9edef-4c9d-4ebc-ba4e-be9683154a04 req-2f98e049-d364-416a-94d4-0b105e7a68e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53610cf8-c016-4fa4-bd6e-178818cc4ab3", "name": "network-vif-plugged", "status": "completed", "tag": "9a29f124-7a82-45e3-890b-8e5e29092482"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:16.269657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-79d9edef-4c9d-4ebc-ba4e-be9683154a04 req-2f98e049-d364-416a-94d4-0b105e7a68e1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.270351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-79d9edef-4c9d-4ebc-ba4e-be9683154a04 req-2f98e049-d364-416a-94d4-0b105e7a68e1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.271041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-79d9edef-4c9d-4ebc-ba4e-be9683154a04 req-2f98e049-d364-416a-94d4-0b105e7a68e1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:16.302228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-79d9edef-4c9d-4ebc-ba4e-be9683154a04 req-2f98e049-d364-416a-94d4-0b105e7a68e1 service nova] Creating event network-vif-plugged:9a29f124-7a82-45e3-890b-8e5e29092482 for instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 on n-h1-master-1 Oct 16 01:23:16.315177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-79d9edef-4c9d-4ebc-ba4e-be9683154a04 req-2f98e049-d364-416a-94d4-0b105e7a68e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067035 Oct 16 01:23:16.319024 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2326/4520] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:16.414097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:16.428114 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-577caaef-bbbf-4e25-8d18-710ca28f5806 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1544 microversion: 2.1 time: 0.455807 Oct 16 01:23:16.429318 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2195/4521] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:15 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1544 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:16.452870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:16.453848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:16.465266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.466282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.466881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:16.467974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.471677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.472505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:16.615234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:16.615923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:16.633202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.634302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.634758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:16.635519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.635991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.636427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:16.841825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:16.853512 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cbf974ab-ede5-42cd-812c-96d185d02c13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1544 microversion: 2.1 time: 0.404821 Oct 16 01:23:16.857910 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2327/4522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:16 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1544 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:16.873503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:16.880000 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:16.897351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.898251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.907659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:16.912382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:16.919227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:16.920826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:17.026979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:17.027465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:17.029692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:17.030584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lazy-loading 'fault' on Instance uuid cbc1403e-9703-433b-9e7e-05ad0d3b0531 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:23:17.204862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:17.220288 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da2e7318-c8f5-4ef7-b3c5-fc7fdbf7e0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 200 len: 1304 microversion: 2.1 time: 0.360942 Oct 16 01:23:17.223624 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2328/4523] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:16 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 1304 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:17.351935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:17.364939 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5cb3239-6a74-4b19-bc11-c322a96a3729 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1371 microversion: 2.1 time: 0.758739 Oct 16 01:23:17.386167 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2196/4524] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:16 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1371 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:18.140120 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62042a05-0e5d-4dcb-937d-286ac48d70df tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1368175878", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "28ac937a-059d-4d41-b96e-b4abb6cf79a6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:18.244749 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-62042a05-0e5d-4dcb-937d-286ac48d70df tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Block Device 28ac937a-059d-4d41-b96e-b4abb6cf79a6 is not bootable. Oct 16 01:23:18.250064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:18.250685 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:18.261159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62042a05-0e5d-4dcb-937d-286ac48d70df tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 358 Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1368175878", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "28ac937a-059d-4d41-b96e-b4abb6cf79a6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: exception: Block Device 28ac937a-059d-4d41-b96e-b4abb6cf79a6 is not bootable. Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1368175878', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '28ac937a-059d-4d41-b96e-b4abb6cf79a6'}], 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 28ac937a-059d-4d41-b96e-b4abb6cf79a6 is not bootable. Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:18.261357 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 28ac937a-059d-4d41-b96e-b4abb6cf79a6 is not bootable. Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 28ac937a-059d-4d41-b96e-b4abb6cf79a6 is not bootable. Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62042a05-0e5d-4dcb-937d-286ac48d70df tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Block Device 28ac937a-059d-4d41-b96e-b4abb6cf79a6 is not bootable. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-62042a05-0e5d-4dcb-937d-286ac48d70df tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.130607 Oct 16 01:23:18.268368 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2329/4525] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:18.271459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:18.272149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:18.273120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:18.273593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:18.274045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:18.279293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:18.280277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:18.287782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:18.288653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:18.289337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:18.290946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:18.292764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:18.293472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:18.304667 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 HTTP/1.1 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: exception: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'cbc1403e-9703-433b-9e7e-05ad0d3b0531'} Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:18.306540 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a3e3e1db-79f9-488b-bcc8-68ce7a7d9cf0 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 404 len: 111 microversion: 2.1 time: 0.061887 Oct 16 01:23:18.310755 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2197/4526] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:18 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:18.392540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:18.393254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:18.401166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:18.401876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:18.402395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:18.403307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:18.403845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:18.404378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:18.716989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:18.724910 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d20fc446-9f19-4175-94d8-9e2e38965d35 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.454570 Oct 16 01:23:18.726227 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2330/4527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:18 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:18.747564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-842718194", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "80782a8b-359e-4c99-bfc4-19cb8408a888"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:18.845265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] validate_networks() for [('80782a8b-359e-4c99-bfc4-19cb8408a888', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:23:19.211192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:19.230475 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f26996d9-bde8-4e53-a48c-aea1bb06eaa8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1564 microversion: 2.1 time: 0.840218 Oct 16 01:23:19.250814 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2198/4528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:18 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1564 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:19.259211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:19.260109 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:19.304584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:19.305500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:19.307324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:19.309593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:19.310204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:19.313484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:19.983927 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:19.990006 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:20.013370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74b7a4d3-f0a1-4c30-980d-17f2557178cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.760301 Oct 16 01:23:20.019840 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2199/4529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:19 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:20.025726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:20.026234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:20.032829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:20.033683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:20.034664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:20.035630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:20.036815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:20.037469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:20.245733 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3527c1a7-165b-4f42-a9cb-8ea1502f08c1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.224422 Oct 16 01:23:20.246654 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2200/4530] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:23:20 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:20.251764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:20.252906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:20.268443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:20.269181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:20.269778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:20.270685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:20.271329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:20.271912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:20.327605 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1b8e1b32-ccc3-4535-ba38-efb26d88e905 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/ips" status: 200 len: 150 microversion: 2.1 time: 0.079673 Oct 16 01:23:20.328488 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2201/4531] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:23:20 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:20.413757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:23:20.414238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:23:20.415238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:23:20.417467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:23:20.418035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:23:20.448971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:20.451905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:20.452535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:20.454701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:20.458294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:20.461679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:20.533405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:23:20.576492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for user a3ac1408c91c4db59f4639abdca2c98f and project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:23:20.633198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:23:20.653954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:23:20.746292 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1843550087", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "4279d430-1168-445d-ba2c-ba13341010bb"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:20.817289 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f45bbec-df4d-400b-bcff-e144c29013e8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.089570 Oct 16 01:23:20.820303 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2331/4532] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:23:20.832826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-94fe924d-9d96-46b4-864b-0390518a9da1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:20.833803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-94fe924d-9d96-46b4-864b-0390518a9da1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:20.900463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] validate_networks() for [('4279d430-1168-445d-ba2c-ba13341010bb', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:23:20.925560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-94fe924d-9d96-46b4-864b-0390518a9da1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:20.938782 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-94fe924d-9d96-46b4-864b-0390518a9da1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1214 microversion: 2.1 time: 0.112442 Oct 16 01:23:20.939249 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2332/4533] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:20 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:21.968471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:21.969092 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:21.998224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:22.000185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:22.000657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:22.004825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:22.006868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:22.009044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:22.257212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:22.275451 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7563129e-a411-4e43-93bc-f44f6f4795cb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1218 microversion: 2.1 time: 0.311327 Oct 16 01:23:22.277099 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2333/4534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:21 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1218 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:22.368787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-de8019c5-de20-48e9-b157-d732c401f050 req-f0e51e7a-e163-4774-90e6-42850afdf055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642a16e0-6927-432c-9a1c-65b4dab274a4", "tag": "ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:22.403032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-de8019c5-de20-48e9-b157-d732c401f050 req-f0e51e7a-e163-4774-90e6-42850afdf055 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:22.406187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-de8019c5-de20-48e9-b157-d732c401f050 req-f0e51e7a-e163-4774-90e6-42850afdf055 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:22.406638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-de8019c5-de20-48e9-b157-d732c401f050 req-f0e51e7a-e163-4774-90e6-42850afdf055 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:22.417066 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:22.456886 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-de8019c5-de20-48e9-b157-d732c401f050 req-f0e51e7a-e163-4774-90e6-42850afdf055 service nova] Creating event network-changed:ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9 for instance 642a16e0-6927-432c-9a1c-65b4dab274a4 on n-h2-master-1 Oct 16 01:23:22.476568 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-de8019c5-de20-48e9-b157-d732c401f050 req-f0e51e7a-e163-4774-90e6-42850afdf055 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112227 Oct 16 01:23:22.477737 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2334/4535] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:23.138619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:23:23.139684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:23:23.140388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:23:23.141038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:23:23.141659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:23:23.158657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.162470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.165003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.168209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.168945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.169909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.203385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Getting quotas for project 918ff4a0b6c34c4bbfd6e31f32967d70. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:23:23.210869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Getting quotas for user baca0537d1844a8ea771011a6c062b30 and project 918ff4a0b6c34c4bbfd6e31f32967d70. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:23:23.234838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Going to run 2 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:23:23.237295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f6afd204-6566-433b-beb7-2e86822cd3a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:23:23.284420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=f6afd204-6566-433b-beb7-2e86822cd3a4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:23:23.308548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:23.310579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:23.323323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.325144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.326212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.327833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.328590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.329270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.443713 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32d40c57-c02c-4fff-89f4-7fb6ddf0632b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.113381 Oct 16 01:23:23.444790 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2202/4536] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:23:23.452018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bed89d9-938f-4290-890f-26169cc148bc"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:23.455591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:23.465483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.466273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.466813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.467902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.469876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.472592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.473735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:23.488683 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f9a8a99-86d2-48c0-af3d-908939ae8892 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1210 microversion: 2.1 time: 0.192063 Oct 16 01:23:23.492594 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2335/4537] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:23 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1210 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:23.501127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f0c706fd-555e-46f9-b29c-788268fca501 req-30be6bcd-ffa7-41e5-bc45-60281f4344e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53610cf8-c016-4fa4-bd6e-178818cc4ab3", "tag": "9a29f124-7a82-45e3-890b-8e5e29092482"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:23.527378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f0c706fd-555e-46f9-b29c-788268fca501 req-30be6bcd-ffa7-41e5-bc45-60281f4344e7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.527378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f0c706fd-555e-46f9-b29c-788268fca501 req-30be6bcd-ffa7-41e5-bc45-60281f4344e7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.527804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f0c706fd-555e-46f9-b29c-788268fca501 req-30be6bcd-ffa7-41e5-bc45-60281f4344e7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.543380 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f0c706fd-555e-46f9-b29c-788268fca501 req-30be6bcd-ffa7-41e5-bc45-60281f4344e7 service nova] Creating event network-changed:9a29f124-7a82-45e3-890b-8e5e29092482 for instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 on n-h1-master-1 Oct 16 01:23:23.560797 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f0c706fd-555e-46f9-b29c-788268fca501 req-30be6bcd-ffa7-41e5-bc45-60281f4344e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065521 Oct 16 01:23:23.562079 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2336/4538] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:23.575790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:23.587258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:23.591676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Searching by: {'deleted': False, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:23:23.614028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.614521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.615234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.616252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:23.616875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:23.617461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:23.654626 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4e440e42-a7d1-4cdf-9dd3-bdb8e7b10572 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.088527 Oct 16 01:23:23.655272 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2337/4539] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:23:23 2022] GET /compute/v2.1/servers => generated 677 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:23.669385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1ed1228-7ba3-4ac6-b26b-5e55b10e3385 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:23.679399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a1ed1228-7ba3-4ac6-b26b-5e55b10e3385 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:23.994948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a1ed1228-7ba3-4ac6-b26b-5e55b10e3385 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:24.003678 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a1ed1228-7ba3-4ac6-b26b-5e55b10e3385 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1220 microversion: 2.1 time: 0.340187 Oct 16 01:23:24.006873 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2338/4540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:23 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1220 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:24.148334 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c48d6e0b-e8a8-4298-a2a7-e6b9c7ca7bae tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.702207 Oct 16 01:23:24.156217 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2203/4541] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:23:23 2022] POST /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:24.282299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f4f4f3a-1eff-408a-a1ed-20b702df145a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1878436488", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a103d6a4-5636-40e5-8e77-0179ae547423", "destination_type": "local"}, {"source_type": "volume", "uuid": "59767939-8643-4252-bade-48cff0b31dad", "destination_type": "invalid"}], "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f4f4f3a-1eff-408a-a1ed-20b702df145a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 495 Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1878436488", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "a103d6a4-5636-40e5-8e77-0179ae547423", "destination_type": "local"}, {"source_type": "volume", "uuid": "59767939-8643-4252-bade-48cff0b31dad", "destination_type": "invalid"}], "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1878436488', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '59767939-8643-4252-bade-48cff0b31dad', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'invalid' Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:24.289537 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 16 01:23:24.294279 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:24.298940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f4f4f3a-1eff-408a-a1ed-20b702df145a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:24.298940 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f4f4f3a-1eff-408a-a1ed-20b702df145a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.021073 Oct 16 01:23:24.302653 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2339/4542] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:24 2022] POST /compute/v2.1/servers => generated 155 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:24.313622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:24.314715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:24.332074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:24.332903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:24.335022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:24.338370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:24.341744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:24.342646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:24.526963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:24.527587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:24.552970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:24.560073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:24.560416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:24.562438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:24.563406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:24.564535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:24.858240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:24.875423 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-811b2604-8aba-4008-ab67-06f334027538 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1266 microversion: 2.1 time: 0.358797 Oct 16 01:23:24.877458 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2340/4543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:24 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:25.034292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-542a970e-1d92-4bd6-a010-3d275631e4b3 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:25.042699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-542a970e-1d92-4bd6-a010-3d275631e4b3 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:25.113732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:25.145385 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c350f36-a663-47d3-bba9-93284acdfeab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.819287 Oct 16 01:23:25.159823 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2204/4544] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:24 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:25.322111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-542a970e-1d92-4bd6-a010-3d275631e4b3 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:25.337884 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-542a970e-1d92-4bd6-a010-3d275631e4b3 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1220 microversion: 2.1 time: 0.309309 Oct 16 01:23:25.340275 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2341/4545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:25 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1220 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:25.363010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:25.363698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:25.380577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:25.386569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:25.387227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:25.388412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:25.389347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:25.389964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:25.560090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9502bef-01be-48e8-94f7-d727d54f8752 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Action: 'create', calling method: .version_select at 0x7fd64e4caf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1248274904"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:26.113116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:26.139111 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eebb4e2c-ed65-46bb-95e1-4b72ab1b23a9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.795921 Oct 16 01:23:26.142282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2342/4546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:25 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:26.177837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:26.180615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:26.201607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:26.202267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:26.205292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:26.206207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:26.206800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:26.208183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:26.254789 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9502bef-01be-48e8-94f7-d727d54f8752 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.093715 Oct 16 01:23:26.265588 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2205/4547] 10.222.0.39 () {60 vars in 1155 bytes} [Sun Oct 16 01:23:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1105 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 16 01:23:26.270477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0e7f1c50-d8a2-460d-bff7-209aca7bd3ca tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e4e6160>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:26.444521 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0e7f1c50-d8a2-460d-bff7-209aca7bd3ca tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 200 len: 345 microversion: 2.1 time: 0.177650 Oct 16 01:23:26.445357 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2206/4548] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:23:26 2022] GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:26.459882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:26.460677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:26.472464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:26.478130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:26.478845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:26.481264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:26.484718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:26.486096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:26.841889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:26.856673 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a3d10dd2-1ab9-4d13-a32a-10ea340cc875 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1216 microversion: 2.1 time: 0.402179 Oct 16 01:23:26.858312 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2207/4549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:26 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1216 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:26.861644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:26.876724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-326dac1d-7428-41d3-b369-eeefd0c71a66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1272 microversion: 2.1 time: 0.726079 Oct 16 01:23:26.893336 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2343/4550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:26 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1272 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:26.904805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-33569714-279b-4a77-a5f5-74fac7f67265 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-970201870", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-33569714-279b-4a77-a5f5-74fac7f67265 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 491 Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-970201870", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-970201870', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:26.920379 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 16 01:23:26.923763 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:26.927208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-33569714-279b-4a77-a5f5-74fac7f67265 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:26.928315 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-33569714-279b-4a77-a5f5-74fac7f67265 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.055956 Oct 16 01:23:26.931729 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2208/4551] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:26 2022] POST /compute/v2.1/servers => generated 624 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:26.940159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:26.941090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:26.952330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:26.954536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:26.956083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:26.958289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:26.959646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:26.961150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:27.253675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:27.263911 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dad5cd1e-95c2-420b-8ee9-9025f8151699 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.327781 Oct 16 01:23:27.266881 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2344/4552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:26 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:27.297764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:27.303175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:27.318375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:27.319553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:27.320257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:27.321426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:27.322227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:27.322895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:27.466002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e38460b-cf94-4eec-8991-34cc7c4c82af tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e387af0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:27.634335 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e38460b-cf94-4eec-8991-34cc7c4c82af tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 200 len: 345 microversion: 2.1 time: 0.174988 Oct 16 01:23:27.643239 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2345/4553] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:23:27 2022] GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:27.885645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:27.886461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:27.888702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:27.897201 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-78b66cf9-1146-4b20-a251-2e9da06558a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.603338 Oct 16 01:23:27.911496 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2209/4554] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:27 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:27.911496 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:27.923476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:27.923476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:27.923654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:27.923746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:27.925872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:27.929296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:27.931333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:27.949215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:27.949908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:27.950373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:27.951343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:27.951813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:27.952243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:28.304921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:28.325557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f592ead-aa0b-44b7-8aaf-92e17d823922 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1290 microversion: 2.1 time: 0.448082 Oct 16 01:23:28.326176 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2346/4555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:27 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1290 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:28.341109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-56597f34-657e-4a46-bec5-da31a39d12a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-56597f34-657e-4a46-bec5-da31a39d12a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 416 Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:28.354894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-56597f34-657e-4a46-bec5-da31a39d12a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:28.359196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-56597f34-657e-4a46-bec5-da31a39d12a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028237 Oct 16 01:23:28.361575 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2347/4556] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:28 2022] POST /compute/v2.1/servers => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:28.403254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:28.404608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:28.428244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:28.429010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:28.429719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:28.433679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:28.435066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:28.437130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:28.622217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:28.640045 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ca7a064-87f0-4b0d-98ba-dbb2bafdae40 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1314 microversion: 2.1 time: 0.733215 Oct 16 01:23:28.651679 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2210/4557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:27 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:28.663454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-983a9ed0-178d-4907-b569-eb2efb942679 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e4ff8b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:28.742167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:28.748715 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-983a9ed0-178d-4907-b569-eb2efb942679 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 200 len: 345 microversion: 2.1 time: 0.095546 Oct 16 01:23:28.749304 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2211/4558] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:23:28 2022] GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:28.752219 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30bac0f7-a6ca-47b9-a7f4-c4022bd726e8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.368965 Oct 16 01:23:28.753397 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2348/4559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:28 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:28.777803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:28.778380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:28.792444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:28.793160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:28.794641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:28.798029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:28.798804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:28.799685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:28.997848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:29.012058 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6dd2a77-6a52-40d2-9cfb-ccf8b5fccc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.239361 Oct 16 01:23:29.013353 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2212/4560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:28 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:29.094526 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37ee51ee-7254-4cae-9c7f-2d81ef48253b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-223022781", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": -1, "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:29.106832 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-37ee51ee-7254-4cae-9c7f-2d81ef48253b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Flavor -1 could not be found. Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37ee51ee-7254-4cae-9c7f-2d81ef48253b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 205 Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-223022781", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": -1, "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: exception: Flavor -1 could not be found. Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-223022781', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': -1, 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:29.109025 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-37ee51ee-7254-4cae-9c7f-2d81ef48253b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:29.114594 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-37ee51ee-7254-4cae-9c7f-2d81ef48253b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.020021 Oct 16 01:23:29.119803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:29.120425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:29.123930 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2349/4561] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:29 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:29.131223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:29.132101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:29.133193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:29.136413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:29.137630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:29.138850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:29.351799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:29.354300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:29.370519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:29.373132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:29.373598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:29.377191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:29.377764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:29.378209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:29.694662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:29.704763 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-278624c5-99f2-4717-86d3-ce5a28b9ee1f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1278 microversion: 2.1 time: 0.359120 Oct 16 01:23:29.729721 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2350/4562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:29 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1278 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:29.746547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:29.748974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:29.760993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:29.762413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:29.763151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:29.764125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:29.764820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:29.765477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:29.849054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:29.874667 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f475904-09a0-4590-9449-e0f6d7354509 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.758886 Oct 16 01:23:29.875827 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2213/4563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:29 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:29.893022 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4f82d954-b701-49f4-8ecd-4367658f0945 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e4e6d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:30.057378 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4f82d954-b701-49f4-8ecd-4367658f0945 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 200 len: 346 microversion: 2.1 time: 0.180178 Oct 16 01:23:30.058207 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2214/4564] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:23:29 2022] GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 346 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:30.065599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:30.066530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:30.074657 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:30.080980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:30.082232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:30.082942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:30.083916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:30.084716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:30.085960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:30.135452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:30.148795 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ee0b7f9-3d5e-4c0d-82e4-ab732f585499 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1314 microversion: 2.1 time: 0.415721 Oct 16 01:23:30.152186 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2351/4565] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:29 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:30.164107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cefdee35-f581-4d0f-ac50-c7672dd8f6e5 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Action: 'create', calling method: .version_select at 0x7fd64df151f0>, body: {"snapshot": {"volume_id": "11185b19-2b97-4cf5-a4b8-4dc24486be7a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1360037151"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:30.544721 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cefdee35-f581-4d0f-ac50-c7672dd8f6e5 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.391296 Oct 16 01:23:30.547437 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2352/4566] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Oct 16 01:23:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:30.559050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-22e38f0e-32b1-46d2-b9e0-5bb1e18736b6 req-c04f3df2-f4a4-4697-957b-beccc89890ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3132186d-4372-4b1c-a4c3-618f2c9a0c62", "tag": "cfbb06bb-88ce-4e59-9ef5-5154424dcb03"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:30.594941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-22e38f0e-32b1-46d2-b9e0-5bb1e18736b6 req-c04f3df2-f4a4-4697-957b-beccc89890ed service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:30.595683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-22e38f0e-32b1-46d2-b9e0-5bb1e18736b6 req-c04f3df2-f4a4-4697-957b-beccc89890ed service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:30.596387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-22e38f0e-32b1-46d2-b9e0-5bb1e18736b6 req-c04f3df2-f4a4-4697-957b-beccc89890ed service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:30.617440 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-22e38f0e-32b1-46d2-b9e0-5bb1e18736b6 req-c04f3df2-f4a4-4697-957b-beccc89890ed service nova] Creating event network-changed:cfbb06bb-88ce-4e59-9ef5-5154424dcb03 for instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 on n-h1-master-1 Oct 16 01:23:30.624435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-22e38f0e-32b1-46d2-b9e0-5bb1e18736b6 req-c04f3df2-f4a4-4697-957b-beccc89890ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074554 Oct 16 01:23:30.625625 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2353/4567] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:30.632331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b51f3239-cd90-4c25-ba61-a3773ca19679 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e1541f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:30.678419 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b51f3239-cd90-4c25-ba61-a3773ca19679 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76" status: 200 len: 287 microversion: 2.1 time: 0.050695 Oct 16 01:23:30.679015 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2354/4568] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:23:30 2022] GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:30.691808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5045e0ad-f14c-422a-a4aa-cae3d85c81dc tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64ddfddc0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:30.738332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:30.742169 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5045e0ad-f14c-422a-a4aa-cae3d85c81dc tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.054969 Oct 16 01:23:30.743361 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2355/4569] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Oct 16 01:23:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:30.749718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:30.750215 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-79c8f255-cd27-476b-8067-7af5be1e680d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.688150 Oct 16 01:23:30.750993 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:30.751500 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2215/4570] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:30 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:30.763264 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-801ea46e-bbbc-4e54-bb47-ef0183fb9eff tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e4ff790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:30.793676 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:30.795636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:30.796183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:30.796623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:30.797335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:30.800566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:30.801018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:30.829098 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-801ea46e-bbbc-4e54-bb47-ef0183fb9eff tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76" status: 200 len: 287 microversion: 2.1 time: 0.076094 Oct 16 01:23:30.829995 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2216/4571] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:23:30 2022] GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:30.844692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c13a2fd1-b492-4138-8331-2379ef0e255d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1956413016", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c13a2fd1-b492-4138-8331-2379ef0e255d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 173 Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1956413016", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1956413016', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi -1 Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:30.852737 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 16 01:23:30.858084 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:30.860299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c13a2fd1-b492-4138-8331-2379ef0e255d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:30.861163 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c13a2fd1-b492-4138-8331-2379ef0e255d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.022151 Oct 16 01:23:30.861751 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2217/4572] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:30 2022] POST /compute/v2.1/servers => generated 145 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:30.871567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:30.872407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:30.879283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:30.880239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:30.881028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:30.882158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:30.882790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:30.884103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:31.183143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:31.192435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f785a44c-3bad-4cd6-8ec8-4f4dc3064302 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.447886 Oct 16 01:23:31.203074 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2356/4573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:30 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:31.213493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:31.214115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:31.232519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:31.233018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:31.233452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:31.234166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:31.234621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:31.235074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:31.296428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:31.309815 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e0d30b3e-126b-4ad7-a9d5-fa64c8147b3c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.443138 Oct 16 01:23:31.312731 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2218/4574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:30 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:31.342969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:31.343595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:31.363590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:31.364163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:31.364621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:31.365380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:31.365845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:31.366315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:31.654386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:31.676862 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2007b48-9b8e-4bb1-b3ec-fa32fce29ea4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1314 microversion: 2.1 time: 0.472410 Oct 16 01:23:31.677996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2357/4575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:31 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:31.713440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:31.735323 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-426cf9c9-3953-4968-8ecd-51c0bb149139 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.403184 Oct 16 01:23:31.736366 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2219/4576] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:31 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:31.833435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8395506-8d92-40d4-a718-006152719e49 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1178652861", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:31.844980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d316c05d-8246-4c2a-b968-1ce2eb67250e tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e1c28b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:31.854296 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-c8395506-8d92-40d4-a718-006152719e49 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8395506-8d92-40d4-a718-006152719e49 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 216 Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1178652861", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1178652861', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:31.859453 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:31.865302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:31.865302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:31.865302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:31.865302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:31.865302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:31.865302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:31.865302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 16 01:23:31.865302 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:31.869263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c8395506-8d92-40d4-a718-006152719e49 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:31.870648 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c8395506-8d92-40d4-a718-006152719e49 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.042864 Oct 16 01:23:31.871755 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2358/4577] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:31 2022] POST /compute/v2.1/servers => generated 123 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:31.881847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:31.882705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:31.893930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:31.895474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:31.896076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:31.897612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:31.898389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:31.899737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:31.915972 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d316c05d-8246-4c2a-b968-1ce2eb67250e tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76" status: 200 len: 287 microversion: 2.1 time: 0.078222 Oct 16 01:23:31.917666 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2220/4578] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:23:31 2022] GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:32.131607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:32.151874 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a00cf4ab-672c-45da-b1f0-6c1ec0f765d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.276231 Oct 16 01:23:32.153051 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2359/4579] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:31 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:32.182246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:32.182884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:32.190699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:32.191275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:32.192322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:32.193242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:32.196173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:32.196768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:32.227535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:32.228905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:32.238528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:32.239058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:32.239500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:32.240203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:32.240659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:32.241089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:32.571430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:32.583544 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eeb65b67-23b0-47da-8334-8331107cae55 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.408619 Oct 16 01:23:32.584825 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2221/4580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:32 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:32.585952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:32.594123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b1e06c4d-3884-4eae-b3ec-525516551161 req-2ce3579a-6b65-4deb-b417-d8cda5e37cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ac0c5e-8d40-4757-9f37-75443f5a12fa", "tag": "324302d0-a2c9-4e9e-8e18-25a65c21d833"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:32.605787 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-982d48f1-9ada-4e5c-9771-f3a563e4a91c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.385336 Oct 16 01:23:32.606392 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2360/4581] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:32 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:32.609786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b1e06c4d-3884-4eae-b3ec-525516551161 req-2ce3579a-6b65-4deb-b417-d8cda5e37cdd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:32.618346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b1e06c4d-3884-4eae-b3ec-525516551161 req-2ce3579a-6b65-4deb-b417-d8cda5e37cdd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:32.625587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b1e06c4d-3884-4eae-b3ec-525516551161 req-2ce3579a-6b65-4deb-b417-d8cda5e37cdd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:32.662118 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b1e06c4d-3884-4eae-b3ec-525516551161 req-2ce3579a-6b65-4deb-b417-d8cda5e37cdd service nova] Creating event network-changed:324302d0-a2c9-4e9e-8e18-25a65c21d833 for instance f2ac0c5e-8d40-4757-9f37-75443f5a12fa on n-h1-master-1 Oct 16 01:23:32.678951 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b1e06c4d-3884-4eae-b3ec-525516551161 req-2ce3579a-6b65-4deb-b417-d8cda5e37cdd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089883 Oct 16 01:23:32.682401 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2222/4582] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:32.700707 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef81c9b1-157e-4355-b1e5-fd87263ba9b3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1857650128", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-key-195477145", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:32.705803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:32.706594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:32.714468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:32.715251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:32.715955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:32.727643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:32.729173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:32.730783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:32.778995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-ef81c9b1-157e-4355-b1e5-fd87263ba9b3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] validate_networks() for [('c823a5ff-2110-4a77-95b2-4f3653a870f1', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:23:33.101790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:33.114117 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a2ff1d89-88fc-432f-8ae8-f549414082a8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1314 microversion: 2.1 time: 0.415050 Oct 16 01:23:33.115091 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2223/4583] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:32 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:33.120022 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-cd39b235-1b2c-472b-bda5-cd1b9b28614b req-277d5d3d-33ae-4e13-b619-fe966eb5ac41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6afd204-6566-433b-beb7-2e86822cd3a4", "tag": "f3fae7a0-d006-4eea-9fb2-8a26c8cbac13"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:33.132199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cd39b235-1b2c-472b-bda5-cd1b9b28614b req-277d5d3d-33ae-4e13-b619-fe966eb5ac41 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:33.132914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cd39b235-1b2c-472b-bda5-cd1b9b28614b req-277d5d3d-33ae-4e13-b619-fe966eb5ac41 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:33.134424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cd39b235-1b2c-472b-bda5-cd1b9b28614b req-277d5d3d-33ae-4e13-b619-fe966eb5ac41 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:33.161063 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-cd39b235-1b2c-472b-bda5-cd1b9b28614b req-277d5d3d-33ae-4e13-b619-fe966eb5ac41 service nova] Creating event network-changed:f3fae7a0-d006-4eea-9fb2-8a26c8cbac13 for instance f6afd204-6566-433b-beb7-2e86822cd3a4 on n-h1-master-1 Oct 16 01:23:33.167978 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-cd39b235-1b2c-472b-bda5-cd1b9b28614b req-277d5d3d-33ae-4e13-b619-fe966eb5ac41 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051193 Oct 16 01:23:33.169158 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2224/4584] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:33.175156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76ccd4d5-aab9-4c02-899c-6d2bc122ca76 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e125c10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:33.184913 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:33.223040 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76ccd4d5-aab9-4c02-899c-6d2bc122ca76 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76" status: 200 len: 288 microversion: 2.1 time: 0.052271 Oct 16 01:23:33.229575 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2225/4585] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:23:33 2022] GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 => generated 288 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:33.240894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8f19a4b-08d8-49fd-a20f-c9279776c4c0 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e1384c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:33.241503 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ef81c9b1-157e-4355-b1e5-fd87263ba9b3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Invalid key_name provided. Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef81c9b1-157e-4355-b1e5-fd87263ba9b3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 246 Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1857650128", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-key-195477145", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid key_name provided. Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1857650128', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'key_name': 'tempest-key-195477145', 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-195477145 not found for user 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:33.243946 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 16 01:23:33.248825 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:33.260165 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:33.260275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef81c9b1-157e-4355-b1e5-fd87263ba9b3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid key_name provided. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:33.260275 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ef81c9b1-157e-4355-b1e5-fd87263ba9b3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.557004 Oct 16 01:23:33.260275 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2361/4586] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:32 2022] POST /compute/v2.1/servers => generated 70 bytes in 559 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 16 01:23:33.270601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:33.271476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:33.281220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:33.281865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:33.282406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:33.283715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:33.284433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:33.285097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:33.398822 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8f19a4b-08d8-49fd-a20f-c9279776c4c0 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76" status: 202 len: 0 microversion: 2.1 time: 0.166856 Oct 16 01:23:33.400985 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2226/4587] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:23:33 2022] DELETE /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:23:33.408843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4ce4dcb-b506-4396-9dcf-e898e385172c tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e4a98b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:33.488753 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4ce4dcb-b506-4396-9dcf-e898e385172c tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76" status: 200 len: 287 microversion: 2.1 time: 0.083615 Oct 16 01:23:33.490306 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2227/4588] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:23:33 2022] GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:33.607934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:33.615617 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c4477aa2-e588-4d1b-bab9-a12cca3b30ee tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.355337 Oct 16 01:23:33.616389 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2362/4589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:33 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:33.641415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:33.642163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:33.642896 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:33.643938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:33.652512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:33.652948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:33.653416 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:33.655625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:33.656389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:33.656863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:33.657300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:33.659349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:33.660092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:33.660822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:33.662362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:33.663103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:33.663747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:33.905141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:33.908707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:33.912371 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:33.917047 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6142a44d-aa61-4e83-b9d7-6aec2da507b2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.279115 Oct 16 01:23:33.917616 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2363/4590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:33 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:33.931251 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-55721ce1-4124-4c02-b01e-e5b39a8058fa tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.292051 Oct 16 01:23:33.931251 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2228/4591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:33 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:33.980822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-008628db-37e4-45de-ba32-c6f9bea7ee4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-838924875", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:34.072528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.security_group_api [None req-008628db-37e4-45de-ba32-c6f9bea7ee4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Neutron security group does_not_exist not found {{(pid=120545) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 16 01:23:34.073108 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-008628db-37e4-45de-ba32-c6f9bea7ee4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-008628db-37e4-45de-ba32-c6f9bea7ee4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 257 Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-838924875", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-838924875', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 16 01:23:34.081124 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.090020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-008628db-37e4-45de-ba32-c6f9bea7ee4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:34.098879 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-008628db-37e4-45de-ba32-c6f9bea7ee4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.105996 Oct 16 01:23:34.098879 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2364/4592] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:33 2022] POST /compute/v2.1/servers => generated 106 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:34.099174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:34.099174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:34.103509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.104404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.104969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.105839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.106252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.106721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.139277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:34.140599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:34.148347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.149060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.149510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.150476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.150984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.151591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.178477 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:34.308075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:34.316241 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-44b0dec5-aa37-4cb5-91f1-fc73bed07dab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.228218 Oct 16 01:23:34.317053 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2229/4593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:34 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:34.341350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:34.344737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:34.347477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:34.353687 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10375ba1-8589-4af0-a6b4-bb592b163be5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1314 microversion: 2.1 time: 0.219038 Oct 16 01:23:34.354273 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2365/4594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:34 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:34.360196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.360921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.361515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.362366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.362997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.363829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.501931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0558e2df-666c-46b0-a8d2-8493e3c8b7fd tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64df95e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:34.551757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0558e2df-666c-46b0-a8d2-8493e3c8b7fd tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76" status: 200 len: 287 microversion: 2.1 time: 0.053960 Oct 16 01:23:34.554688 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2366/4595] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:23:34 2022] GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:34.596239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:34.605954 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-805ed614-8516-4d41-948d-636efb4ca45b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.268927 Oct 16 01:23:34.607212 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2230/4596] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:34 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:34.629187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-48844d95-5f2e-49bb-8542-d093f8eb0adf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:34.629678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-48844d95-5f2e-49bb-8542-d093f8eb0adf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 37437fb1-9db7-491d-971f-918a740663b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:34.635851 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-48844d95-5f2e-49bb-8542-d093f8eb0adf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 37437fb1-9db7-491d-971f-918a740663b5 could not be found. Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-48844d95-5f2e-49bb-8542-d093f8eb0adf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/37437fb1-9db7-491d-971f-918a740663b5 HTTP/1.1 Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 37437fb1-9db7-491d-971f-918a740663b5 could not be found. Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '37437fb1-9db7-491d-971f-918a740663b5'} Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37437fb1-9db7-491d-971f-918a740663b5 could not be found. Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37437fb1-9db7-491d-971f-918a740663b5 could not be found. Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.637328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37437fb1-9db7-491d-971f-918a740663b5 could not be found. Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-48844d95-5f2e-49bb-8542-d093f8eb0adf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 37437fb1-9db7-491d-971f-918a740663b5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-48844d95-5f2e-49bb-8542-d093f8eb0adf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "DELETE /compute/v2.1/servers/37437fb1-9db7-491d-971f-918a740663b5" status: 404 len: 111 microversion: 2.1 time: 0.013806 Oct 16 01:23:34.642165 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2367/4597] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:23:34 2022] DELETE /compute/v2.1/servers/37437fb1-9db7-491d-971f-918a740663b5 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:23:34.651317 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:34.651935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:34.658044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.658533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.659013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.659717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.660172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.660598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.804204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:34.812507 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16a4fc2d-c9fe-4bd0-a826-87cbafa1c31d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.165430 Oct 16 01:23:34.813283 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2231/4598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:34 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:34.837661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:34.838289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:34.847776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.848301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.848738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.849436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.849896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.850323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.945615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:34.946246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:34.953015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.953429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.954072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:34.955038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:34.955706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:34.956337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.000580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:35.009095 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5bbc11cd-3c65-479b-a984-98391efa8f37 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.175848 Oct 16 01:23:35.009687 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2368/4599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:34 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:35.032283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4027716c-c224-4cee-9178-9c5cf76db1cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:35.032283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4027716c-c224-4cee-9178-9c5cf76db1cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 16 01:23:35.032680 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4027716c-c224-4cee-9178-9c5cf76db1cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4027716c-c224-4cee-9178-9c5cf76db1cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 9223372036854775808 could not be found. Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '9223372036854775808'} Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.034286 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:35.039274 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:35.039274 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:35.039274 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:35.039274 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 16 01:23:35.039274 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.039274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4027716c-c224-4cee-9178-9c5cf76db1cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:35.039274 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4027716c-c224-4cee-9178-9c5cf76db1cc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008311 Oct 16 01:23:35.040300 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2369/4600] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Oct 16 01:23:35 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:23:35.044697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:35.045308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:35.052466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.052988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.053444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.054196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.054686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.056088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.145809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:35.154849 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5c6542c9-2855-4867-b447-c3d586bfa147 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.213062 Oct 16 01:23:35.155592 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2232/4601] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:34 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:35.216274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:35.224146 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa353301-511d-4bfc-b4d1-ecd1883c34b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.183588 Oct 16 01:23:35.224717 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2370/4602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:35 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:35.249343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:35.250025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:35.256327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.256812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.257251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.257950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.258449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.258867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.380707 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:35.381323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:35.383481 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:35.387507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:35.389045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.389538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.389976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.390683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.391345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.391801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.396263 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-febf145d-091a-42d2-80a2-94702b856399 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.150882 Oct 16 01:23:35.397198 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2233/4603] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:35 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:35.421422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15b27400-dc73-4d21-9e8e-d2e001a85155 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:35.421898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-15b27400-dc73-4d21-9e8e-d2e001a85155 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Failed to fetch instance by id -1 {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 16 01:23:35.422408 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-15b27400-dc73-4d21-9e8e-d2e001a85155 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance -1 could not be found. Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15b27400-dc73-4d21-9e8e-d2e001a85155 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: exception: Instance -1 could not be found. Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '-1'} Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:35.424212 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:35.429641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:35.429641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:35.429641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 16 01:23:35.429641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.429641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15b27400-dc73-4d21-9e8e-d2e001a85155 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:35.429641 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-15b27400-dc73-4d21-9e8e-d2e001a85155 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008065 Oct 16 01:23:35.429641 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2234/4604] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:23:35 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:23:35.434408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:35.435407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:35.445531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.446068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.446505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.447247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.447705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.448132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.761513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:35.769732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7ac89a88-dff8-4f50-b127-6e5843fedf41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.339261 Oct 16 01:23:35.771283 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2235/4605] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:35 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:35.777960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56fce51f-2495-4ec5-a0ca-24c381454dfd tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e4ff0d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:35.798666 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:35.810784 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e122c16-af04-48e2-955f-e0309402a166 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1314 microversion: 2.1 time: 0.433745 Oct 16 01:23:35.811823 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2371/4606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:35 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:35.818220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-892ea880-88ef-4084-9408-844223fa143a req-7a66112c-37b4-481b-b83e-1f6cc81382ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3132186d-4372-4b1c-a4c3-618f2c9a0c62", "name": "network-vif-plugged", "status": "completed", "tag": "cfbb06bb-88ce-4e59-9ef5-5154424dcb03"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:35.826480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-56fce51f-2495-4ec5-a0ca-24c381454dfd tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] HTTP exception thrown: Snapshot ccfb9762-869f-483f-9cf3-2816ce18ad76 could not be found. Oct 16 01:23:35.834561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-892ea880-88ef-4084-9408-844223fa143a req-7a66112c-37b4-481b-b83e-1f6cc81382ce service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.835068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-892ea880-88ef-4084-9408-844223fa143a req-7a66112c-37b4-481b-b83e-1f6cc81382ce service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.835752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-892ea880-88ef-4084-9408-844223fa143a req-7a66112c-37b4-481b-b83e-1f6cc81382ce service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56fce51f-2495-4ec5-a0ca-24c381454dfd tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Request method failure captured: Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 HTTP/1.1 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS10Msy1t2tng5HytbqT5ORUFON1-glzXrNdL-ft_QMOkzJl-zwiDnHAbiuCEqX3kbnXlSK_ydfEcttVp6WGt5wxQukSf3oDJTl7XZqP3VaVs_YRLaDIuJAuKXRN--5gqKR6cIqj2VCSMkK6P80tiaBqBNAZWa8rbKasZeqtbdrsVrKw Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 09382aca0c684d049e3f5defd29e8b72 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09382aca0c684d049e3f5defd29e8b72", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 09382aca0c684d049e3f5defd29e8b72 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-VolumesSnapshotsTestJSON-274307016-project Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 54adae8e56bc4e61b4c5bafd8f09ce5e Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-VolumesSnapshotsTestJSON-274307016-project Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: exception: Snapshot ccfb9762-869f-483f-9cf3-2816ce18ad76 could not be found. Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ccfb9762-869f-483f-9cf3-2816ce18ad76'} Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ccfb9762-869f-483f-9cf3-2816ce18ad76 could not be found. (HTTP 404) (Request-ID: req-268f3969-8e87-4bc1-ace7-ecebea1ca76b) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:23:35.841247 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ccfb9762-869f-483f-9cf3-2816ce18ad76 could not be found. Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ccfb9762-869f-483f-9cf3-2816ce18ad76 could not be found. Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ccfb9762-869f-483f-9cf3-2816ce18ad76 could not be found. Oct 16 01:23:35.845637 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:35.853468 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56fce51f-2495-4ec5-a0ca-24c381454dfd tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Returning 404 to user: Snapshot ccfb9762-869f-483f-9cf3-2816ce18ad76 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:35.854295 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56fce51f-2495-4ec5-a0ca-24c381454dfd tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76" status: 404 len: 111 microversion: 2.1 time: 0.081673 Oct 16 01:23:35.855436 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2236/4607] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 01:23:35 2022] GET /compute/v2.1/os-snapshots/ccfb9762-869f-483f-9cf3-2816ce18ad76 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:35.862489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:35.863474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:35.874589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.875513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.876166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.877087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:35.877839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:35.878609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:35.893928 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-892ea880-88ef-4084-9408-844223fa143a req-7a66112c-37b4-481b-b83e-1f6cc81382ce service nova] Creating event network-vif-plugged:cfbb06bb-88ce-4e59-9ef5-5154424dcb03 for instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 on n-h1-master-1 Oct 16 01:23:35.901436 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-892ea880-88ef-4084-9408-844223fa143a req-7a66112c-37b4-481b-b83e-1f6cc81382ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087188 Oct 16 01:23:35.902045 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2372/4608] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:35.908754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-915f78be-34be-42fd-985d-abbd1bdcee1b tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64df15a60>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:36.010474 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-915f78be-34be-42fd-985d-abbd1bdcee1b tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 202 len: 0 microversion: 2.1 time: 0.106647 Oct 16 01:23:36.014421 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2373/4609] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:23:35 2022] DELETE /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:23:36.020456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa6ce224-06b3-472c-a797-b225b2567ad7 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e13cd30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:36.143592 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa6ce224-06b3-472c-a797-b225b2567ad7 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 200 len: 345 microversion: 2.1 time: 0.127684 Oct 16 01:23:36.144405 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2374/4610] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:23:36 2022] GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:36.178181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:36.181238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:36.188823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.189318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.189758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.190479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.191025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.191403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.233211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:36.244460 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0e110808-cb04-4ca3-89a7-ab9281f533e5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.387715 Oct 16 01:23:36.259300 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2237/4611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:35 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:36.267105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f25e44e-75e5-4716-8b06-02d7518cc22f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:36.268222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7f25e44e-75e5-4716-8b06-02d7518cc22f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: d0c1b649-8e28-4461-9c97-6e4dc8cc8cab] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:36.273693 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7f25e44e-75e5-4716-8b06-02d7518cc22f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance d0c1b649-8e28-4461-9c97-6e4dc8cc8cab could not be found. Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f25e44e-75e5-4716-8b06-02d7518cc22f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/d0c1b649-8e28-4461-9c97-6e4dc8cc8cab/action HTTP/1.1 Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 19 Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: {"forceDelete": {}} Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: exception: Instance d0c1b649-8e28-4461-9c97-6e4dc8cc8cab could not be found. Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'd0c1b649-8e28-4461-9c97-6e4dc8cc8cab', 'body': {'forceDelete': {}}} Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c1b649-8e28-4461-9c97-6e4dc8cc8cab could not be found. Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c1b649-8e28-4461-9c97-6e4dc8cc8cab could not be found. Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:36.285458 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:36.291595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:36.291595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:36.291595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c1b649-8e28-4461-9c97-6e4dc8cc8cab could not be found. Oct 16 01:23:36.291595 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.291595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f25e44e-75e5-4716-8b06-02d7518cc22f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance d0c1b649-8e28-4461-9c97-6e4dc8cc8cab could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:36.292444 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7f25e44e-75e5-4716-8b06-02d7518cc22f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/d0c1b649-8e28-4461-9c97-6e4dc8cc8cab/action" status: 404 len: 111 microversion: 2.1 time: 0.028731 Oct 16 01:23:36.293316 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2238/4612] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:36 2022] POST /compute/v2.1/servers/d0c1b649-8e28-4461-9c97-6e4dc8cc8cab/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:23:36.301385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:36.302029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:36.309855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.310355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.310797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.312171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.312717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.313249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.337654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:36.346159 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da151dce-1798-4d23-8a9b-cbfb7906f149 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.172314 Oct 16 01:23:36.346796 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2375/4613] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:36 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:36.454192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:36.462848 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-70cddad7-bca4-42f7-8380-3e0ff0397d9e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.165496 Oct 16 01:23:36.463577 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2239/4614] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:36 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:36.487103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:36.487962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:36.495356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.496161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.496917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.497857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.498587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.499402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.684264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:36.694307 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8fd2339f-f238-4dac-ba0f-cf7a8ce9b5b8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.211374 Oct 16 01:23:36.694890 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2376/4615] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:36 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:36.718052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32995d78-c99b-4af5-b9b5-b42205dc6a61 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:36.720555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32995d78-c99b-4af5-b9b5-b42205dc6a61 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: a0d3cea5-5813-4302-a546-2c3fccdf8318] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:36.726852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-32995d78-c99b-4af5-b9b5-b42205dc6a61 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance a0d3cea5-5813-4302-a546-2c3fccdf8318 could not be found. Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32995d78-c99b-4af5-b9b5-b42205dc6a61 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/a0d3cea5-5813-4302-a546-2c3fccdf8318/action HTTP/1.1 Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 39 Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: {"os-getConsoleOutput": {"length": 10}} Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a0d3cea5-5813-4302-a546-2c3fccdf8318 could not be found. Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a0d3cea5-5813-4302-a546-2c3fccdf8318', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d3cea5-5813-4302-a546-2c3fccdf8318 could not be found. Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d3cea5-5813-4302-a546-2c3fccdf8318 could not be found. Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.736701 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d3cea5-5813-4302-a546-2c3fccdf8318 could not be found. Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32995d78-c99b-4af5-b9b5-b42205dc6a61 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance a0d3cea5-5813-4302-a546-2c3fccdf8318 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32995d78-c99b-4af5-b9b5-b42205dc6a61 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/a0d3cea5-5813-4302-a546-2c3fccdf8318/action" status: 404 len: 111 microversion: 2.1 time: 0.024795 Oct 16 01:23:36.743289 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2240/4616] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:36 2022] POST /compute/v2.1/servers/a0d3cea5-5813-4302-a546-2c3fccdf8318/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:36.749337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:36.750107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:36.756848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.757500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.758039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.759454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.760049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.760573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.841814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:36.842841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:36.851683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.852288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.852830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.853598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:36.854152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:36.854645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:36.963134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:36.971994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-819b16bc-9a4c-4961-8031-979ef5342c15 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.226624 Oct 16 01:23:36.972583 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2377/4617] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:36 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:36.998068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:36.998979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:37.005207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:37.005702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:37.006137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:37.006872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:37.007376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:37.007942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:37.421142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:37.434445 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5e49bbbf-504e-4ca5-949b-142a33e9cce1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1314 microversion: 2.1 time: 0.599737 Oct 16 01:23:37.443707 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2241/4618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:36 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:37.444834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4d19dbb-2103-40df-ae0b-681f9a850e9a tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e4a9a60>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:37.458396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:37.467543 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1288f68-5a29-4f9f-8988-023c83fd0fd3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.473173 Oct 16 01:23:37.468222 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2378/4619] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:36 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:37.473329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:37.474135 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:37.481633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:37.482324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:37.483299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:37.484173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:37.484788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:37.485375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:37.523603 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4d19dbb-2103-40df-ae0b-681f9a850e9a tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 200 len: 345 microversion: 2.1 time: 0.084795 Oct 16 01:23:37.525042 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2242/4620] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:23:37 2022] GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:37.530982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35a78d47-a53c-420a-9a0f-4861e020e0c3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:37.531839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35a78d47-a53c-420a-9a0f-4861e020e0c3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 97c877af-6ed4-402f-ae08-da5b216a223d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:37.539140 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-35a78d47-a53c-420a-9a0f-4861e020e0c3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 97c877af-6ed4-402f-ae08-da5b216a223d could not be found. Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35a78d47-a53c-420a-9a0f-4861e020e0c3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/97c877af-6ed4-402f-ae08-da5b216a223d HTTP/1.1 Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 97c877af-6ed4-402f-ae08-da5b216a223d could not be found. Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '97c877af-6ed4-402f-ae08-da5b216a223d'} Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c877af-6ed4-402f-ae08-da5b216a223d could not be found. Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c877af-6ed4-402f-ae08-da5b216a223d could not be found. Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:37.541603 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:37.545919 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:37.545919 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:37.545919 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:37.545919 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c877af-6ed4-402f-ae08-da5b216a223d could not be found. Oct 16 01:23:37.545919 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:37.547215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35a78d47-a53c-420a-9a0f-4861e020e0c3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 97c877af-6ed4-402f-ae08-da5b216a223d could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:37.548247 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35a78d47-a53c-420a-9a0f-4861e020e0c3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/97c877af-6ed4-402f-ae08-da5b216a223d" status: 404 len: 111 microversion: 2.1 time: 0.022038 Oct 16 01:23:37.549025 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2243/4621] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:37 2022] GET /compute/v2.1/servers/97c877af-6ed4-402f-ae08-da5b216a223d => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:37.558415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:37.560558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:37.579747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:37.580438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:37.580956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:37.581749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:37.582331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:37.582871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:37.698758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:37.706656 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-21269522-a753-45a2-b676-10a06da8860c tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.237250 Oct 16 01:23:37.707411 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2379/4622] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:37 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:37.749874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:37.757662 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4bf036b5-44f6-4e98-a74e-41e3fd89010f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.204156 Oct 16 01:23:37.758240 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2244/4623] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:37 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:37.780889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:37.781497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:37.787526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:37.788009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:37.788438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:37.789120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:37.789701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:37.790073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:37.920233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:37.928224 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4599faa3-d4cd-441b-a4c8-0d9a98212fe2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.151263 Oct 16 01:23:37.928802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2380/4624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:37 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:37.993958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cb72387-1016-480d-85de-c8cce5d6c987 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1421888203", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cb72387-1016-480d-85de-c8cce5d6c987 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 238 Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1421888203", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1421888203', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.015872 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cb72387-1016-480d-85de-c8cce5d6c987 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2cb72387-1016-480d-85de-c8cce5d6c987 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028077 Oct 16 01:23:38.021498 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2245/4625] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:38.026461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:38.027105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:38.033206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.033920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.034354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.035079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.035538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.035960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.178464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:38.188052 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22188bc2-a54c-4442-b13e-1600dfcea948 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.165796 Oct 16 01:23:38.188592 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2381/4626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:38 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:38.213511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:38.214136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:38.222072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.222559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.223021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.223719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.224807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.225486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.272427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a8122fd7-0708-4326-9717-77e6a4835a55 req-33efa0df-10fd-4bb1-a6a3-5bf266bc8b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6afd204-6566-433b-beb7-2e86822cd3a4", "name": "network-vif-plugged", "status": "completed", "tag": "f3fae7a0-d006-4eea-9fb2-8a26c8cbac13"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:38.286939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a8122fd7-0708-4326-9717-77e6a4835a55 req-33efa0df-10fd-4bb1-a6a3-5bf266bc8b5a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.287656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a8122fd7-0708-4326-9717-77e6a4835a55 req-33efa0df-10fd-4bb1-a6a3-5bf266bc8b5a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.288390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a8122fd7-0708-4326-9717-77e6a4835a55 req-33efa0df-10fd-4bb1-a6a3-5bf266bc8b5a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.302210 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a8122fd7-0708-4326-9717-77e6a4835a55 req-33efa0df-10fd-4bb1-a6a3-5bf266bc8b5a service nova] Creating event network-vif-plugged:f3fae7a0-d006-4eea-9fb2-8a26c8cbac13 for instance f6afd204-6566-433b-beb7-2e86822cd3a4 on n-h1-master-1 Oct 16 01:23:38.309768 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a8122fd7-0708-4326-9717-77e6a4835a55 req-33efa0df-10fd-4bb1-a6a3-5bf266bc8b5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040927 Oct 16 01:23:38.310836 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2382/4627] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:38.367174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:38.378757 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22b97700-0fae-492d-890d-4dbc3b0db3af tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.169681 Oct 16 01:23:38.380516 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2246/4628] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:38 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:38.450532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06d6bd58-b0c3-45ee-9165-3e53e8399d4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-458045314", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06d6bd58-b0c3-45ee-9165-3e53e8399d4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 234 Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-458045314", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-458045314', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.456152 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 16 01:23:38.462300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.469167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:38.471037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:38.478736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06d6bd58-b0c3-45ee-9165-3e53e8399d4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:38.480029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-06d6bd58-b0c3-45ee-9165-3e53e8399d4d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.034558 Oct 16 01:23:38.481182 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2383/4629] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:38 2022] POST /compute/v2.1/servers => generated 133 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:38.485405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.486066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.486595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.487422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.487965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.488468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.497571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:38.499817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:38.526505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.527389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.527661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.528449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.528977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.529476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.745392 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:38.753694 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e5a089cb-8e09-4a5d-80c6-d65b79d4c53d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1501 microversion: 2.1 time: 0.288315 Oct 16 01:23:38.754296 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2247/4630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:38 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:38.771061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d5395ad-1b92-43a2-8ca1-765f8240f0f9 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e53eaf0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:38.778798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:38.787557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2a256229-84d1-4289-b38d-24135f383c44 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.300635 Oct 16 01:23:38.791976 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2384/4631] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:38 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:38.797987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:38.798596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:38.804411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.805943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.806564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.807389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.808008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.814978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.823843 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7d5395ad-1b92-43a2-8ca1-765f8240f0f9 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] HTTP exception thrown: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d5395ad-1b92-43a2-8ca1-765f8240f0f9 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Request method failure captured: Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a HTTP/1.1 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS10Msy1t2tng5HytbqT5ORUFON1-glzXrNdL-ft_QMOkzJl-zwiDnHAbiuCEqX3kbnXlSK_ydfEcttVp6WGt5wxQukSf3oDJTl7XZqP3VaVs_YRLaDIuJAuKXRN--5gqKR6cIqj2VCSMkK6P80tiaBqBNAZWa8rbKasZeqtbdrsVrKw Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 09382aca0c684d049e3f5defd29e8b72 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09382aca0c684d049e3f5defd29e8b72", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 09382aca0c684d049e3f5defd29e8b72 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-VolumesSnapshotsTestJSON-274307016-project Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 54adae8e56bc4e61b4c5bafd8f09ce5e Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-VolumesSnapshotsTestJSON-274307016-project Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: exception: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '11185b19-2b97-4cf5-a4b8-4dc24486be7a'} Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. (HTTP 404) (Request-ID: req-3cd0754b-8f48-452b-afd6-4c904e2c4bcf) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:23:38.826053 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d5395ad-1b92-43a2-8ca1-765f8240f0f9 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Returning 404 to user: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:38.830998 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d5395ad-1b92-43a2-8ca1-765f8240f0f9 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 404 len: 109 microversion: 2.1 time: 0.073872 Oct 16 01:23:38.833891 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2248/4632] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:23:38 2022] GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:38.839034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:38.839710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:38.847915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.850250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.850250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.850250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:38.850250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:38.850887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:38.878616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lazy-loading 'flavor' on Instance uuid 3132186d-4372-4b1c-a4c3-618f2c9a0c62 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:23:38.987107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:38.995529 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2df3a3c0-c256-459f-9a2b-5c9f9dd228bf tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.202024 Oct 16 01:23:38.996314 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2385/4633] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:38 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:39.000776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:39.001366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:39.011174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.012174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.012611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.013489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.013939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.014349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.096561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-52fb12a6-b9d2-48ae-b2a2-170178a7c45f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62/action" status: 202 len: 0 microversion: 2.1 time: 0.261694 Oct 16 01:23:39.097173 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2249/4634] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:38 2022] POST /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:23:39.104800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c103732-8922-419a-bc78-d87f7087a127 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e53e5e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:39.134948 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-0c103732-8922-419a-bc78-d87f7087a127 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] HTTP exception thrown: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c103732-8922-419a-bc78-d87f7087a127 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Request method failure captured: Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a HTTP/1.1 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS10Msy1t2tng5HytbqT5ORUFON1-glzXrNdL-ft_QMOkzJl-zwiDnHAbiuCEqX3kbnXlSK_ydfEcttVp6WGt5wxQukSf3oDJTl7XZqP3VaVs_YRLaDIuJAuKXRN--5gqKR6cIqj2VCSMkK6P80tiaBqBNAZWa8rbKasZeqtbdrsVrKw Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 09382aca0c684d049e3f5defd29e8b72 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09382aca0c684d049e3f5defd29e8b72", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 09382aca0c684d049e3f5defd29e8b72 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-VolumesSnapshotsTestJSON-274307016-project Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 54adae8e56bc4e61b4c5bafd8f09ce5e Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-VolumesSnapshotsTestJSON-274307016-project Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: method: Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: exception: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '11185b19-2b97-4cf5-a4b8-4dc24486be7a'} Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. (HTTP 404) (Request-ID: req-95535e52-7610-4f29-8d02-4d8bac0f29b6) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:23:39.137079 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c103732-8922-419a-bc78-d87f7087a127 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Returning 404 to user: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0c103732-8922-419a-bc78-d87f7087a127 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 404 len: 109 microversion: 2.1 time: 0.038223 Oct 16 01:23:39.141498 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2250/4635] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:23:39 2022] DELETE /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:39.146891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:39.146891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:39.158041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.158839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.159535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.160446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.161172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.161797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.183129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:39.191425 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ef23a63d-8a48-49cf-84a2-33d7487ca444 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.194280 Oct 16 01:23:39.191999 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2386/4636] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:38 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:39.197367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55e08d40-5375-4037-9224-59baee920ee6 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Calling method '.version_select at 0x7fd64e240700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:39.232409 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-55e08d40-5375-4037-9224-59baee920ee6 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] HTTP exception thrown: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55e08d40-5375-4037-9224-59baee920ee6 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Request method failure captured: Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a HTTP/1.1 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS10Msy1t2tng5HytbqT5ORUFON1-glzXrNdL-ft_QMOkzJl-zwiDnHAbiuCEqX3kbnXlSK_ydfEcttVp6WGt5wxQukSf3oDJTl7XZqP3VaVs_YRLaDIuJAuKXRN--5gqKR6cIqj2VCSMkK6P80tiaBqBNAZWa8rbKasZeqtbdrsVrKw Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 09382aca0c684d049e3f5defd29e8b72 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_09382aca0c684d049e3f5defd29e8b72", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/09382aca0c684d049e3f5defd29e8b72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 09382aca0c684d049e3f5defd29e8b72 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-274307016 Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesSnapshotsTestJSON-274307016-project Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 54adae8e56bc4e61b4c5bafd8f09ce5e Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesSnapshotsTestJSON-274307016-project Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: exception: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '11185b19-2b97-4cf5-a4b8-4dc24486be7a'} Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. (HTTP 404) (Request-ID: req-b05c40dd-7810-439f-a7fd-cde58b6f7dac) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:23:39.234564 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55e08d40-5375-4037-9224-59baee920ee6 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] Returning 404 to user: Volume 11185b19-2b97-4cf5-a4b8-4dc24486be7a could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-55e08d40-5375-4037-9224-59baee920ee6 tempest-VolumesSnapshotsTestJSON-274307016 tempest-VolumesSnapshotsTestJSON-274307016-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a" status: 404 len: 109 microversion: 2.1 time: 0.042879 Oct 16 01:23:39.239609 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2387/4637] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:23:39 2022] GET /compute/v2.1/os-volumes/11185b19-2b97-4cf5-a4b8-4dc24486be7a => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:39.246226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ba9dff5-7c39-470c-82ef-6a7f345d81de tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:39.246873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ba9dff5-7c39-470c-82ef-6a7f345d81de tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: d0dd65ad-d05b-4316-b897-0081ddabd5bc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:39.254565 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4ba9dff5-7c39-470c-82ef-6a7f345d81de tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance d0dd65ad-d05b-4316-b897-0081ddabd5bc could not be found. Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ba9dff5-7c39-470c-82ef-6a7f345d81de tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/d0dd65ad-d05b-4316-b897-0081ddabd5bc/action HTTP/1.1 Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 13 Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: {"pause": {}} Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: exception: Instance d0dd65ad-d05b-4316-b897-0081ddabd5bc could not be found. Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'd0dd65ad-d05b-4316-b897-0081ddabd5bc', 'body': {'pause': {}}} Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0dd65ad-d05b-4316-b897-0081ddabd5bc could not be found. Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0dd65ad-d05b-4316-b897-0081ddabd5bc could not be found. Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:39.263224 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:39.267682 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:39.267682 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:39.267682 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0dd65ad-d05b-4316-b897-0081ddabd5bc could not be found. Oct 16 01:23:39.267682 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:39.267682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ba9dff5-7c39-470c-82ef-6a7f345d81de tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance d0dd65ad-d05b-4316-b897-0081ddabd5bc could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:39.267682 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ba9dff5-7c39-470c-82ef-6a7f345d81de tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/d0dd65ad-d05b-4316-b897-0081ddabd5bc/action" status: 404 len: 111 microversion: 2.1 time: 0.028320 Oct 16 01:23:39.271142 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2388/4638] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:39 2022] POST /compute/v2.1/servers/d0dd65ad-d05b-4316-b897-0081ddabd5bc/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:39.278938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:39.280326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:39.288419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.288941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.289397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.290319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.290796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.291408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.400051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:39.410252 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7bef3ca-c075-45b9-b872-2df4518576e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.270111 Oct 16 01:23:39.411201 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2251/4639] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:39 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:39.476204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:39.484533 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1b3e27de-212a-4f2f-9396-33ee27ab7d68 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.212262 Oct 16 01:23:39.485043 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2389/4640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:39 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:39.509948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:39.511178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:39.517720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.518228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.518877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.519620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.520087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.520516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.540949 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:39.691313 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:39.700022 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d0267880-261b-4c80-8914-685e74d4e701 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.195511 Oct 16 01:23:39.700632 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2252/4641] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:39 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:39.722373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:39.722902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:39.730677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.731223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.731660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.732406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.732863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.733687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.800429 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:39.824791 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6efa563f-8725-410f-9040-dc38b32e608e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 202 len: 0 microversion: 2.1 time: 0.105853 Oct 16 01:23:39.829027 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2390/4642] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:39 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:23:39.834647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:39.835867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:39.843092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.843594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.844288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:39.845005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:39.845516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:39.846040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:40.021087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:40.021792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:40.029294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:40.029789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:40.030257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:40.031009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:40.031469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:40.031909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:40.048294 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:40.058665 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-724e74cf-3f38-4ce6-a187-3456deca853f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1511 microversion: 2.1 time: 0.228642 Oct 16 01:23:40.059480 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2253/4643] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:39 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:40.201708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:40.209689 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d70d513a-f606-486b-a15a-916a8c958711 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.193947 Oct 16 01:23:40.210275 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2391/4644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:40 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:40.331142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-20b65f6d-5c2e-45fa-a31f-2899985c6eb8 req-1ade9895-77db-4b12-a0b5-d16d4442fbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ac0c5e-8d40-4757-9f37-75443f5a12fa", "name": "network-vif-plugged", "status": "completed", "tag": "324302d0-a2c9-4e9e-8e18-25a65c21d833"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:40.341409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-20b65f6d-5c2e-45fa-a31f-2899985c6eb8 req-1ade9895-77db-4b12-a0b5-d16d4442fbc5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:40.342036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-20b65f6d-5c2e-45fa-a31f-2899985c6eb8 req-1ade9895-77db-4b12-a0b5-d16d4442fbc5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:40.342483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-20b65f6d-5c2e-45fa-a31f-2899985c6eb8 req-1ade9895-77db-4b12-a0b5-d16d4442fbc5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:40.355373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-20b65f6d-5c2e-45fa-a31f-2899985c6eb8 req-1ade9895-77db-4b12-a0b5-d16d4442fbc5 service nova] Creating event network-vif-plugged:324302d0-a2c9-4e9e-8e18-25a65c21d833 for instance f2ac0c5e-8d40-4757-9f37-75443f5a12fa on n-h1-master-1 Oct 16 01:23:40.360196 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-20b65f6d-5c2e-45fa-a31f-2899985c6eb8 req-1ade9895-77db-4b12-a0b5-d16d4442fbc5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032717 Oct 16 01:23:40.360803 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2254/4645] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:40.434415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:40.435056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:40.441443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:40.442034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:40.442540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:40.443492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:40.444022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:40.444510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:40.608397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:40.616548 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-281ad396-6500-4166-ab90-7e14d08c8f3c tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.186786 Oct 16 01:23:40.617119 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2392/4646] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:40 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:41.082275 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:41.083009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:41.089375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.089805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.090246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.090968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.091432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.091862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.233739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:41.234350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:41.240606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:41.241922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.243365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.244061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.244953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.245593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.246019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.250304 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-edc5789a-69c8-4cd5-b9a3-bcc22c549160 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1491 microversion: 2.1 time: 0.173104 Oct 16 01:23:41.250890 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2255/4647] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:41 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1491 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:41.279550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:41.279550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:41.286167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.286736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.287629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.288612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.291211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.291748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.319341 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Cannot 'pause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state paused Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action HTTP/1.1 Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 13 Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: {"pause": {}} Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: exception: Cannot 'pause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state paused Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'pause': {}}} Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 in vm_state paused. Cannot pause while the instance is in this state. Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state paused Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:41.322522 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:41.327391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:41.327391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:41.327391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:41.327391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state paused Oct 16 01:23:41.327391 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:41.327391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 409 to user: Cannot 'pause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state paused {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:41.327881 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7af60212-aaa4-4631-9da1-12988c6858e4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 409 len: 143 microversion: 2.1 time: 0.053885 Oct 16 01:23:41.328378 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2256/4648] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:41 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 143 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 16 01:23:41.341089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:41.341848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:41.348737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.349446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.349949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.350810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.351341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.351796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.394838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:41.405305 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f1ff8fba-9a8f-4e4f-aac6-14d2660b759b tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.175181 Oct 16 01:23:41.405961 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2393/4649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:41 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:41.431572 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8edaaefc-459a-4e57-919c-91dd586d9e43 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 202 len: 0 microversion: 2.1 time: 0.097548 Oct 16 01:23:41.432371 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2257/4650] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:41 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:23:41.441316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:41.442002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:41.448906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.449502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.450093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.450838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.451323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.451749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.603305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:41.622270 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e94e523e-447c-439c-bd45-f482e2872edf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1498 microversion: 2.1 time: 0.175340 Oct 16 01:23:41.623391 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2394/4651] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:41 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:41.641866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:41.642635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:41.650487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.651107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.651784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.652626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:41.653394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:41.653918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:41.799668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:41.808305 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73b821dc-8dcc-4942-a619-6666e8c22524 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.171685 Oct 16 01:23:41.809061 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2258/4652] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:41 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:41.996770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bed89d9-938f-4290-890f-26169cc148bc"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:41.999819 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:42.006066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.006556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.007022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.007742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.009004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.009004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.103153 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Invalid volume: volume 4bed89d9-938f-4290-890f-26169cc148bc is already attached to instances: f8b35480-ba38-4c33-bfa8-e63c3eafbeec Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments HTTP/1.1 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 74 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: {"volumeAttachment": {"volumeId": "4bed89d9-938f-4290-890f-26169cc148bc"}} Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid volume: volume 4bed89d9-938f-4290-890f-26169cc148bc is already attached to instances: f8b35480-ba38-4c33-bfa8-e63c3eafbeec Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': 'f8b35480-ba38-4c33-bfa8-e63c3eafbeec', 'body': {'volumeAttachment': {'volumeId': '4bed89d9-938f-4290-890f-26169cc148bc'}}} Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4bed89d9-938f-4290-890f-26169cc148bc is already attached to instances: f8b35480-ba38-4c33-bfa8-e63c3eafbeec Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:42.104877 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4bed89d9-938f-4290-890f-26169cc148bc is already attached to instances: f8b35480-ba38-4c33-bfa8-e63c3eafbeec Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4bed89d9-938f-4290-890f-26169cc148bc is already attached to instances: f8b35480-ba38-4c33-bfa8-e63c3eafbeec Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 400 to user: Invalid volume: volume 4bed89d9-938f-4290-890f-26169cc148bc is already attached to instances: f8b35480-ba38-4c33-bfa8-e63c3eafbeec {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-27e5ad8e-1eab-4912-b5db-8121ce1608b0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116423 Oct 16 01:23:42.110798 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2395/4653] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:23:41 2022] POST /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:42.197228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:42.197775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:42.205468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.205976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.206419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.207452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.208295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.209360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.312145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lazy-loading 'services' on Instance uuid f8b35480-ba38-4c33-bfa8-e63c3eafbeec {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:23:42.436344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:42.437101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:42.437482 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-06cba5cc-f69b-4f24-ad0c-4c7d5660483b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments/4bed89d9-938f-4290-890f-26169cc148bc" status: 202 len: 0 microversion: 2.1 time: 0.245773 Oct 16 01:23:42.438093 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2259/4654] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:23:42 2022] DELETE /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments/4bed89d9-938f-4290-890f-26169cc148bc => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:23:42.449037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.449626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.450157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.450269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:42.453784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.453784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.453784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.454021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:42.461993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.462599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.463167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.464023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.464549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.465048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.513730 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5661c4aa-1413-49a2-b8e8-080903108200 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070189 Oct 16 01:23:42.514364 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2260/4655] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:23:42 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:42.641654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:42.648329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:42.649835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:42.651214 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c1911d32-f0f6-4ed8-ad81-91b995a66436 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1320 microversion: 2.1 time: 0.224667 Oct 16 01:23:42.652119 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2396/4656] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:42 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:42.658378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.658935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.659430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.660322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.660945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.661535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.811016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:42.818831 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df7469b4-70db-417c-bf36-1c9562c88acb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.175880 Oct 16 01:23:42.819669 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2261/4657] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:42 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:42.831837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:42.832454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:42.847369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:42.848114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:42.849855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.850351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.850787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.852530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.853658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.854446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.856146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.857132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.857742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:42.858588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:42.859093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:42.859531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.095099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:43.104173 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-120b4589-4424-416b-8f00-f8e2e60089ae tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.276497 Oct 16 01:23:43.104816 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2397/4658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:42 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:43.114525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:43.123712 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-71dd6123-db70-4943-a659-2529990ed6f2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.283297 Oct 16 01:23:43.124453 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2262/4659] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:42 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:43.147382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:43.151123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.157259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.157755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.158195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.158900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.159389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.159817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.175201 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9/action HTTP/1.1 Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 28 Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: {"reboot": {"type": "SOFT"}} Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6514e50b-9489-47f4-89c6-db0bb9bc99a9', 'body': {'reboot': {'type': 'SOFT'}}} Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:43.177045 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0839ac81-69fa-4082-809a-c81a96b49af8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9/action" status: 404 len: 111 microversion: 2.1 time: 0.035181 Oct 16 01:23:43.181780 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2398/4660] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:43 2022] POST /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:43.187836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:43.188152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.194558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.194799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.195135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.196024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.196401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.196984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.275301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:43.277567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.291805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.292521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.293148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.294079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.294587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.295033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.352924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:43.366722 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-86c76b13-8b82-4b6d-82d4-c8fc3315ea13 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4/action" status: 200 len: 24565 microversion: 2.1 time: 0.096010 Oct 16 01:23:43.367890 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2399/4661] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:43 2022] POST /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4/action => generated 24565 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 01:23:43.372758 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a12b1e48-240b-4d7d-b659-93b342b45928 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.188939 Oct 16 01:23:43.373350 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2263/4662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:43 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:43.400035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:43.401320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.410128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.410810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.411293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.420894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.421643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.421997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.529583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:43.532973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.540325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.541427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.542906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.544285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.545040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.545666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.592742 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e29fba9-799f-4b9d-913c-8affdf5efe45 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070835 Oct 16 01:23:43.594703 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2264/4663] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:23:43 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:43.594898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:43.603532 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-41468a26-cb8d-4d92-8eda-8f728e304f41 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.209978 Oct 16 01:23:43.604070 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2400/4664] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:43 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:43.626696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c72f98c-1823-4074-bfd6-7c5b442b9bca tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:43.629613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c72f98c-1823-4074-bfd6-7c5b442b9bca tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 5d4f431a-5f29-4b5e-9f48-134d44673562] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.635930 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9c72f98c-1823-4074-bfd6-7c5b442b9bca tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 5d4f431a-5f29-4b5e-9f48-134d44673562 could not be found. Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c72f98c-1823-4074-bfd6-7c5b442b9bca tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/5d4f431a-5f29-4b5e-9f48-134d44673562/action HTTP/1.1 Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 28 Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: {"reboot": {"type": "SOFT"}} Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 5d4f431a-5f29-4b5e-9f48-134d44673562 could not be found. Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5d4f431a-5f29-4b5e-9f48-134d44673562', 'body': {'reboot': {'type': 'SOFT'}}} Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4f431a-5f29-4b5e-9f48-134d44673562 could not be found. Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4f431a-5f29-4b5e-9f48-134d44673562 could not be found. Oct 16 01:23:43.638195 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4f431a-5f29-4b5e-9f48-134d44673562 could not be found. Oct 16 01:23:43.643268 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:43.644329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c72f98c-1823-4074-bfd6-7c5b442b9bca tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 5d4f431a-5f29-4b5e-9f48-134d44673562 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:43.645386 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c72f98c-1823-4074-bfd6-7c5b442b9bca tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/5d4f431a-5f29-4b5e-9f48-134d44673562/action" status: 404 len: 111 microversion: 2.1 time: 0.022678 Oct 16 01:23:43.646131 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2265/4665] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:43 2022] POST /compute/v2.1/servers/5d4f431a-5f29-4b5e-9f48-134d44673562/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:43.657717 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:43.658337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.667530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.668155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.668757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.669622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.670449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.671136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.678606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:43.679515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.690087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.690582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.691198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.692182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.692653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.693082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.910570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:43.911693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:43.921466 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64985cea-033e-404d-a619-48628cfe2f6a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 200 len: 1509 microversion: 2.1 time: 0.247653 Oct 16 01:23:43.934660 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2266/4666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:43 2022] GET /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:43.950226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:43.951520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f6afd204-6566-433b-beb7-2e86822cd3a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:43.962327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.963274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.963821 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8cc082d4-a56a-4057-b24a-97f6da5cd6d6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.312068 Oct 16 01:23:43.964250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.965274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:43.966564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:43.967252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:43.967582 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2401/4667] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:43 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:43.994683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:43.995617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:44.002443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.003186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.003800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.004680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.005299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.005886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.205558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:44.217274 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8d2d8e1-f6d8-46fe-9664-6559f7cf789d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/f6afd204-6566-433b-beb7-2e86822cd3a4" status: 200 len: 1508 microversion: 2.1 time: 0.272635 Oct 16 01:23:44.218271 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2267/4668] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:43 2022] GET /compute/v2.1/servers/f6afd204-6566-433b-beb7-2e86822cd3a4 => generated 1508 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:44.224473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:44.225130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:44.245221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.245723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.246158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.247487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.248118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.248774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.260093 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:44.269113 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-94c938f7-8518-4168-8dbb-5ae0afab8034 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.278369 Oct 16 01:23:44.270313 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2402/4669] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:43 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:44.275973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:44.276754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f6afd204-6566-433b-beb7-2e86822cd3a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:44.283657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.284442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.285129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.286054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.286726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.287389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.318626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f6afd204-6566-433b-beb7-2e86822cd3a4] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:23:44.419837 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c69176ef-3246-4991-ba83-30a402030e44 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f6afd204-6566-433b-beb7-2e86822cd3a4" status: 204 len: 0 microversion: 2.1 time: 0.147572 Oct 16 01:23:44.421513 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2403/4670] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:23:44 2022] DELETE /compute/v2.1/servers/f6afd204-6566-433b-beb7-2e86822cd3a4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:23:44.431757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:44.435459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:44.437086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:44.443638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.444726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.445495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.447260 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d397d59-db02-4d9e-9f78-3f02982ac5bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.226592 Oct 16 01:23:44.447657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.448335 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2268/4671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:44 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:44.448472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.449250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.453037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:44.453521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:44.459684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.460173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.460611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.461949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.462644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.463271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.482292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:44.483906 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9/action HTTP/1.1 Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 65 Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6514e50b-9489-47f4-89c6-db0bb9bc99a9', 'body': {'rebuild': {'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423'}}} Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 16 01:23:44.489178 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:23:44.494352 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:44.496172 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: f2ac0c5e-8d40-4757-9f37-75443f5a12fa] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:23:44.497833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:44.498873 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de2771ae-e2a6-468a-9b51-ad8396cf80d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9/action" status: 404 len: 111 microversion: 2.1 time: 0.075977 Oct 16 01:23:44.500272 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2404/4672] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:44 2022] POST /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:44.510168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:44.511270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:44.520667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.521391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.522043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.522908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.523457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.524507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.621802 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88a246ca-739c-49fd-bdd0-ad07d45fa1d2 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa" status: 204 len: 0 microversion: 2.1 time: 0.171918 Oct 16 01:23:44.625651 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2269/4673] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:23:44 2022] DELETE /compute/v2.1/servers/f2ac0c5e-8d40-4757-9f37-75443f5a12fa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:23:44.638608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:44.643134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:44.651394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.652452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.653108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.654453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.655152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.655733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.703472 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e36acfea-c3d7-4b63-878a-6375dc90ad65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076002 Oct 16 01:23:44.707057 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2270/4674] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:23:44 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:44.717738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:44.732888 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea943b61-7b03-4996-9d4a-1c96ee0523ea tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.228582 Oct 16 01:23:44.739736 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2405/4675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:44 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:44.757196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:44.757911 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:44.766794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.767661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.768272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.769143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:44.769937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:44.770534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:44.812788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-695187443", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "4279d430-1168-445d-ba2c-ba13341010bb"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:44.904237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] validate_networks() for [('4279d430-1168-445d-ba2c-ba13341010bb', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:23:45.026222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:45.039023 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a88844b4-031d-446e-87ea-3b7d27a958e9 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.285004 Oct 16 01:23:45.040552 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2271/4676] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:44 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:45.064902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d9d4326-62c0-4086-b0e6-f6ab8e4ac681 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:45.069747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1d9d4326-62c0-4086-b0e6-f6ab8e4ac681 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 3d0d74f6-3588-46df-8983-8c489056e906] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:45.085676 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-1d9d4326-62c0-4086-b0e6-f6ab8e4ac681 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 3d0d74f6-3588-46df-8983-8c489056e906 could not be found. Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d9d4326-62c0-4086-b0e6-f6ab8e4ac681 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/3d0d74f6-3588-46df-8983-8c489056e906/action HTTP/1.1 Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 65 Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3d0d74f6-3588-46df-8983-8c489056e906 could not be found. Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3d0d74f6-3588-46df-8983-8c489056e906', 'body': {'rebuild': {'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423'}}} Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0d74f6-3588-46df-8983-8c489056e906 could not be found. Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 16 01:23:45.088186 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0d74f6-3588-46df-8983-8c489056e906 could not be found. Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0d74f6-3588-46df-8983-8c489056e906 could not be found. Oct 16 01:23:45.092623 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.096057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d9d4326-62c0-4086-b0e6-f6ab8e4ac681 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 3d0d74f6-3588-46df-8983-8c489056e906 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:45.097286 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d9d4326-62c0-4086-b0e6-f6ab8e4ac681 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/3d0d74f6-3588-46df-8983-8c489056e906/action" status: 404 len: 111 microversion: 2.1 time: 0.037188 Oct 16 01:23:45.098317 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2272/4677] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:45 2022] POST /compute/v2.1/servers/3d0d74f6-3588-46df-8983-8c489056e906/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:45.108805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:45.109606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:45.118130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.119010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.119582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.120414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.120857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.121320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.376548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:45.387152 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3935cbf-c3b7-41a3-a8c7-229506f2a84f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.282999 Oct 16 01:23:45.388433 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2273/4678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:45 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:45.413274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:45.415093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:45.419271 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:45.424285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.425010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.425632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.426505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.427198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.427786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.455062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:23:45.455589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:23:45.456121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:23:45.456602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:23:45.457099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:23:45.470057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.470575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.471047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.471782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.472243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.472667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.497249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Getting quotas for project 918ff4a0b6c34c4bbfd6e31f32967d70. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:23:45.504881 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:45.508481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Getting quotas for user baca0537d1844a8ea771011a6c062b30 and project 918ff4a0b6c34c4bbfd6e31f32967d70. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:23:45.526583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Going to run 2 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:23:45.529647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:23:45.568736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=3156062e-3f97-4796-b94f-59674406826d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:23:45.597753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:45.608135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1be0ccec-f211-42cf-81db-d0aa184acd32 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.200034 Oct 16 01:23:45.621118 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2274/4679] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:45 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:45.629021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:45.629953 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:45.642148 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8606041d-8a81-4864-87cb-4cde63e6baf0 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.838653 Oct 16 01:23:45.646229 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2406/4680] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:44 2022] POST /compute/v2.1/servers => generated 32 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 16 01:23:45.651730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8495d50c-e714-4e1a-aff1-91befbbc6495 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:45.652556 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8495d50c-e714-4e1a-aff1-91befbbc6495 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: b22e2314-1686-413d-b8d1-6ab7c1af4008] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:45.659082 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-8495d50c-e714-4e1a-aff1-91befbbc6495 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance b22e2314-1686-413d-b8d1-6ab7c1af4008 could not be found. Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8495d50c-e714-4e1a-aff1-91befbbc6495 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/b22e2314-1686-413d-b8d1-6ab7c1af4008/action HTTP/1.1 Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: {"restore": {}} Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: exception: Instance b22e2314-1686-413d-b8d1-6ab7c1af4008 could not be found. Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'b22e2314-1686-413d-b8d1-6ab7c1af4008', 'body': {'restore': {}}} Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b22e2314-1686-413d-b8d1-6ab7c1af4008 could not be found. Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b22e2314-1686-413d-b8d1-6ab7c1af4008 could not be found. Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:45.661368 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:45.667858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:45.667858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:45.667858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b22e2314-1686-413d-b8d1-6ab7c1af4008 could not be found. Oct 16 01:23:45.667858 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:45.667858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8495d50c-e714-4e1a-aff1-91befbbc6495 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance b22e2314-1686-413d-b8d1-6ab7c1af4008 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:45.667858 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8495d50c-e714-4e1a-aff1-91befbbc6495 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/b22e2314-1686-413d-b8d1-6ab7c1af4008/action" status: 404 len: 111 microversion: 2.1 time: 0.017958 Oct 16 01:23:45.670353 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2407/4681] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:45 2022] POST /compute/v2.1/servers/b22e2314-1686-413d-b8d1-6ab7c1af4008/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:45.670943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.671918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.672561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.675832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.676011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:45.676369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.676816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.682458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:45.683255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Searching by: {'deleted': False, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 01:23:45.723512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.724363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.724921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.726172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.728651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.729379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.762852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 01:23:45.781061 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:45.814356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-17fdcbb8-f4d3-4aec-ab29-5583d629de65 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.140700 Oct 16 01:23:45.815354 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2408/4682] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 01:23:45 2022] GET /compute/v2.1/servers => generated 1335 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:45.820583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:45.822659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:45.835601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.836464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.836905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.838690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.839487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.840445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.859467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:45.871182 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56bdedb4-674c-48c2-b769-390cfde50ec6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.246601 Oct 16 01:23:45.872358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2275/4683] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:45 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:45.878823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:45.881357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:45.896041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.899363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.900002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.900942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:45.901407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:45.901832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:45.946031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2b008e2e-68ba-4ec8-86df-2e0c75a91d65 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072054 Oct 16 01:23:45.946989 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2276/4684] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:23:45 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:45.955245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-754d8995-60b7-42ba-b857-290c7d45b109 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:45.955859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-754d8995-60b7-42ba-b857-290c7d45b109 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:46.039124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-754d8995-60b7-42ba-b857-290c7d45b109 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:46.050902 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-754d8995-60b7-42ba-b857-290c7d45b109 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1217 microversion: 2.1 time: 0.097916 Oct 16 01:23:46.052708 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2277/4685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:45 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:46.092546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:46.103846 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2ee3daf3-aec7-431d-ab23-02c7a37dc965 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.285245 Oct 16 01:23:46.104478 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2409/4686] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:45 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:46.129149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:46.130262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:46.137012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.138250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.138702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.139440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.139906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.140538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.326774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:46.336998 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-31449e5b-3686-4a36-b9c8-354f88c9c37f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.211688 Oct 16 01:23:46.337952 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2278/4687] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:46 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:46.363020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:46.363653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:46.372248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.372688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.373319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.374233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.375031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.375621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.404862 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Cannot 'restore' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action HTTP/1.1 Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: {"restore": {}} Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'restore' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'restore': {}}} Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 in vm_state active. Cannot restore while the instance is in this state. Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:46.407214 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:46.412267 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:46.412267 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:46.412267 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:46.412267 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:23:46.412267 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.412267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 409 to user: Cannot 'restore' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:46.412267 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcd1e8fb-599b-42d9-ab78-fb32c7ce4c50 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 409 len: 145 microversion: 2.1 time: 0.051146 Oct 16 01:23:46.413335 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2410/4688] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:46 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 145 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:23:46.419594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:46.420550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:46.428019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.428720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.430536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.432530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.433209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.434454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.601332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:46.618816 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6d8fc56c-6dab-441c-bf05-64de5979ba7b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.202237 Oct 16 01:23:46.619555 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2279/4689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:46 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:46.641844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:46.642660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:46.650351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.651294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.651928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.652815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.654305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.654909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.880053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:46.889177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2867eb3a-5014-43a6-988f-abe7ebc2129d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.251126 Oct 16 01:23:46.891199 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2411/4690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:46 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:46.917969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b04209dd-61d9-4a06-93c2-97824bd3e2d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:46.919441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b04209dd-61d9-4a06-93c2-97824bd3e2d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: a26c749d-3aea-4b6d-99b9-bc7dc788a5ea] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:46.921747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:46.923028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:46.933360 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b04209dd-61d9-4a06-93c2-97824bd3e2d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance a26c749d-3aea-4b6d-99b9-bc7dc788a5ea could not be found. Oct 16 01:23:46.937402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.941493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.941493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.941493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.943074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b04209dd-61d9-4a06-93c2-97824bd3e2d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/a26c749d-3aea-4b6d-99b9-bc7dc788a5ea/action HTTP/1.1 Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 14 Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: {"resume": {}} Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: exception: Instance a26c749d-3aea-4b6d-99b9-bc7dc788a5ea could not be found. Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'a26c749d-3aea-4b6d-99b9-bc7dc788a5ea', 'body': {'resume': {}}} Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26c749d-3aea-4b6d-99b9-bc7dc788a5ea could not be found. Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26c749d-3aea-4b6d-99b9-bc7dc788a5ea could not be found. Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:46.943206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:46.953921 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:46.953921 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:46.953921 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26c749d-3aea-4b6d-99b9-bc7dc788a5ea could not be found. Oct 16 01:23:46.953921 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:23:46.953921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b04209dd-61d9-4a06-93c2-97824bd3e2d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance a26c749d-3aea-4b6d-99b9-bc7dc788a5ea could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:46.953921 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b04209dd-61d9-4a06-93c2-97824bd3e2d1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/a26c749d-3aea-4b6d-99b9-bc7dc788a5ea/action" status: 404 len: 111 microversion: 2.1 time: 0.034549 Oct 16 01:23:46.954353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.954443 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2412/4691] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:46 2022] POST /compute/v2.1/servers/a26c749d-3aea-4b6d-99b9-bc7dc788a5ea/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:23:46.957583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:46.959867 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:46.968696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.969334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.969765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:46.970493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:46.970996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:46.971431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.007444 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-881efd02-7045-4d19-8e3b-dfecc16b8a73 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053602 Oct 16 01:23:47.012524 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2413/4692] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:23:46 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:47.017241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:47.017859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:47.024472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.025216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.025821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.026521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.027167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.027776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.173777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:47.185027 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cbeb9f3e-376d-4049-b71a-7616489da576 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.279830 Oct 16 01:23:47.186041 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2280/4693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:46 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:47.215139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:47.219802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:47.237504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.238281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.238951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.240075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.240813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.241441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.322046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:47.333079 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e33344e-3ae3-412e-a366-b6da35c0e8ab tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.319427 Oct 16 01:23:47.333675 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2414/4694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:47 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:47.362159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:47.364266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:47.376906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.377924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.379727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.381761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.382504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.384781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.431936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:47.462154 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0d9b521a-c9a6-48d6-a93d-aa0a532d2f4f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1213 microversion: 2.1 time: 0.259376 Oct 16 01:23:47.464689 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2281/4695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:47 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:47.743304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:47.760945 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-edf93eec-f26c-4ef6-b374-d8272910db1a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.404649 Oct 16 01:23:47.761854 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2415/4696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:47 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:47.790404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:47.792246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:47.811689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.817466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.819796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.821580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.824193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.826507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.869653 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Cannot 'resume' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action HTTP/1.1 Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 14 Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: {"resume": {}} Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: exception: Cannot 'resume' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'resume': {}}} Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 in vm_state active. Cannot resume while the instance is in this state. Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:47.878482 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:47.884822 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:47.884822 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:47.884822 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:47.884822 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:47.884822 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:47.884822 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:23:47.884822 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:47.890007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 409 to user: Cannot 'resume' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:47.891960 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1adbda78-9713-4890-93b3-0d4a22a06a1b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 409 len: 144 microversion: 2.1 time: 0.106087 Oct 16 01:23:47.893523 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2282/4697] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:47 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 144 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:23:47.902710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:47.904065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:47.912533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.913400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.914065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:47.916744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:47.917547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:47.918192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:48.021837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:48.025732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:48.041236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:48.041844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:48.042402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:48.043246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:48.047442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:48.048002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:48.107108 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e048cb0a-b84e-4244-81a6-8b1402e503f6 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090350 Oct 16 01:23:48.108135 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2283/4698] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:23:48 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:48.228128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:48.239702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:48.255396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:48.256558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:48.259554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:48.265194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:48.267717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:48.270801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:48.505382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:48.518882 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c05cfc9e-98a1-49b0-b6f3-59a0bb5ba8a2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.620524 Oct 16 01:23:48.567259 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2416/4699] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:47 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:48.582133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-814c2829-6bfd-404f-8ede-7a9dc1025570 req-5557248b-f352-4e8a-85da-a8c806bd125b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ac0c5e-8d40-4757-9f37-75443f5a12fa", "name": "network-vif-deleted", "tag": "324302d0-a2c9-4e9e-8e18-25a65c21d833"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:48.604814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-814c2829-6bfd-404f-8ede-7a9dc1025570 req-5557248b-f352-4e8a-85da-a8c806bd125b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:48.606521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-814c2829-6bfd-404f-8ede-7a9dc1025570 req-5557248b-f352-4e8a-85da-a8c806bd125b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:48.607264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-814c2829-6bfd-404f-8ede-7a9dc1025570 req-5557248b-f352-4e8a-85da-a8c806bd125b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:48.624223 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-814c2829-6bfd-404f-8ede-7a9dc1025570 req-5557248b-f352-4e8a-85da-a8c806bd125b service nova] Creating event network-vif-deleted:324302d0-a2c9-4e9e-8e18-25a65c21d833 for instance f2ac0c5e-8d40-4757-9f37-75443f5a12fa on n-h1-master-1 Oct 16 01:23:48.631071 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-814c2829-6bfd-404f-8ede-7a9dc1025570 req-5557248b-f352-4e8a-85da-a8c806bd125b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061742 Oct 16 01:23:48.632020 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2417/4700] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:48.639860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:48.640870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:48.648256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:48.649005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:48.649912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:48.651901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:48.652705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:48.653380 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:48.971969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:48.982425 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4fa9047f-170c-442c-af33-09082adfc794 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1269 microversion: 2.1 time: 0.348712 Oct 16 01:23:48.995753 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2418/4701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:48 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1269 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:49.015836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:49.017198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:49.038870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.039705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.040276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.057745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.058270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.058865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.232128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:49.247344 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-83c54039-bedc-4f6a-8876-2df4d5d566cd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 1.023947 Oct 16 01:23:49.252480 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2284/4702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:48 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:49.257472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:49.269798 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:49.281807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.282949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.288600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.289541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.290358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.291086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.382678 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ea9b487-803e-4d13-a8b2-fa0ec8fc59bf tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128940 Oct 16 01:23:49.384266 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2285/4703] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:23:49 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:23:49.403410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b2bdb70e-526c-411d-8753-0c176e253a16 req-25359ec0-72ba-4a33-98f4-43828554e49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6afd204-6566-433b-beb7-2e86822cd3a4", "name": "network-vif-deleted", "tag": "f3fae7a0-d006-4eea-9fb2-8a26c8cbac13"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:49.441211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b2bdb70e-526c-411d-8753-0c176e253a16 req-25359ec0-72ba-4a33-98f4-43828554e49b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.443423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b2bdb70e-526c-411d-8753-0c176e253a16 req-25359ec0-72ba-4a33-98f4-43828554e49b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.444136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b2bdb70e-526c-411d-8753-0c176e253a16 req-25359ec0-72ba-4a33-98f4-43828554e49b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.456339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:49.475561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b2bdb70e-526c-411d-8753-0c176e253a16 req-25359ec0-72ba-4a33-98f4-43828554e49b service nova] Creating event network-vif-deleted:f3fae7a0-d006-4eea-9fb2-8a26c8cbac13 for instance f6afd204-6566-433b-beb7-2e86822cd3a4 on n-h1-master-1 Oct 16 01:23:49.483182 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4b6940c-fc73-44c3-afb8-3db34cd0b56a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.485964 Oct 16 01:23:49.488758 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2419/4704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:48 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:49.502760 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b2bdb70e-526c-411d-8753-0c176e253a16 req-25359ec0-72ba-4a33-98f4-43828554e49b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114763 Oct 16 01:23:49.506559 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2286/4705] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:49.510014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:49.510520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:49.528841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.529341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.529787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.530670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.531167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.532446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.585458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:23:49.698572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-963d9f71-7e7a-4aaa-8b35-73c5ae25d48e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-963d9f71-7e7a-4aaa-8b35-73c5ae25d48e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 160 Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c823a5ff-2110-4a77-95b2-4f3653a870f1"}]}} Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: action_args: {'body': {'server': {'name': '', 'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423', 'flavorRef': '452', 'networks': [{'uuid': 'c823a5ff-2110-4a77-95b2-4f3653a870f1'}]}}} Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi '' Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:23:49.702527 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-963d9f71-7e7a-4aaa-8b35-73c5ae25d48e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:49.709194 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-963d9f71-7e7a-4aaa-8b35-73c5ae25d48e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.016340 Oct 16 01:23:49.710461 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2287/4706] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:49 2022] POST /compute/v2.1/servers => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:23:49.718515 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-441fcd3d-fc90-4c35-b82d-9c3bb1d7dc6b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 204 len: 0 microversion: 2.1 time: 0.212589 Oct 16 01:23:49.721738 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2420/4707] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:23:49 2022] DELETE /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:23:49.723570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:49.724383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:49.731333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:49.732517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:49.752376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.754367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.756034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.756976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.759134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.759447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.760120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.760754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.761586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.764647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:49.765357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:49.766481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:49.814829 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:50.189642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:50.200444 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7f1341c8-56cf-49f3-a0c9-753247f9a05e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.483611 Oct 16 01:23:50.201785 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2288/4708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:49 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:50.220866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:50.229804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:50.232874 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc9f3435-1796-466c-afe8-6015dc7d262a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1681 microversion: 2.1 time: 0.505716 Oct 16 01:23:50.233939 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:50.236426 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2421/4709] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:49 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1681 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:50.244120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:50.244840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:50.245435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:50.250315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:50.251154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:50.256612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:50.257819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:50.262213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:50.266421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:50.272393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:50.272393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:50.272661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:50.273019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:50.273446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:50.612425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:50.612768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:50.629182 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-969123bd-2579-4d5d-840e-5cacac629970 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.390805 Oct 16 01:23:50.630602 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2422/4710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:50 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:50.632174 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d00de1c4-e69a-4f81-9c31-9b1b41faaafd tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1317 microversion: 2.1 time: 0.428426 Oct 16 01:23:50.633821 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2289/4711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:50 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:50.658953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:50.663720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:50.667527 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b239873d-3097-4d57-bfd6-eff1b42d6f1f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:50.668698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b239873d-3097-4d57-bfd6-eff1b42d6f1f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: ed8a363d-69bf-440b-8d06-14dced1d2f32] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:50.676541 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-b239873d-3097-4d57-bfd6-eff1b42d6f1f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance ed8a363d-69bf-440b-8d06-14dced1d2f32 could not be found. Oct 16 01:23:50.676768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:50.677585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:50.678198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:50.679168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:50.679797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:50.681552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b239873d-3097-4d57-bfd6-eff1b42d6f1f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/ed8a363d-69bf-440b-8d06-14dced1d2f32/action HTTP/1.1 Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 14 Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: {"shelve": {}} Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ed8a363d-69bf-440b-8d06-14dced1d2f32 could not be found. Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ed8a363d-69bf-440b-8d06-14dced1d2f32', 'body': {'shelve': {}}} Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8a363d-69bf-440b-8d06-14dced1d2f32 could not be found. Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8a363d-69bf-440b-8d06-14dced1d2f32 could not be found. Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:50.686106 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:50.691110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:50.691110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:50.691110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8a363d-69bf-440b-8d06-14dced1d2f32 could not be found. Oct 16 01:23:50.691110 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:50.691110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b239873d-3097-4d57-bfd6-eff1b42d6f1f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance ed8a363d-69bf-440b-8d06-14dced1d2f32 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:50.691110 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b239873d-3097-4d57-bfd6-eff1b42d6f1f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/ed8a363d-69bf-440b-8d06-14dced1d2f32/action" status: 404 len: 111 microversion: 2.1 time: 0.030211 Oct 16 01:23:50.691110 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2290/4712] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:50 2022] POST /compute/v2.1/servers/ed8a363d-69bf-440b-8d06-14dced1d2f32/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:23:50.701417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:50.704109 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:50.711798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:50.713022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:50.713834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:50.715666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:50.716431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:50.717683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.109617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:51.115639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:51.119580 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ba110b4-10ab-4a7f-a7a0-00d36f077d4e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.425834 Oct 16 01:23:51.120778 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2291/4713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:50 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:51.123612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-690aa279-b17f-4e5f-bd24-eb07f82d7d62 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.479195 Oct 16 01:23:51.130965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-82ec8029-22f5-44ed-aa0a-dfb350e6893b req-eb09d013-76f8-4a9a-ad1f-6d680e0a5d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c78106-efc9-4912-b435-0d7aa5f6221a", "tag": "9c082ef9-aaa7-4b10-982a-b5749b418617"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:51.131449 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2423/4714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:50 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:51.146698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:51.147603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:51.152321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-82ec8029-22f5-44ed-aa0a-dfb350e6893b req-eb09d013-76f8-4a9a-ad1f-6d680e0a5d3c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.152851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-82ec8029-22f5-44ed-aa0a-dfb350e6893b req-eb09d013-76f8-4a9a-ad1f-6d680e0a5d3c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.153695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-82ec8029-22f5-44ed-aa0a-dfb350e6893b req-eb09d013-76f8-4a9a-ad1f-6d680e0a5d3c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.157114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.157754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.158353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.159187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.159724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.160226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.168159 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-82ec8029-22f5-44ed-aa0a-dfb350e6893b req-eb09d013-76f8-4a9a-ad1f-6d680e0a5d3c service nova] Creating event network-changed:9c082ef9-aaa7-4b10-982a-b5749b418617 for instance b2c78106-efc9-4912-b435-0d7aa5f6221a on n-h2-master-1 Oct 16 01:23:51.174654 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-82ec8029-22f5-44ed-aa0a-dfb350e6893b req-eb09d013-76f8-4a9a-ad1f-6d680e0a5d3c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051922 Oct 16 01:23:51.176377 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2292/4715] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:51.263026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:51.264956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:51.279496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.280873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.281619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.282453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.283410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.283849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.507990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:51.544787 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e09c7e10-cbe4-48dc-b875-8cf3364c504c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.398983 Oct 16 01:23:51.558945 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2424/4716] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:51 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:51.569836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:51.570456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:51.585038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.585711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.586403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.587326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.587839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.588412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.621098 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:51.645671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:51.645898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lazy-loading 'flavor' on Instance uuid 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:23:51.673805 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-89676554-001b-4b33-8203-deb219755c87 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1681 microversion: 2.1 time: 0.419759 Oct 16 01:23:51.678016 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2293/4717] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:51 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1681 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:51.692186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:51.693069 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:51.700718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.701495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.702339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.714617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.715449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.717316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.904548 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fad1fb34-b8f1-4c3b-ae61-9821fbb5333f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 202 len: 0 microversion: 2.1 time: 0.338414 Oct 16 01:23:51.907392 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2425/4718] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:23:51 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:23:51.917899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:51.918595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:51.924914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.925611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.926238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:51.927134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:51.927586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:51.928169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:52.153280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:52.163730 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-093541ff-83d0-4222-82a7-f618abfa48b8 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1317 microversion: 2.1 time: 0.482497 Oct 16 01:23:52.165711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2294/4719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:51 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:52.171484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:52.172173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:52.178545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:52.179168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:52.179696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:52.180984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:52.181713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:52.182244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:52.383462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:52.393696 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ac41135-96be-4eb7-abb9-969028ca9dc4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.483451 Oct 16 01:23:52.402550 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2426/4720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:51 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:52.476407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c1a06e19-babc-4462-a1e9-7dad13d3c5a0 req-11fa7a18-339d-4493-a094-3f2c128159a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3156062e-3f97-4796-b94f-59674406826d", "tag": "a0ff4508-3815-4596-bcad-42c7786e1924"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:52.486062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c1a06e19-babc-4462-a1e9-7dad13d3c5a0 req-11fa7a18-339d-4493-a094-3f2c128159a9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:52.486765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c1a06e19-babc-4462-a1e9-7dad13d3c5a0 req-11fa7a18-339d-4493-a094-3f2c128159a9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:52.487212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c1a06e19-babc-4462-a1e9-7dad13d3c5a0 req-11fa7a18-339d-4493-a094-3f2c128159a9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:52.499597 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c1a06e19-babc-4462-a1e9-7dad13d3c5a0 req-11fa7a18-339d-4493-a094-3f2c128159a9 service nova] Creating event network-changed:a0ff4508-3815-4596-bcad-42c7786e1924 for instance 3156062e-3f97-4796-b94f-59674406826d on n-h2-master-1 Oct 16 01:23:52.504716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c1a06e19-babc-4462-a1e9-7dad13d3c5a0 req-11fa7a18-339d-4493-a094-3f2c128159a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032819 Oct 16 01:23:52.505555 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2427/4721] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:52.633563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:52.643422 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1035b612-98d6-440b-8d07-87ef2933e14f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.476267 Oct 16 01:23:52.644006 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2295/4722] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:52 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:52.705929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:52.706615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:52.713779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:52.714261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:52.714903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:52.715788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:52.716242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:52.716664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:53.009926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:53.018853 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4eb148db-136e-44eb-b205-c55397a37fdd tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1681 microversion: 2.1 time: 0.317587 Oct 16 01:23:53.022967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2428/4723] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:52 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1681 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:53.198782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:53.200057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:53.214284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:53.215387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:53.216662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:53.217630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:53.218407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:53.219177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:53.418789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:53.419544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:53.432117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:53.432938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:53.436195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:53.437184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:53.437824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:53.439701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:53.936992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:53.946785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:53.956069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2caadb1a-f8f3-446b-8fef-a1aea7385c11 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.541916 Oct 16 01:23:53.956655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2429/4724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:53 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:53.961876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:53.962694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:53.963681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c25b11c-0462-4870-9bf8-4e03378191a7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1317 microversion: 2.1 time: 0.769298 Oct 16 01:23:53.965490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2296/4725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:53 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:53.971515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:53.972201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:53.972997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:53.973876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:53.974531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:53.975161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:54.050314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:54.051231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:54.060505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:54.061956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:54.062395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:54.065239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:54.065895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:54.068301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:54.129307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:54.129818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:54.130324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:54.130794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lazy-loading 'fault' on Instance uuid f8b35480-ba38-4c33-bfa8-e63c3eafbeec {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:23:54.197133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:54.201470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:54.212818 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82233199-831b-4d24-a46d-1751cec7a44d tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.251496 Oct 16 01:23:54.212818 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2430/4726] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:53 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:54.229629 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ccd1b72-b554-41c4-a223-55e3ab02814d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 200 len: 1330 microversion: 2.1 time: 0.188394 Oct 16 01:23:54.241666 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2297/4727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:54 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 1330 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:54.542402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-281a1c38-e229-4f1e-96cc-f60c9587fa18 req-bf9a5fbf-4483-4680-8058-fc069e86fd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b35480-ba38-4c33-bfa8-e63c3eafbeec", "name": "network-vif-deleted", "tag": "22ac8bf9-7ba3-4496-838e-9f0b26eada5a"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:54.556787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-281a1c38-e229-4f1e-96cc-f60c9587fa18 req-bf9a5fbf-4483-4680-8058-fc069e86fd87 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:54.556787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-281a1c38-e229-4f1e-96cc-f60c9587fa18 req-bf9a5fbf-4483-4680-8058-fc069e86fd87 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:54.556787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-281a1c38-e229-4f1e-96cc-f60c9587fa18 req-bf9a5fbf-4483-4680-8058-fc069e86fd87 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:54.569075 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-281a1c38-e229-4f1e-96cc-f60c9587fa18 req-bf9a5fbf-4483-4680-8058-fc069e86fd87 service nova] Creating event network-vif-deleted:22ac8bf9-7ba3-4496-838e-9f0b26eada5a for instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec on n-h1-master-1 Oct 16 01:23:54.578169 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-281a1c38-e229-4f1e-96cc-f60c9587fa18 req-bf9a5fbf-4483-4680-8058-fc069e86fd87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039894 Oct 16 01:23:54.579765 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2431/4728] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:23:54.989693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:54.990347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:54.997927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:54.998755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:55.003341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:55.005226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:55.006355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:55.006491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:55.007075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:55.007866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:55.008035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:55.008739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:55.008875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:55.009198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:55.009767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:55.010260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:55.322369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:55.325417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:55.331234 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-db7aebea-1c57-448a-8213-50fc3fcfb0f1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1317 microversion: 2.1 time: 0.341207 Oct 16 01:23:55.331860 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2432/4729] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:54 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:55.334074 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ade8164d-98c0-4d47-866a-5510120b110f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.350711 Oct 16 01:23:55.334726 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2298/4730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:54 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:55.338248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:55.338868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:55.340906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:55.341741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:55.345272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:55.345782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:55.346225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:55.346956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:55.347482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:55.347912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:55.349374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:55.350105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:55.350652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:55.351602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:55.352793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:55.353478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:55.368204 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec HTTP/1.1 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: exception: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'f8b35480-ba38-4c33-bfa8-e63c3eafbeec'} Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:23:55.370352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:55.375646 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:23:55.375646 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:23:55.375646 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:23:55.375646 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:23:55.375646 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:23:55.375646 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:23:55.375646 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:23:55.377765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:23:55.378977 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2420cf56-3584-4ff7-93b9-86eb6abebea2 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 404 len: 111 microversion: 2.1 time: 0.043062 Oct 16 01:23:55.380066 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2299/4731] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:55 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:23:55.389279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19468e41-efe9-4310-884b-98662c3afd55 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '.version_select at 0x7fd64e876310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:55.409859 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19468e41-efe9-4310-884b-98662c3afd55 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-439365635" status: 202 len: 0 microversion: 2.1 time: 0.024181 Oct 16 01:23:55.410519 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2300/4732] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Oct 16 01:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-439365635 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:23:55.499280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:55.509378 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d7bdb88-ff3d-4de9-bb87-d2d8ee955b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.175796 Oct 16 01:23:55.511185 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2433/4733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:55 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:56.071152 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:56.078629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b79899d-ef9f-4a1e-98e9-15c3b17208d4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: .version_select at 0x7fd6527a55e0>, body: {"keypair": {"name": "tempest-keypair-2040644614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq1AiJYJmpWuP5sAIJ5mOgJRDm1Jk+0yCoE+7nKI5KFI7PfEDuLSaEMdeM6Z97t5jWA8v82i+J1xW7PxcGsSzbaEsvZSzUWhdXJjY4idse73LbU/nl4SWocn/ZToCLpcg=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:56.103711 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3b79899d-ef9f-4a1e-98e9-15c3b17208d4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for project e664ea80daaf450886978f25b2d9e373. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:23:56.109562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3b79899d-ef9f-4a1e-98e9-15c3b17208d4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for user d5e97960c4eb488b900951e0898f34c8 and project e664ea80daaf450886978f25b2d9e373. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:23:56.140809 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b79899d-ef9f-4a1e-98e9-15c3b17208d4 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072025 Oct 16 01:23:56.141613 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2301/4734] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:23:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:56.244180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eff9ac7a-1965-4a48-8768-ac7b6b33b2dd"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:56.247665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:56.249977 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:56.250699 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:56.261157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:56.261915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:56.262770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:56.264503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:56.265536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:56.266420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:56.358947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:56.359625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:56.366112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:56.366855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:56.367502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:56.368869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:56.369329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:56.369754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:56.650607 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-529bbcc8-bec7-4893-812e-8ab67dae90b5 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412106 Oct 16 01:23:56.656878 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2434/4735] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:23:56 2022] POST /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:56.657054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:56.664916 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7527a0a-fa5a-4599-b413-8391f5a614d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1317 microversion: 2.1 time: 0.313607 Oct 16 01:23:56.667146 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2302/4736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:56 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:56.683311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:56.684833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:56.688475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:56.690985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:56.705594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:56.706221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:56.706728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:56.707458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:56.710200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:56.710816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:56.711456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:56.712823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:56.713206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:56.717270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:56.717959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:56.718733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:57.006210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:57.007924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:57.017178 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e769339-f992-4841-a432-e05bcc887548 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.363737 Oct 16 01:23:57.018305 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2435/4737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:56 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:57.028160 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4371c41-c4a3-4ed4-b28a-0d1a289e6beb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.346366 Oct 16 01:23:57.029167 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2303/4738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:56 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:57.700987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:57.702482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:57.712685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:57.713180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:57.713626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:57.714325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:57.731687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:57.732340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:57.931638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:57.945132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1386853371", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52e8b52a-a014-46fd-b3eb-a7709906aae7"}], "security_groups": [{"name": "tempest-securitygroup--464980367"}], "key_name": "tempest-keypair-2040644614", "user_data": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:57.952811 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-349f94e5-b361-4edb-b3ef-0afc13ac85a5 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1317 microversion: 2.1 time: 0.257753 Oct 16 01:23:57.953870 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2436/4739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:57 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:58.048353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:58.048353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:58.061639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.068297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.069042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:58.071784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.074327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.075528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:58.154781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] validate_networks() for [('52e8b52a-a014-46fd-b3eb-a7709906aae7', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:23:58.566843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:58.582152 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6cefd506-927d-4e47-82ad-576be8ace05d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.540126 Oct 16 01:23:58.596467 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2437/4740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:58 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:58.609019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:58.609804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:58.619011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.619580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.620221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:58.621300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.621815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.622286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:58.851061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:23:58.852191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:23:58.852936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:23:58.853585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:23:58.854220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:23:58.865883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:58.869616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.870366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.871029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:58.871961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.873695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.874344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:58.876539 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7fe82cd8-2b72-4323-8276-092640b7ed87 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.275638 Oct 16 01:23:58.877890 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2438/4741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:58 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:23:58.882429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1e902c5d-1e2c-43de-bdff-67ffd7eb22c5 req-fc582d7e-ea9f-4296-b75d-d729a91c0db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c78106-efc9-4912-b435-0d7aa5f6221a", "name": "network-vif-plugged", "status": "completed", "tag": "9c082ef9-aaa7-4b10-982a-b5749b418617"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:23:58.892631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e902c5d-1e2c-43de-bdff-67ffd7eb22c5 req-fc582d7e-ea9f-4296-b75d-d729a91c0db6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.893541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e902c5d-1e2c-43de-bdff-67ffd7eb22c5 req-fc582d7e-ea9f-4296-b75d-d729a91c0db6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.894152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e902c5d-1e2c-43de-bdff-67ffd7eb22c5 req-fc582d7e-ea9f-4296-b75d-d729a91c0db6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:58.911424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1e902c5d-1e2c-43de-bdff-67ffd7eb22c5 req-fc582d7e-ea9f-4296-b75d-d729a91c0db6 service nova] Creating event network-vif-plugged:9c082ef9-aaa7-4b10-982a-b5749b418617 for instance b2c78106-efc9-4912-b435-0d7aa5f6221a on n-h2-master-1 Oct 16 01:23:58.912032 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for project e664ea80daaf450886978f25b2d9e373. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:23:58.917186 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1e902c5d-1e2c-43de-bdff-67ffd7eb22c5 req-fc582d7e-ea9f-4296-b75d-d729a91c0db6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038032 Oct 16 01:23:58.918398 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2439/4742] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:23:58.918528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Getting quotas for user d5e97960c4eb488b900951e0898f34c8 and project e664ea80daaf450886978f25b2d9e373. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:23:58.933127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:23:58.935571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:23:58.978160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:58.978867 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:58.986550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.988375 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b239acc-3087-4ef8-8ce8-1540e8a07a9a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.047712 Oct 16 01:23:58.990183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.990550 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2304/4743] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:23:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:23:58.993277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:58.994097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:58.994582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:58.996320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:59.003162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-34c4667e-ef9c-4776-85cd-1e3d9f2d6628 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:59.003877 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-34c4667e-ef9c-4776-85cd-1e3d9f2d6628 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:59.144097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-34c4667e-ef9c-4776-85cd-1e3d9f2d6628 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:59.156119 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-34c4667e-ef9c-4776-85cd-1e3d9f2d6628 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1242 microversion: 2.1 time: 0.157687 Oct 16 01:23:59.158000 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2305/4744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:58 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:59.347991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:59.352928 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:23:59.359351 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b9d1e0af-41ab-449e-a591-a11a3e9dfb9a tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1317 microversion: 2.1 time: 0.384517 Oct 16 01:23:59.360266 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2440/4745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:58 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:23:59.613689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:59.614323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:59.623252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:59.623634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:59.624083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:59.626536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:59.631046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:59.631572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:59.908782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:23:59.910110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:23:59.923033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:59.923700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:59.924142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:59.924839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:23:59.925299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:23:59.925723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:23:59.957916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:23:59.986356 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d83a5e4-ab07-46e7-a8dc-8d25fd1d561a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.376778 Oct 16 01:23:59.993135 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2306/4746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:59 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:00.182693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:00.183354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:00.194731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:00.195281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:00.196366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:00.197101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:00.197569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:00.198008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:00.304436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:00.315526 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-90aa308d-3a88-4c6a-a10f-673ebb8cbddc tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1294 microversion: 2.1 time: 0.137600 Oct 16 01:24:00.333051 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2307/4747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:00 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1294 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:00.383490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:00.384706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:00.386874 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:00.393745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:00.395332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:00.396030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:00.396984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:00.397667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:00.398323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:00.399202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:00.415045 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49b359cc-623b-432c-9783-945bc3171787 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.510445 Oct 16 01:24:00.430567 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2441/4748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:23:59 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:00.692604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:00.702892 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ca6fba4-70d6-4a30-bbcd-4ad07d27205d tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1317 microversion: 2.1 time: 0.323459 Oct 16 01:24:00.703525 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2308/4749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:00 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:00.935767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-36335da0-8236-4feb-aeea-78e4ad176f7d req-5adaf60c-39eb-4cd8-9605-8b2c57e447ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3156062e-3f97-4796-b94f-59674406826d", "name": "network-vif-plugged", "status": "completed", "tag": "a0ff4508-3815-4596-bcad-42c7786e1924"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:00.957745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-36335da0-8236-4feb-aeea-78e4ad176f7d req-5adaf60c-39eb-4cd8-9605-8b2c57e447ba service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:00.959146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-36335da0-8236-4feb-aeea-78e4ad176f7d req-5adaf60c-39eb-4cd8-9605-8b2c57e447ba service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:00.960242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-36335da0-8236-4feb-aeea-78e4ad176f7d req-5adaf60c-39eb-4cd8-9605-8b2c57e447ba service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:00.999992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-36335da0-8236-4feb-aeea-78e4ad176f7d req-5adaf60c-39eb-4cd8-9605-8b2c57e447ba service nova] Creating event network-vif-plugged:a0ff4508-3815-4596-bcad-42c7786e1924 for instance 3156062e-3f97-4796-b94f-59674406826d on n-h2-master-1 Oct 16 01:24:01.009481 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-36335da0-8236-4feb-aeea-78e4ad176f7d req-5adaf60c-39eb-4cd8-9605-8b2c57e447ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075328 Oct 16 01:24:01.011263 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2442/4750] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:24:01.022127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:01.023443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:01.032394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:01.033115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:01.033759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:01.034728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:01.035463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:01.036119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:01.128253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0c1daafc-7f1c-4764-85f2-c80d38cf514a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'create', calling method: .version_select at 0x7fd64ec063a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1435263857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9aJD9H4wkTygQwE/VjAvccW42Q7VyyKlWthhiXjT7E0YflSV7RVAS9cpNG7YtTtcOH27cIVPulmzPtyj6wsWWijvsj7B8oaaT6pYmR6UAzOuz7Vqw2n+v/s0hhzsRo1w=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:01.182053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-0c1daafc-7f1c-4764-85f2-c80d38cf514a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for project 0d53034488714fc8980132211d0d5c0b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:01.200818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-0c1daafc-7f1c-4764-85f2-c80d38cf514a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for user 88d5c0890ae64fd6aa7e7e547e9bf736 and project 0d53034488714fc8980132211d0d5c0b. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:01.221588 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:01.245021 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0c1daafc-7f1c-4764-85f2-c80d38cf514a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.121438 Oct 16 01:24:01.245639 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2443/4751] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:24:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:24:01.358945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:01.359716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:01.369351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:01.373546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:01.374067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:01.374861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:01.377225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:01.377682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:01.831509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:01.842035 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-96872da3-6ffd-4568-b47f-12e9456dfd9b tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1300 microversion: 2.1 time: 0.488428 Oct 16 01:24:01.857634 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2444/4752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:01 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1300 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:01.863638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:01.864265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:01.876952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:01.881968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:01.882471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:01.883486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:01.884263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:01.884683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:01.885116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:01.899203 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5dfef390-7da7-4f00-bf53-2cc2b5fcb2b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.881205 Oct 16 01:24:01.915124 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2309/4753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:01 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:01.931805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:01.932833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:01.946671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:01.950994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:01.951748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:01.952650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:01.953401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:01.953996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:02.385267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:02.402052 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5067a5d3-e7fc-4ed4-86c1-9062cafd8151 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.556934 Oct 16 01:24:02.403536 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2445/4754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:01 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:02.464220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:02.470833 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:02.485369 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-13cd7f43-34ea-4aef-8b6e-2a1137d08a0e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 200 len: 1505 microversion: 2.1 time: 0.568910 Oct 16 01:24:02.487980 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2310/4755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:01 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:02.521768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:02.560670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:02.576201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:02.577137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:02.577922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:02.578966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:02.579547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:02.580078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:02.865414 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:02.866228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:02.873196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:02.873694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:02.874349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:02.875276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:02.875911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:02.876506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:03.037136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:03.044921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:03.074131 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9c255ae3-8845-478f-adc3-8316b38469ba tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d" status: 200 len: 1317 microversion: 2.1 time: 0.564869 Oct 16 01:24:03.075315 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f7463e47-70b4-4082-b047-a4a7a316e4d0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1300 microversion: 2.1 time: 0.213909 Oct 16 01:24:03.080313 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2311/4756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:02 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1300 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:03.080837 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2446/4757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:02 2022] GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:03.108600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:03.109694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:03.165796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:03.173879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:03.179890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:03.186932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:03.189258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:03.193750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:03.444364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:03.456800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:03.494497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:03.495809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:03.496831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:03.498681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:03.499910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:03.501349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.001217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:04.012406 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-995981c1-1cf1-4606-bc30-11204a24d93a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.584470 Oct 16 01:24:04.026746 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2447/4758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:03 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:04.131046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:04.131664 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:04.155312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:04.156009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:04.156334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.157142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:04.157777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:04.158281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.166986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:04.196902 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-86705b8e-5900-4c6d-b357-cbe08b65bc07 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 1.110056 Oct 16 01:24:04.198709 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2312/4759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:03 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:04.208559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:04.209744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:04.224638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:04.225795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:04.229079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.231093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:04.232295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:04.233493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.628122 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:04.649877 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-44a714ba-f96c-4edd-8559-19b591ae1b9e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1367 microversion: 2.1 time: 0.446712 Oct 16 01:24:04.651352 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2313/4760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:04 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:04.654773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:04.659147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-403990893", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e6415be7-bd54-4fe3-b1f8-2dd9f6e782e6"}], "key_name": "tempest-TestNetworkBasicOps-1435263857", "security_groups": [{"name": "tempest-secgroup-smoke-692160103"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:04.669046 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6037fa16-f9d1-4a9f-9e20-cae63d284be6 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d" status: 200 len: 1506 microversion: 2.1 time: 0.544798 Oct 16 01:24:04.671619 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2448/4761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:04 2022] GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:04.700387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:04.700895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:04.710641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:04.711720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:04.712919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.713642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:04.714108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:04.714549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.761874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:24:04.856315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] validate_networks() for [('e6415be7-bd54-4fe3-b1f8-2dd9f6e782e6', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:24:04.877507 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7f86e58f-7bee-460b-8be4-813e78d57ad7 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d" status: 204 len: 0 microversion: 2.1 time: 0.181424 Oct 16 01:24:04.878282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2449/4762] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:24:04 2022] DELETE /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:24:04.889967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:04.891011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:04.897905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:04.898714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:04.899930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.900980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:04.901728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:04.902315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:04.956497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:24:05.069031 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c15227db-8c82-4a8c-baab-1ced3dabc67f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 204 len: 0 microversion: 2.1 time: 0.185715 Oct 16 01:24:05.070040 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2450/4763] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:24:04 2022] DELETE /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:24:05.080054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:05.080916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:05.089723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.090833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.091427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.092233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.094610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.096061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.469885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:05.482381 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-04370e93-8651-44d7-a771-f989308707ea tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.408667 Oct 16 01:24:05.484023 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2451/4764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:05 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:05.489164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:05.490021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:05.497187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.498196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.498865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.499976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.500454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.500916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.820113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:24:05.821203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:24:05.821607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:24:05.822908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:24:05.822908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:24:05.832535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.833031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.833612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.837415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:05.846476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.846676 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3109a455-c7e4-4e3f-83bd-8d6221a981d9 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d" status: 200 len: 1512 microversion: 2.1 time: 0.360250 Oct 16 01:24:05.847406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.848018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.859294 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2452/4765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:05 2022] GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:05.864369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:05.865090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:05.872272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.872968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.873871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.874943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.875521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for project 0d53034488714fc8980132211d0d5c0b. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:05.875762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.876301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.880717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for user 88d5c0890ae64fd6aa7e7e547e9bf736 and project 0d53034488714fc8980132211d0d5c0b. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:05.894364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:24:05.896705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:24:05.949563 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-229904ba-41c0-4b92-b094-a41f66ad51a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.296920 Oct 16 01:24:05.956391 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2314/4766] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:24:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:24:05.962809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:05.964261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:05.980083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.980653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.981406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:05.982041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:05.982564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:05.983558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:06.190514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:06.199092 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2e1df6ae-3517-4217-bad6-4072764aa05f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.338544 Oct 16 01:24:06.200376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2453/4767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:05 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:06.205089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b443acaa-4f1a-49cd-809b-2c56845d4c87 req-ea5dac1e-4a05-4845-8542-30ca438fafff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12931e29-f20a-423d-9473-94cca81d5ff5", "tag": "79e277f2-09d2-40c6-8432-70bd8c888740"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:06.221367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b443acaa-4f1a-49cd-809b-2c56845d4c87 req-ea5dac1e-4a05-4845-8542-30ca438fafff service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:06.222356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b443acaa-4f1a-49cd-809b-2c56845d4c87 req-ea5dac1e-4a05-4845-8542-30ca438fafff service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:06.223136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b443acaa-4f1a-49cd-809b-2c56845d4c87 req-ea5dac1e-4a05-4845-8542-30ca438fafff service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:06.236990 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b443acaa-4f1a-49cd-809b-2c56845d4c87 req-ea5dac1e-4a05-4845-8542-30ca438fafff service nova] Creating event network-changed:79e277f2-09d2-40c6-8432-70bd8c888740 for instance 12931e29-f20a-423d-9473-94cca81d5ff5 on n-h1-master-1 Oct 16 01:24:06.245498 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b443acaa-4f1a-49cd-809b-2c56845d4c87 req-ea5dac1e-4a05-4845-8542-30ca438fafff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043415 Oct 16 01:24:06.246686 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2454/4768] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:06.252810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f87ee18-fa06-413c-86db-c31dffdf3ff3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:06.253820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f87ee18-fa06-413c-86db-c31dffdf3ff3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:06.343554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f87ee18-fa06-413c-86db-c31dffdf3ff3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:06.352511 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f87ee18-fa06-413c-86db-c31dffdf3ff3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1248 microversion: 2.1 time: 0.103683 Oct 16 01:24:06.354023 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2455/4769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:06 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1248 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:06.430124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:06.438389 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5416b7e7-cf9e-4cb7-8b74-188597d43007 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1367 microversion: 2.1 time: 0.486915 Oct 16 01:24:06.438987 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2315/4770] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:05 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:06.507332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:06.508082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:06.515020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:06.515515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:06.516739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:06.517648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:06.518301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:06.518757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:06.665448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:06.674405 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aeddcfca-8733-43c0-989e-87c31e79eb52 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.171551 Oct 16 01:24:06.675234 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2456/4771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:06 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:06.873767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:06.874389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:06.880584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:06.881070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:06.881509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:06.882207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:06.882670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:06.883651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:07.062393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:07.072783 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0fb83ef0-a5c9-4da2-babc-651bb8bc1a5e tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d" status: 200 len: 1512 microversion: 2.1 time: 0.202720 Oct 16 01:24:07.073845 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2316/4772] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:06 2022] GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:07.221465 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:07.222108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:07.229503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:07.229994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:07.230429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:07.231162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:07.231622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:07.232155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:07.250486 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:07.371799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:07.379494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:07.379651 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-08dc7921-d563-4b86-bb02-0bc2659354fc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.161941 Oct 16 01:24:07.380111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:07.380271 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2457/4773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:07 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:07.389050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:07.389711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:07.390328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:07.391496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:07.392122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:07.392709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:07.499582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:07.509919 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-488d9e76-9b9c-43f4-bc7f-137c8f27105d tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1252 microversion: 2.1 time: 0.134729 Oct 16 01:24:07.511795 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2317/4774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:07 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1252 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:07.708328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:07.709451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:07.724801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:07.727936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:07.730403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:07.731639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:07.733745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:07.736107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:07.819705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:07.820891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:07.842909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:07.846308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:07.846839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:07.849523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:07.852551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:07.852681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:08.770820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:08.779383 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fae636e-fbef-4778-8431-e9f7bf1d1731 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 1.076195 Oct 16 01:24:08.783788 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2318/4775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:07 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:08.788624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:08.793893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:08.810307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:08.811103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:08.812429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:08.813463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:08.814091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:08.819784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:08.925873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:08.936399 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1dee9772-8aa6-486f-83ca-977cb2e451eb tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1367 microversion: 2.1 time: 1.478021 Oct 16 01:24:08.937734 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2458/4776] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:07 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1367 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:08.952873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:08.953758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:08.959888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:08.960640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:08.962274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:08.963200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:08.963819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:08.964533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:09.502447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:09.522557 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f1a8ef5-64ff-4348-9386-d571cf45a3d1 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d" status: 200 len: 1512 microversion: 2.1 time: 0.734545 Oct 16 01:24:09.527248 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2319/4777] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:08 2022] GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d => generated 1512 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:09.534232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:09.534709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:09.535982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:09.546239 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c597332-9b40-49f1-b68b-cf353def5bfc tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.607253 Oct 16 01:24:09.548544 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2459/4778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:08 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:09.561182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:09.561956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:09.562599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:09.563641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:09.564230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:09.564659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:09.569838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-300de7bf-1298-4be1-8881-dc8e566de209 req-4692d87f-cdf8-42ee-b31c-ff1d163965f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c78106-efc9-4912-b435-0d7aa5f6221a", "name": "network-vif-deleted", "tag": "9c082ef9-aaa7-4b10-982a-b5749b418617"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:09.583367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-300de7bf-1298-4be1-8881-dc8e566de209 req-4692d87f-cdf8-42ee-b31c-ff1d163965f0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:09.584152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-300de7bf-1298-4be1-8881-dc8e566de209 req-4692d87f-cdf8-42ee-b31c-ff1d163965f0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:09.584896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-300de7bf-1298-4be1-8881-dc8e566de209 req-4692d87f-cdf8-42ee-b31c-ff1d163965f0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:09.602337 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-300de7bf-1298-4be1-8881-dc8e566de209 req-4692d87f-cdf8-42ee-b31c-ff1d163965f0 service nova] Creating event network-vif-deleted:9c082ef9-aaa7-4b10-982a-b5749b418617 for instance b2c78106-efc9-4912-b435-0d7aa5f6221a on n-h2-master-1 Oct 16 01:24:09.607612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-300de7bf-1298-4be1-8881-dc8e566de209 req-4692d87f-cdf8-42ee-b31c-ff1d163965f0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041597 Oct 16 01:24:09.608221 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2460/4779] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:09.614563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e8320fa0-9ade-4e46-a907-660d7f37165d req-fb81ee74-089b-4416-bf75-910bedad719b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3156062e-3f97-4796-b94f-59674406826d", "name": "network-vif-deleted", "tag": "a0ff4508-3815-4596-bcad-42c7786e1924"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:09.629732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e8320fa0-9ade-4e46-a907-660d7f37165d req-fb81ee74-089b-4416-bf75-910bedad719b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:09.630610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e8320fa0-9ade-4e46-a907-660d7f37165d req-fb81ee74-089b-4416-bf75-910bedad719b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:09.631487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e8320fa0-9ade-4e46-a907-660d7f37165d req-fb81ee74-089b-4416-bf75-910bedad719b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:09.647994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e8320fa0-9ade-4e46-a907-660d7f37165d req-fb81ee74-089b-4416-bf75-910bedad719b service nova] Creating event network-vif-deleted:a0ff4508-3815-4596-bcad-42c7786e1924 for instance 3156062e-3f97-4796-b94f-59674406826d on n-h2-master-1 Oct 16 01:24:09.654102 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e8320fa0-9ade-4e46-a907-660d7f37165d req-fb81ee74-089b-4416-bf75-910bedad719b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044331 Oct 16 01:24:09.655327 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2461/4780] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:09.745423 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:09.763303 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-66c1e914-29ab-430b-b95f-90015e5352ee tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1306 microversion: 2.1 time: 0.229883 Oct 16 01:24:09.765648 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2320/4781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:09 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:09.819349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:09.822123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:09.852034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:09.852804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:09.853275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:09.854063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:09.854533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:09.854996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:09.970016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:09.970632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:09.978252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:09.984382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:09.985016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:09.987326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:09.988448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:09.989990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.273115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:10.284701 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba19ace1-0ad3-421c-bec8-9fc0bc7ae645 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1507 microversion: 2.1 time: 0.476465 Oct 16 01:24:10.291263 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2462/4782] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:09 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:10.296274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e654ca7a-c765-49fd-81b7-2351a462f39e req-ece42cfc-50f9-44ab-9216-74b53096a77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12931e29-f20a-423d-9473-94cca81d5ff5", "name": "network-vif-plugged", "status": "completed", "tag": "79e277f2-09d2-40c6-8432-70bd8c888740"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:10.306244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e654ca7a-c765-49fd-81b7-2351a462f39e req-ece42cfc-50f9-44ab-9216-74b53096a77a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:10.307009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e654ca7a-c765-49fd-81b7-2351a462f39e req-ece42cfc-50f9-44ab-9216-74b53096a77a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:10.307610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e654ca7a-c765-49fd-81b7-2351a462f39e req-ece42cfc-50f9-44ab-9216-74b53096a77a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.320574 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e654ca7a-c765-49fd-81b7-2351a462f39e req-ece42cfc-50f9-44ab-9216-74b53096a77a service nova] Creating event network-vif-plugged:79e277f2-09d2-40c6-8432-70bd8c888740 for instance 12931e29-f20a-423d-9473-94cca81d5ff5 on n-h1-master-1 Oct 16 01:24:10.326475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e654ca7a-c765-49fd-81b7-2351a462f39e req-ece42cfc-50f9-44ab-9216-74b53096a77a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033676 Oct 16 01:24:10.327858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2463/4783] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:10.383685 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:10.402955 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2ba14bb1-250d-4ca1-8d06-3d18f2eb80b7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1367 microversion: 2.1 time: 0.438931 Oct 16 01:24:10.424231 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2321/4784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:09 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:10.556761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:10.559411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:10.571078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:10.571585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:10.572027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.572774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:10.577203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:10.577807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.583056 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:10.585142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:10.603302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:10.603814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:10.604257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.604979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:10.605445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:10.605879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.624425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:10.625489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:10.626245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.627304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lazy-loading 'fault' on Instance uuid 3156062e-3f97-4796-b94f-59674406826d {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:24:10.687992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baca0537d1844a8ea771011a6c062b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ff4a0b6c34c4bbfd6e31f32967d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:10.700796 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd40d0a8-4c3f-4323-8a2a-0f1e5cf9f62f tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d" status: 200 len: 1307 microversion: 2.1 time: 0.151124 Oct 16 01:24:10.702462 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2464/4785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:10 2022] GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:10.793797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:10.794406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:10.807039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:10.808811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:10.809416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.812072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:10.812562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:10.813005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:10.825668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:10.839785 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fc59b318-d11b-4a9c-86af-f4ad43d44df7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.268901 Oct 16 01:24:10.841063 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2322/4786] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:10 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:10.987977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:10.997371 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78a1429d-a6dd-4430-81bd-337d3124f2c4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1373 microversion: 2.1 time: 0.207550 Oct 16 01:24:10.998202 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2465/4787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:10 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:11.310181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:11.310795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:11.317991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.318480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.318964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.319895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.321662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.321880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.440058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:11.440814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:11.448350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.448946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.449390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.450097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.450580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.451188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.471470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:11.481177 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7f632cc3-1bcc-4f3a-968a-1d82303abd79 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1528 microversion: 2.1 time: 0.175111 Oct 16 01:24:11.482508 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2323/4788] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:11 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1528 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:11.615298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:11.623664 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fca36718-3137-40ff-9917-0edc958e5763 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1367 microversion: 2.1 time: 0.195549 Oct 16 01:24:11.624252 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2466/4789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:11 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:11.643477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e4140088-4452-497b-b8fb-305a03aa84f6 req-738dfdc0-494d-4b23-9910-591d57ff8ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d8ca59-64bb-4786-8831-91317c83f5ad", "tag": "3ab7dfee-6241-4295-ab7f-04a4781bab69"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:11.656665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e4140088-4452-497b-b8fb-305a03aa84f6 req-738dfdc0-494d-4b23-9910-591d57ff8ae8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.662556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e4140088-4452-497b-b8fb-305a03aa84f6 req-738dfdc0-494d-4b23-9910-591d57ff8ae8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.663338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e4140088-4452-497b-b8fb-305a03aa84f6 req-738dfdc0-494d-4b23-9910-591d57ff8ae8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.676503 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e4140088-4452-497b-b8fb-305a03aa84f6 req-738dfdc0-494d-4b23-9910-591d57ff8ae8 service nova] Creating event network-changed:3ab7dfee-6241-4295-ab7f-04a4781bab69 for instance 22d8ca59-64bb-4786-8831-91317c83f5ad on n-h1-master-1 Oct 16 01:24:11.683172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e4140088-4452-497b-b8fb-305a03aa84f6 req-738dfdc0-494d-4b23-9910-591d57ff8ae8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043321 Oct 16 01:24:11.686394 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2324/4790] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:11.729431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:11.730051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: 3156062e-3f97-4796-b94f-59674406826d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:11.736473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.737049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.737562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.738341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.739062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.739726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.754700 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] HTTP exception thrown: Instance 3156062e-3f97-4796-b94f-59674406826d could not be found. Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Request method failure captured: Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d HTTP/1.1 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS10Ht8WqM7PbJxQCFrdeXAp7U2oXozoL1AiBsBvOOOJ0wYJxbKxfZEQlVHJVQAKMCsBM1rI1mjol1d-r7e5anL2tNNWzfA8FlexVberZf2ubf_L8QLXymDapV0k2QtU45_h7KsA-eU3RVJJmHmwBfxLUn7UGndgy5Sge3sNV71BbtCQ Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 918ff4a0b6c34c4bbfd6e31f32967d70 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-MultipleCreateTestJSON-1850966510 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_918ff4a0b6c34c4bbfd6e31f32967d70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/918ff4a0b6c34c4bbfd6e31f32967d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/918ff4a0b6c34c4bbfd6e31f32967d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/918ff4a0b6c34c4bbfd6e31f32967d70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-MultipleCreateTestJSON-1850966510 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 918ff4a0b6c34c4bbfd6e31f32967d70 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1850966510 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-MultipleCreateTestJSON-1850966510-project Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: baca0537d1844a8ea771011a6c062b30 Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-MultipleCreateTestJSON-1850966510-project Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 3156062e-3f97-4796-b94f-59674406826d could not be found. Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '3156062e-3f97-4796-b94f-59674406826d'} Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3156062e-3f97-4796-b94f-59674406826d could not be found. Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3156062e-3f97-4796-b94f-59674406826d could not be found. Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:11.758787 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.763771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:11.763771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:11.763771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:11.763771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:24:11.763771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:24:11.763771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3156062e-3f97-4796-b94f-59674406826d could not be found. Oct 16 01:24:11.763771 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.765326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Returning 404 to user: Instance 3156062e-3f97-4796-b94f-59674406826d could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:24:11.766491 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-206b7a46-78cf-4eed-928b-a3141c59ee47 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d" status: 404 len: 111 microversion: 2.1 time: 0.042434 Oct 16 01:24:11.767631 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2467/4791] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:11 2022] GET /compute/v2.1/servers/3156062e-3f97-4796-b94f-59674406826d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:24:11.778403 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:11.780412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] [instance: b2c78106-efc9-4912-b435-0d7aa5f6221a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:11.790575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.791334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.791990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.792918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.793446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.794094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.817380 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] HTTP exception thrown: Instance b2c78106-efc9-4912-b435-0d7aa5f6221a could not be found. Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Request method failure captured: Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a HTTP/1.1 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS10Ht8WqM7PbJxQCFrdeXAp7U2oXozoL1AiBsBvOOOJ0wYJxbKxfZEQlVHJVQAKMCsBM1rI1mjol1d-r7e5anL2tNNWzfA8FlexVberZf2ubf_L8QLXymDapV0k2QtU45_h7KsA-eU3RVJJmHmwBfxLUn7UGndgy5Sge3sNV71BbtCQ Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 918ff4a0b6c34c4bbfd6e31f32967d70 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-MultipleCreateTestJSON-1850966510 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_918ff4a0b6c34c4bbfd6e31f32967d70", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/918ff4a0b6c34c4bbfd6e31f32967d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/918ff4a0b6c34c4bbfd6e31f32967d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/918ff4a0b6c34c4bbfd6e31f32967d70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-MultipleCreateTestJSON-1850966510 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 918ff4a0b6c34c4bbfd6e31f32967d70 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1850966510 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-MultipleCreateTestJSON-1850966510-project Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: baca0537d1844a8ea771011a6c062b30 Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-MultipleCreateTestJSON-1850966510-project Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: exception: Instance b2c78106-efc9-4912-b435-0d7aa5f6221a could not be found. Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'b2c78106-efc9-4912-b435-0d7aa5f6221a'} Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c78106-efc9-4912-b435-0d7aa5f6221a could not be found. Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c78106-efc9-4912-b435-0d7aa5f6221a could not be found. Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:11.820389 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.825760 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:11.825760 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:11.825760 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:11.825760 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:24:11.825760 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:24:11.825760 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c78106-efc9-4912-b435-0d7aa5f6221a could not be found. Oct 16 01:24:11.825760 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:11.827905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] Returning 404 to user: Instance b2c78106-efc9-4912-b435-0d7aa5f6221a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:24:11.829014 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d15c0d8-1fd1-4a83-8bed-ee0588cb6727 tempest-MultipleCreateTestJSON-1850966510 tempest-MultipleCreateTestJSON-1850966510-project] 10.222.0.39 "GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a" status: 404 len: 111 microversion: 2.1 time: 0.057131 Oct 16 01:24:11.829802 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2325/4792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:11 2022] GET /compute/v2.1/servers/b2c78106-efc9-4912-b435-0d7aa5f6221a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:24:11.863594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:11.864471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:11.875782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.876290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.876762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:11.879674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:11.881579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:11.882161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:12.022853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:12.024288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:12.037048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:12.041046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:12.043360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:12.045590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:12.046300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:12.046734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:12.302664 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:12.311771 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7ac9481-ba04-4308-aabf-eb9b440023d0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.451920 Oct 16 01:24:12.323932 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2468/4793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:11 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:12.355282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:12.363790 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6cebbf1b-b8d5-44ed-9006-80de75cfdb32 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1373 microversion: 2.1 time: 0.346629 Oct 16 01:24:12.366962 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2326/4794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:12 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1373 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:12.503925 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:12.504530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:12.511919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:12.512416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:12.513049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:12.513758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:12.514221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:12.515188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:12.648611 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:12.649237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:12.656481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:12.656980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:12.657645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:12.658549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:12.659329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:12.659941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:12.787452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:12.796977 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4106438e-aabd-4fc2-ac16-d8e7e7180d42 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1528 microversion: 2.1 time: 0.296677 Oct 16 01:24:12.811262 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2469/4795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:12 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1528 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:12.929377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:12.939362 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88a8465e-195c-4a74-8b25-cd4233d80126 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1557 microversion: 2.1 time: 0.294543 Oct 16 01:24:12.939953 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2327/4796] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:12 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1557 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:12.963313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:12.963867 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:12.970216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:12.971007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:12.972417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:12.973326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:12.974335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:12.974335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:13.098249 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c21d0492-706e-4b38-8abe-ef1e96da5bbe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139847 Oct 16 01:24:13.099459 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2470/4797] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:24:12 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:13.337030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:13.338341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:13.358636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:13.366192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:13.369139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:13.370136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:13.370633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:13.371092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:13.387854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:13.388495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:13.406470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:13.407266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:13.407887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:13.408803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:13.409494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:13.410144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:13.874210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:13.891590 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dade3203-4f3e-4a57-acf6-dbc15954d48b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.559406 Oct 16 01:24:13.895512 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2328/4798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:13 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:13.913605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:13.916000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:13.954162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:13.955072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:13.957209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:13.958847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:13.961700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:13.963649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:14.038008 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:14.433463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:14.455673 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2655c64-1c36-41d6-926a-02113f21935c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1373 microversion: 2.1 time: 1.071471 Oct 16 01:24:14.465518 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2471/4799] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:13 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1373 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:14.824248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:14.840758 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-66e39dbb-460c-4e12-807b-3d9b89f98be4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.942529 Oct 16 01:24:14.843401 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2329/4800] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:13 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:14.924563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:14.925172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:14.942226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:14.944957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:14.945467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:14.953106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9e1da404-216a-49a2-ac7e-514154e8c851 req-c479ad6a-f581-4dd3-9519-03c282155bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3132186d-4372-4b1c-a4c3-618f2c9a0c62", "name": "network-vif-plugged", "status": "completed", "tag": "cfbb06bb-88ce-4e59-9ef5-5154424dcb03"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:14.962516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:14.963050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:14.963495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:15.000766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9e1da404-216a-49a2-ac7e-514154e8c851 req-c479ad6a-f581-4dd3-9519-03c282155bf1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:15.010984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9e1da404-216a-49a2-ac7e-514154e8c851 req-c479ad6a-f581-4dd3-9519-03c282155bf1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:15.011717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9e1da404-216a-49a2-ac7e-514154e8c851 req-c479ad6a-f581-4dd3-9519-03c282155bf1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:15.047793 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9e1da404-216a-49a2-ac7e-514154e8c851 req-c479ad6a-f581-4dd3-9519-03c282155bf1 service nova] Creating event network-vif-plugged:cfbb06bb-88ce-4e59-9ef5-5154424dcb03 for instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 on n-h1-master-1 Oct 16 01:24:15.064560 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9e1da404-216a-49a2-ac7e-514154e8c851 req-c479ad6a-f581-4dd3-9519-03c282155bf1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115868 Oct 16 01:24:15.065683 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2330/4801] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:15.428431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-edf36945-df1d-497d-a4c2-2725314a7be5 req-b09be5f6-a7b4-417d-b9f6-9a745f333154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12931e29-f20a-423d-9473-94cca81d5ff5", "tag": "79e277f2-09d2-40c6-8432-70bd8c888740"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:15.453418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edf36945-df1d-497d-a4c2-2725314a7be5 req-b09be5f6-a7b4-417d-b9f6-9a745f333154 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:15.453866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edf36945-df1d-497d-a4c2-2725314a7be5 req-b09be5f6-a7b4-417d-b9f6-9a745f333154 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:15.454305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-edf36945-df1d-497d-a4c2-2725314a7be5 req-b09be5f6-a7b4-417d-b9f6-9a745f333154 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:15.522575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-edf36945-df1d-497d-a4c2-2725314a7be5 req-b09be5f6-a7b4-417d-b9f6-9a745f333154 service nova] Creating event network-changed:79e277f2-09d2-40c6-8432-70bd8c888740 for instance 12931e29-f20a-423d-9473-94cca81d5ff5 on n-h1-master-1 Oct 16 01:24:15.541250 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-edf36945-df1d-497d-a4c2-2725314a7be5 req-b09be5f6-a7b4-417d-b9f6-9a745f333154 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119810 Oct 16 01:24:15.553823 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2331/4802] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:15.594272 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:15.598072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:15.632189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:15.634168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:15.634836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:15.635780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:15.636479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:15.637117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:15.841880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:15.856615 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:15.857214 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c5acab10-b4f4-4e42-93c8-e7a9803efc5f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.937127 Oct 16 01:24:15.858011 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2472/4803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:14 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:15.871829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:15.872678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:15.888003 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=18 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:15.890180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:15.890882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:15.891853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:15.892809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:15.893452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:15.921542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:16.249255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:16.265039 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c54df10c-279a-4ad0-a97f-5c58e7eacd70 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.395219 Oct 16 01:24:16.271749 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2473/4804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:15 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:16.288387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:16.290975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:16.322212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:16.322712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:16.323170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:16.326373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:16.328206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:16.331067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:16.352772 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:16.437864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lazy-loading 'flavor' on Instance uuid 53610cf8-c016-4fa4-bd6e-178818cc4ab3 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:24:16.766392 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:16.780908 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-42f6686e-817f-4e68-a79b-2c6f0455e203 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1373 microversion: 2.1 time: 1.215681 Oct 16 01:24:16.783489 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2332/4805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:15 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1373 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:16.859026 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:16.886961 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e5c4885-1a35-48e4-897f-d5746de7722d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/action" status: 200 len: 32 microversion: 2.1 time: 0.613472 Oct 16 01:24:16.887578 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2474/4806] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:24:16 2022] POST /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/action => generated 32 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:24:16.891562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:16.894526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:16.918898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:16.922193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:16.923338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:16.923847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:16.924559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:16.927704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:16.929164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:16.932484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:16.961542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:16.962123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:16.962559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:16.963290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:16.979049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:16.982281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:17.581085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:17.596532 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1deb7c4-e296-421d-b6ab-72f8e72a0e78 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.714852 Oct 16 01:24:17.598740 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2333/4807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:16 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:17.611793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:17.614593 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:17.615504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:17.627535 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1328d67-9e6d-4537-9a5a-8146338d0019 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.732686 Oct 16 01:24:17.629807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:17.630445 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2475/4808] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:16 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:17.631795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:17.633752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:17.635081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:17.635945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:17.636615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:17.810602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:17.811518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:17.824206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:17.828994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:17.829618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:17.830540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:17.831041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:17.835403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:18.034972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:18.045145 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3fdb650a-178a-4795-b7e3-ea94ebdbcfc4 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.444974 Oct 16 01:24:18.064727 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2334/4809] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:17 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:18.234426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:18.250198 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2caa3ce4-567a-44f7-8293-6646740e9137 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1373 microversion: 2.1 time: 0.436527 Oct 16 01:24:18.255181 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2476/4810] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:17 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1373 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:18.394348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-36af88ed-c532-4747-9762-f9d9aa725763 req-4c6c57dd-5f38-442a-ab4f-00f9325bd957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d8ca59-64bb-4786-8831-91317c83f5ad", "name": "network-vif-plugged", "status": "completed", "tag": "3ab7dfee-6241-4295-ab7f-04a4781bab69"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:18.425217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-36af88ed-c532-4747-9762-f9d9aa725763 req-4c6c57dd-5f38-442a-ab4f-00f9325bd957 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:18.429119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-36af88ed-c532-4747-9762-f9d9aa725763 req-4c6c57dd-5f38-442a-ab4f-00f9325bd957 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:18.430174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-36af88ed-c532-4747-9762-f9d9aa725763 req-4c6c57dd-5f38-442a-ab4f-00f9325bd957 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:18.476481 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-36af88ed-c532-4747-9762-f9d9aa725763 req-4c6c57dd-5f38-442a-ab4f-00f9325bd957 service nova] Creating event network-vif-plugged:3ab7dfee-6241-4295-ab7f-04a4781bab69 for instance 22d8ca59-64bb-4786-8831-91317c83f5ad on n-h1-master-1 Oct 16 01:24:18.490997 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-36af88ed-c532-4747-9762-f9d9aa725763 req-4c6c57dd-5f38-442a-ab4f-00f9325bd957 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101092 Oct 16 01:24:18.491885 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2335/4811] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:18.625828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:18.626839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:18.639244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:18.640090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:18.640875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:18.641812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:18.642478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:18.643178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:18.659684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:18.660484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:18.680001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:18.683529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:18.703181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:18.704000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:18.704500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:18.713884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:19.078013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:19.088098 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1c38647a-4e63-4adc-b379-21c79f5a662f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.468243 Oct 16 01:24:19.096161 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2477/4812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:18 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:19.111650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:19.112661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:19.113452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:19.130506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:19.132692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:19.133402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:19.134010 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c84b701f-c7a3-4f31-afed-d409956ecc7c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.478110 Oct 16 01:24:19.134746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:19.137121 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2336/4813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:18 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:19.151241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:19.151942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:19.284291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:19.285157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:19.294037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:19.294782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:19.295417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:19.296581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:19.297361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:19.297943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:19.694326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:19.707781 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b716d86-b683-425f-96c3-56e081d58a0f tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.609017 Oct 16 01:24:19.708392 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2478/4814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:19 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:19.740874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:19.753562 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d6d9e63-eab8-4994-b2b7-3cb91f252281 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1373 microversion: 2.1 time: 0.483706 Oct 16 01:24:19.754168 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2337/4815] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:19 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1373 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:20.122757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:20.124106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:20.165084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:20.166777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:20.175712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:20.179098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:20.180194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:20.182960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:20.184040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:20.184649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:20.185421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:20.186371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:20.187860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:20.189753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:20.192101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:20.194376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:20.504406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:20.517345 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc5f657e-22f8-4866-8ba3-98b51176f2d7 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.399070 Oct 16 01:24:20.531695 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2479/4816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:20 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:20.634053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:20.649319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ae5dc7eb-4046-4ee7-b124-e14e6b191a2e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.494156 Oct 16 01:24:20.650873 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2338/4817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:20 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:20.733877 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:20.735255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:20.752895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:20.756546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:20.757816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:20.758744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:20.759403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:20.761249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:20.782646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:20.783867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:20.802403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:20.803337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:20.805512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:20.806624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:20.808914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:20.809823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:21.107685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:21.118507 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cd01cde-0059-43f0-991f-88c16e2c7b53 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.388574 Oct 16 01:24:21.120494 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2480/4818] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:20 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:21.160777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:21.173779 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1303aa98-50d2-4a27-ae34-7b165c770d0c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1546 microversion: 2.1 time: 0.395510 Oct 16 01:24:21.176101 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2339/4819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:20 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1546 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:21.199255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:21.200152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:21.214330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:21.215475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:21.216628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:21.217699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:21.218370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:21.219105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:21.423661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:21.434389 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fb011f5b-54df-4d37-b79e-e5c181599b63 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1546 microversion: 2.1 time: 0.238522 Oct 16 01:24:21.446947 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2481/4820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:21 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:21.543462 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:21.549271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:21.551600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:21.552356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:21.552797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:21.553505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:21.553959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:21.554551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:21.674549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:21.675588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:21.691797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:21.697175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:21.700587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:21.703867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:21.705852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:21.707529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:21.796256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:21.806575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b14a009-7169-4abb-b562-2ea45b25a02d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.268121 Oct 16 01:24:21.807981 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2340/4821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:21 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:21.956406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:21.971489 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7f60f257-680c-4621-9df5-62428f8fe095 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.300678 Oct 16 01:24:21.973301 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2482/4822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:21 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:22.143444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:22.144058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:22.154341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:22.154857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:22.156728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:22.157641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:22.158448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:22.159085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:22.332246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:22.354871 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-faeb2e4d-8e38-4fad-8516-e9ecdeee5b02 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.202256 Oct 16 01:24:22.376678 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2341/4823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:22 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:22.802378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2014810236", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": "none"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:22.837731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:22.838362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:22.850152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:22.854312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:22.856654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:22.857443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:22.857912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:22.858357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:22.919193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:24:22.919931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:24:22.921312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:24:22.921978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:24:22.922602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:24:22.930552 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:22.942675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:22.943676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:22.944351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:22.946154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:22.947033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:22.947981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:22.992396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Getting quotas for project 7b9c69693c7d4ee595104571ec6843e6. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:23.002115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Getting quotas for user d6230942d9ee420a9c0c5fa203259f64 and project 7b9c69693c7d4ee595104571ec6843e6. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:23.019501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:24:23.022972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:24:23.115323 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-721cedee-40b5-4850-9d1a-abea6bf88dac tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.680524 Oct 16 01:24:23.116817 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2483/4824] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 16 01:24:23.134793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:23.136585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:23.145909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:23.146687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:23.147878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:23.149584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:23.150229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:23.150892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:23.986293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:23.999635 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-536e88a1-d191-4aa8-bfa0-311b1e1efab3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 1.163885 Oct 16 01:24:24.000445 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2342/4825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:22 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:24.021388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:24.022364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:24.029461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:24.030282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:24.031075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:24.032012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:24.032709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:24.033355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:24.215730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:24.247751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:24.249472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:24.250665 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3e42cf54-dd6a-4123-8df9-db7c1325a9e9 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1285 microversion: 2.47 time: 0.238328 Oct 16 01:24:24.251273 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2343/4826] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:24 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:24:24.255740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:24.256457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:24.262343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:24.277720 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a13090f8-0b43-4fb5-9a85-ab32987ebe18 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 1.158461 Oct 16 01:24:24.283469 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2484/4827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:23 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:24.287180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:24.289986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:24.291485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:24.295875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:24.296617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:24.297063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:24.644316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:24.654890 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c627e42f-8d9a-4d2d-a53d-f0fab2593ffe tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.402585 Oct 16 01:24:24.657147 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2344/4828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:24 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:25.029144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:25.029776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:25.043097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:25.048329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:25.049005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:25.049916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:25.050543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:25.062327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:25.283226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:25.283905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:25.307343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:25.309365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:25.311758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:25.312975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:25.315112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:25.317585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:25.460453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:25.474865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:25.480240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:25.482900 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-261627c0-0c21-45e7-98c4-1fadc07d3abc tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1333 microversion: 2.47 time: 0.208578 Oct 16 01:24:25.510752 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2345/4829] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:25 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1333 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:24:25.516912 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:25.517783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:25.524038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:25.525889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:25.526582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:25.527225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:25.528172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:25.528797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:25.529390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:25.548452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5b0993cb-1666-4f8c-8845-a0c57b93a296 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1533 microversion: 2.1 time: 0.524046 Oct 16 01:24:25.549065 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2485/4830] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:25 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1533 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:25.686551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:25.687382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:25.702553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:25.703461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:25.704105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:25.705047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:25.705708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:25.706328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:26.420357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:26.440923 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8aaecbce-1e78-45c0-bcaa-93622fe31152 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.923849 Oct 16 01:24:26.456125 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2346/4831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:25 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:26.505359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:26.520839 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da87924c-4759-461b-8957-293d65ffa292 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.844336 Oct 16 01:24:26.532708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:26.533750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:26.535453 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2486/4832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:25 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:26.564443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:26.571299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:26.573713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:26.575488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:26.576400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:26.577753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:26.580899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:26.584777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:26.585273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:26.586777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:26.587644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:26.588915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:26.589995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:26.591317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:26.913172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:26.919071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:26.936236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:26.936481 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-53d4d2b2-7ee5-4c40-a773-75580f0451ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.359785 Oct 16 01:24:26.937315 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2487/4833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:26 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:26.938248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:26.939870 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d14ccc05-9df1-4315-8e28-419a5767af96 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1339 microversion: 2.47 time: 0.425873 Oct 16 01:24:26.955910 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2347/4834] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:26 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1339 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:24:27.468889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:27.470647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:27.491708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:27.494245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:27.497350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:27.499753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:27.501528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:27.507052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:27.555878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:27.556756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:27.572441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:27.573533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:27.574339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:27.575794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:27.576464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:27.577101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:27.582171 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:27.886721 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:27.892983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:27.902180 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6167699b-1815-4c2a-a4b6-0a6dc0b7d927 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.351846 Oct 16 01:24:27.911425 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7557b253-7645-493b-89c3-9a3895bd58eb tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.447104 Oct 16 01:24:27.912954 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2488/4835] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:27 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:27.927482 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2348/4836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:27 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:27.970781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:27.971236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:27.975633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:27.977035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:27.998498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:27.999073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:27.999516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:28.000220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:28.000675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:28.001114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:28.015892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:28.016401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:28.016840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:28.017560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:28.018141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:28.027285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:28.350417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:28.358894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:28.360372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:28.362039 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2270a0c0-9560-437a-a3d1-6b26ac24a040 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1339 microversion: 2.47 time: 0.396264 Oct 16 01:24:28.399117 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2349/4837] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:27 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1339 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:24:28.601641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-056cea62-686b-4af5-9b48-9edb279c7b96 req-1dd687e9-17be-454b-927a-9b221452ba09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438", "name": "network-vif-plugged", "status": "completed", "tag": "ebf526f4-6d18-4e21-9c38-4219f2d56da2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:28.608413 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:28.638077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-056cea62-686b-4af5-9b48-9edb279c7b96 req-1dd687e9-17be-454b-927a-9b221452ba09 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:28.638855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-056cea62-686b-4af5-9b48-9edb279c7b96 req-1dd687e9-17be-454b-927a-9b221452ba09 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:28.639481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-056cea62-686b-4af5-9b48-9edb279c7b96 req-1dd687e9-17be-454b-927a-9b221452ba09 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:28.669103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:28.682395 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-056cea62-686b-4af5-9b48-9edb279c7b96 req-1dd687e9-17be-454b-927a-9b221452ba09 service nova] Creating event network-vif-plugged:ebf526f4-6d18-4e21-9c38-4219f2d56da2 for instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 on n-h2-master-1 Oct 16 01:24:28.684734 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1d4f9f4-ac04-4ab4-81b6-d550dd61d245 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.723989 Oct 16 01:24:28.685711 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2489/4838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:27 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:28.707528 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-056cea62-686b-4af5-9b48-9edb279c7b96 req-1dd687e9-17be-454b-927a-9b221452ba09 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109301 Oct 16 01:24:28.708467 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2350/4839] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:24:28.928720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:28.930140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:28.939185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:28.941087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:28.941792 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:28.943801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:28.944371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:28.946593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:28.947228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:28.949498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:28.959233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:28.959856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:28.960318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:28.961074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:28.961541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:28.974872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:29.728553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:29.741523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-96b6bd5c-18e8-472a-931f-5e3ea5a332db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.816985 Oct 16 01:24:29.748604 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2490/4840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:28 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:29.758297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:29.759910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:29.773982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:29.777427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:29.778098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:29.779030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:29.782465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:29.783205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:29.858166 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:29.870951 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-25623020-de42-4cd8-a99f-d82bfebbf1a2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.933725 Oct 16 01:24:29.871582 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2351/4841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:28 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:29.888940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:29.889546 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:29.916938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:29.917745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:29.918844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:29.929073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:29.930682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:29.931588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:29.938080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:29.953653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:29.956295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:29.963129 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ede0075-2d77-4780-a841-62617438c330 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1360 microversion: 2.47 time: 0.212316 Oct 16 01:24:29.981522 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2491/4842] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:29 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:24:29.996402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2055796035"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:30.001674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:30.026044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:30.031222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:30.032865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:30.033733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:30.035430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:30.039698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:30.048832 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:30.249570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:30.260836 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8b10e8e-ce1d-494a-ba7e-ad6dce769b67 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.387350 Oct 16 01:24:30.272152 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2352/4843] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:29 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:30.777004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:30.777486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:30.793783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:30.794200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:30.794649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:30.808159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:30.808445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:30.810931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:31.188296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:31.199821 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-10d7cf80-7c82-46a0-8b69-89fb93be05af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.427226 Oct 16 01:24:31.202427 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2353/4844] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:30 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:31.217876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:31.219497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:31.233299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:31.235004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:31.238340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:31.240099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:31.240828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:31.242651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:31.517099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:31.537275 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-54322c20-f24d-46fe-98df-3f5c1b275c21 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.332069 Oct 16 01:24:31.538826 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2354/4845] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:31 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:31.565741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:31.567346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:31.577545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:31.578509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:31.579242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:31.580316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:31.580936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:31.583017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:31.898943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:31.911996 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f13058ef-e489-4d41-84e2-0b8c3f569213 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.371020 Oct 16 01:24:31.912543 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2355/4846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:31 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:32.228217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:32.228913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:32.239454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:32.239971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:32.240421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:32.241143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:32.241782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:32.252584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:32.583186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:32.599725 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-26866e0a-7f33-43d2-beba-6ec71eed8144 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.377544 Oct 16 01:24:32.602205 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2356/4847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:32 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:32.607848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:32.608771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:32.615390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:32.616121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:32.624115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:32.625174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:32.625827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:32.626273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:32.974297 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:33.013426 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:33.024865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:33.039732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-40e55566-a4af-4a5c-9c26-2f438668f464 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.435264 Oct 16 01:24:33.040762 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2357/4848] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:32 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:33.049165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:33.049785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:33.067849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:33.069267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:33.070437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:33.071766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:33.072412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:33.073040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:33.361235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:33.377973 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c3149971-0182-4652-85fb-4269d7bc9306 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.335963 Oct 16 01:24:33.395020 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2358/4849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:33 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:33.637430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:33.638284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:33.654973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:33.655590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:33.656111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:33.657167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:33.657549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:33.657994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:33.958789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:33.969792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ee21d03-62ed-45b6-b38c-e89d768da798 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1523 microversion: 2.1 time: 0.337373 Oct 16 01:24:33.986430 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2359/4850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:33 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:34.071378 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:34.072000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:34.079904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:34.080652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:34.081361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:34.082232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:34.082847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:34.083448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:34.123215 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8377d5c9-2304-4b3f-b96a-0f780f154270 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "POST /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb/action" status: 202 len: 52 microversion: 2.47 time: 4.133444 Oct 16 01:24:34.124449 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2492/4851] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:24:29 2022] POST /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb/action => generated 52 bytes in 4135 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:24:34.139717 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:34.141008 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:34.148710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:34.149743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:34.150450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:34.151587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:34.152373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:34.153093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:34.183531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:24:34.343825 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1f57624-44b5-47fc-9760-39103d6a324d tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 204 len: 0 microversion: 2.47 time: 0.211011 Oct 16 01:24:34.345002 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2493/4852] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:24:34 2022] DELETE /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:24:34.360604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:34.361568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:34.366406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:34.368059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:34.368547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:34.369339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:34.370205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:34.371435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:34.372039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:34.376635 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5536781a-cb0e-443a-867d-34bcf3ac8997 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.309732 Oct 16 01:24:34.377245 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2360/4853] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:34 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:34.411651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:34.412370 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:34.425061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:34.426019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:34.426782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:34.427680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:34.428297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:34.428924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:34.543085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:34.565645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:34.568025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:34.572273 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c76d077a-ae75-4cfa-b6b8-3fa6b61c318c tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1366 microversion: 2.47 time: 0.220606 Oct 16 01:24:34.573481 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2494/4854] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:34 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:24:34.915101 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:34.927442 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c25906b9-9218-49cb-b41a-726048a5cdf8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.526800 Oct 16 01:24:34.928044 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2361/4855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:34 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:34.999474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:35.000096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:35.012522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:35.013002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:35.013444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:35.014143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:35.014604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:35.015061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:35.330942 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:35.340193 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-869e5803-7796-4974-a3cf-a93a442043a3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1505 microversion: 2.1 time: 0.345172 Oct 16 01:24:35.342223 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2495/4856] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:34 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:35.402455 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:35.403609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:35.418668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:35.419299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:35.420466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:35.424192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:35.427992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:35.428677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:35.602825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:35.603471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:35.616543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:35.617734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:35.618192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:35.618935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:35.619392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:35.619826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:35.637610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:35.649185 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-93eaa2a8-e81c-45ef-b63d-7cdbb221e099 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.252407 Oct 16 01:24:35.649799 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2362/4857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:35 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:35.713226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:35.723176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:35.725127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:35.726998 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eba0dcfe-27ba-437a-83d5-8c2cbd422337 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1366 microversion: 2.47 time: 0.127956 Oct 16 01:24:35.728296 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2496/4858] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:35 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:24:35.958110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:35.958878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:35.966480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:35.967408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:35.968017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:35.969060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:35.969710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:35.970349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:36.176045 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:36.191561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a76d2e05-a10a-4cc4-a692-5c3a2d8eb53e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.239855 Oct 16 01:24:36.192151 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2363/4859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:35 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:36.370744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:36.372048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:36.381918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:36.384387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:36.386386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:36.387357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:36.389179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:36.391164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:36.572834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:36.581041 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac1ad0e9-e94c-42e3-b15d-94facc10c69e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1505 microversion: 2.1 time: 0.215727 Oct 16 01:24:36.591753 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2497/4860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:36 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:36.688763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:36.689502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:36.703540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:36.704165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:36.705286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:36.707529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:36.708009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:36.708562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:36.755932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:36.757216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:36.770310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:36.774743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:36.775410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:36.776332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:36.776954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:36.777766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:36.880422 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:36.893822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:36.895373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:36.901668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6c8619ff-d470-4421-ba16-852026ead0b0 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1366 microversion: 2.47 time: 0.150229 Oct 16 01:24:36.902826 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2498/4861] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:36 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:24:36.931957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:36.946438 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0638d0ef-ae64-4f60-a483-18f6db147a90 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.276270 Oct 16 01:24:36.959547 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2364/4862] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:36 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:37.218967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:37.219716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:37.247037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:37.248384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:37.250742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:37.253116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:37.258802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:37.259658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:37.567089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:37.589590 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ffa1335d-6b66-40fb-9249-11b469c6e8a5 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.376511 Oct 16 01:24:37.590186 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2499/4863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:37 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:37.613426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:37.615346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:37.625712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:37.626458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:37.627100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:37.628085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:37.628876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:37.629564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:37.688546 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:37.870413 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:37.884543 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5dd4a7b6-65f5-4f60-9676-b766fc3971fa tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 200 len: 1508 microversion: 2.1 time: 0.282024 Oct 16 01:24:37.885400 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2365/4864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:37 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:37.907842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:37.908641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:37.916096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:37.916862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:37.917297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:37.918187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:37.918815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:37.920224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:37.928571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:37.931140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:37.948249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:37.948749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:37.949185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:37.949894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:37.950349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:37.952621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:37.996033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:24:38.017111 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Working on deleting snapshot 97705c89-758e-4986-a898-d5f7c8af6771 from shelved instance... Oct 16 01:24:38.031606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:38.032852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:38.033713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:38.045669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lazy-loading 'fault' on Instance uuid 5d482bef-8776-4fc4-bcee-eff72155c5eb {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:24:38.163263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:38.175726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:38.179270 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6230942d9ee420a9c0c5fa203259f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b9c69693c7d4ee595104571ec6843e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:38.181305 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b86e4419-f28a-42df-9bcf-622ae418d170 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 200 len: 1371 microversion: 2.47 time: 0.257097 Oct 16 01:24:38.195446 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2366/4865] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:37 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:24:38.212576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:38.214299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:38.222286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:38.223324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:38.224047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:38.225179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:38.228963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:38.230310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:38.549857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:38.563396 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b87f61ef-6450-44ef-a05e-54b94b637a88 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.363906 Oct 16 01:24:38.565198 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2367/4866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:38 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:38.615928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:38.616537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:38.627198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:38.627894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:38.636641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:38.637592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:38.638226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:38.638813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:38.947347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:38.958373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c378cdb8-ec57-4839-a73b-cda2bdbce594 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.345012 Oct 16 01:24:38.979861 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2368/4867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:38 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:39.214255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:39.215545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] [instance: 5d482bef-8776-4fc4-bcee-eff72155c5eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:39.222186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:39.222674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:39.223138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:39.223835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:39.224290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:39.224737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:39.255656 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] HTTP exception thrown: Instance 5d482bef-8776-4fc4-bcee-eff72155c5eb could not be found. Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Request method failure captured: Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb HTTP/1.1 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS11GPtY9XRUF5kFASZnRuAzhfhnGbwB-le_lk2tjDE1SO7-LuWcfU08vAeJ7vxIK2axEM2O7lcW5_0kp9Psz1xmyIwRRNSmsNXRZZOY0_2TSbR7cEAYUk1-caHVg6tbe7d3cnZJ542gwsShtfvYwHMhYqAQVJVyWhSTa_vsgVE9kV8U Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.47 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 7b9c69693c7d4ee595104571ec6843e6 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersAaction247Test-1357999806 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7b9c69693c7d4ee595104571ec6843e6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7b9c69693c7d4ee595104571ec6843e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b9c69693c7d4ee595104571ec6843e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b9c69693c7d4ee595104571ec6843e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersAaction247Test-1357999806 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 7b9c69693c7d4ee595104571ec6843e6 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersAaction247Test-1357999806 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersAaction247Test-1357999806-project Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d6230942d9ee420a9c0c5fa203259f64 Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersAaction247Test-1357999806-project Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 5d482bef-8776-4fc4-bcee-eff72155c5eb could not be found. Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5d482bef-8776-4fc4-bcee-eff72155c5eb'} Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d482bef-8776-4fc4-bcee-eff72155c5eb could not be found. Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d482bef-8776-4fc4-bcee-eff72155c5eb could not be found. Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:39.258342 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:39.263547 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:39.263547 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:39.263547 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:39.263547 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:39.263547 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:24:39.263547 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:24:39.263547 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d482bef-8776-4fc4-bcee-eff72155c5eb could not be found. Oct 16 01:24:39.263547 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:39.264867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] Returning 404 to user: Instance 5d482bef-8776-4fc4-bcee-eff72155c5eb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:24:39.265899 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c8e8302-9197-42eb-a3d0-e5866986af31 tempest-ServersAaction247Test-1357999806 tempest-ServersAaction247Test-1357999806-project] 10.222.0.39 "GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb" status: 404 len: 111 microversion: 2.47 time: 0.056749 Oct 16 01:24:39.266631 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2369/4868] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:24:39 2022] GET /compute/v2.1/servers/5d482bef-8776-4fc4-bcee-eff72155c5eb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:24:39.272436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Doing local delete in cell 15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) {{(pid=120545) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 16 01:24:39.274621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:39.276301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:39.277015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:39.277718 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 16 01:24:39.282237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] deallocate_for_instance() {{(pid=120545) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 16 01:24:39.591589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:39.592473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:39.607809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:39.608736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:39.609212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:39.610226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:39.610636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:39.611213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:39.947150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:39.962547 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af8c0353-8fa7-4af2-b284-a98a953c4492 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.373595 Oct 16 01:24:39.966078 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2370/4869] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:39 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:39.992795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:39.993642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:40.001025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:40.001800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:40.002257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:40.003162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:40.003815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:40.004511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:40.282486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:40.298011 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-204e75a8-2b10-4e78-aa91-d68f1505fde3 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.312807 Oct 16 01:24:40.303450 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2371/4870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:39 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:40.454873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d6350e02-aa6a-4d20-9f1d-fcc0c0d619fa req-1a4d71a1-7560-4dd5-ab63-e4104a20e462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3132186d-4372-4b1c-a4c3-618f2c9a0c62", "name": "network-vif-deleted", "tag": "cfbb06bb-88ce-4e59-9ef5-5154424dcb03"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:40.463861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Updating instance_info_cache with network_info: [] {{(pid=120545) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 16 01:24:40.470214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d6350e02-aa6a-4d20-9f1d-fcc0c0d619fa req-1a4d71a1-7560-4dd5-ab63-e4104a20e462 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:40.471055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d6350e02-aa6a-4d20-9f1d-fcc0c0d619fa req-1a4d71a1-7560-4dd5-ab63-e4104a20e462 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:40.471721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d6350e02-aa6a-4d20-9f1d-fcc0c0d619fa req-1a4d71a1-7560-4dd5-ab63-e4104a20e462 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:40.512818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.server_external_events [req-d6350e02-aa6a-4d20-9f1d-fcc0c0d619fa req-1a4d71a1-7560-4dd5-ab63-e4104a20e462 service nova] Unable to find a host for instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62. Dropping event network-vif-deleted {{(pid=120546) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 16 01:24:40.513964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d6350e02-aa6a-4d20-9f1d-fcc0c0d619fa req-1a4d71a1-7560-4dd5-ab63-e4104a20e462 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.065240 Oct 16 01:24:40.515166 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2372/4871] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 16 01:24:40.764949 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=12,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:40.816248 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d04b9ed7-58f7-4cfd-89f9-37a625aa28db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 204 len: 0 microversion: 2.1 time: 2.912165 Oct 16 01:24:40.817216 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2500/4872] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:24:37 2022] DELETE /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 0 bytes in 2914 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:24:40.827870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:40.829103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:40.838664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:40.839521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:40.840289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:40.841216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:40.841875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:40.842499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:40.859302 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 HTTP/1.1 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3132186d-4372-4b1c-a4c3-618f2c9a0c62'} Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:40.861341 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:40.865674 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:40.865674 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:40.865674 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:40.865674 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:24:40.865674 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:24:40.865674 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:24:40.865674 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:24:40.868660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:24:40.870159 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-abc144de-911e-455b-ac36-91b7c1fb90fb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 404 len: 111 microversion: 2.1 time: 0.048376 Oct 16 01:24:40.871658 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2373/4873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:40 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:24:40.992869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:40.993491 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:41.009420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:41.009926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:41.011124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:41.014227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:41.015950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:41.017092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:41.058306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-986726564", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "80782a8b-359e-4c99-bfc4-19cb8408a888"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:41.211035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] validate_networks() for [('80782a8b-359e-4c99-bfc4-19cb8408a888', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:24:41.346274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:41.364996 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd7ebaae-4025-49a8-aaa4-2cc338f42bc3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.376524 Oct 16 01:24:41.367709 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2501/4874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:40 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:41.381789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:41.385042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:41.399160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:41.400074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:41.403131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:41.404513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:41.405592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:41.406265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:41.761215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:41.773972 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e2983861-09ac-4e4b-91f5-1859068a9985 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.403171 Oct 16 01:24:41.776914 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2502/4875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:41 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:41.947384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:24:41.947819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:24:41.948299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:24:41.949244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:24:41.949844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:24:41.964151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:41.964849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:41.965479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:41.966377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:41.967174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:41.967804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:42.000015 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:42.006304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for user a3ac1408c91c4db59f4639abdca2c98f and project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:42.024146 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:24:42.026562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:24:42.103486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b599b2bc-a2e7-4223-91bf-2d139c6789af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049791 Oct 16 01:24:42.105141 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2374/4876] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:24:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:24:42.120484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0e02d3e-6084-4143-813a-3ad7c659d0c2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:42.121334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c0e02d3e-6084-4143-813a-3ad7c659d0c2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:42.222058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0e02d3e-6084-4143-813a-3ad7c659d0c2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:42.232872 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0e02d3e-6084-4143-813a-3ad7c659d0c2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1214 microversion: 2.1 time: 0.120159 Oct 16 01:24:42.253793 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2503/4877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:42 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:42.392150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:42.393036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:42.401202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:42.402050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:42.402665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:42.403651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:42.404409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:42.405008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:42.734570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:42.746101 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e9d7b46c-e26f-44a5-bd20-3072e3c972c0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.360420 Oct 16 01:24:42.767876 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2375/4878] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:42 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:42.799814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:42.801674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:42.814393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:42.819746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:42.820642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:42.822585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:42.824548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:42.827018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:43.105059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:43.118721 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe9f4edd-2ab8-47b8-88d1-c000548ad766 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.323641 Oct 16 01:24:43.122416 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2504/4879] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:42 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:43.259040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:43.260484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:43.271480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:43.275600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:43.276307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:43.277231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:43.277931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:43.278686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:43.434704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:43.482546 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a11d4e7-01ec-4127-ac77-691ca2c43f1b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1210 microversion: 2.1 time: 0.227592 Oct 16 01:24:43.483661 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2376/4880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:43 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1210 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:43.810359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:43.812469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:43.822689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:43.823919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:43.824726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:43.825725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:43.826769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:43.827640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:44.123246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:44.137958 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10b2cdaa-5c40-4abe-8104-b1167cb7f81d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.357610 Oct 16 01:24:44.138543 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2505/4881] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:43 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:44.148894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:44.150449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:44.160157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:44.162830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:44.163642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:44.167336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:44.168160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:44.170026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:44.484601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:44.499260 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64294ddb-780d-4d64-a5ee-482de01ccde2 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1528 microversion: 2.1 time: 0.353397 Oct 16 01:24:44.504738 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2377/4882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:44 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1528 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:44.535775 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:44.536749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:44.551342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:44.553808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:44.555057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:44.556009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:44.556905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:44.557708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:45.057932 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:45.066056 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92cdc301-7f5f-45ec-840b-865870ac9288 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1274 microversion: 2.1 time: 0.541231 Oct 16 01:24:45.066860 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2506/4883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:44 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1274 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:45.168073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:45.168844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:45.183092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:45.183557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:45.183924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:45.184643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:45.185096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:45.186904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:45.507668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:45.521026 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3e14a3e9-5230-4c12-9f4c-bb1120680a95 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.358884 Oct 16 01:24:45.536767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:45.540439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:45.543427 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2378/4884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:45 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:45.567832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:45.568342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:45.568794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:45.569506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:45.575045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:45.575554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:46.097781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:46.105762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:46.106885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:46.118254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:46.120155 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-43ede846-e098-4640-9630-abdd0be829dd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1510 microversion: 2.1 time: 0.588562 Oct 16 01:24:46.139092 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2507/4885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:45 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1510 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:46.140101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:46.140790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:46.141995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:46.142805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:46.143734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:46.312912 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:46.322480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-607a557f-7fe8-4bf6-99ca-a73b7754b9e3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1272 microversion: 2.1 time: 0.234184 Oct 16 01:24:46.324271 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2379/4886] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:46 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:46.550726 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:46.551358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:46.563998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:46.568207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:46.568927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:46.572075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:46.572565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:46.573002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:46.890095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:46.898989 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-18a322c1-95d2-428d-8d4f-5018f7c6b60b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.354455 Oct 16 01:24:46.899905 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2508/4887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:46 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:47.147297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:47.148361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:47.156605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:47.157448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:47.158232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:47.159831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:47.160741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:47.161333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:47.346679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:47.347949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:47.372389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:47.375027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:47.375787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:47.380321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:47.387296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:47.388098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:47.388829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:47.389090 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfc45c48-45fa-4ee8-9df2-1c654b817950 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1510 microversion: 2.1 time: 0.246427 Oct 16 01:24:47.393898 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2380/4888] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:47 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:47.831776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:47.855951 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-117eb394-fc28-4cc2-a59f-b757f5259943 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 0.513824 Oct 16 01:24:47.875921 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2509/4889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:47 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:47.924122 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:47.924749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:47.939763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:47.940992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:47.941901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:47.943308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:47.945917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:47.946649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:48.359230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:48.375910 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a37a5b19-d73d-423d-9f40-645d31dbba1d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.455959 Oct 16 01:24:48.377090 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2381/4890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:47 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:48.418729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f21f161b-b7e7-40a3-a96d-69d3fbfc15f0 req-282849fa-51e4-419b-bc6d-f6f8ce13ce6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438", "name": "network-vif-unplugged", "status": "completed", "tag": "ebf526f4-6d18-4e21-9c38-4219f2d56da2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:48.419386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:48.419633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:48.436441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:48.436945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:48.437398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:48.438125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:48.438782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:48.439284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:48.449217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f21f161b-b7e7-40a3-a96d-69d3fbfc15f0 req-282849fa-51e4-419b-bc6d-f6f8ce13ce6e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:48.449946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f21f161b-b7e7-40a3-a96d-69d3fbfc15f0 req-282849fa-51e4-419b-bc6d-f6f8ce13ce6e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:48.450741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f21f161b-b7e7-40a3-a96d-69d3fbfc15f0 req-282849fa-51e4-419b-bc6d-f6f8ce13ce6e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:48.479212 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f21f161b-b7e7-40a3-a96d-69d3fbfc15f0 req-282849fa-51e4-419b-bc6d-f6f8ce13ce6e service nova] Creating event network-vif-unplugged:ebf526f4-6d18-4e21-9c38-4219f2d56da2 for instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 on n-h2-master-1 Oct 16 01:24:48.493424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f21f161b-b7e7-40a3-a96d-69d3fbfc15f0 req-282849fa-51e4-419b-bc6d-f6f8ce13ce6e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083734 Oct 16 01:24:48.499434 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2510/4891] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:48.885768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:48.886868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:48.896541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:48.897045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:48.897523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:48.899086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:48.899539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:48.899973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:49.337723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:49.354135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0b140c96-d219-45ed-bad2-b02121164e04 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1513 microversion: 2.1 time: 0.940537 Oct 16 01:24:49.359849 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2382/4892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:48 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1513 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:49.383833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:49.385186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:49.397437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:49.398330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:49.399166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:49.400082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:49.400732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:49.401350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:49.456639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:49.465108 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d43e5796-ee1a-4133-8ad4-a2821f6248fc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 0.586486 Oct 16 01:24:49.465713 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2511/4893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:48 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:49.487494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:49.488148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:49.515473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:49.515793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:49.517530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:49.518291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:49.518773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:49.522540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.098300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:50.112697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-60e0ec50-7a0f-4069-8fe2-6ad737deb7a8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1453 microversion: 2.1 time: 0.733558 Oct 16 01:24:50.112973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:50.113928 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2383/4894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:49 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1453 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:24:50.128518 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ff887a7-1a12-4100-a60a-6ae80ffa6805 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1735 microversion: 2.1 time: 0.661525 Oct 16 01:24:50.129702 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2512/4895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:49 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1735 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:50.191386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:50.191929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:50.200472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.203494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.205490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.209424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.211583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.212938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.267730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lazy-loading 'flavor' on Instance uuid 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:24:50.284162 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Cannot 'shelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state shelved_offloaded Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action HTTP/1.1 Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 14 Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: {"shelve": {}} Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'shelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state shelved_offloaded Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'shelve': {}}} Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:24:50.286542 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state shelved_offloaded Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state shelved_offloaded Oct 16 01:24:50.292932 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:50.295150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 409 to user: Cannot 'shelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state shelved_offloaded {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:24:50.296311 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9bc5806b-dd99-411b-8dec-46b5ffcaeed4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 409 len: 155 microversion: 2.1 time: 0.109782 Oct 16 01:24:50.298133 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2513/4896] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:24:50 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 155 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:24:50.308537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:50.309399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:50.320998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.321761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.322461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.323500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.324131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.324730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.355965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bef3124e-f76b-4608-82c4-e91084f0cb42 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Action: 'create', calling method: .version_select at 0x7fd64db03b80>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-596256657", "policies": ["affinity"]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:50.375999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-bef3124e-f76b-4608-82c4-e91084f0cb42 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:50.383586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-bef3124e-f76b-4608-82c4-e91084f0cb42 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:50.396275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120545) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 01:24:50.423275 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:50.451388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-bef3124e-f76b-4608-82c4-e91084f0cb42 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:50.465009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-bef3124e-f76b-4608-82c4-e91084f0cb42 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:50.498130 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bef3124e-f76b-4608-82c4-e91084f0cb42 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.382799 Oct 16 01:24:50.499625 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2384/4897] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Oct 16 01:24:50 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:50.512399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-188a8233-8059-4c2a-bb10-54fca073b789 req-46baea36-4e9b-45de-9c42-2a74ef98a135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7527a58-5949-446c-8c17-b1bebce85599", "tag": "01bb6887-ede9-4b17-85c5-8211d3d9ca93"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:50.539193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-188a8233-8059-4c2a-bb10-54fca073b789 req-46baea36-4e9b-45de-9c42-2a74ef98a135 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.539602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-188a8233-8059-4c2a-bb10-54fca073b789 req-46baea36-4e9b-45de-9c42-2a74ef98a135 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.540010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-188a8233-8059-4c2a-bb10-54fca073b789 req-46baea36-4e9b-45de-9c42-2a74ef98a135 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.556876 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d84051e5-f44e-4345-9c8a-3500a53ae0bd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 202 len: 0 microversion: 2.1 time: 0.254951 Oct 16 01:24:50.563713 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2514/4898] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:24:50 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:24:50.569469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:50.580994 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-188a8233-8059-4c2a-bb10-54fca073b789 req-46baea36-4e9b-45de-9c42-2a74ef98a135 service nova] Creating event network-changed:01bb6887-ede9-4b17-85c5-8211d3d9ca93 for instance f7527a58-5949-446c-8c17-b1bebce85599 on n-h2-master-1 Oct 16 01:24:50.583812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:50.589062 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-188a8233-8059-4c2a-bb10-54fca073b789 req-46baea36-4e9b-45de-9c42-2a74ef98a135 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088030 Oct 16 01:24:50.590028 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2385/4899] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:50.590536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.591063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.591502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.592466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.592658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.593377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.595865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-126b1f9c-5caa-4b8f-923a-8afe0a449a61 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Action: 'create', calling method: .version_select at 0x7fd64d7de040>, body: {"server_group": {"name": "tempest-server-group-775570772", "policies": ["affinity"]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:50.623904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-126b1f9c-5caa-4b8f-923a-8afe0a449a61 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:50.631545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-126b1f9c-5caa-4b8f-923a-8afe0a449a61 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:50.693218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-126b1f9c-5caa-4b8f-923a-8afe0a449a61 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:50.700841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-126b1f9c-5caa-4b8f-923a-8afe0a449a61 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:50.717565 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-126b1f9c-5caa-4b8f-923a-8afe0a449a61 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.125966 Oct 16 01:24:50.719145 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2386/4900] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Oct 16 01:24:50 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:50.740908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:50.742674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:50.753733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.754229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.754670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.755415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:50.756063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:50.756656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:50.763936 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:51.047499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:51.061477 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b4ed88de-e6f3-461e-bc40-5962740d4e17 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 0.492796 Oct 16 01:24:51.062265 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2515/4901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:50 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:51.073357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-610e6d18-9197-471d-9fb2-66e460510aa8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Action: 'create', calling method: .version_select at 0x7fd64d7864c0>, body: {"server_group": {"name": "tempest-server-group-775570772", "policies": ["affinity"]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:51.094472 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:51.120952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-610e6d18-9197-471d-9fb2-66e460510aa8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:51.153157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-610e6d18-9197-471d-9fb2-66e460510aa8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:51.284560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:51.301283 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-25cd432d-a308-4a54-a974-e10e3a1e0bfa tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1461 microversion: 2.1 time: 0.576577 Oct 16 01:24:51.303490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2387/4902] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:50 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1461 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:51.304803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-610e6d18-9197-471d-9fb2-66e460510aa8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:51.311650 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:51.312690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:51.326994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-610e6d18-9197-471d-9fb2-66e460510aa8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:51.337005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:51.338023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:51.340261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:51.342031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:51.344009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:51.344837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:51.346827 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-610e6d18-9197-471d-9fb2-66e460510aa8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.282807 Oct 16 01:24:51.347670 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2516/4903] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Oct 16 01:24:51 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:51.353016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:51.354094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:51.360908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:51.361789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:51.362404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:51.363351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:51.364168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:51.364784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:51.425405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5973c74d-b5c2-479a-b1e5-1fb454370443 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/ips" status: 200 len: 150 microversion: 2.1 time: 0.119680 Oct 16 01:24:51.440087 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2388/4904] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:24:51 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/ips => generated 150 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:51.456889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59fc1f3a-0ba9-4c86-ae09-1458f3fcf2c7 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:51.525783 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59fc1f3a-0ba9-4c86-ae09-1458f3fcf2c7 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/648cfd5d-671c-4500-adbc-2b6b7d82c712" status: 204 len: 0 microversion: 2.1 time: 0.082385 Oct 16 01:24:51.526373 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2389/4905] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:24:51 2022] DELETE /compute/v2.1/os-server-groups/648cfd5d-671c-4500-adbc-2b6b7d82c712 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:24:51.538636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0a621848-2a82-4746-a39d-f35787dfa2ea tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:51.586703 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0a621848-2a82-4746-a39d-f35787dfa2ea tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.047807 Oct 16 01:24:51.589414 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2390/4906] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:24:51 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:24:51.600094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b31bd9c0-48a2-4088-b156-d0ff83ba9740 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:51.647805 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b31bd9c0-48a2-4088-b156-d0ff83ba9740 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/40fd64d8-ffd2-4955-b944-cd830e80faf3" status: 204 len: 0 microversion: 2.1 time: 0.052416 Oct 16 01:24:51.650702 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2391/4907] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:24:51 2022] DELETE /compute/v2.1/os-server-groups/40fd64d8-ffd2-4955-b944-cd830e80faf3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:24:51.657436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c292e04f-4df8-4768-8751-86508cfbb589 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:51.712174 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c292e04f-4df8-4768-8751-86508cfbb589 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.056925 Oct 16 01:24:51.724877 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2392/4908] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:24:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:51.731162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e691254-10c7-4faf-9b28-4c61c29e0f9a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Action: 'create', calling method: .version_select at 0x7fd64d7de280>, body: {"server_group": {"name": "tempest-server-group-786481060", "policies": ["affinity"]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:51.766419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9e691254-10c7-4faf-9b28-4c61c29e0f9a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:51.776175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9e691254-10c7-4faf-9b28-4c61c29e0f9a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:51.899445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9e691254-10c7-4faf-9b28-4c61c29e0f9a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:51.917776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9e691254-10c7-4faf-9b28-4c61c29e0f9a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:51.971420 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e691254-10c7-4faf-9b28-4c61c29e0f9a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.244125 Oct 16 01:24:51.972496 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2393/4909] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Oct 16 01:24:51 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:52.041449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-41ad1467-d083-4924-8f29-95e64acd2253 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:52.065334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:52.069764 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:DELETE=2,nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:52.082045 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd745cda-e050-4cf9-a55e-8feb0a67cd7f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1715 microversion: 2.1 time: 0.733015 Oct 16 01:24:52.084880 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:52.086663 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2517/4910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:51 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1715 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:52.114280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:52.114280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:52.131254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:52.131767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:52.132783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:52.135869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:52.136353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:52.136794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:52.158006 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-41ad1467-d083-4924-8f29-95e64acd2253 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/a0986fce-71aa-42cd-a983-c4d2653d4e54" status: 204 len: 0 microversion: 2.1 time: 0.153470 Oct 16 01:24:52.174554 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2394/4911] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:24:52 2022] DELETE /compute/v2.1/os-server-groups/a0986fce-71aa-42cd-a983-c4d2653d4e54 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:24:52.185831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5eff31c3-cdd4-483e-a7cb-4145f84c0535 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:52.193023 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:24:52.200138 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5eff31c3-cdd4-483e-a7cb-4145f84c0535 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.022009 Oct 16 01:24:52.200892 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2395/4912] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:24:52 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:52.232844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a3172e46-fdf2-442c-817b-2f306d460db1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Action: 'create', calling method: .version_select at 0x7fd652830b80>, body: {"server_group": {"name": "tempest-server-group-1146537881", "policies": ["anti-affinity"]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:52.314461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-a3172e46-fdf2-442c-817b-2f306d460db1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:52.336322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-a3172e46-fdf2-442c-817b-2f306d460db1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:52.474322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-a3172e46-fdf2-442c-817b-2f306d460db1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:52.490306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-a3172e46-fdf2-442c-817b-2f306d460db1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_groups'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:52.510457 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a3172e46-fdf2-442c-817b-2f306d460db1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.301025 Oct 16 01:24:52.511740 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2396/4913] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Oct 16 01:24:52 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:52.521554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:52.523666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:52.542233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:52.542754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:52.544809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:52.546044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:52.546833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:52.547343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:52.579261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:52.590413 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78f01616-3d55-49e2-a84f-39164a72ca74 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 0.499156 Oct 16 01:24:52.596039 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2518/4914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:52 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:52.603968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:52.604497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:52.616228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:52.617634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:52.618349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:52.619503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:52.631717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:52.633000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:52.759248 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Cannot 'detach_volume' instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 while it is in vm_state rescued Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments/eff9ac7a-1965-4a48-8768-ac7b6b33b2dd HTTP/1.1 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'detach_volume' instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 while it is in vm_state rescued Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': '53610cf8-c016-4fa4-bd6e-178818cc4ab3', 'id': 'eff9ac7a-1965-4a48-8768-ac7b6b33b2dd'} Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 while it is in vm_state rescued Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:52.763280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:24:52.768708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:24:52.768708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:24:52.768708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:24:52.768708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:24:52.768708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 while it is in vm_state rescued Oct 16 01:24:52.768708 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:24:52.770051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 409 to user: Cannot 'detach_volume' instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 while it is in vm_state rescued {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:24:52.774282 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-99997a8f-4446-4f13-9c85-ccd719726969 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments/eff9ac7a-1965-4a48-8768-ac7b6b33b2dd" status: 409 len: 152 microversion: 2.1 time: 0.177112 Oct 16 01:24:52.775527 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2519/4915] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:24:52 2022] DELETE /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments/eff9ac7a-1965-4a48-8768-ac7b6b33b2dd => generated 152 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:24:52.784842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-40e0e157-118e-4be8-9f6a-7d8046b18057 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:52.824334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:52.837829 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-14789e64-e137-4b1b-ab82-1eddb81cf856 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1461 microversion: 2.1 time: 0.323756 Oct 16 01:24:52.851034 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2397/4916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:52 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1461 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:52.851271 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-40e0e157-118e-4be8-9f6a-7d8046b18057 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/8eea8f74-1208-4b5b-9b1f-d8b2f9315c13" status: 204 len: 0 microversion: 2.1 time: 0.065658 Oct 16 01:24:52.851271 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2520/4917] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:24:52 2022] DELETE /compute/v2.1/os-server-groups/8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:24:52.856460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:52.857024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:52.858997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f9f119d-3c29-48da-bc24-efc625f1121e tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:52.865422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:52.865925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:52.867006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:52.867718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:52.868175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:52.868601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:52.897724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f9f119d-3c29-48da-bc24-efc625f1121e tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.050042 Oct 16 01:24:52.898109 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2521/4918] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:24:52 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:53.026067 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7bd32155-f235-4742-bb65-52ef5d895ed1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/action" status: 202 len: 0 microversion: 2.1 time: 0.184489 Oct 16 01:24:53.026658 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2398/4919] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:24:52 2022] POST /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:24:53.036071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:53.036973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:53.050161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:53.055951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:53.057449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:53.060048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:53.062597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:53.063321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:53.104387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1390100713", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "27a7d894-58aa-47c9-87e0-52001c6a19f4"}]}, "os:scheduler_hints": {"group": "d0da8c1f-54eb-49a6-8ff4-cf7575fc1156"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:53.206450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] validate_networks() for [('27a7d894-58aa-47c9-87e0-52001c6a19f4', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:24:54.340464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:24:54.341144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:24:54.341383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:24:54.341854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:24:54.342206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:24:54.369381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:54.370101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:54.370720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:54.371680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:54.372318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:54.372912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:54.401760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:54.421297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:54.427171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:54.439446 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8656e040-6b9b-4dee-9f83-c99fcd9bf22f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1723 microversion: 2.1 time: 1.408179 Oct 16 01:24:54.440047 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2522/4920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:53 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1723 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:54.448058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:54.448911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:54.468226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:24:54.471034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:24:54.479919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:54.480584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:54.481046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:54.481808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:54.482275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:54.482716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:54.568251 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:54.579207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:54.668692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:24:54.688418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Getting quotas for user c68d50afc01442eb9dbf1d306bba7052 and project e0751d3ff2014be3ba106590c6abe65d. Resources: {'server_group_members'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:24:54.737358 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dcf7b9c6-c16f-4024-b27f-16fd055acd8c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637111 Oct 16 01:24:54.738407 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2399/4921] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:24:54.754447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:54.755347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:54.762815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:54.763512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:54.763944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:54.764668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:54.765131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:54.765564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:55.203030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:55.213475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68459b89-5d51-4f62-a150-0474187afad7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 0.769572 Oct 16 01:24:55.214361 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2523/4922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:54 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:55.235527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:55.236179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:55.242766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:55.254687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:55.255912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:55.258495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:55.259789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:55.260424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:55.381926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:24:55.480470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:55.490363 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-54cbbee7-67cd-472f-ba31-a5b86c6c33db tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.745234 Oct 16 01:24:55.498560 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2400/4923] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:54 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:55.504932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aa9e423-838d-402a-a38c-140911a6ca4e"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:55.513809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:55.536465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:55.544402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:55.549998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:55.552567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:55.553307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:55.562574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:55.636275 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b267ba6f-49ff-46a1-bfce-69baea45372b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "DELETE /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 204 len: 0 microversion: 2.1 time: 0.417154 Oct 16 01:24:55.637940 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2524/4924] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:24:55 2022] DELETE /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:24:55.652377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9dcc451e-ffec-4033-aac0-e68a2b333f6d tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:55.657029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9dcc451e-ffec-4033-aac0-e68a2b333f6d tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:55.810196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9dcc451e-ffec-4033-aac0-e68a2b333f6d tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:55.818798 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9dcc451e-ffec-4033-aac0-e68a2b333f6d tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1213 microversion: 2.1 time: 0.179403 Oct 16 01:24:55.819844 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2525/4925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:55 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:55.841186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:55.842102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:55.849785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:55.850538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:55.851762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:55.852760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:55.853388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:55.853984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:56.212462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:56.221663 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb29ec81-a44f-4e56-8f9c-929964061bea tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1723 microversion: 2.1 time: 0.400533 Oct 16 01:24:56.239225 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2526/4926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:55 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1723 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:56.245485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:56.246310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:56.252906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:56.253824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:56.254554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:56.255582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:56.256301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:56.257041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:56.630337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:56.641859 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a5185f11-e495-4081-bf7a-23f7902838c3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1552 microversion: 2.1 time: 0.400633 Oct 16 01:24:56.648731 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2527/4927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:56 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1552 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:56.659508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:56.660836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:56.683131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:56.683970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:56.686599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:56.687577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:56.688225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:56.689434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:56.967890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:56.996824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f9458d69-9c30-48ee-928c-61810e5d9c57 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 0.346153 Oct 16 01:24:56.998402 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2528/4928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:56 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:57.026211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:57.027187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:57.047578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:57.048124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:57.048572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:57.052712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:57.055055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:57.057336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:57.196960 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-50debdeb-790c-404b-8f07-d8ca44a8581c tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "POST /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.677805 Oct 16 01:24:57.202676 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2401/4929] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:24:55 2022] POST /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments => generated 194 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:57.243950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:57.246407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:57.262457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:57.265946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:57.266579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:57.267852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:57.281810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:57.282485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:57.489390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:57.498568 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22a6f7ec-2d53-4575-a175-798dbab796ee tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1273 microversion: 2.1 time: 0.278479 Oct 16 01:24:57.502716 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2402/4930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:57 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:57.513369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:57.524745 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-72453d2b-cbac-4d7e-aa5d-042d4c3ef689 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.524371 Oct 16 01:24:57.525546 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2529/4931] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:56 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:57.528179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:57.528835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:57.552467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:57.553266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:57.553928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:57.554966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:57.555602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:57.556188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:57.668672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:57.669289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:57.681554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:57.682307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:57.700836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:57.700836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:57.700836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:57.700836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:57.925592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:57.941587 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5455279d-4673-4b40-b231-f147ed67cc4e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1723 microversion: 2.1 time: 0.437722 Oct 16 01:24:57.942842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2403/4932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:57 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:57.951828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:57.968933 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6d861b0-9535-4cf4-96dd-c32e1a3779dc tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1552 microversion: 2.1 time: 0.304065 Oct 16 01:24:57.970446 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2530/4933] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:57 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1552 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:58.025156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:58.027305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:58.057834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:58.060646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:58.061763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:58.063516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:58.065131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:58.067878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:58.315203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:58.328752 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-682a1a4d-2b5d-4cd8-a472-94236383c204 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 0.311041 Oct 16 01:24:58.346202 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2404/4934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:58 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:58.527734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:58.530634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:58.557119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:58.558094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:58.566034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:58.566698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:58.571059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:58.575546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:58.576419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:58.578683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:58.587917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:58.588974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:58.590999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:58.592939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:58.598585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:58.599467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:58.813355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:58.827813 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-75079bf9-c80f-4ef1-a330-01273136be17 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1271 microversion: 2.1 time: 0.306136 Oct 16 01:24:58.831410 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2531/4935] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:58 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:58.909276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b35fff6a-da28-4923-9afe-f78f8750024e req-e3dcb5ed-f18c-4317-b310-4635fa8804b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7527a58-5949-446c-8c17-b1bebce85599", "name": "network-vif-plugged", "status": "completed", "tag": "01bb6887-ede9-4b17-85c5-8211d3d9ca93"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:58.942140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b35fff6a-da28-4923-9afe-f78f8750024e req-e3dcb5ed-f18c-4317-b310-4635fa8804b3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:58.944705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b35fff6a-da28-4923-9afe-f78f8750024e req-e3dcb5ed-f18c-4317-b310-4635fa8804b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:58.946629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b35fff6a-da28-4923-9afe-f78f8750024e req-e3dcb5ed-f18c-4317-b310-4635fa8804b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:58.986903 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b35fff6a-da28-4923-9afe-f78f8750024e req-e3dcb5ed-f18c-4317-b310-4635fa8804b3 service nova] Creating event network-vif-plugged:01bb6887-ede9-4b17-85c5-8211d3d9ca93 for instance f7527a58-5949-446c-8c17-b1bebce85599 on n-h2-master-1 Oct 16 01:24:59.002949 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b35fff6a-da28-4923-9afe-f78f8750024e req-e3dcb5ed-f18c-4317-b310-4635fa8804b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100629 Oct 16 01:24:59.006474 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2532/4936] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:59.027379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:59.028496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:59.037426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.040717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.041365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:59.042270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.042578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:59.043714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.044320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:59.056596 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-27401088-1e62-4e45-966a-b949ff957b48 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.506594 Oct 16 01:24:59.074959 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2405/4937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:58 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:59.089035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:59.090178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:59.107276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.108574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.110655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:59.111426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.111890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.114729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:59.364093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:59.397302 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-996c0504-32f8-4cce-8cae-f176f7a3096a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 200 len: 1485 microversion: 2.1 time: 0.318649 Oct 16 01:24:59.403252 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2406/4938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:59 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 1485 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:59.426686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-21f0d144-9c01-48ab-b35f-4da4a4d06546 req-0ae8337a-7d14-4557-9881-cd4b0f373599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d8ca59-64bb-4786-8831-91317c83f5ad", "name": "network-vif-deleted", "tag": "3ab7dfee-6241-4295-ab7f-04a4781bab69"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:24:59.477579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-21f0d144-9c01-48ab-b35f-4da4a4d06546 req-0ae8337a-7d14-4557-9881-cd4b0f373599 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.478346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-21f0d144-9c01-48ab-b35f-4da4a4d06546 req-0ae8337a-7d14-4557-9881-cd4b0f373599 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.481389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-21f0d144-9c01-48ab-b35f-4da4a4d06546 req-0ae8337a-7d14-4557-9881-cd4b0f373599 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:59.528787 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-21f0d144-9c01-48ab-b35f-4da4a4d06546 req-0ae8337a-7d14-4557-9881-cd4b0f373599 service nova] Creating event network-vif-deleted:3ab7dfee-6241-4295-ab7f-04a4781bab69 for instance 22d8ca59-64bb-4786-8831-91317c83f5ad on n-h1-master-1 Oct 16 01:24:59.557718 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-21f0d144-9c01-48ab-b35f-4da4a4d06546 req-0ae8337a-7d14-4557-9881-cd4b0f373599 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150332 Oct 16 01:24:59.559895 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2407/4939] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:24:59.581510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:59.586093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:59.629330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.630732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.636564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:59.640222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.643757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.644724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:59.750607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:24:59.778707 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e84e655a-e070-47a9-a2da-7fd4b908ef4b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1729 microversion: 2.1 time: 0.766429 Oct 16 01:24:59.784127 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2533/4940] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:59 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1729 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:24:59.812745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:24:59.813571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:24:59.852208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.854792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.858713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:24:59.860593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:24:59.861573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:24:59.862359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:00.272262 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fd38e882-efa5-485b-982b-abb070de0edf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.467744 Oct 16 01:25:00.273947 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2534/4941] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:24:59 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-interface => generated 284 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:00.290513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:00.292053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:00.313835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:00.320371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:00.324210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:00.325748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:00.326830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:00.330044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:01.010690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:01.041969 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e2b37da3-bb9a-4834-9ccf-d03d4995960a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 1.474264 Oct 16 01:25:01.044116 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2408/4942] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:24:59 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:01.113821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:01.114905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:01.162991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:01.171727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:01.175064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:01.182332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:01.188135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:01.190590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:01.658904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:01.671608 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa4b0067-095b-4bb3-be60-d63eac81d6cc tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 1.395842 Oct 16 01:25:01.676831 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2535/4943] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:00 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:01.703716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:01.714610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 22d8ca59-64bb-4786-8831-91317c83f5ad] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:01.738284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:01.738733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:01.740143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:01.743026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:01.744976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:01.745741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:01.792688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] HTTP exception thrown: Instance 22d8ca59-64bb-4786-8831-91317c83f5ad could not be found. Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Request method failure captured: Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad HTTP/1.1 Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1ziAuG6j_JD8guND5I1dGsK1Rfw0fPM_1wwTb1CqSapss852Ff5ibwYBdkHyh2EDS_dqE1LI_4GZcCidmN0LYZi7Y20DCYMzOhuqbvNW1k48vjIjg-mF0E9fyyhLVFqqL-gCxrOoW124VDirWjYaWldknrg-51licReGw9SEOSTuOk Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 0d53034488714fc8980132211d0d5c0b Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestNetworkBasicOps-225643155 Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0d53034488714fc8980132211d0d5c0b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestNetworkBasicOps-225643155 Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 0d53034488714fc8980132211d0d5c0b Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestNetworkBasicOps-225643155 Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestNetworkBasicOps-225643155-project Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 88d5c0890ae64fd6aa7e7e547e9bf736 Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestNetworkBasicOps-225643155-project Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 22d8ca59-64bb-4786-8831-91317c83f5ad could not be found. Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '22d8ca59-64bb-4786-8831-91317c83f5ad'} Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d8ca59-64bb-4786-8831-91317c83f5ad could not be found. Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d8ca59-64bb-4786-8831-91317c83f5ad could not be found. Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:01.794680 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:01.800285 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:01.800285 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:01.800285 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:01.800285 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:01.800285 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:01.800285 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d8ca59-64bb-4786-8831-91317c83f5ad could not be found. Oct 16 01:25:01.800285 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:01.807992 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Returning 404 to user: Instance 22d8ca59-64bb-4786-8831-91317c83f5ad could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:01.809177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-16cbe948-6e46-499d-8806-93dde77edd1a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad" status: 404 len: 111 microversion: 2.1 time: 0.131185 Oct 16 01:25:01.818475 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2536/4944] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:01 2022] GET /compute/v2.1/servers/22d8ca59-64bb-4786-8831-91317c83f5ad => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:01.933907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:01.950851 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37f5b797-5aa0-4d36-833c-540e5f675b75 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.869037 Oct 16 01:25:01.966615 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2409/4945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:01 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:02.069126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:02.069763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:02.085823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:02.087504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:02.088182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:02.089976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:02.094123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:02.094793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:02.134571 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:02.435814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60493035-2077-407d-810f-518e76153332 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '.version_select at 0x7fd64e827ca0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:02.500983 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-60493035-2077-407d-810f-518e76153332 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1435263857" status: 202 len: 0 microversion: 2.1 time: 0.079228 Oct 16 01:25:02.507946 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2410/4946] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:25:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1435263857 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:25:02.701229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:02.701849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:02.712962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:02.713526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:02.714092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:02.714832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:02.728695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:02.729377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:03.900839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:03.939567 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-592052e4-6b95-417c-a4cf-e5fc14340eba tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1314 microversion: 2.1 time: 1.856580 Oct 16 01:25:03.942559 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2537/4947] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:02 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1314 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:03.956649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:03.960546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:03.979168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:03.980165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:03.981429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:03.983180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:03.986359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:03.987092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:04.383998 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:04.424407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:04.441169 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b3c927c2-581b-4264-900f-2a99731855be tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 1.742775 Oct 16 01:25:04.443563 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2411/4948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:02 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:04.459723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a22ea6de-026a-48c5-a5b3-1c1b1a9704b2 req-ecb46811-0b62-4fbc-b976-4b76f5b726ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6ead7e-041d-40be-973c-90816a76eef4", "tag": "db877cfc-924a-4008-b3b6-4d6b636dda90"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:04.482700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:04.494416 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:04.496845 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-538fcb38-0ece-4f45-8d59-c827853a0d92 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.550531 Oct 16 01:25:04.503959 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2538/4949] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:03 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:04.521654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a22ea6de-026a-48c5-a5b3-1c1b1a9704b2 req-ecb46811-0b62-4fbc-b976-4b76f5b726ea service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:04.524741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a22ea6de-026a-48c5-a5b3-1c1b1a9704b2 req-ecb46811-0b62-4fbc-b976-4b76f5b726ea service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:04.525653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a22ea6de-026a-48c5-a5b3-1c1b1a9704b2 req-ecb46811-0b62-4fbc-b976-4b76f5b726ea service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:04.536336 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:04.573377 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a22ea6de-026a-48c5-a5b3-1c1b1a9704b2 req-ecb46811-0b62-4fbc-b976-4b76f5b726ea service nova] Creating event network-changed:db877cfc-924a-4008-b3b6-4d6b636dda90 for instance dc6ead7e-041d-40be-973c-90816a76eef4 on n-h2-master-1 Oct 16 01:25:04.583092 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a22ea6de-026a-48c5-a5b3-1c1b1a9704b2 req-ecb46811-0b62-4fbc-b976-4b76f5b726ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134825 Oct 16 01:25:04.584490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2412/4950] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:04.832966 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-11d47081-30c0-48aa-8b96-44152a70b890 req-7f7b5f7f-130a-43f1-9f17-09112b9d3a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53610cf8-c016-4fa4-bd6e-178818cc4ab3", "tag": "9a29f124-7a82-45e3-890b-8e5e29092482"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:04.862743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-11d47081-30c0-48aa-8b96-44152a70b890 req-7f7b5f7f-130a-43f1-9f17-09112b9d3a0e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:04.864497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-11d47081-30c0-48aa-8b96-44152a70b890 req-7f7b5f7f-130a-43f1-9f17-09112b9d3a0e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:04.866743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-11d47081-30c0-48aa-8b96-44152a70b890 req-7f7b5f7f-130a-43f1-9f17-09112b9d3a0e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:04.895606 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-11d47081-30c0-48aa-8b96-44152a70b890 req-7f7b5f7f-130a-43f1-9f17-09112b9d3a0e service nova] Creating event network-changed:9a29f124-7a82-45e3-890b-8e5e29092482 for instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 on n-h1-master-1 Oct 16 01:25:04.908945 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-11d47081-30c0-48aa-8b96-44152a70b890 req-7f7b5f7f-130a-43f1-9f17-09112b9d3a0e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078936 Oct 16 01:25:04.911845 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2539/4951] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:04.967584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:04.968313 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:04.982882 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=52 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:04.999262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:04.999843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:05.000298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:05.009364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:05.009892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:05.010350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:05.355817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:05.371003 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16f331c0-dba7-407a-bd01-9f4f7fa87a65 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1501 microversion: 2.1 time: 0.408459 Oct 16 01:25:05.374336 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2413/4952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:04 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1501 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:05.395297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8caf03f5-442c-4fb7-8095-14d20c1df638 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:05.407758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8caf03f5-442c-4fb7-8095-14d20c1df638 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:05.410694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8caf03f5-442c-4fb7-8095-14d20c1df638 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:05.428447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8caf03f5-442c-4fb7-8095-14d20c1df638 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:05.481653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:05.483383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:05.502798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:05.503851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:05.505262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:05.507006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:05.508094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:05.508800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:05.510356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8caf03f5-442c-4fb7-8095-14d20c1df638 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Going to try to stop instance {{(pid=120545) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:25:05.684804 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8caf03f5-442c-4fb7-8095-14d20c1df638 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599/action" status: 202 len: 0 microversion: 2.1 time: 0.293900 Oct 16 01:25:05.686524 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2540/4953] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:05 2022] POST /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:25:05.720984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:05.722102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:05.742870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:05.743706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:05.744393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:05.747181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:05.747851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:05.761024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:05.820574 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:06.025959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:06.049080 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7fdaa6d4-619d-4baf-9a5b-eea9dd03afe8 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 0.577541 Oct 16 01:25:06.073554 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2414/4954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:05 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:06.082745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:06.083883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:06.091060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:06.091803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:06.092429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:06.093674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:06.094350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:06.094962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:06.245602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:06.254520 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-03b14d8e-7b8c-4f8a-ac94-857f637db7eb tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.558423 Oct 16 01:25:06.261817 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2541/4955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:05 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:06.480732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:06.491766 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73fe019f-98d0-4829-93a4-8fadd3bb51c5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.412221 Oct 16 01:25:06.499040 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2415/4956] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:06 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:07.040761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0a63e623-ab80-42f1-95ed-89797bbf5c13 req-76735e26-0f91-4356-a4e5-cf2533a23054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53610cf8-c016-4fa4-bd6e-178818cc4ab3", "tag": "9a29f124-7a82-45e3-890b-8e5e29092482"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:07.068529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0a63e623-ab80-42f1-95ed-89797bbf5c13 req-76735e26-0f91-4356-a4e5-cf2533a23054 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:07.069134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0a63e623-ab80-42f1-95ed-89797bbf5c13 req-76735e26-0f91-4356-a4e5-cf2533a23054 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:07.071811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0a63e623-ab80-42f1-95ed-89797bbf5c13 req-76735e26-0f91-4356-a4e5-cf2533a23054 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:07.087157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:07.087964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:07.113146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:07.115037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:07.115776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:07.121111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:07.121871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:07.122595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:07.123124 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0a63e623-ab80-42f1-95ed-89797bbf5c13 req-76735e26-0f91-4356-a4e5-cf2533a23054 service nova] Creating event network-changed:9a29f124-7a82-45e3-890b-8e5e29092482 for instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 on n-h1-master-1 Oct 16 01:25:07.133771 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0a63e623-ab80-42f1-95ed-89797bbf5c13 req-76735e26-0f91-4356-a4e5-cf2533a23054 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106440 Oct 16 01:25:07.142975 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2542/4957] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:07.291299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:07.294739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:07.311930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:07.313189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:07.316594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:07.321237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:07.328456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:07.329154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:07.627389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:07.640590 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fc11dd1b-582b-4838-af90-4ca3fb374770 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 0.559147 Oct 16 01:25:07.642575 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2416/4958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:07 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:07.651515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:07.655728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:07.676398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:07.683120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:07.683931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:07.687317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:07.688950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:07.690255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:08.023620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:08.034567 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a6ee1a9-624f-4e25-b98c-f6d26d1359ba tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.747981 Oct 16 01:25:08.042181 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2543/4959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:07 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:08.117575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:08.137233 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8564736a-fd0a-444a-9bc0-b9242fad49db tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.493202 Oct 16 01:25:08.142168 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2417/4960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:07 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:08.668927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:08.669561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:08.688745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:08.689325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:08.689679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:08.690405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:08.690881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:08.691300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:08.983881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:09.012508 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-db728d85-8947-47fe-8311-a2b1d486307f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 0.348167 Oct 16 01:25:09.031504 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2544/4961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:08 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:09.071143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:09.072684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:09.079777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:09.080928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:09.081797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:09.083067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:09.083765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:09.084422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:09.166791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:09.167805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:09.181352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:09.187578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:09.191087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:09.192093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:09.192686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:09.195482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:09.511141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:09.527946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:09.533460 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f8eda36-dc25-4ec2-af10-3b7fb601beb1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.358378 Oct 16 01:25:09.537844 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2545/4962] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:09 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:09.541903 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-652d9ad9-c214-4d23-a0d8-dc2a0f9c73f8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.475984 Oct 16 01:25:09.542608 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2418/4963] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:09 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:10.039621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:10.040259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:10.046418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.047075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.047789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.048713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.049354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.050787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.186080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:10.193840 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d5a1693-f6df-44f9-a0bf-f8fe0e9f9c45 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 0.160194 Oct 16 01:25:10.194483 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2546/4964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:10 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:10.454889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-55e02e82-655e-47d0-adae-468e3f755021 req-1c090d47-f44c-458b-aadb-02ee523475af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6ead7e-041d-40be-973c-90816a76eef4", "name": "network-vif-plugged", "status": "completed", "tag": "db877cfc-924a-4008-b3b6-4d6b636dda90"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:10.467496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-55e02e82-655e-47d0-adae-468e3f755021 req-1c090d47-f44c-458b-aadb-02ee523475af service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.468385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-55e02e82-655e-47d0-adae-468e3f755021 req-1c090d47-f44c-458b-aadb-02ee523475af service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.469983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-55e02e82-655e-47d0-adae-468e3f755021 req-1c090d47-f44c-458b-aadb-02ee523475af service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.483110 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-55e02e82-655e-47d0-adae-468e3f755021 req-1c090d47-f44c-458b-aadb-02ee523475af service nova] Creating event network-vif-plugged:db877cfc-924a-4008-b3b6-4d6b636dda90 for instance dc6ead7e-041d-40be-973c-90816a76eef4 on n-h2-master-1 Oct 16 01:25:10.488491 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-55e02e82-655e-47d0-adae-468e3f755021 req-1c090d47-f44c-458b-aadb-02ee523475af service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037758 Oct 16 01:25:10.489112 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2419/4965] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:10.561164 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:10.562288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:10.567678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:10.568386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:10.569946 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:10.572062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.572660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.573193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.574041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.574673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.575233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.575706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.576197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.576829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.577543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.577999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.578616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.900781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:10.905331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:10.913428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30beab38-69d2-4adc-90cd-686c8be0e587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.356489 Oct 16 01:25:10.913808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-828a5412-c5ab-4835-ba55-6311c181a8b4 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.350546 Oct 16 01:25:10.927299 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2547/4966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:10 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:10.927505 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2420/4967] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:10 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:10.935515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:10.936027 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:10.936356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1e349dfa-7034-4c16-8fbb-08458967d035 req-39efd5dc-e2b9-44d7-a92f-3bef6ad61ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "642a16e0-6927-432c-9a1c-65b4dab274a4", "tag": "ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:10.942608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.942868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.943345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.944046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.945290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.945810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.948325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e349dfa-7034-4c16-8fbb-08458967d035 req-39efd5dc-e2b9-44d7-a92f-3bef6ad61ac7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:10.949084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e349dfa-7034-4c16-8fbb-08458967d035 req-39efd5dc-e2b9-44d7-a92f-3bef6ad61ac7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:10.949740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e349dfa-7034-4c16-8fbb-08458967d035 req-39efd5dc-e2b9-44d7-a92f-3bef6ad61ac7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:10.965697 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1e349dfa-7034-4c16-8fbb-08458967d035 req-39efd5dc-e2b9-44d7-a92f-3bef6ad61ac7 service nova] Creating event network-changed:ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9 for instance 642a16e0-6927-432c-9a1c-65b4dab274a4 on n-h2-master-1 Oct 16 01:25:10.971727 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1e349dfa-7034-4c16-8fbb-08458967d035 req-39efd5dc-e2b9-44d7-a92f-3bef6ad61ac7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042655 Oct 16 01:25:10.972655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2548/4968] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:10.977085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:25:11.058615 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-716e8852-4bbc-437b-80b8-fe3a83d06a07 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "DELETE /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 204 len: 0 microversion: 2.1 time: 0.129723 Oct 16 01:25:11.059273 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2421/4969] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:10 2022] DELETE /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:25:11.070887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:11.071682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:11.080410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:11.081231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:11.081936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:11.082747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:11.083699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:11.085346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:11.221543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:11.222620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:11.234359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:11.234896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:11.235398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:11.236158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:11.236923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:11.237359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:11.356963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:11.367313 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d15f7c28-35e2-433d-89c3-7706484539d3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1669 microversion: 2.1 time: 0.302509 Oct 16 01:25:11.385468 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2549/4970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:11 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1669 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:11.408448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:11.417462 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba56accf-b2eb-4ecd-b028-f6673987eed3 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 0.203599 Oct 16 01:25:11.418236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2422/4971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:11 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:11.939598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:11.940276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:11.940406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:11.940705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:11.947939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:11.948408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:11.948642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:11.948894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:11.949328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:11.949447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:11.950023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:11.950138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:11.950481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:11.950698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:11.950904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:11.951422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:12.161122 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:12.161620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:12.169783 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-59a98cb2-8aab-42a7-802d-86861e18f2fd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.234440 Oct 16 01:25:12.170279 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-24367b24-6565-4f31-8f4e-3618e6c76066 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.234686 Oct 16 01:25:12.170750 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2550/4972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:11 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:12.170887 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2423/4973] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:11 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:12.393165 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:12.393784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:12.400358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:12.400850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:12.401290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:12.401998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:12.402460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:12.402892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:12.441583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:12.442198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:12.457150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:12.457778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:12.458308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:12.459160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:12.459745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:12.460505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:12.606175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:12.614146 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6d5b5bbd-53be-4441-93c6-5eebc3eeb068 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1669 microversion: 2.1 time: 0.224908 Oct 16 01:25:12.615123 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2551/4974] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:12 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1669 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:12.637095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:12.644917 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-241ada0e-32bd-4d09-b0fb-c6e15289e093 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 0.207159 Oct 16 01:25:12.645497 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2424/4975] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:12 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:13.194377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:13.195550 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:13.196046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:13.196381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:13.205301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:13.206041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:13.206714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:13.207618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:13.208254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:13.208855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:13.218316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:13.222743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:13.225648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:13.227052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:13.230764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:13.231328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:13.566922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:13.574070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:13.579268 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-68ab9494-9173-4478-810a-c2deeef8ece5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.388667 Oct 16 01:25:13.580173 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2425/4976] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:13 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:13.587217 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0fb86d23-9a86-47bb-9490-9324da85f57b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.395473 Oct 16 01:25:13.599786 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2552/4977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:13 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:13.640992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:13.641610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:13.648457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:13.649292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:13.649733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:13.650440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:13.651116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:13.651548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:13.692595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:13.693207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:13.700556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:13.701060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:13.701498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:13.702203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:13.702717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:13.703180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:14.410505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:14.415577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:14.427943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e57d3afb-1fe6-4d89-9be3-6b9f837bc8b1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1669 microversion: 2.1 time: 0.791520 Oct 16 01:25:14.431732 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a47a9fb7-9219-496b-92bd-c6c4eaf1c558 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1313 microversion: 2.1 time: 0.748531 Oct 16 01:25:14.433297 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2426/4978] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:13 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1669 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:14.434078 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2553/4979] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:13 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:14.622582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:14.623434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:14.625970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:14.628150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:14.659587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:14.660197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:14.660795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:14.661959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:14.662422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:14.663248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:14.663927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:14.664688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:14.665162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:14.666588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:14.667085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:14.668807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:14.935776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:14.945809 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-638a4079-e3ec-4ec0-9ad2-ef8e217a2b4b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.333432 Oct 16 01:25:14.959719 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2554/4980] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:14 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:14.968953 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a579f84d-c0ae-47b5-bc20-e17be351e2f5 req-f05fed22-3898-4c06-807b-2b7257cffc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642a16e0-6927-432c-9a1c-65b4dab274a4", "name": "network-vif-deleted", "tag": "ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:14.987522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a579f84d-c0ae-47b5-bc20-e17be351e2f5 req-f05fed22-3898-4c06-807b-2b7257cffc57 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:14.988090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a579f84d-c0ae-47b5-bc20-e17be351e2f5 req-f05fed22-3898-4c06-807b-2b7257cffc57 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:14.988629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a579f84d-c0ae-47b5-bc20-e17be351e2f5 req-f05fed22-3898-4c06-807b-2b7257cffc57 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.000737 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:15.008796 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a579f84d-c0ae-47b5-bc20-e17be351e2f5 req-f05fed22-3898-4c06-807b-2b7257cffc57 service nova] Creating event network-vif-deleted:ae3ad2b0-bf0e-4e2c-ab56-0852f381e9f9 for instance 642a16e0-6927-432c-9a1c-65b4dab274a4 on n-h2-master-1 Oct 16 01:25:15.024505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a579f84d-c0ae-47b5-bc20-e17be351e2f5 req-f05fed22-3898-4c06-807b-2b7257cffc57 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062847 Oct 16 01:25:15.030934 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2555/4981] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:15.307802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:15.317561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-28259f29-d1b7-406d-b440-e7eed5297818 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.715035 Oct 16 01:25:15.318435 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2427/4982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:14 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:15.463225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:15.463225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:15.464255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:15.464255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:15.470584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.473411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.473856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.474570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.474727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.475066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.475225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.475583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.476254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.477036 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.477504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.477938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.505653 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:15.596451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.597031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.597559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.601183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lazy-loading 'fault' on Instance uuid 642a16e0-6927-432c-9a1c-65b4dab274a4 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:25:15.692394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:15.702760 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e62e3f4-90a3-4b66-a037-db46d1e6fe42 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 200 len: 1338 microversion: 2.1 time: 0.248832 Oct 16 01:25:15.705057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:15.713756 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-388378af-764b-4df0-a064-df51777c261b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1497 microversion: 2.1 time: 0.260064 Oct 16 01:25:15.727209 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2428/4983] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:15 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:15.727537 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2556/4984] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:15 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 1338 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:15.727809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:15.728505 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:15.735229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.735937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.736539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.738266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.739108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.739715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.750685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f42dd1dd-55a5-4beb-aeea-0c93b6acecb1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:15.777167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.compute.server_groups [None req-f42dd1dd-55a5-4beb-aeea-0c93b6acecb1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Querying cell 15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) for 1 instances {{(pid=120545) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 16 01:25:15.778581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42dd1dd-55a5-4beb-aeea-0c93b6acecb1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.779276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42dd1dd-55a5-4beb-aeea-0c93b6acecb1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.779826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42dd1dd-55a5-4beb-aeea-0c93b6acecb1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.824894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f42dd1dd-55a5-4beb-aeea-0c93b6acecb1 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/d0da8c1f-54eb-49a6-8ff4-cf7575fc1156" status: 200 len: 221 microversion: 2.1 time: 0.088773 Oct 16 01:25:15.825682 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2557/4985] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:25:15 2022] GET /compute/v2.1/os-server-groups/d0da8c1f-54eb-49a6-8ff4-cf7575fc1156 => generated 221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:25:15.837723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:15.838221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:15.844443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.845192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.845792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.847159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.847836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.848847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.861845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lazy-loading 'services' on Instance uuid 12931e29-f20a-423d-9473-94cca81d5ff5 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:25:15.899642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:25:15.973500 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-61e13af1-f7fb-4b99-9140-66d4e61a06a0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments/1aa9e423-838d-402a-a38c-140911a6ca4e" status: 202 len: 0 microversion: 2.1 time: 0.257952 Oct 16 01:25:15.974533 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2429/4986] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:25:15 2022] DELETE /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments/1aa9e423-838d-402a-a38c-140911a6ca4e => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:25:15.982638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:15.983278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:15.992931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.993740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.994362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:15.995312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:15.996594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:15.997085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.018037 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3a621349-fefa-4402-9eda-d7aa474fc217 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 204 len: 0 microversion: 2.1 time: 0.184767 Oct 16 01:25:16.019274 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2558/4987] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:15 2022] DELETE /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:25:16.032176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:16.036093 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:16.061499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.062269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.062763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.063699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.064527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.064967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.104394 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e5a7a181-be04-4990-8891-2023e5724348 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083584 Oct 16 01:25:16.105373 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2559/4988] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:16 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:16.110066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:16.110971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:16.117865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.118359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.119022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.119962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.120591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.121620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.205183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:16.217388 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-91134259-2b58-4781-bc84-a57dd74d336a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.240732 Oct 16 01:25:16.218166 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2430/4989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:15 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:16.273365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:16.281352 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dac9048c-b699-4389-8b2b-476a3c441718 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1503 microversion: 2.1 time: 0.174874 Oct 16 01:25:16.281931 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2560/4990] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:16 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:16.346198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:16.346901 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:16.353464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.353949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.354383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.355259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.355710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.356344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.467542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c9b6de63-2837-4b4d-9731-3e258defe1ca req-fa3dd919-9fb5-4d6e-b99d-22e7fbd2f2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438", "name": "network-vif-plugged", "status": "completed", "tag": "ebf526f4-6d18-4e21-9c38-4219f2d56da2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:16.488937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c9b6de63-2837-4b4d-9731-3e258defe1ca req-fa3dd919-9fb5-4d6e-b99d-22e7fbd2f2cc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.489471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c9b6de63-2837-4b4d-9731-3e258defe1ca req-fa3dd919-9fb5-4d6e-b99d-22e7fbd2f2cc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.489958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c9b6de63-2837-4b4d-9731-3e258defe1ca req-fa3dd919-9fb5-4d6e-b99d-22e7fbd2f2cc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.510302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:16.520858 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-934cf3ba-a680-41f9-b2c2-f6c14cd44b2b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.178837 Oct 16 01:25:16.521522 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2431/4991] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:16 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:16.521674 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c9b6de63-2837-4b4d-9731-3e258defe1ca req-fa3dd919-9fb5-4d6e-b99d-22e7fbd2f2cc service nova] Creating event network-vif-plugged:ebf526f4-6d18-4e21-9c38-4219f2d56da2 for instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 on n-h2-master-1 Oct 16 01:25:16.529676 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c9b6de63-2837-4b4d-9731-3e258defe1ca req-fa3dd919-9fb5-4d6e-b99d-22e7fbd2f2cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066619 Oct 16 01:25:16.532561 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2561/4992] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:25:16.729182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:16.729795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: 642a16e0-6927-432c-9a1c-65b4dab274a4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:16.736245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.736734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.737186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.738420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:16.738868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:16.739535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:16.753790 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] HTTP exception thrown: Instance 642a16e0-6927-432c-9a1c-65b4dab274a4 could not be found. Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Request method failure captured: Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 HTTP/1.1 Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ziAuG6j_JD8guND5I1dGsK1Rfw0fPM_1wwTb1CqSapss852Ff5ibwYBdkHyh2EDS_dqE1LI_4GZcCidmN0LYZi7Y20DCYMzOhuqbvNW1k48vjIjg-mF0E9fyyhLVFqqL-gCxrOoW124VDirWjYaWldknrg-51licReGw9SEOSTuOk Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0d53034488714fc8980132211d0d5c0b Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestNetworkBasicOps-225643155 Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0d53034488714fc8980132211d0d5c0b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestNetworkBasicOps-225643155 Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0d53034488714fc8980132211d0d5c0b Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestNetworkBasicOps-225643155 Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestNetworkBasicOps-225643155-project Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 88d5c0890ae64fd6aa7e7e547e9bf736 Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestNetworkBasicOps-225643155-project Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 642a16e0-6927-432c-9a1c-65b4dab274a4 could not be found. Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '642a16e0-6927-432c-9a1c-65b4dab274a4'} Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642a16e0-6927-432c-9a1c-65b4dab274a4 could not be found. Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642a16e0-6927-432c-9a1c-65b4dab274a4 could not be found. Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:16.755618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642a16e0-6927-432c-9a1c-65b4dab274a4 could not be found. Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Returning 404 to user: Instance 642a16e0-6927-432c-9a1c-65b4dab274a4 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:16.761207 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-641a6ac0-a345-4171-b29b-6653750414a8 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4" status: 404 len: 111 microversion: 2.1 time: 0.032098 Oct 16 01:25:16.761979 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2432/4993] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:16 2022] GET /compute/v2.1/servers/642a16e0-6927-432c-9a1c-65b4dab274a4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:16.941290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83843c08-6949-4166-8525-36587f3aee44 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '.version_select at 0x7fd64e0ed4c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:16.987101 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83843c08-6949-4166-8525-36587f3aee44 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-455576843" status: 202 len: 0 microversion: 2.1 time: 0.049851 Oct 16 01:25:16.991514 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2562/4994] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:25:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-455576843 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:25:17.117831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:17.120567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:17.126889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:17.127623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:17.128421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:17.129287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:17.129927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:17.130506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:17.188552 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e2af8518-3e43-4c2d-aaba-5aee46275976 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075384 Oct 16 01:25:17.189560 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2433/4995] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:17 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:17.242784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:17.243957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:17.250431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:17.252232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:17.252931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:17.253900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:17.254591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:17.255271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:17.306694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:17.307611 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:17.324220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:17.325003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:17.325614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:17.327036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:17.327661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:17.328274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:17.686338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:17.698460 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49bf1932-f2f8-48de-9bde-f16fb8a05918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.460064 Oct 16 01:25:17.716403 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2563/4996] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:17 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:17.724225 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:17.726426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:17.737870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:17.739946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:17.741622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:17.743938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:17.744953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:17.746390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:17.844385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:17.856790 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0908c4f4-ad69-4f2d-9751-3a5f0eab7c31 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1503 microversion: 2.1 time: 0.555033 Oct 16 01:25:17.858200 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2434/4997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:17 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1503 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:18.116411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:18.125241 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9fc558ce-a02f-4a27-bc68-75a11b73b3c7 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.406800 Oct 16 01:25:18.139345 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2564/4998] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:17 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:18.202929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:18.205634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:18.215285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:18.218232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:18.219250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:18.220304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:18.221534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:18.222277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:18.265938 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3c9388d5-f08c-46e3-b0c0-7afee3b8484f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067252 Oct 16 01:25:18.271242 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2435/4999] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:18 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:25:18.685784 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-219b66d0-6a8f-4e87-91bb-5eb21ac9a061 req-8681dabe-e9f9-4d81-9be2-169a583659a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6ead7e-041d-40be-973c-90816a76eef4", "name": "network-vif-deleted", "tag": "db877cfc-924a-4008-b3b6-4d6b636dda90"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:18.707313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-219b66d0-6a8f-4e87-91bb-5eb21ac9a061 req-8681dabe-e9f9-4d81-9be2-169a583659a3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:18.708458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-219b66d0-6a8f-4e87-91bb-5eb21ac9a061 req-8681dabe-e9f9-4d81-9be2-169a583659a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:18.708891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-219b66d0-6a8f-4e87-91bb-5eb21ac9a061 req-8681dabe-e9f9-4d81-9be2-169a583659a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:18.722442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:18.723366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:18.732708 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-219b66d0-6a8f-4e87-91bb-5eb21ac9a061 req-8681dabe-e9f9-4d81-9be2-169a583659a3 service nova] Creating event network-vif-deleted:db877cfc-924a-4008-b3b6-4d6b636dda90 for instance dc6ead7e-041d-40be-973c-90816a76eef4 on n-h2-master-1 Oct 16 01:25:18.740064 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-219b66d0-6a8f-4e87-91bb-5eb21ac9a061 req-8681dabe-e9f9-4d81-9be2-169a583659a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058315 Oct 16 01:25:18.741854 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2565/5000] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:18.742822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:18.743339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:18.743801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:18.744509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:18.744973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:18.745379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:18.884786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:18.885766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:18.909444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:18.909961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:18.912494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:18.913776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:18.914355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:18.914807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:18.988007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:18.989095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:18.990062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:18.991091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lazy-loading 'fault' on Instance uuid dc6ead7e-041d-40be-973c-90816a76eef4 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:25:19.136022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68d50afc01442eb9dbf1d306bba7052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0751d3ff2014be3ba106590c6abe65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:19.148992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d1eacfb-16eb-4f18-99ba-0e1453c94e4a tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 200 len: 1303 microversion: 2.1 time: 0.270928 Oct 16 01:25:19.154154 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2566/5001] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:18 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 1303 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:19.159207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:19.168176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:19.187951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:19.190693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:19.191516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:19.192478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:19.195477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:19.206960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:19.221868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:19.231225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-020f089c-3c07-474d-afca-24a1ca73580d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1519 microversion: 2.1 time: 0.513326 Oct 16 01:25:19.254242 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2436/5002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:18 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1519 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:19.282219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:19.290856 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:19.312118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:19.312629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:19.313290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:19.314017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:19.316287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:19.316767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:19.352693 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-852604cf-fcef-4ed9-b40a-daef23ae4768 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078584 Oct 16 01:25:19.358831 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2437/5003] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:19 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:19.520988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:19.532307 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-daaf0d7f-6bd8-4659-bcc3-74fdc82b16f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.376864 Oct 16 01:25:19.535980 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2567/5004] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:19 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:20.180568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:20.181337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:20.199144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.199898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.200607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.201696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.202334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.202963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.261376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:20.262624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:20.271671 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] HTTP exception thrown: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Request method failure captured: Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 HTTP/1.1 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS11hMu49tKdTIv_MizbtKf4IF9U1aFDS0jjiXsg0opOxJW1Ci0gezFu6LoX7bUuDSzQ7CZdamh9W6OCn1qKA8-zaBOzBzOtHkMYUtRbYYRcP_kMoicdHmpKwgqJxJabCFauhBfijroyQCdhK6vhP4Nxbrwpt9VhDXGxCzLq0rkoeBE4 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0751d3ff2014be3ba106590c6abe65d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: c68d50afc01442eb9dbf1d306bba7052 Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: exception: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'dc6ead7e-041d-40be-973c-90816a76eef4'} Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:20.285276 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:20.291041 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:20.291041 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:20.291041 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:20.291041 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:20.291041 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:20.291041 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:20.291041 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:20.297478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Returning 404 to user: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:20.297774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.298975 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3dcc9b6c-b3da-482f-939c-ad5bbf3378b0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 404 len: 111 microversion: 2.1 time: 0.123333 Oct 16 01:25:20.299870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.302212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.305219 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2438/5005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:20 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:20.305864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.307414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.309434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.328892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23b96ed0-c914-463c-812c-c7af822232c0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:20.389461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.server_groups [None req-23b96ed0-c914-463c-812c-c7af822232c0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Querying cell 15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) for 1 instances {{(pid=120546) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 16 01:25:20.393706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b96ed0-c914-463c-812c-c7af822232c0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.396666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b96ed0-c914-463c-812c-c7af822232c0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.398740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b96ed0-c914-463c-812c-c7af822232c0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.440717 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23b96ed0-c914-463c-812c-c7af822232c0 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.127097 Oct 16 01:25:20.443053 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2439/5006] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Oct 16 01:25:20 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:20.457118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:20.468769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:20.488789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.489744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.490592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.492735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.494426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.496128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.575082 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f71d9970-4bec-4fbd-870f-6098cbe1bc3e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122729 Oct 16 01:25:20.581199 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2440/5007] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:20 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:20.586488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-549002b9-7452-4c53-9c92-2c02fd94ee8b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:20.626479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.server_groups [None req-549002b9-7452-4c53-9c92-2c02fd94ee8b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Querying cell 15fd7fc4-bf67-4964-a6d6-3d113af26712(cell1) for 1 instances {{(pid=120546) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 16 01:25:20.627536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-549002b9-7452-4c53-9c92-2c02fd94ee8b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.628202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-549002b9-7452-4c53-9c92-2c02fd94ee8b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.629682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-549002b9-7452-4c53-9c92-2c02fd94ee8b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.661478 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-549002b9-7452-4c53-9c92-2c02fd94ee8b tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/d0da8c1f-54eb-49a6-8ff4-cf7575fc1156" status: 200 len: 183 microversion: 2.1 time: 0.078686 Oct 16 01:25:20.662451 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2441/5008] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:25:20 2022] GET /compute/v2.1/os-server-groups/d0da8c1f-54eb-49a6-8ff4-cf7575fc1156 => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:20.668196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:20.675039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:20.688834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.695997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.696812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:20.697815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:20.698467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:20.699117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.277948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:21.281413 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:21.291849 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-87c4b87e-493d-4c28-98b6-a54dc0afd527 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 1.035208 Oct 16 01:25:21.294235 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2568/5009] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:20 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:21.295559 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-94ba9841-1a2f-4548-96de-5f28a5a028eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.629885 Oct 16 01:25:21.296585 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2442/5010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:20 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:21.304264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.305299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:21.312720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.313659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.314333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.316020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.316609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.317906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.319758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.320590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:21.329638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.330448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.331581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.332726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.333658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.334675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.347374 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] HTTP exception thrown: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Request method failure captured: Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 HTTP/1.1 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS11hMu49tKdTIv_MizbtKf4IF9U1aFDS0jjiXsg0opOxJW1Ci0gezFu6LoX7bUuDSzQ7CZdamh9W6OCn1qKA8-zaBOzBzOtHkMYUtRbYYRcP_kMoicdHmpKwgqJxJabCFauhBfijroyQCdhK6vhP4Nxbrwpt9VhDXGxCzLq0rkoeBE4 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0751d3ff2014be3ba106590c6abe65d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c68d50afc01442eb9dbf1d306bba7052 Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: exception: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'dc6ead7e-041d-40be-973c-90816a76eef4'} Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:21.351219 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.360690 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.363259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Returning 404 to user: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:21.363781 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b3db3fe4-081b-49dc-b3c5-78b1d627a2df tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 404 len: 111 microversion: 2.1 time: 0.067588 Oct 16 01:25:21.368093 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2569/5011] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:21 2022] DELETE /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:21.376387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.377096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] [instance: dc6ead7e-041d-40be-973c-90816a76eef4] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:21.385239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.385829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.386279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.387441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.387793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.388372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.407643 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] HTTP exception thrown: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Request method failure captured: Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 HTTP/1.1 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS11hMu49tKdTIv_MizbtKf4IF9U1aFDS0jjiXsg0opOxJW1Ci0gezFu6LoX7bUuDSzQ7CZdamh9W6OCn1qKA8-zaBOzBzOtHkMYUtRbYYRcP_kMoicdHmpKwgqJxJabCFauhBfijroyQCdhK6vhP4Nxbrwpt9VhDXGxCzLq0rkoeBE4 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0751d3ff2014be3ba106590c6abe65d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c68d50afc01442eb9dbf1d306bba7052 Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: exception: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'dc6ead7e-041d-40be-973c-90816a76eef4'} Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.409740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Returning 404 to user: Instance dc6ead7e-041d-40be-973c-90816a76eef4 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-26618a20-a56f-4fa2-9d6a-ec2fdb482799 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4" status: 404 len: 111 microversion: 2.1 time: 0.042026 Oct 16 01:25:21.421298 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2570/5012] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:21 2022] GET /compute/v2.1/servers/dc6ead7e-041d-40be-973c-90816a76eef4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:21.427541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60d19ce6-d532-4d6e-aeeb-e44ac0252b32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.439985 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-60d19ce6-d532-4d6e-aeeb-e44ac0252b32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] HTTP exception thrown: Instance group 8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 could not be found. Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60d19ce6-d532-4d6e-aeeb-e44ac0252b32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Request method failure captured: Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-server-groups/8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 HTTP/1.1 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS11hMu49tKdTIv_MizbtKf4IF9U1aFDS0jjiXsg0opOxJW1Ci0gezFu6LoX7bUuDSzQ7CZdamh9W6OCn1qKA8-zaBOzBzOtHkMYUtRbYYRcP_kMoicdHmpKwgqJxJabCFauhBfijroyQCdhK6vhP4Nxbrwpt9VhDXGxCzLq0rkoeBE4 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0751d3ff2014be3ba106590c6abe65d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c68d50afc01442eb9dbf1d306bba7052 Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: exception: Instance group 8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 could not be found. Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8eea8f74-1208-4b5b-9b1f-d8b2f9315c13'} Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 could not be found. Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 could not be found. Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.443096 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 could not be found. Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60d19ce6-d532-4d6e-aeeb-e44ac0252b32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Returning 404 to user: Instance group 8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60d19ce6-d532-4d6e-aeeb-e44ac0252b32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/8eea8f74-1208-4b5b-9b1f-d8b2f9315c13" status: 404 len: 117 microversion: 2.1 time: 0.024543 Oct 16 01:25:21.448339 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2571/5013] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:25:21 2022] DELETE /compute/v2.1/os-server-groups/8eea8f74-1208-4b5b-9b1f-d8b2f9315c13 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:21.473882 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-53ddab02-e979-4460-9a99-ee33c789238f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.495883 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-53ddab02-e979-4460-9a99-ee33c789238f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] HTTP exception thrown: Instance group a0986fce-71aa-42cd-a983-c4d2653d4e54 could not be found. Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-53ddab02-e979-4460-9a99-ee33c789238f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Request method failure captured: Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-server-groups/a0986fce-71aa-42cd-a983-c4d2653d4e54 HTTP/1.1 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS11hMu49tKdTIv_MizbtKf4IF9U1aFDS0jjiXsg0opOxJW1Ci0gezFu6LoX7bUuDSzQ7CZdamh9W6OCn1qKA8-zaBOzBzOtHkMYUtRbYYRcP_kMoicdHmpKwgqJxJabCFauhBfijroyQCdhK6vhP4Nxbrwpt9VhDXGxCzLq0rkoeBE4 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0751d3ff2014be3ba106590c6abe65d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c68d50afc01442eb9dbf1d306bba7052 Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: exception: Instance group a0986fce-71aa-42cd-a983-c4d2653d4e54 could not be found. Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'a0986fce-71aa-42cd-a983-c4d2653d4e54'} Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a0986fce-71aa-42cd-a983-c4d2653d4e54 could not be found. Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a0986fce-71aa-42cd-a983-c4d2653d4e54 could not be found. Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.502849 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.507908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.507908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.507908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:21.507908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:21.507908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a0986fce-71aa-42cd-a983-c4d2653d4e54 could not be found. Oct 16 01:25:21.507908 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.507908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-53ddab02-e979-4460-9a99-ee33c789238f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Returning 404 to user: Instance group a0986fce-71aa-42cd-a983-c4d2653d4e54 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:21.507908 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-53ddab02-e979-4460-9a99-ee33c789238f tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/a0986fce-71aa-42cd-a983-c4d2653d4e54" status: 404 len: 117 microversion: 2.1 time: 0.044317 Oct 16 01:25:21.510335 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2572/5014] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:25:21 2022] DELETE /compute/v2.1/os-server-groups/a0986fce-71aa-42cd-a983-c4d2653d4e54 => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:21.521642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14da8476-2aaf-4d2d-a58a-b9f45c92ac32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.536152 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-14da8476-2aaf-4d2d-a58a-b9f45c92ac32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] HTTP exception thrown: Instance group 40fd64d8-ffd2-4955-b944-cd830e80faf3 could not be found. Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14da8476-2aaf-4d2d-a58a-b9f45c92ac32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Request method failure captured: Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-server-groups/40fd64d8-ffd2-4955-b944-cd830e80faf3 HTTP/1.1 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS11hMu49tKdTIv_MizbtKf4IF9U1aFDS0jjiXsg0opOxJW1Ci0gezFu6LoX7bUuDSzQ7CZdamh9W6OCn1qKA8-zaBOzBzOtHkMYUtRbYYRcP_kMoicdHmpKwgqJxJabCFauhBfijroyQCdhK6vhP4Nxbrwpt9VhDXGxCzLq0rkoeBE4 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0751d3ff2014be3ba106590c6abe65d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c68d50afc01442eb9dbf1d306bba7052 Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: exception: Instance group 40fd64d8-ffd2-4955-b944-cd830e80faf3 could not be found. Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '40fd64d8-ffd2-4955-b944-cd830e80faf3'} Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 40fd64d8-ffd2-4955-b944-cd830e80faf3 could not be found. Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 40fd64d8-ffd2-4955-b944-cd830e80faf3 could not be found. Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.539836 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.544335 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.544335 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.544335 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:21.544335 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:21.544335 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 40fd64d8-ffd2-4955-b944-cd830e80faf3 could not be found. Oct 16 01:25:21.544335 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.544335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14da8476-2aaf-4d2d-a58a-b9f45c92ac32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Returning 404 to user: Instance group 40fd64d8-ffd2-4955-b944-cd830e80faf3 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:21.544335 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-14da8476-2aaf-4d2d-a58a-b9f45c92ac32 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/40fd64d8-ffd2-4955-b944-cd830e80faf3" status: 404 len: 117 microversion: 2.1 time: 0.029565 Oct 16 01:25:21.545448 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2573/5015] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:25:21 2022] DELETE /compute/v2.1/os-server-groups/40fd64d8-ffd2-4955-b944-cd830e80faf3 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:21.557281 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16a84a00-c596-4cc3-81a2-82f57045dc1c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.584484 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-16a84a00-c596-4cc3-81a2-82f57045dc1c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] HTTP exception thrown: Instance group 648cfd5d-671c-4500-adbc-2b6b7d82c712 could not be found. Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16a84a00-c596-4cc3-81a2-82f57045dc1c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Request method failure captured: Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-server-groups/648cfd5d-671c-4500-adbc-2b6b7d82c712 HTTP/1.1 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS11hMu49tKdTIv_MizbtKf4IF9U1aFDS0jjiXsg0opOxJW1Ci0gezFu6LoX7bUuDSzQ7CZdamh9W6OCn1qKA8-zaBOzBzOtHkMYUtRbYYRcP_kMoicdHmpKwgqJxJabCFauhBfijroyQCdhK6vhP4Nxbrwpt9VhDXGxCzLq0rkoeBE4 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0751d3ff2014be3ba106590c6abe65d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0751d3ff2014be3ba106590c6abe65d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e0751d3ff2014be3ba106590c6abe65d Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerGroupTestJSON-2064464185 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c68d50afc01442eb9dbf1d306bba7052 Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerGroupTestJSON-2064464185-project Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: exception: Instance group 648cfd5d-671c-4500-adbc-2b6b7d82c712 could not be found. Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '648cfd5d-671c-4500-adbc-2b6b7d82c712'} Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 648cfd5d-671c-4500-adbc-2b6b7d82c712 could not be found. Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 648cfd5d-671c-4500-adbc-2b6b7d82c712 could not be found. Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.596245 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 648cfd5d-671c-4500-adbc-2b6b7d82c712 could not be found. Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16a84a00-c596-4cc3-81a2-82f57045dc1c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Returning 404 to user: Instance group 648cfd5d-671c-4500-adbc-2b6b7d82c712 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-16a84a00-c596-4cc3-81a2-82f57045dc1c tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/648cfd5d-671c-4500-adbc-2b6b7d82c712" status: 404 len: 117 microversion: 2.1 time: 0.048253 Oct 16 01:25:21.601380 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2574/5016] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:25:21 2022] DELETE /compute/v2.1/os-server-groups/648cfd5d-671c-4500-adbc-2b6b7d82c712 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:25:21.609756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.612128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:21.624422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.627163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.628201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.628924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.629390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.629818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.676466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:21.685391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cc1a6b7b-c55f-40d7-a4b3-d1cd68e8663d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.374154 Oct 16 01:25:21.690228 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2443/5017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:21 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:21.699564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-388d7468-57bd-4a21-92fd-beff4b02bf67 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.732190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8995e91d-3434-4c08-becf-303afded9844 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132215 Oct 16 01:25:21.732815 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2575/5018] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:21 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:21.737907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:21.739642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:21.748158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.749042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.749851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.750981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:21.751867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:21.752580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:21.762208 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-388d7468-57bd-4a21-92fd-beff4b02bf67 tempest-ServerGroupTestJSON-2064464185 tempest-ServerGroupTestJSON-2064464185-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/d0da8c1f-54eb-49a6-8ff4-cf7575fc1156" status: 204 len: 0 microversion: 2.1 time: 0.070581 Oct 16 01:25:21.762800 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2444/5019] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 01:25:21 2022] DELETE /compute/v2.1/os-server-groups/d0da8c1f-54eb-49a6-8ff4-cf7575fc1156 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:25:22.038301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:22.046712 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d49181a8-2375-4a9a-ba78-f695c2365459 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.312822 Oct 16 01:25:22.050574 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2576/5020] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:21 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:22.076010 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8815927c-9489-4418-a6e2-5c9d3e33f324 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:22.087277 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-8815927c-9489-4418-a6e2-5c9d3e33f324 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 12133772-9e7f-433d-b08c-d18ef8c7958b has no mapping to a cell. Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8815927c-9489-4418-a6e2-5c9d3e33f324 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/12133772-9e7f-433d-b08c-d18ef8c7958b/action HTTP/1.1 Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 15 Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: {"os-stop": {}} Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 12133772-9e7f-433d-b08c-d18ef8c7958b has no mapping to a cell. Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '12133772-9e7f-433d-b08c-d18ef8c7958b', 'body': {'os-stop': {}}} Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 12133772-9e7f-433d-b08c-d18ef8c7958b has no mapping to a cell. Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:22.096645 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12133772-9e7f-433d-b08c-d18ef8c7958b has no mapping to a cell. Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12133772-9e7f-433d-b08c-d18ef8c7958b has no mapping to a cell. Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.102262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8815927c-9489-4418-a6e2-5c9d3e33f324 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 12133772-9e7f-433d-b08c-d18ef8c7958b has no mapping to a cell. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:22.104876 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8815927c-9489-4418-a6e2-5c9d3e33f324 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/12133772-9e7f-433d-b08c-d18ef8c7958b/action" status: 404 len: 117 microversion: 2.1 time: 0.032699 Oct 16 01:25:22.106733 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2445/5021] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:22 2022] POST /compute/v2.1/servers/12133772-9e7f-433d-b08c-d18ef8c7958b/action => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:22.114499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:22.115733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:22.125561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.126552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.127423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.129392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.130255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.131016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.323555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:22.324808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:22.332058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.332803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.333407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.334297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.335510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.336128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.396223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:22.407448 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b178e1b9-4bb1-4af7-aba9-ceb4061c9d05 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.297135 Oct 16 01:25:22.408635 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2577/5022] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:22 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:22.452411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:22.453435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:22.465356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.467977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.469144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.473601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.474171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.474703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.482197 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:22.603780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:22.626490 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c981077d-3c5b-41b0-b3a8-f72578394c18 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.308629 Oct 16 01:25:22.627154 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2446/5023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:22 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:22.721619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:22.735977 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5c7443db-9c54-4a4b-a0b7-539317a31451 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.305883 Oct 16 01:25:22.736941 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2578/5024] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:22 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:22.754836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:22.757186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:22.759986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-50ee3ff7-1dbc-467d-887c-d03bd4dd8d83 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:22.760863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-50ee3ff7-1dbc-467d-887c-d03bd4dd8d83 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: ca8b1e67-2cb4-4a2f-a152-e334fda52049] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:22.764433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.764922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.765579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.766471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.767137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.767806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.769621 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-50ee3ff7-1dbc-467d-887c-d03bd4dd8d83 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance ca8b1e67-2cb4-4a2f-a152-e334fda52049 could not be found. Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-50ee3ff7-1dbc-467d-887c-d03bd4dd8d83 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/ca8b1e67-2cb4-4a2f-a152-e334fda52049/action HTTP/1.1 Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: {"suspend": {}} Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: exception: Instance ca8b1e67-2cb4-4a2f-a152-e334fda52049 could not be found. Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'ca8b1e67-2cb4-4a2f-a152-e334fda52049', 'body': {'suspend': {}}} Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8b1e67-2cb4-4a2f-a152-e334fda52049 could not be found. Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8b1e67-2cb4-4a2f-a152-e334fda52049 could not be found. Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:22.771195 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:22.776424 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:22.776424 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:22.776424 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8b1e67-2cb4-4a2f-a152-e334fda52049 could not be found. Oct 16 01:25:22.776424 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:22.776424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-50ee3ff7-1dbc-467d-887c-d03bd4dd8d83 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance ca8b1e67-2cb4-4a2f-a152-e334fda52049 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:22.776424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-50ee3ff7-1dbc-467d-887c-d03bd4dd8d83 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/ca8b1e67-2cb4-4a2f-a152-e334fda52049/action" status: 404 len: 111 microversion: 2.1 time: 0.017804 Oct 16 01:25:22.778108 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2579/5025] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:22 2022] POST /compute/v2.1/servers/ca8b1e67-2cb4-4a2f-a152-e334fda52049/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:22.784344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:22.785095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:22.793555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.794057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.794491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.795409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.795874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.796302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.813923 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b3de924-8b19-4632-af04-7dcc819e169f tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063034 Oct 16 01:25:22.815152 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2447/5026] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:22 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:25:22.894550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:22.897794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:22.904064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.904804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.905244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.905940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:22.906389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:22.907026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:22.933428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:25:22.948906 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:23.027675 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-efd12b39-6bdc-4c39-a681-172f730bb52e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 204 len: 0 microversion: 2.1 time: 0.137024 Oct 16 01:25:23.028879 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2448/5027] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:22 2022] DELETE /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:25:23.040302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:23.042170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:23.049164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.049660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.050095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.050798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.051284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.051710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.126443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:23.136721 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-acba9354-9cce-405b-aadd-926bcc37e6ef tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.357488 Oct 16 01:25:23.156809 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2580/5028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:22 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:23.168954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:23.170142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:23.185060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.185704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.186402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.187429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.189755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.190715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.394386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:23.403244 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-67d177c7-1980-47ec-9072-0c4be6d34d4e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1682 microversion: 2.1 time: 0.369151 Oct 16 01:25:23.404191 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2449/5029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:23 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1682 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:23.503701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:23.515049 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7478661-b274-4d31-98f1-faa7ebb3e285 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.355675 Oct 16 01:25:23.532164 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2581/5030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:23 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:23.542210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:23.542748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:23.559476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.560334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.560839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.561609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.562457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.563147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.595623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lazy-loading 'flavor' on Instance uuid 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:25:23.650537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:23.651470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:23.657751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.658604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.659344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.660405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.661129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.661854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.727862 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fdcfbb74-257c-4b44-bd63-e1a5f5144ac6 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 202 len: 0 microversion: 2.1 time: 0.189793 Oct 16 01:25:23.729227 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2450/5031] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:23 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:25:23.740112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:23.741202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:23.746446 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:23.751031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.751697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.756879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.758517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:23.759596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:23.760389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:23.992865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:24.009197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ed9c45b-7ef8-4e6e-94c4-4807ac35d35e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.363024 Oct 16 01:25:24.011477 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2582/5032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:23 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:24.090419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:24.103821 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fade15da-3374-4231-a41c-395ab1e38800 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1514 microversion: 2.1 time: 0.367964 Oct 16 01:25:24.106414 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2451/5033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:23 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1514 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:24.432402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:24.433569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:24.449516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:24.450751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:24.451493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:24.452455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:24.453145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:24.453793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:24.772257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:24.786274 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b844e48f-187e-4a21-bc0b-3fad7d442497 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1682 microversion: 2.1 time: 0.360582 Oct 16 01:25:24.787790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2583/5034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:24 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1682 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:25.036118 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:25.036728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:25.051711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:25.052683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:25.054062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:25.055338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:25.056500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:25.057714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:25.139199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:25.140575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:25.151366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:25.152954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:25.168474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:25.172379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:25.173072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:25.174015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:25.861395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:25.936635 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-77eb57e8-141e-4783-b3ec-debe871b0368 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.899168 Oct 16 01:25:25.944366 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2452/5035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:25 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:25.968051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:25.981355 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:25.984464 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:25.987913 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b677b300-ba73-47b3-ad81-16ea9638bb66 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1497 microversion: 2.1 time: 0.852971 Oct 16 01:25:25.988549 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2584/5036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:25 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1497 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:26.018369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:26.019248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:26.028779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.033216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.034086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.037669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.038761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.039494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.039724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.040710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.041174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.042153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.042819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.068071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.099991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lazy-loading 'flavor' on Instance uuid 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:25:26.138735 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Cannot 'suspend' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state suspended Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action HTTP/1.1 Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: {"suspend": {}} Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'suspend' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state suspended Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'suspend': {}}} Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 16 01:25:26.142208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state suspended Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state suspended Oct 16 01:25:26.148712 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:26.154940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 409 to user: Cannot 'suspend' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state suspended {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:26.156103 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-06ff3168-d9df-415b-8248-40686149cfb8 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 409 len: 148 microversion: 2.1 time: 0.142303 Oct 16 01:25:26.157219 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2585/5037] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:26 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 148 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:25:26.165483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:26.171292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:26.184559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.185288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.186983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.190052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.190793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.191558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.372317 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc9bb4e3-9ed1-4088-a6d4-db3da2696c3b tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 202 len: 0 microversion: 2.1 time: 0.210693 Oct 16 01:25:26.379440 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2586/5038] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:26 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:25:26.398114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:26.398839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:26.409440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.409947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.410395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.429805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.432845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.433326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.706380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:26.721450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-21e492bf-2dd7-42ff-85e8-257d04b477e7 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1682 microversion: 2.1 time: 0.771562 Oct 16 01:25:26.738948 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2453/5039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:25 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1682 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:26.964815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:26.965783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:26.980812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.981647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.983237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:26.984242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:26.986531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:26.989284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:27.044393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:27.061140 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-172cb3bd-f6a6-4a33-a2ad-805a9822874d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1503 microversion: 2.1 time: 0.678015 Oct 16 01:25:27.062149 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2587/5040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:26 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1503 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:27.670845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:27.686226 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7521aab8-71c7-4394-acd5-ff42086a0ca9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.726133 Oct 16 01:25:27.687589 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2454/5041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:26 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:27.752965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:27.754138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:27.765659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:27.780897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:27.782639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:27.792065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:27.796179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:27.810227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:28.064039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e97960c4eb488b900951e0898f34c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e664ea80daaf450886978f25b2d9e373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:28.075002 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3473028c-e2da-41fe-9d35-a1786d497b88 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 200 len: 1615 microversion: 2.1 time: 0.328956 Oct 16 01:25:28.078438 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2588/5042] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:27 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 1615 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:28.093143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:28.093968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:28.102092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:28.108466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:28.109204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:28.110299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:28.113415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:28.114799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:28.234942 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-37bdebc7-5b59-4e87-b905-c0ecb8dc8b85 req-43137c27-3259-4144-8f59-4b54544613aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12931e29-f20a-423d-9473-94cca81d5ff5", "name": "network-vif-deleted", "tag": "79e277f2-09d2-40c6-8432-70bd8c888740"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:28.262102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-37bdebc7-5b59-4e87-b905-c0ecb8dc8b85 req-43137c27-3259-4144-8f59-4b54544613aa service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:28.264468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-37bdebc7-5b59-4e87-b905-c0ecb8dc8b85 req-43137c27-3259-4144-8f59-4b54544613aa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:28.266078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-37bdebc7-5b59-4e87-b905-c0ecb8dc8b85 req-43137c27-3259-4144-8f59-4b54544613aa service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:28.294724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-37bdebc7-5b59-4e87-b905-c0ecb8dc8b85 req-43137c27-3259-4144-8f59-4b54544613aa service nova] Creating event network-vif-deleted:79e277f2-09d2-40c6-8432-70bd8c888740 for instance 12931e29-f20a-423d-9473-94cca81d5ff5 on n-h1-master-1 Oct 16 01:25:28.312956 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-37bdebc7-5b59-4e87-b905-c0ecb8dc8b85 req-43137c27-3259-4144-8f59-4b54544613aa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080534 Oct 16 01:25:28.314470 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2589/5043] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:25:28.649105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:28.659225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-497258f5-a3ea-45b1-b453-407e1611313c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1503 microversion: 2.1 time: 0.574869 Oct 16 01:25:28.660154 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2455/5044] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:28 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1503 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:28.713494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:28.714567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:28.720802 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:28.723724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:28.724565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:28.739730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:28.741599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:28.742374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:28.743070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:29.107750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:29.109630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:29.133802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:29.135732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:29.137057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:29.140255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:29.140982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:29.141615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:29.197113 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 HTTP/1.1 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '12931e29-f20a-423d-9473-94cca81d5ff5'} Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:29.198976 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cc9780ce-c3b0-4e56-9ffb-19f27284ea2e tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 404 len: 111 microversion: 2.1 time: 0.100621 Oct 16 01:25:29.205370 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2456/5045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:29 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:29.222315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9362f845-d988-47d0-b43b-31f41d12b04a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '.version_select at 0x7fd64d6229d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:29.270164 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9362f845-d988-47d0-b43b-31f41d12b04a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040644614" status: 202 len: 0 microversion: 2.1 time: 0.062089 Oct 16 01:25:29.271579 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2457/5046] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:25:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040644614 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:25:29.379677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:29.388581 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b90f0fba-044c-49f6-8702-debc06240172 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.680114 Oct 16 01:25:29.389165 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2590/5047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:28 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:29.692295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:29.692911 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:29.723004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:29.723511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:29.723950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:29.724666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:29.725122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:29.726378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:29.943768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:29.944826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:29.952119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:29.952624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:29.953074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:29.956756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:29.957270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:29.957721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:30.141286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lazy-loading 'services' on Instance uuid 53610cf8-c016-4fa4-bd6e-178818cc4ab3 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:25:30.298266 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a0e92ca8-49e9-4642-8ca7-f14b68003bf3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments/eff9ac7a-1965-4a48-8768-ac7b6b33b2dd" status: 202 len: 0 microversion: 2.1 time: 0.357918 Oct 16 01:25:30.300009 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2591/5048] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:25:29 2022] DELETE /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments/eff9ac7a-1965-4a48-8768-ac7b6b33b2dd => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:25:30.319903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:30.322563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:30.339703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:30.340474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:30.341118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:30.341995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:30.342628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:30.343261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:30.442899 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b169abe2-c3c3-45be-86c2-f37fae1dece0 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134136 Oct 16 01:25:30.470276 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2592/5049] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:30 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:30.479115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:30.480207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:30.502035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:30.502695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:30.503619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:30.506059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:30.509278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:30.510120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:30.947950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:30.956932 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ae905d20-f859-41e6-b451-f652598fa803 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1503 microversion: 2.1 time: 1.276851 Oct 16 01:25:30.968139 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2458/5050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:29 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1503 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:31.126649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:31.135550 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-95425870-f139-44b7-8861-fa58d4eb5c5e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.663694 Oct 16 01:25:31.136140 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2593/5051] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:30 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:31.481905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:31.484931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:31.503390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:31.504201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:31.505137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:31.506038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:31.507813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:31.508843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:31.597869 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-45670730-6efd-45f4-ade9-ca24d06d39a1 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122823 Oct 16 01:25:31.606610 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2459/5052] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:31 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:31.985879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:31.987250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:32.009686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:32.011465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:32.013057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:32.014268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:32.015178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:32.016357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:32.163972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:32.166208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:32.179532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:32.181984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:32.188608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:32.207122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:32.208715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:32.209434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:33.003157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:33.018418 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-68c36895-52d1-4ce2-a12d-d8acaa01d2a5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1511 microversion: 2.1 time: 0.860291 Oct 16 01:25:33.021706 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2460/5053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:32 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1511 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:33.041913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:33.044857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:33.064671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:33.065681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:33.066374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:33.067790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:33.071910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:33.073204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:33.103735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:33.113679 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:33.113679 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7698fbc8-76ba-4a56-ad4b-96f8e59605cf tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 1.135905 Oct 16 01:25:33.127429 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2594/5054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:31 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:33.157486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:33.162031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:33.199182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:33.201949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:33.208904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:33.213451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:33.214949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:33.217590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:33.226123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4f6531a5-0173-4cf7-94fc-8686c78d8bef tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197967 Oct 16 01:25:33.229631 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2461/5055] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:33 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:33.632665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d92fd02b-6f5a-420e-b184-fcb5e4abc717 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Calling method '.version_select at 0x7fd64d1e5b80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:33.727817 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d92fd02b-6f5a-420e-b184-fcb5e4abc717 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db/defaults" status: 200 len: 371 microversion: 2.1 time: 0.428185 Oct 16 01:25:33.729764 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2462/5056] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:25:33 2022] GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db/defaults => generated 371 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:33.753158 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7131307a-af62-46e5-95e1-4ebfd27dad5a tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Calling method '.version_select at 0x7fd64d0b0d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:33.801021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:33.812038 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f65549a-1ab3-4472-b10d-6121173431b1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.662567 Oct 16 01:25:33.818349 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2595/5057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:33 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:33.840291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60785a02-3915-4cda-91ca-2d53c4067955 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:33.841167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60785a02-3915-4cda-91ca-2d53c4067955 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 634180c0-53b9-4b32-b242-aaa19415021b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:33.851803 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-60785a02-3915-4cda-91ca-2d53c4067955 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 634180c0-53b9-4b32-b242-aaa19415021b could not be found. Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60785a02-3915-4cda-91ca-2d53c4067955 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/634180c0-53b9-4b32-b242-aaa19415021b/action HTTP/1.1 Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: {"unpause": {}} Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 634180c0-53b9-4b32-b242-aaa19415021b could not be found. Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '634180c0-53b9-4b32-b242-aaa19415021b', 'body': {'unpause': {}}} Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634180c0-53b9-4b32-b242-aaa19415021b could not be found. Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634180c0-53b9-4b32-b242-aaa19415021b could not be found. Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:33.853750 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:33.858474 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:33.858474 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:33.858474 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634180c0-53b9-4b32-b242-aaa19415021b could not be found. Oct 16 01:25:33.858474 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:33.858474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60785a02-3915-4cda-91ca-2d53c4067955 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 634180c0-53b9-4b32-b242-aaa19415021b could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:33.858474 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60785a02-3915-4cda-91ca-2d53c4067955 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/634180c0-53b9-4b32-b242-aaa19415021b/action" status: 404 len: 111 microversion: 2.1 time: 0.020773 Oct 16 01:25:33.858474 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2596/5058] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:33 2022] POST /compute/v2.1/servers/634180c0-53b9-4b32-b242-aaa19415021b/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:25:33.868951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:33.869658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:33.883699 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7131307a-af62-46e5-95e1-4ebfd27dad5a tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db" status: 200 len: 371 microversion: 2.1 time: 0.143864 Oct 16 01:25:33.884468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:33.884971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:33.885410 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2463/5059] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:25:33 2022] GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:33.885568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:33.886560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:33.888502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:33.889132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:33.898845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c05e2077-7fdb-412c-86a1-4a6f7bd27a4a tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Calling method '.version_select at 0x7fd64d1e51f0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:33.962980 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c05e2077-7fdb-412c-86a1-4a6f7bd27a4a tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db/defaults" status: 200 len: 371 microversion: 2.1 time: 0.068162 Oct 16 01:25:33.964293 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2464/5060] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:25:33 2022] GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db/defaults => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:25:33.980389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-487094b0-c085-4c45-9350-112784274349 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Calling method '.version_select at 0x7fd64d681940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:34.103894 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-487094b0-c085-4c45-9350-112784274349 tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db" status: 200 len: 371 microversion: 2.1 time: 0.129402 Oct 16 01:25:34.115679 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2465/5061] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:25:33 2022] GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:25:34.125840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:34.128221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:34.143300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.144252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.144960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.145940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.146651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.147991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.218014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:34.232086 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e0dfd2c-6cef-4fc6-8335-ef4da38040f0 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.369354 Oct 16 01:25:34.248931 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2597/5062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:33 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:34.256159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eeeef7f6-2f19-401c-a7f7-1adfbe68c5be tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] Calling method '.version_select at 0x7fd64e419820>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:34.416118 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eeeef7f6-2f19-401c-a7f7-1adfbe68c5be tempest-QuotasTestJSON-147246195 tempest-QuotasTestJSON-147246195-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db?user_id=6ad333699d5f49d1b8fe8e2a298ad344" status: 200 len: 371 microversion: 2.1 time: 0.163774 Oct 16 01:25:34.419239 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2598/5063] 10.222.0.39 () {58 vars in 1323 bytes} [Sun Oct 16 01:25:34 2022] GET /compute/v2.1/os-quota-sets/49b137214679475b8afbae82fd4900db?user_id=6ad333699d5f49d1b8fe8e2a298ad344 => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:34.428406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:34.430820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:34.451578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.456747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.457588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.458578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.459286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.460698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.546007 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2e2ecf00-32d9-4709-a9d6-4730bdcd0b06 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125268 Oct 16 01:25:34.552168 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2599/5064] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:34 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:34.570689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:34.571694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:34.597558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.598183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.598784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.599556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.600138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.602819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.857732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:34.868022 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1b8f55b2-4631-49b0-aa87-77cb80bd83bf tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1488 microversion: 2.1 time: 0.750951 Oct 16 01:25:34.875600 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2466/5065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:34 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1488 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:34.901965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:34.902822 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:34.916901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.917735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.918392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.919341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.920014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.920678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.929258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:34.940473 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca712d6f-5e22-4dcc-b5c9-91ec0ed1ee7c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.386840 Oct 16 01:25:34.943655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2600/5066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:34 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:34.969725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:34.970696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:34.986879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.987704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.988164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:34.988906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:34.992354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:34.993052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:35.009694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:25:35.043865 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:35.058133 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Cannot 'unpause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action HTTP/1.1 Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 15 Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: {"unpause": {}} Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'unpause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'unpause': {}}} Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 in vm_state active. Cannot unpause while the instance is in this state. Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:35.065350 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:35.074547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:35.074547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:35.074547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:35.074547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:25:35.074547 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:35.074547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 409 to user: Cannot 'unpause' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:35.074547 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7eff58fa-34f6-4353-a030-aa6f4b1f341a tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 409 len: 145 microversion: 2.1 time: 0.101690 Oct 16 01:25:35.074547 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2601/5067] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:34 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 145 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:25:35.091905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:35.092543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:35.119024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:35.119612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:35.120088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:35.130168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:35.133485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:35.134006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:35.192492 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a00e5406-dcd4-4bc1-8d8d-3a037bdc995b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 204 len: 0 microversion: 2.1 time: 0.293901 Oct 16 01:25:35.195185 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2467/5068] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:34 2022] DELETE /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:25:35.210509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:35.214634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:35.238559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:35.240370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:35.241573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:35.242329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:35.242803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:35.245421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:35.943324 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:35.958359 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b47344b0-e104-4ebe-ac7a-b788aadfe70f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.881500 Oct 16 01:25:35.960987 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2602/5069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:35 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:35.981960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:35.984576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:35.993125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:35.993985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:35.994675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:35.995676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:35.996502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:35.997192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:36.018522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:36.028988 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85833ac5-6ed6-497f-a527-937dea7605ca tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1494 microversion: 2.1 time: 0.825279 Oct 16 01:25:36.035680 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2468/5070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:35 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1494 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:36.036941 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c4785d22-989f-47a6-a2c0-776b00013409 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073851 Oct 16 01:25:36.042395 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2603/5071] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:35 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:36.047582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:36.048288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:36.058219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:36.059776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:36.060437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:36.061802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:36.062630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:36.063317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:36.454529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:36.463081 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f90ec906-0732-48e0-9a13-e1cda3f47935 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.426230 Oct 16 01:25:36.467244 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2469/5072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:36 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:36.487903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e950b0ef-1b13-4c4e-b509-8eb768718f89 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:36.488437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e950b0ef-1b13-4c4e-b509-8eb768718f89 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 8c2945da-c56e-4635-b3b4-2045fd240dde] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:36.495383 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-e950b0ef-1b13-4c4e-b509-8eb768718f89 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 8c2945da-c56e-4635-b3b4-2045fd240dde could not be found. Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e950b0ef-1b13-4c4e-b509-8eb768718f89 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/8c2945da-c56e-4635-b3b4-2045fd240dde/action HTTP/1.1 Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 18 Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: {"unshelve": null} Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 8c2945da-c56e-4635-b3b4-2045fd240dde could not be found. Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '8c2945da-c56e-4635-b3b4-2045fd240dde', 'body': {'unshelve': None}} Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2945da-c56e-4635-b3b4-2045fd240dde could not be found. Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2945da-c56e-4635-b3b4-2045fd240dde could not be found. Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:36.497146 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2945da-c56e-4635-b3b4-2045fd240dde could not be found. Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e950b0ef-1b13-4c4e-b509-8eb768718f89 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 8c2945da-c56e-4635-b3b4-2045fd240dde could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e950b0ef-1b13-4c4e-b509-8eb768718f89 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/8c2945da-c56e-4635-b3b4-2045fd240dde/action" status: 404 len: 111 microversion: 2.1 time: 0.015550 Oct 16 01:25:36.505310 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2604/5073] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:36 2022] POST /compute/v2.1/servers/8c2945da-c56e-4635-b3b4-2045fd240dde/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:36.509594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:36.510212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:36.517916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:36.519217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:36.519651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:36.520350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:36.520804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:36.521221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.052968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:37.063438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:37.074595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.076368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.076991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.077900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.078529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.079177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.121872 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6ca0a7d-82d6-4d61-9342-05c2544f87f3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075919 Oct 16 01:25:37.123073 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2605/5074] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:37 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:25:37.127878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:37.128694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:37.139347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.140098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.140719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.141669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.142292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.142897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.242984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:37.258123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b794abbc-fd2b-49af-a0f5-26af8451bb96 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.751556 Oct 16 01:25:37.279187 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2470/5075] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:36 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:37.284431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:37.285040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:37.292133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.292789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.294115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.309862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.311033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.312318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.672843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:37.688333 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7b414399-5b42-47bd-8dc2-65dc1e178587 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1494 microversion: 2.1 time: 0.564040 Oct 16 01:25:37.692313 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2606/5076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:37 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1494 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:37.770065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:37.780423 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5808f7a9-37b4-4e7e-b32b-d3117ac8f918 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.499977 Oct 16 01:25:37.795593 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2471/5077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:37 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:37.810531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:37.811259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:37.824801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.836456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.837021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.837878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.838467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.839052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.889741 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Cannot 'unshelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action HTTP/1.1 Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 18 Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: {"unshelve": null} Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'unshelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'unshelve': None}} Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 in vm_state active. Cannot unshelve while the instance is in this state. Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:25:37.893072 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active Oct 16 01:25:37.901068 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:37.905513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 409 to user: Cannot 'unshelve' instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 while it is in vm_state active {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:37.905513 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbacc934-e349-442d-8d7c-f8c03768ab85 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action" status: 409 len: 146 microversion: 2.1 time: 0.098207 Oct 16 01:25:37.905513 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2607/5078] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:37 2022] POST /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438/action => generated 146 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:25:37.912867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:37.913289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:37.927403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.927964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.933964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:37.935138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:37.936656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:37.938628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.135633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:38.138841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:38.157528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.166339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.168757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.170039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.173071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.173770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.252730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b2a5fcaf-2ab8-4760-8b5a-449f197535e8 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122456 Oct 16 01:25:38.253594 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2608/5079] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:25:38 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 16 01:25:38.378022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:38.380323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:38.388405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.390489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.391458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.392673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.393297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.394060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.449117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:38.458780 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c8f97f3-5650-4d5f-a4a7-484494f38025 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.549748 Oct 16 01:25:38.463261 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2472/5080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:37 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:38.469327 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Cannot 'reboot' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622/action HTTP/1.1 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 28 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: {"reboot": {"type": "HARD"}} Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'reboot' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '37681f89-f769-4371-9f0f-b51aed53f622', 'body': {'reboot': {'type': 'HARD'}}} Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 37681f89-f769-4371-9f0f-b51aed53f622 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:25:38.471379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued Oct 16 01:25:38.477203 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.484781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 409 to user: Cannot 'reboot' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:38.486044 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92d386b9-a6e5-4858-95ac-0d681635b1f6 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622/action" status: 409 len: 145 microversion: 2.1 time: 0.112066 Oct 16 01:25:38.487297 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2609/5081] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:38 2022] POST /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622/action => generated 145 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:25:38.487713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:38.488407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:38.502947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.503472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.503926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.504761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.505234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.505668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.514520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:38.523429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:38.543293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.544851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.545717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.548749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.549569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.550242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.621014 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Cannot 'rebuild' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622/action HTTP/1.1 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 65 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: exception: Cannot 'rebuild' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '37681f89-f769-4371-9f0f-b51aed53f622', 'body': {'rebuild': {'imageRef': 'a103d6a4-5636-40e5-8e77-0179ae547423'}}} Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 37681f89-f769-4371-9f0f-b51aed53f622 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:38.630444 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 409 to user: Cannot 'rebuild' instance 37681f89-f769-4371-9f0f-b51aed53f622 while it is in vm_state rescued {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65aedc4e-d73a-44a8-91a3-4a658f38be08 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "POST /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622/action" status: 409 len: 146 microversion: 2.1 time: 0.129625 Oct 16 01:25:38.637703 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2610/5082] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:25:38 2022] POST /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622/action => generated 146 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:25:38.655081 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:38.655634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:38.671137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.671975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.672599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.673568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:38.674198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:38.677489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:38.753646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:25:38.998716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7588f7f1-89c1-4798-9ac1-8bd7454ecc5b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 204 len: 0 microversion: 2.1 time: 0.353548 Oct 16 01:25:39.009513 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2611/5083] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:38 2022] DELETE /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:25:39.017894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:39.019765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:39.027805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:39.028618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:39.030724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:39.031696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:39.040601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:39.041473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:39.328358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:39.344488 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-49696894-b310-4f39-895f-8c6ca25f5307 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.859303 Oct 16 01:25:39.345739 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2473/5084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:38 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:39.362738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:39.363386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:39.371171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:39.371983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:39.372680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:39.373659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:39.374300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:39.374953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:39.390448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:39.401269 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-074b33b3-fb40-4bee-a52f-95bc9834df96 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 200 len: 1452 microversion: 2.1 time: 0.389321 Oct 16 01:25:39.401859 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2612/5085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:39 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 1452 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:39.415956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b59430eb-bcfd-4c8e-93f5-0681a2b17efc req-7d03a195-ce74-41cd-8070-e391906f4b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7527a58-5949-446c-8c17-b1bebce85599", "name": "network-vif-deleted", "tag": "01bb6887-ede9-4b17-85c5-8211d3d9ca93"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:39.447025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b59430eb-bcfd-4c8e-93f5-0681a2b17efc req-7d03a195-ce74-41cd-8070-e391906f4b42 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:39.452642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b59430eb-bcfd-4c8e-93f5-0681a2b17efc req-7d03a195-ce74-41cd-8070-e391906f4b42 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:39.453146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b59430eb-bcfd-4c8e-93f5-0681a2b17efc req-7d03a195-ce74-41cd-8070-e391906f4b42 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:39.472479 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b59430eb-bcfd-4c8e-93f5-0681a2b17efc req-7d03a195-ce74-41cd-8070-e391906f4b42 service nova] Creating event network-vif-deleted:01bb6887-ede9-4b17-85c5-8211d3d9ca93 for instance f7527a58-5949-446c-8c17-b1bebce85599 on n-h2-master-1 Oct 16 01:25:39.489701 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b59430eb-bcfd-4c8e-93f5-0681a2b17efc req-7d03a195-ce74-41cd-8070-e391906f4b42 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077137 Oct 16 01:25:39.490561 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2613/5086] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:39.496636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92f10f0e-aec6-4351-9e5d-03c635763fb1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2098785853_updated"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:39.507788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92f10f0e-aec6-4351-9e5d-03c635763fb1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 2f7598c6-79ac-4486-9871-3233f9f0ac3f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:39.518978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-92f10f0e-aec6-4351-9e5d-03c635763fb1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 2f7598c6-79ac-4486-9871-3233f9f0ac3f could not be found. Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92f10f0e-aec6-4351-9e5d-03c635763fb1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/servers/2f7598c6-79ac-4486-9871-3233f9f0ac3f HTTP/1.1 Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 81 Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2098785853_updated"}} Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 2f7598c6-79ac-4486-9871-3233f9f0ac3f could not be found. Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '2f7598c6-79ac-4486-9871-3233f9f0ac3f', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2098785853_updated'}}} Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7598c6-79ac-4486-9871-3233f9f0ac3f could not be found. Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 16 01:25:39.522106 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7598c6-79ac-4486-9871-3233f9f0ac3f could not be found. Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7598c6-79ac-4486-9871-3233f9f0ac3f could not be found. Oct 16 01:25:39.528040 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:39.530161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92f10f0e-aec6-4351-9e5d-03c635763fb1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 2f7598c6-79ac-4486-9871-3233f9f0ac3f could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:39.531241 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92f10f0e-aec6-4351-9e5d-03c635763fb1 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "PUT /compute/v2.1/servers/2f7598c6-79ac-4486-9871-3233f9f0ac3f" status: 404 len: 111 microversion: 2.1 time: 0.038694 Oct 16 01:25:39.532036 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2614/5087] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:25:39 2022] PUT /compute/v2.1/servers/2f7598c6-79ac-4486-9871-3233f9f0ac3f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:39.540537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:39.541411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:39.549085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:39.549882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:39.550501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:39.551434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:39.552066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:39.552665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:39.750785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:39.769104 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d91608c-a4ad-4e55-b166-b0dac03ac2bf tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1689 microversion: 2.1 time: 0.419439 Oct 16 01:25:39.769766 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2474/5088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:39 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1689 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:39.786243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7d5a15af-685f-44d9-b961-23ed18ebca04 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'create', calling method: .version_select at 0x7fd64d0b3160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1360423187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALM+a20w51Im4SDsmaRkkBuzZoOCpmjNd8urn2R+6qxxJMWkmqrHAeUlPnGgSiI/kd3I2ZI49GBlK2UDuWf6tbRIY4+T9DQNQbSBI7Y4k0QpEuSNypFF9mbBmirYMDr1w=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:39.837985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7d5a15af-685f-44d9-b961-23ed18ebca04 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for project 0d53034488714fc8980132211d0d5c0b. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:25:39.893857 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-7d5a15af-685f-44d9-b961-23ed18ebca04 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for user 88d5c0890ae64fd6aa7e7e547e9bf736 and project 0d53034488714fc8980132211d0d5c0b. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:25:39.976413 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7d5a15af-685f-44d9-b961-23ed18ebca04 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.201456 Oct 16 01:25:39.978692 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2475/5089] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:25:39 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:40.242176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:40.246097 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:40.253922 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97c28b49-c917-4adc-b858-c2c1f96ce25f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.717061 Oct 16 01:25:40.256704 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2615/5090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:39 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:40.285907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:40.286649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:40.297270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:40.298115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:40.298727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:40.299488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:40.300002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:40.300457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:40.428019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:40.429300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:40.436709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:40.437508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:40.438136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:40.439224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:40.440001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:40.440602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:40.460565 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 HTTP/1.1 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: exception: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f7527a58-5949-446c-8c17-b1bebce85599'} Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:40.462584 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:40.468127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:40.468127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:40.468127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:40.468127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:40.468127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:40.468127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:25:40.468127 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:40.469696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:40.470893 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cdb9f25b-4b26-479d-8bb5-6293ca7bc971 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 404 len: 111 microversion: 2.1 time: 0.046792 Oct 16 01:25:40.472063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2616/5091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:40 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:25:40.721717 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-209203230", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "80782a8b-359e-4c99-bfc4-19cb8408a888"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:40.821512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] validate_networks() for [('80782a8b-359e-4c99-bfc4-19cb8408a888', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:25:40.957982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:40.979643 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d6b09191-535c-461b-abdd-8ea762aa8989 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.698710 Oct 16 01:25:40.982571 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2476/5092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:40 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:40.997423 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:40.998750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:41.016889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:41.023992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:41.024839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:41.025997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:41.026706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:41.027435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:41.391434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:41.406405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ace56571-0d97-4fa1-9073-fa41a9cf2aed tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1689 microversion: 2.1 time: 0.416223 Oct 16 01:25:41.407748 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2477/5093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:40 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1689 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:41.414452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4c6bddf-31d6-43b1-bd64-0517c248924d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4c6bddf-31d6-43b1-bd64-0517c248924d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 HTTP/1.1 Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 280 Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:41.419886 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 16 01:25:41.423883 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:41.430999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4c6bddf-31d6-43b1-bd64-0517c248924d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:41.432785 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4c6bddf-31d6-43b1-bd64-0517c248924d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "PUT /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 400 len: 619 microversion: 2.1 time: 0.023393 Oct 16 01:25:41.433944 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2478/5094] 10.222.0.39 () {60 vars in 1257 bytes} [Sun Oct 16 01:25:41 2022] PUT /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:25:41.446507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:41.451177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:41.458714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:41.459723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:41.462755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:41.465407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:41.466122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:41.466788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:41.912460 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:25:41.914114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:25:41.914817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:25:41.915336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:25:41.915821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:25:41.922446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:41.933107 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cc4292f2-1ac0-404a-a4d3-413ec80d298e tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 0.494818 Oct 16 01:25:41.936973 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2479/5095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:41 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:41.946257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:41.947365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:41.948313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:41.949287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:41.950037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:41.950847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:41.960941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:41.962757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:41.976858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:25:41.980291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:41.981128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:41.981812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:41.983644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:41.983782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Getting quotas for user a3ac1408c91c4db59f4639abdca2c98f and project b0304839bb0f444a9786183ba8b4e446. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:25:41.984794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:41.985764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:41.999462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:25:42.003560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:25:42.078100 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c3b96611-6581-47a5-8cd9-6ba9d0c22e63 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360668 Oct 16 01:25:42.079810 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2617/5096] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:25:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:25:42.113005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5618a443-b238-4308-87b5-a51e18d72dfc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:42.113649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5618a443-b238-4308-87b5-a51e18d72dfc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:42.385018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5618a443-b238-4308-87b5-a51e18d72dfc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:42.406674 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5618a443-b238-4308-87b5-a51e18d72dfc tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1214 microversion: 2.1 time: 0.318122 Oct 16 01:25:42.410622 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2618/5097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:42 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1214 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:42.440796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:42.445807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:42.458668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:42.459193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:42.460289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:42.464102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:42.465701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:42.466562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:43.173930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:43.188684 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7932a0b-202d-483b-8ff0-0dc80085acfe tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 1.231778 Oct 16 01:25:43.190183 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2480/5098] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:41 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:43.215819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d9975ca-b5a6-4ad3-8502-e9514997fe21 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d9975ca-b5a6-4ad3-8502-e9514997fe21 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: request: PUT /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 HTTP/1.1 Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 24 Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: {"server": {"name": ""}} Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438', 'body': {'server': {'name': ''}}} Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi '' Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:25:43.222188 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:43.229982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8d9975ca-b5a6-4ad3-8502-e9514997fe21 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:43.232998 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8d9975ca-b5a6-4ad3-8502-e9514997fe21 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "PUT /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 400 len: 108 microversion: 2.1 time: 0.022010 Oct 16 01:25:43.238852 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2481/5099] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:25:43 2022] PUT /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:25:43.260035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:43.260670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:43.296500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:43.297663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:43.298125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:43.298872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:43.305176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:43.305738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:44.289807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:44.314796 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de8c7a79-e58e-499f-908a-97956c17ade4 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1689 microversion: 2.1 time: 1.883039 Oct 16 01:25:44.317133 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2619/5100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:42 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1689 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:44.328310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:44.334146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:44.336441 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d87e9226-c8b8-42d8-bfa5-90a97f47403c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1506 microversion: 2.1 time: 1.089953 Oct 16 01:25:44.336614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:44.337239 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2482/5101] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:43 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1506 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:44.352872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:44.353444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:44.382569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:44.384074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:44.384586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:44.385027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:44.385753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:44.386214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:44.386461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:44.386640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:44.387311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:44.390390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:44.393062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:44.393796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:44.413333 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 HTTP/1.1 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '12931e29-f20a-423d-9473-94cca81d5ff5'} Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:44.424666 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:44.431073 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7012678f-3243-47e3-814e-17b0fbdd9b00 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 404 len: 111 microversion: 2.1 time: 0.088145 Oct 16 01:25:44.436182 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2483/5102] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:44 2022] DELETE /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:44.441051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:44.441672 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 12931e29-f20a-423d-9473-94cca81d5ff5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:44.466351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:44.466891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:44.467407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:44.475981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:44.476537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:44.476996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:44.508488 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 HTTP/1.1 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '12931e29-f20a-423d-9473-94cca81d5ff5'} Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:44.510111 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.516239 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:44.516239 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:44.516239 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:44.516239 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:44.516239 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:44.516239 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. Oct 16 01:25:44.516239 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:44.516239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 12931e29-f20a-423d-9473-94cca81d5ff5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:44.517125 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e186ee6-a83f-452d-afe4-9e5ff5f8893a tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5" status: 404 len: 111 microversion: 2.1 time: 0.079844 Oct 16 01:25:44.517621 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2484/5103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:44 2022] GET /compute/v2.1/servers/12931e29-f20a-423d-9473-94cca81d5ff5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:44.575383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:44.588818 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ecc2d2b3-2bb0-4d15-b83b-801dc70e40de tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1274 microversion: 2.1 time: 0.265987 Oct 16 01:25:44.589423 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2620/5104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:44 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:45.345805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:45.346801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:45.367639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:45.368889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:45.379226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:45.382729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:45.383272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:45.385915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:45.510181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:45.528388 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-547cb56f-a839-4670-a749-0fc9dbed8b1f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1622 microversion: 2.1 time: 0.189824 Oct 16 01:25:45.529337 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2485/5105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:45 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1622 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:45.615159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:45.616887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:45.659902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:45.665145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:45.665971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:45.667042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:45.667743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:45.673336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:46.174699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:46.183712 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-942f0d64-1fed-452e-84ea-3826041d9bc9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1272 microversion: 2.1 time: 0.573622 Oct 16 01:25:46.195773 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2621/5106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:45 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1272 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:46.553093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:46.554575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:46.564111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:46.571807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:46.575609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:46.580387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:46.581022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:46.584075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:46.809521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:46.824951 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5415b644-a98f-4024-a0fd-a55bf5eb7301 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1622 microversion: 2.1 time: 0.275804 Oct 16 01:25:46.831707 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2486/5107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:46 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1622 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:46.945944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-def6662a-4a55-486e-909e-1d72cab4fbe0 req-27fba7d1-a898-4f5e-bf21-296d047e4690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53610cf8-c016-4fa4-bd6e-178818cc4ab3", "name": "network-vif-deleted", "tag": "9a29f124-7a82-45e3-890b-8e5e29092482"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:46.970382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-def6662a-4a55-486e-909e-1d72cab4fbe0 req-27fba7d1-a898-4f5e-bf21-296d047e4690 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:46.973915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-def6662a-4a55-486e-909e-1d72cab4fbe0 req-27fba7d1-a898-4f5e-bf21-296d047e4690 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:46.976997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-def6662a-4a55-486e-909e-1d72cab4fbe0 req-27fba7d1-a898-4f5e-bf21-296d047e4690 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:47.052457 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-def6662a-4a55-486e-909e-1d72cab4fbe0 req-27fba7d1-a898-4f5e-bf21-296d047e4690 service nova] Creating event network-vif-deleted:9a29f124-7a82-45e3-890b-8e5e29092482 for instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 on n-h1-master-1 Oct 16 01:25:47.067399 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-def6662a-4a55-486e-909e-1d72cab4fbe0 req-27fba7d1-a898-4f5e-bf21-296d047e4690 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126847 Oct 16 01:25:47.078832 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2622/5108] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:47.221784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:47.226482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:47.248365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:47.248991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:47.249528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:47.250537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:47.259363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:47.260069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:47.305417 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:47.770237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:47.783356 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-753275bd-6c14-4460-ba3a-b729834dad9b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1314 microversion: 2.1 time: 0.565546 Oct 16 01:25:47.788630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2487/5109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:47 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:47.856540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:47.857670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:47.871600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:47.872516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:47.873194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:47.874152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:47.874841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:47.875577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:47.951586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:47.952900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:47.953605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:47.954297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lazy-loading 'fault' on Instance uuid 53610cf8-c016-4fa4-bd6e-178818cc4ab3 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:25:48.205614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:48.214458 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2c81ab4a-6521-4447-8969-2607ee5ede8c tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 200 len: 1336 microversion: 2.1 time: 0.362127 Oct 16 01:25:48.248438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1910690000", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "8844657e-96b5-4e2a-b13d-401b47552368"}], "key_name": "tempest-TestNetworkBasicOps-1360423187", "security_groups": [{"name": "tempest-secgroup-smoke-1767048917"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:48.258318 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2623/5110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:47 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 1336 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:48.524183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] validate_networks() for [('8844657e-96b5-4e2a-b13d-401b47552368', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:25:48.812989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:48.814566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:48.825947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:48.828910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:48.830410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:48.833591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:48.835472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:48.836242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:49.836874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:25:49.839404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:25:49.840139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:25:49.840714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:25:49.841631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:25:49.865307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:49.873192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:49.873753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:49.879269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:49.879758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:49.880194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:49.993562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for project 0d53034488714fc8980132211d0d5c0b. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:25:50.014989 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:50.017182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Getting quotas for user 88d5c0890ae64fd6aa7e7e547e9bf736 and project 0d53034488714fc8980132211d0d5c0b. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:25:50.072318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:25:50.076663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:25:50.246374 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3dc2f242-0016-47c5-a83a-90116cb07bd4 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.007924 Oct 16 01:25:50.248148 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2488/5111] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:25:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:25:50.253354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:50.275326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 53610cf8-c016-4fa4-bd6e-178818cc4ab3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:50.306679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:50.307801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:50.308441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:50.309480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:50.310108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:50.311221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:50.349541 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 could not be found. Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 HTTP/1.1 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 could not be found. Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '53610cf8-c016-4fa4-bd6e-178818cc4ab3'} Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 could not be found. Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 could not be found. Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:50.355339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:50.360677 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:50.360677 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:50.360677 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:50.360677 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:50.360677 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:50.360677 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:50.360677 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 could not be found. Oct 16 01:25:50.360677 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:50.370533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 404 to user: Instance 53610cf8-c016-4fa4-bd6e-178818cc4ab3 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:50.371723 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eff17ad6-5c5d-48c4-bf81-f9c3a1155536 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3" status: 404 len: 111 microversion: 2.1 time: 0.122381 Oct 16 01:25:50.376710 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2489/5112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:50 2022] GET /compute/v2.1/servers/53610cf8-c016-4fa4-bd6e-178818cc4ab3 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:50.383795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b6af8a2-85b3-4019-9dcd-96c0dc47156a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:50.384704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b6af8a2-85b3-4019-9dcd-96c0dc47156a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:51.049086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8b6af8a2-85b3-4019-9dcd-96c0dc47156a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:51.064973 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b6af8a2-85b3-4019-9dcd-96c0dc47156a tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1249 microversion: 2.1 time: 0.686907 Oct 16 01:25:51.065575 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2490/5113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:50 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1249 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:51.074681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-49b27688-cec9-4038-b402-5f80c9003f3f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '.version_select at 0x7fd64d1e5940>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:51.123974 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-49b27688-cec9-4038-b402-5f80c9003f3f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472889101" status: 202 len: 0 microversion: 2.1 time: 0.056250 Oct 16 01:25:51.124939 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2491/5114] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:25:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472889101 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:25:51.352553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:51.371252 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f3432cf-ce62-43a3-a22a-35d7aae1eac5 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1314 microversion: 2.1 time: 2.558590 Oct 16 01:25:51.371859 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2624/5115] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:48 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1314 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:51.557847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-dc5112fa-558f-4db4-ac96-d426187ed45c req-b53bb859-47f8-4001-b46d-4a950e429892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec7cc75-03d5-4298-9569-b66ce3f1ed10", "tag": "484867a7-33a9-478d-baa1-ae22f7a23b7d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:51.601633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dc5112fa-558f-4db4-ac96-d426187ed45c req-b53bb859-47f8-4001-b46d-4a950e429892 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.618096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dc5112fa-558f-4db4-ac96-d426187ed45c req-b53bb859-47f8-4001-b46d-4a950e429892 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.627012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dc5112fa-558f-4db4-ac96-d426187ed45c req-b53bb859-47f8-4001-b46d-4a950e429892 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:51.639773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:51.640287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:51.657089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.659949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-dc5112fa-558f-4db4-ac96-d426187ed45c req-b53bb859-47f8-4001-b46d-4a950e429892 service nova] Creating event network-changed:484867a7-33a9-478d-baa1-ae22f7a23b7d for instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 on n-h1-master-1 Oct 16 01:25:51.660659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.661387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:51.662176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.663387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.663828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:51.684545 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-dc5112fa-558f-4db4-ac96-d426187ed45c req-b53bb859-47f8-4001-b46d-4a950e429892 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133402 Oct 16 01:25:51.688348 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2492/5116] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:51.717082 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec HTTP/1.1 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: exception: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f8b35480-ba38-4c33-bfa8-e63c3eafbeec'} Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:51.726971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.732280 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.741346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:51.752194 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac3e1c8b-1497-485e-a92a-a31758b13cc0 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 404 len: 111 microversion: 2.1 time: 0.116516 Oct 16 01:25:51.753392 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2625/5117] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:51 2022] DELETE /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:51.763712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:51.764077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: f8b35480-ba38-4c33-bfa8-e63c3eafbeec] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:51.785187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.790293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.790888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:51.793769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.794540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.795269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:51.821233 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec HTTP/1.1 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: exception: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'f8b35480-ba38-4c33-bfa8-e63c3eafbeec'} Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:51.829792 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.835157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.835157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:51.835157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:51.835157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:51.835157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:51.835157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. Oct 16 01:25:51.835157 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.842707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance f8b35480-ba38-4c33-bfa8-e63c3eafbeec could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:51.845577 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-786334f8-ce48-48b4-9d35-96f083f3673d tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec" status: 404 len: 111 microversion: 2.1 time: 0.087092 Oct 16 01:25:51.853686 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2493/5118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:51 2022] GET /compute/v2.1/servers/f8b35480-ba38-4c33-bfa8-e63c3eafbeec => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:51.854570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:51.855116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:51.858685 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:51.873139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.874201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.875096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:51.876633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.879249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.879819 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:51.953551 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 HTTP/1.1 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '01a7fde5-97e2-4522-a0ae-d0dc4840c4e7'} Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:51.955360 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:51.964830 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc8be57b-9d73-43c4-adbc-06e36a6fbffe tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 404 len: 111 microversion: 2.1 time: 0.106128 Oct 16 01:25:51.968846 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2626/5119] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:51 2022] DELETE /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:25:51.972675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:51.976826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:51.987696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.989707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.990368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:51.992304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:51.993117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:51.993857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:52.038754 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 HTTP/1.1 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '01a7fde5-97e2-4522-a0ae-d0dc4840c4e7'} Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:52.040410 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:52.045132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:52.045132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:52.045132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:52.045132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:52.045132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:52.045132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. Oct 16 01:25:52.045132 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:52.045132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:52.047765 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b0430d8e-9de9-4efc-996c-b74fc86960e8 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7" status: 404 len: 111 microversion: 2.1 time: 0.080304 Oct 16 01:25:52.051438 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2494/5120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:51 2022] GET /compute/v2.1/servers/01a7fde5-97e2-4522-a0ae-d0dc4840c4e7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:52.090140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:52.091066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:52.101008 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:52.108138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:52.108730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:52.116153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:52.117270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:52.117969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:52.118616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:52.326098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:52.336199 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e4d630c2-e009-4e20-997f-59de325174a2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1301 microversion: 2.1 time: 0.251014 Oct 16 01:25:52.339215 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2627/5121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:52 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1301 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:52.395193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:52.395193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:52.420664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:52.421492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:52.423619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:52.427460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:52.431449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:52.432862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:53.035994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:53.048963 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d3454408-fedf-49e1-bae2-377118620fd1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1314 microversion: 2.1 time: 0.658995 Oct 16 01:25:53.050161 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2495/5122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:52 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:53.366475 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:53.367183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:53.370033 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:25:53.392315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:53.392834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:53.393271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:53.393994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:53.394460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:53.394894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:53.561699 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-980997a2-7234-4a00-8002-6a322e31a30f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'create', calling method: .version_select at 0x7fd64d1e58b0>, body: {"keypair": {"name": "tempest-keypair-1021252464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4s8Lx8qcRa7vpwUKP21PXO7iZvwnsqH4GF4CVZvDHr7uZaClUNz+zAoztwsURDfGbq5vHdEKwRHIGTbNQs2c7koyfDr70Hn32iVQzyhYYFSJcdJveBpN1VXxqhb7kRxQ=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:53.591869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-980997a2-7234-4a00-8002-6a322e31a30f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Getting quotas for project cff8886e6a5f4728806b806cb3459ac5. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:25:53.597793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-980997a2-7234-4a00-8002-6a322e31a30f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Getting quotas for user 1fbc6af4172d4f3d95ae57485bf6d7a2 and project cff8886e6a5f4728806b806cb3459ac5. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:25:53.638302 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-980997a2-7234-4a00-8002-6a322e31a30f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.186284 Oct 16 01:25:53.641353 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2496/5123] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:25:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:25:53.702515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:53.749217 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec099804-17f0-463d-86b6-b2abc6bfdffe tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1307 microversion: 2.1 time: 0.386824 Oct 16 01:25:53.750709 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2628/5124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:53 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1307 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:54.075949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:54.076816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:54.102880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:54.103440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:54.110232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:54.114965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:54.117250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:54.118260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:54.776655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:54.777930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:54.798864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:54.802234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:54.805269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:54.806686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:54.811441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:54.815603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:54.826024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:54.852970 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f576c80a-65c9-495b-bb0d-f353ece95582 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1314 microversion: 2.1 time: 0.779290 Oct 16 01:25:54.875890 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2497/5125] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:54 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:54.920444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:54.922051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:54.938827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:54.939993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:54.941382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:54.943801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:54.945372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:54.946042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:54.979332 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 HTTP/1.1 Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '6514e50b-9489-47f4-89c6-db0bb9bc99a9'} Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:54.981753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:54.989705 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:54.992354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:54.995301 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-343f34d9-4c0a-4219-8158-eccf7d0d1c0f tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 404 len: 111 microversion: 2.1 time: 0.079346 Oct 16 01:25:54.996457 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2498/5126] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:54 2022] DELETE /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:25:55.013394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:55.015611 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 6514e50b-9489-47f4-89c6-db0bb9bc99a9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:55.032010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:55.033843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:55.035511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:55.038097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:55.039836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:55.040648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:55.086731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:55.088148 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 HTTP/1.1 Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '6514e50b-9489-47f4-89c6-db0bb9bc99a9'} Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:55.091960 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:55.097271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:55.097271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:55.097271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:55.097271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:55.097271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:55.097271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. Oct 16 01:25:55.097271 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:55.097785 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5297479f-67b4-43ac-be11-5caa996430d2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1307 microversion: 2.1 time: 0.323844 Oct 16 01:25:55.100608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 6514e50b-9489-47f4-89c6-db0bb9bc99a9 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:55.104416 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-83e278c2-62d5-4131-9f8a-67c26ce05b56 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9" status: 404 len: 111 microversion: 2.1 time: 0.102124 Oct 16 01:25:55.107290 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2629/5127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:54 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:55.109531 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2499/5128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:55 2022] GET /compute/v2.1/servers/6514e50b-9489-47f4-89c6-db0bb9bc99a9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:55.113623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:55.118593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:55.134135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:55.135558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:55.139251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:55.140257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:55.143344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:55.144036 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:55.235492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:25:55.371848 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-73ca38c8-f043-44c2-9d63-01a9dfdf1984 tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 204 len: 0 microversion: 2.1 time: 0.261338 Oct 16 01:25:55.375857 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2630/5129] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:55 2022] DELETE /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:25:55.386046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:55.387213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:55.397707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:55.398516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:55.399298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:55.400258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:55.400931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:55.401753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:55.883511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:55.884399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:55.896316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:55.899903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:55.900493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:55.901370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:55.901952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:55.903233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:56.462057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:56.488805 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76c9f437-d30d-4d29-b26b-d1f655a3cb4c tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 1.108453 Oct 16 01:25:56.489780 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2500/5130] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:55 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:56.503566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:56.505435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:56.521085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:56.523880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:56.524637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:56.525957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:56.527728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:56.528988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:56.636954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:56.650849 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cfcc2404-d4b9-4707-ad5e-cf025ddd546a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1314 microversion: 2.1 time: 0.772171 Oct 16 01:25:56.651544 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2631/5131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:55 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:57.293683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:57.316373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c4d3b7b1-e34f-4d87-b1d5-102bf11c1d4b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1375 microversion: 2.1 time: 0.822821 Oct 16 01:25:57.323699 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2501/5132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:56 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1375 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:57.519819 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:57.520488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:57.537838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:57.538380 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:57.538860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:57.542484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:57.548865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:57.549717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:57.691991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:57.692756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:57.713185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:57.713860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:57.714315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:57.715098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:57.715566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:57.719541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:58.187128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:58.200322 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d46c66f4-c24b-4a83-92b8-120c5d38cd8d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1512 microversion: 2.1 time: 0.684244 Oct 16 01:25:58.201525 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2632/5133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:57 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1512 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:58.216779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-682993008", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b61e752-e41f-4213-806a-ad45c0ea73a1"}], "security_groups": [{"name": "tempest-securitygroup--259952779"}], "key_name": "tempest-keypair-1021252464", "user_data": "}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:58.539304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:58.570435 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5efafc68-9370-427c-b9d8-d9b9ec25ed3b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1314 microversion: 2.1 time: 0.893548 Oct 16 01:25:58.574240 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2502/5134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:57 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1314 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:25:58.591212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:58.592311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:58.605142 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:58.605671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:58.606193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:58.609061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:58.609705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:58.610863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:58.630937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] validate_networks() for [('8b61e752-e41f-4213-806a-ad45c0ea73a1', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:25:59.143837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:59.157151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-47a6609d-7e23-48c8-aecc-762bf9e8d72c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1375 microversion: 2.1 time: 0.576535 Oct 16 01:25:59.159615 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2503/5135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:58 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1375 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:59.169226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-eabef55c-562b-4713-8f2a-c1d0d94648ae req-23ea83d7-43ee-4d78-8026-0895726b4741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec7cc75-03d5-4298-9569-b66ce3f1ed10", "name": "network-vif-plugged", "status": "completed", "tag": "484867a7-33a9-478d-baa1-ae22f7a23b7d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:59.211557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-eabef55c-562b-4713-8f2a-c1d0d94648ae req-23ea83d7-43ee-4d78-8026-0895726b4741 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.214341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-eabef55c-562b-4713-8f2a-c1d0d94648ae req-23ea83d7-43ee-4d78-8026-0895726b4741 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.214777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-eabef55c-562b-4713-8f2a-c1d0d94648ae req-23ea83d7-43ee-4d78-8026-0895726b4741 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.254354 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-eabef55c-562b-4713-8f2a-c1d0d94648ae req-23ea83d7-43ee-4d78-8026-0895726b4741 service nova] Creating event network-vif-plugged:484867a7-33a9-478d-baa1-ae22f7a23b7d for instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 on n-h1-master-1 Oct 16 01:25:59.272870 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-eabef55c-562b-4713-8f2a-c1d0d94648ae req-23ea83d7-43ee-4d78-8026-0895726b4741 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111873 Oct 16 01:25:59.278550 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2504/5136] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:59.305700 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:59.306341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:59.320268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.321052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.321844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.322771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.323416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.324078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.434022 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 HTTP/1.1 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5f39da51-b797-405f-8c98-c4d962123c45'} Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:59.441777 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:59.448134 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-221922cd-af99-4e39-9043-5890cd9d4051 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 404 len: 111 microversion: 2.1 time: 0.160063 Oct 16 01:25:59.455347 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2505/5137] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:25:59 2022] DELETE /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:59.468847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-71f94b48-e684-466b-95eb-8496f14cee38 req-fa746422-f127-4489-979d-013069258c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438", "name": "network-vif-deleted", "tag": "ebf526f4-6d18-4e21-9c38-4219f2d56da2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:25:59.491966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71f94b48-e684-466b-95eb-8496f14cee38 req-fa746422-f127-4489-979d-013069258c28 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.492733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71f94b48-e684-466b-95eb-8496f14cee38 req-fa746422-f127-4489-979d-013069258c28 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.493573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71f94b48-e684-466b-95eb-8496f14cee38 req-fa746422-f127-4489-979d-013069258c28 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.512887 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-71f94b48-e684-466b-95eb-8496f14cee38 req-fa746422-f127-4489-979d-013069258c28 service nova] Creating event network-vif-deleted:ebf526f4-6d18-4e21-9c38-4219f2d56da2 for instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 on n-h2-master-1 Oct 16 01:25:59.528106 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-71f94b48-e684-466b-95eb-8496f14cee38 req-fa746422-f127-4489-979d-013069258c28 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071406 Oct 16 01:25:59.529540 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2506/5138] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:25:59.534829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:59.539789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:59.563656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.565068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.565709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.566609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.567451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.568044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.640018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.641276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.641945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.642992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lazy-loading 'fault' on Instance uuid 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:25:59.741329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85cb1d720ba24d7f908a93fffe29427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93a361db0a42c0ac90b82d20b91cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:25:59.749189 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-319dbdaa-d45f-407d-980d-446e65646fbd tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 200 len: 1306 microversion: 2.1 time: 0.218285 Oct 16 01:25:59.750027 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2507/5139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:59 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:25:59.755068 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:59.755873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] [instance: 5f39da51-b797-405f-8c98-c4d962123c45] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:59.761913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.762617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.763237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.764109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.764719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.765295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.788419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] HTTP exception thrown: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Request method failure captured: Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 HTTP/1.1 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1wKDqgRD8Xcc75udvPjTVSJBcj3z-t-e-c5NekLdQ51BwXhNsusAXjfjMjEUNcUf6WtCDVc4tzYDr7kwDjaMYDNbQLgoSnA_KhPtJqm2Rudnks790wbyR5cW276D0gFk990TsYGWu1HAjNuxrMoobQ4c3ig81qGUyWA35hL8R-2i6Q Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e664ea80daaf450886978f25b2d9e373", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e664ea80daaf450886978f25b2d9e373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: e664ea80daaf450886978f25b2d9e373 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1734256379 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: d5e97960c4eb488b900951e0898f34c8 Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeNegativeTest-1734256379-project Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5f39da51-b797-405f-8c98-c4d962123c45'} Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:25:59.792846 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.798089 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:25:59.798089 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:25:59.798089 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:25:59.798089 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:25:59.798089 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:25:59.798089 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. Oct 16 01:25:59.798089 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:25:59.800827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] Returning 404 to user: Instance 5f39da51-b797-405f-8c98-c4d962123c45 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:25:59.801935 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82920de9-dd0a-4c92-a6aa-70660cf8b562 tempest-AttachVolumeNegativeTest-1734256379 tempest-AttachVolumeNegativeTest-1734256379-project] 10.222.0.39 "GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45" status: 404 len: 111 microversion: 2.1 time: 0.050678 Oct 16 01:25:59.802719 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2508/5140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:59 2022] GET /compute/v2.1/servers/5f39da51-b797-405f-8c98-c4d962123c45 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:25:59.809384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:25:59.810543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:25:59.822319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.823132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.823805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.825542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:25:59.826218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:25:59.827057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:25:59.940799 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:00.072474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:26:00.073064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:26:00.073902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:26:00.074392 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:26:00.075002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:26:00.100354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:00.103074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:00.104770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:00.105715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:00.107311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:00.108542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:00.144512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Getting quotas for project cff8886e6a5f4728806b806cb3459ac5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:26:00.151837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Getting quotas for user 1fbc6af4172d4f3d95ae57485bf6d7a2 and project cff8886e6a5f4728806b806cb3459ac5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:26:00.167658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:26:00.170701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:26:00.190349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:00.200772 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f768bbfa-a73b-451b-86bb-fe415eb4057a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1314 microversion: 2.1 time: 0.396716 Oct 16 01:26:00.204990 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2509/5141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:25:59 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:00.211651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:00.214039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:00.220796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:00.221634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:00.222467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:00.223582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:00.224288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:00.237147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:00.256038 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30b06705-fe7b-425c-a3e2-8e4ac3f5a53e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.044166 Oct 16 01:26:00.258667 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2633/5142] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:25:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 16 01:26:00.263957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-90c19613-a2dc-4b0b-a618-8ee0a5cdd802 req-0231b373-5baa-4cc1-b965-2cd475b9eea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d0190-b646-45ec-bc90-5b09fb541a10", "tag": "9f8f68e3-bf9d-4291-8222-c7190f91aac8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:00.276675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-90c19613-a2dc-4b0b-a618-8ee0a5cdd802 req-0231b373-5baa-4cc1-b965-2cd475b9eea2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:00.277475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-90c19613-a2dc-4b0b-a618-8ee0a5cdd802 req-0231b373-5baa-4cc1-b965-2cd475b9eea2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:00.278127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-90c19613-a2dc-4b0b-a618-8ee0a5cdd802 req-0231b373-5baa-4cc1-b965-2cd475b9eea2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:00.291914 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-90c19613-a2dc-4b0b-a618-8ee0a5cdd802 req-0231b373-5baa-4cc1-b965-2cd475b9eea2 service nova] Creating event network-changed:9f8f68e3-bf9d-4291-8222-c7190f91aac8 for instance e57d0190-b646-45ec-bc90-5b09fb541a10 on n-h2-master-1 Oct 16 01:26:00.302510 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-90c19613-a2dc-4b0b-a618-8ee0a5cdd802 req-0231b373-5baa-4cc1-b965-2cd475b9eea2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041732 Oct 16 01:26:00.304373 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2634/5143] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:00.311239 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4063c7f2-7147-4be0-a375-ff56b4324609 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:00.312523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4063c7f2-7147-4be0-a375-ff56b4324609 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:00.468457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4063c7f2-7147-4be0-a375-ff56b4324609 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:00.478620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4063c7f2-7147-4be0-a375-ff56b4324609 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:00.480098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4063c7f2-7147-4be0-a375-ff56b4324609 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:00.481271 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4063c7f2-7147-4be0-a375-ff56b4324609 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1281 microversion: 2.20 time: 0.175780 Oct 16 01:26:00.482090 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2635/5144] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:00 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:00.520481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:00.534640 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6d4d437-5258-4d78-bb32-8c6a46c2533c tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1375 microversion: 2.1 time: 0.324243 Oct 16 01:26:00.535351 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2510/5145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:00 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1375 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:00.775388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:00.776487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] [instance: 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:00.786218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:00.786984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:00.788812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:00.789712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:00.791144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:00.791850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:00.809663 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] HTTP exception thrown: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 could not be found. Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Request method failure captured: Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 HTTP/1.1 Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1zST5sxylZODwvvV0S4TzpsUhlZht8C6HW38bAl2QQgghGt2-4wzGAcBFniuUDBBFFOp6XIg5TjdIXAmI1YRBlgD30oEJvVu1bMG85NR0EnlmbSlkM1HAzwPXjuoGrneKHby6SggwEfczBVYzeGgBZpdiTrkQCTqUrUvfRDxoOyKSg Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fc93a361db0a42c0ac90b82d20b91cff", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fc93a361db0a42c0ac90b82d20b91cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: fc93a361db0a42c0ac90b82d20b91cff Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1651707345 Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 85cb1d720ba24d7f908a93fffe29427b Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-1651707345-project Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 could not be found. Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438'} Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 could not be found. Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 could not be found. Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:00.811723 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:00.816463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:00.816463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:00.816463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:00.816463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:00.816463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:00.816463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 could not be found. Oct 16 01:26:00.816463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:00.819345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] Returning 404 to user: Instance 7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:00.820653 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcb9577c-22db-4ae7-977c-94a0b7b30f2d tempest-ServersNegativeTestJSON-1651707345 tempest-ServersNegativeTestJSON-1651707345-project] 10.222.0.39 "GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438" status: 404 len: 111 microversion: 2.1 time: 0.051351 Oct 16 01:26:00.822496 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2636/5146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:00 2022] GET /compute/v2.1/servers/7b3ebca8-25e9-4ac5-aa92-4f93bd5cf438 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:01.232260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:01.232888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:01.252002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:01.252859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:01.253667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:01.254532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:01.255327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:01.255918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:01.511851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:01.512450 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:01.522477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:01.522994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:01.523452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:01.524148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:01.524608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:01.525036 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:01.886210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:01.892578 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:01.898659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:01.900260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:01.901456 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aca4ebd1-dd91-4f7f-9e4c-4b45acd36266 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1333 microversion: 2.20 time: 0.393700 Oct 16 01:26:01.915403 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2637/5147] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:01 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1333 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:01.926196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:01.927318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:01.935563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:01.936305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:01.936919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:01.937806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:01.938466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:01.939111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:02.462066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:02.481747 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3bd4f534-aa6f-494a-a1dd-25f6ef8ef04e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1501 microversion: 2.1 time: 1.254096 Oct 16 01:26:02.492493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:02.499318 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2511/5148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:01 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1501 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:02.501583 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b02a4c2b-4d21-481c-8bdd-90a25597c6a3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1375 microversion: 2.1 time: 0.584709 Oct 16 01:26:02.502542 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2638/5149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:01 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1375 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:02.520436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:02.522805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:02.532056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:02.532589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:02.533080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:02.533980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:02.535929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:02.536602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:02.579423 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lazy-loading 'flavor' on Instance uuid 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:26:02.680433 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:02.732910 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-930e840f-2f74-4fa3-aeac-1ed09b9de0b6 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "POST /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10/action" status: 202 len: 0 microversion: 2.1 time: 0.215418 Oct 16 01:26:02.734871 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2512/5150] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:26:02 2022] POST /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:26:02.747118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:02.747584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:02.759830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:02.765473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:02.766002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:02.767038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:02.767699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:02.768297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:02.941908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:02.942896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:02.958289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:02.962980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:02.964303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:02.981479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:02.982233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:02.983162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:03.233221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:03.250009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:03.282453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:03.284451 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-17eadc6a-0f0b-465e-a852-a97503e2a80f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1339 microversion: 2.20 time: 0.352075 Oct 16 01:26:03.299132 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2513/5151] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:02 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1339 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:26:03.335544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:03.350686 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10e7e2c6-62a2-4032-9a1c-0cbc1da106d2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1509 microversion: 2.1 time: 0.608687 Oct 16 01:26:03.352171 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2639/5152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:02 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1509 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:03.532983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:03.536882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:03.570070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:03.570813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:03.571475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:03.572210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:03.572666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:03.581829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:03.612583 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=20 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:03.942587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:03.958327 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a1b2561-94ca-4e21-a971-2adaf42ec383 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1375 microversion: 2.1 time: 0.433624 Oct 16 01:26:03.964795 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2514/5153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:03 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1375 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:04.311702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:04.312292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:04.331135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:04.331646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:04.332089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:04.332817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:04.333922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:04.334906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:04.377628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:04.378665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:04.391861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:04.395666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:04.399464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:04.400510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:04.403410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:04.404111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:04.810952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:04.823219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:04.828980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:04.838947 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ec2b32d-8723-458a-a508-0b0a01648b7d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1406 microversion: 2.20 time: 0.531284 Oct 16 01:26:04.839825 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2640/5154] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:04 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:04.844769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:04.858958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:04.873321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:04.875595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:04.876863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:04.878824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:04.882501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:04.883360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:04.946159 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:26:05.054538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:05.104497 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e65fd97f-7924-482a-9751-43414cfad8e3 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 204 len: 0 microversion: 2.1 time: 0.263132 Oct 16 01:26:05.107640 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2641/5155] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:04 2022] DELETE /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:26:05.110444 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e0599037-fffd-4fb3-aec9-7c8b1d2e88dd tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1492 microversion: 2.1 time: 0.736161 Oct 16 01:26:05.112672 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2515/5156] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:04 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1492 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:05.121788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:05.122881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:05.127190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:05.129866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:05.145724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.150105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.151552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.152253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.152697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.153505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.153647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.155873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.156568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.158063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.158736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.177196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.684533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:05.693735 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-602c1615-19ca-4e1c-ad7c-298cb1542ee9 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1375 microversion: 2.1 time: 0.583967 Oct 16 01:26:05.707658 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2642/5157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:05 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1375 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:05.716531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:05.717268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:05.723531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.724280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.725453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.726336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.726983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.727569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.757862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:26:05.781539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:05.806415 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c3a0cb2e-c749-400f-b2b9-705e73e91488 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1507 microversion: 2.1 time: 0.691179 Oct 16 01:26:05.807606 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2516/5158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:05 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1507 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:05.866395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:05.867603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:05.878059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.878555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.883395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.884239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.884697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.885316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.940255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9be982c7-eccc-4723-8606-eb02e426060b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 204 len: 0 microversion: 2.1 time: 0.230717 Oct 16 01:26:05.941085 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2643/5159] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:05 2022] DELETE /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:26:05.955665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:05.956378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:05.974393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.975467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.976260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:05.977207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:05.977872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:05.981317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:06.829832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:06.852649 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d62764d-9fbb-4093-acea-89913e4a4752 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1498 microversion: 2.1 time: 0.901205 Oct 16 01:26:06.853641 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2644/5160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:05 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1498 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:06.859257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b94de503-acb4-41f4-a71d-40d6a21de42f req-455aec2b-d609-40cd-bcd9-75b924200ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa8ed22-d042-41d4-84a6-63e1b1ac9b2a", "tag": "1753d20a-a3ba-48cb-b791-16b43c88ff56"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:06.880324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b94de503-acb4-41f4-a71d-40d6a21de42f req-455aec2b-d609-40cd-bcd9-75b924200ea6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:06.881824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b94de503-acb4-41f4-a71d-40d6a21de42f req-455aec2b-d609-40cd-bcd9-75b924200ea6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:06.882492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b94de503-acb4-41f4-a71d-40d6a21de42f req-455aec2b-d609-40cd-bcd9-75b924200ea6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:06.899855 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b94de503-acb4-41f4-a71d-40d6a21de42f req-455aec2b-d609-40cd-bcd9-75b924200ea6 service nova] Creating event network-changed:1753d20a-a3ba-48cb-b791-16b43c88ff56 for instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a on n-h1-master-1 Oct 16 01:26:06.903681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:06.904829 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b94de503-acb4-41f4-a71d-40d6a21de42f req-455aec2b-d609-40cd-bcd9-75b924200ea6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049797 Oct 16 01:26:06.905808 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2645/5161] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:06.913185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:06.913981 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:06.918103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:06.922119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:06.922388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:06.923194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:06.923806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:06.924528 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-89fceb2c-2981-4b89-b926-3f8a73b29d84 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1406 microversion: 2.20 time: 1.062793 Oct 16 01:26:06.924892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:06.925576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:06.926193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:06.926330 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2517/5162] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:05 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1406 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:06.959154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:06.961076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:06.979698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:06.981657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:06.982670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:06.983709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:06.986205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:06.987849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:07.523479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:07.525382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:07.533562 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6aa58523-5d11-4bbb-9be5-8204061c1988 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1375 microversion: 2.1 time: 0.626191 Oct 16 01:26:07.534456 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2646/5163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:06 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1375 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:07.545409 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a31224ee-5b14-4658-a210-600d45d59b2f tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1507 microversion: 2.1 time: 0.616729 Oct 16 01:26:07.547447 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2518/5164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:06 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1507 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:07.630763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9ba1a913-7524-4c39-9dc9-4f4179c6a780 req-59a9c519-4738-4d0b-b1c4-1ac3d853d1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d0190-b646-45ec-bc90-5b09fb541a10", "name": "network-vif-plugged", "status": "completed", "tag": "9f8f68e3-bf9d-4291-8222-c7190f91aac8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:07.646123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9ba1a913-7524-4c39-9dc9-4f4179c6a780 req-59a9c519-4738-4d0b-b1c4-1ac3d853d1f3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:07.646741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9ba1a913-7524-4c39-9dc9-4f4179c6a780 req-59a9c519-4738-4d0b-b1c4-1ac3d853d1f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:07.647888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9ba1a913-7524-4c39-9dc9-4f4179c6a780 req-59a9c519-4738-4d0b-b1c4-1ac3d853d1f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:07.663345 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9ba1a913-7524-4c39-9dc9-4f4179c6a780 req-59a9c519-4738-4d0b-b1c4-1ac3d853d1f3 service nova] Creating event network-vif-plugged:9f8f68e3-bf9d-4291-8222-c7190f91aac8 for instance e57d0190-b646-45ec-bc90-5b09fb541a10 on n-h2-master-1 Oct 16 01:26:07.669127 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9ba1a913-7524-4c39-9dc9-4f4179c6a780 req-59a9c519-4738-4d0b-b1c4-1ac3d853d1f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042671 Oct 16 01:26:07.675081 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2647/5165] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:07.893046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:07.893960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:07.913201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:07.915305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:07.915926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:07.918455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:07.920100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:07.923007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:07.961824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:07.965038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:07.984259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:07.985245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:07.987334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:07.988247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:07.993054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:07.993775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:08.299722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:08.314445 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57c05ab8-4ee1-45e7-8ef7-1c345334311a tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1498 microversion: 2.1 time: 0.434896 Oct 16 01:26:08.315437 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2519/5166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:07 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1498 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:08.360004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:08.371422 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:08.373502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:08.375171 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-241a47f5-93cc-453f-95d6-c9bd0e5efadc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1406 microversion: 2.20 time: 0.419886 Oct 16 01:26:08.376344 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2648/5167] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:07 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:26:08.566550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:08.566705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:08.572650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:08.573534 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:08.575072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:08.575807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:08.576430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:08.577317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:08.577951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:08.578552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:08.585121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:08.585911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:08.586528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:08.587501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:08.588131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:08.588732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:09.041419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:09.051351 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9dce8e92-f6ee-4ec4-a1eb-666577970e78 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1375 microversion: 2.1 time: 0.489805 Oct 16 01:26:09.052435 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2520/5168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:08 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1375 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:09.119266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:09.128474 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1a03f7f3-196d-4ac5-9854-42a09ecd9552 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1507 microversion: 2.1 time: 0.560208 Oct 16 01:26:09.134986 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2649/5169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:08 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:26:09.342592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:09.344564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:09.355445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:09.356573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:09.358405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:09.363550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:09.370275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:09.374313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:09.408621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:09.409608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:09.431472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:09.434664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:09.436794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:09.439112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:09.440766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:09.442431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:10.136741 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:10.420295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:10.429574 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-300fecb6-57a1-4d4f-9707-2ea643213bdb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1498 microversion: 2.1 time: 1.090954 Oct 16 01:26:10.430171 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2521/5170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:09 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1498 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:10.448470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:10.450522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:10.458735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:10.460352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:10.460994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:10.461795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:10.462322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:10.462815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:10.475532 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:10.502508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:10.516127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:10.517964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:10.519171 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fea2e444-d10f-450c-be6d-88c6269761a4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1406 microversion: 2.20 time: 1.115678 Oct 16 01:26:10.522593 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2650/5171] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:09 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1406 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:26:10.529307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:10.530104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:10.542239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:10.542239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:10.542239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:10.542239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:10.542239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:10.542239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:10.742413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:10.754304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c6624fc9-42a2-417d-acc3-41f930c831f2 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1465 microversion: 2.1 time: 0.230049 Oct 16 01:26:10.755265 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2651/5172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:10 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1465 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:10.761698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-97a5e0cb-7185-4162-8dbd-de507c6b4d2b req-697dd315-3895-4581-945c-b92bc5ddce29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec7cc75-03d5-4298-9569-b66ce3f1ed10", "name": "network-vif-deleted", "tag": "484867a7-33a9-478d-baa1-ae22f7a23b7d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:10.773702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-97a5e0cb-7185-4162-8dbd-de507c6b4d2b req-697dd315-3895-4581-945c-b92bc5ddce29 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:10.775204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-97a5e0cb-7185-4162-8dbd-de507c6b4d2b req-697dd315-3895-4581-945c-b92bc5ddce29 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:10.776284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-97a5e0cb-7185-4162-8dbd-de507c6b4d2b req-697dd315-3895-4581-945c-b92bc5ddce29 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:10.788852 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-97a5e0cb-7185-4162-8dbd-de507c6b4d2b req-697dd315-3895-4581-945c-b92bc5ddce29 service nova] Creating event network-vif-deleted:484867a7-33a9-478d-baa1-ae22f7a23b7d for instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 on n-h1-master-1 Oct 16 01:26:10.798614 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-97a5e0cb-7185-4162-8dbd-de507c6b4d2b req-697dd315-3895-4581-945c-b92bc5ddce29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041255 Oct 16 01:26:10.800086 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2652/5173] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:10.820218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-03117527-77dc-4343-b9bf-78937e744a11 req-0e0255a9-3753-4149-aaf4-2d1e880cc5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37681f89-f769-4371-9f0f-b51aed53f622", "name": "network-vif-deleted", "tag": "f1fac4ee-7e70-46bf-9a5f-83c662e5ceb5"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:10.831861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-03117527-77dc-4343-b9bf-78937e744a11 req-0e0255a9-3753-4149-aaf4-2d1e880cc5b9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:10.832486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-03117527-77dc-4343-b9bf-78937e744a11 req-0e0255a9-3753-4149-aaf4-2d1e880cc5b9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:10.833253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-03117527-77dc-4343-b9bf-78937e744a11 req-0e0255a9-3753-4149-aaf4-2d1e880cc5b9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:10.837488 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:10.852575 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-03117527-77dc-4343-b9bf-78937e744a11 req-0e0255a9-3753-4149-aaf4-2d1e880cc5b9 service nova] Creating event network-vif-deleted:f1fac4ee-7e70-46bf-9a5f-83c662e5ceb5 for instance 37681f89-f769-4371-9f0f-b51aed53f622 on n-h1-master-1 Oct 16 01:26:10.858688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-03117527-77dc-4343-b9bf-78937e744a11 req-0e0255a9-3753-4149-aaf4-2d1e880cc5b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044111 Oct 16 01:26:10.859429 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2653/5174] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:26:10.924554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:10.935729 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a93693f8-75c8-47f4-9b1c-638bd8f2ca30 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1546 microversion: 2.1 time: 0.504093 Oct 16 01:26:10.936665 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2522/5175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:10 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1546 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:10.962043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:10.963064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:10.970775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:10.971615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:10.972076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:10.972972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:10.973444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:10.974164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:11.387312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:11.402513 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fbf515cb-4d49-4dfa-a794-4d2ab4c91fa7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1546 microversion: 2.1 time: 0.445260 Oct 16 01:26:11.414976 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2654/5176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:10 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1546 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:11.454819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:11.456327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:11.465262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:11.465865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:11.467374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:11.468314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:11.468991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:11.469631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:11.548584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:11.549594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:11.549915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:11.551297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:11.552367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:11.553471 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lazy-loading 'fault' on Instance uuid 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:26:11.564382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:11.565094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:11.566879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:11.569950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:11.574022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:11.574778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:11.852074 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ac1408c91c4db59f4639abdca2c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0304839bb0f444a9786183ba8b4e446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:11.862268 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f18ab5a-3a19-403a-ac58-dbacd67506eb tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 200 len: 1304 microversion: 2.1 time: 0.412025 Oct 16 01:26:11.864177 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2523/5177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:11 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 1304 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:11.884810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:11.885963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:11.899150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:11.899968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:11.900670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:11.901710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:11.902403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:11.903501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:12.028123 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:12.036085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:12.039384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:12.040645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:12.042895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lazy-loading 'fault' on Instance uuid 37681f89-f769-4371-9f0f-b51aed53f622 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:26:12.111912 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:12.132776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:12.135430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:12.137089 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0c3ad5af-a826-41b3-92d6-487deaca472f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1406 microversion: 2.20 time: 0.592774 Oct 16 01:26:12.137867 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2655/5178] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:11 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:26:12.173896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:12.190789 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-687a4e7b-4abc-43f3-85ff-f9e9f2e90166 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 200 len: 1312 microversion: 2.1 time: 0.323756 Oct 16 01:26:12.195092 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2524/5179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:11 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 1312 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:12.893393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:12.898181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:12.918186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:12.918790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:12.919271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:12.921773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:12.924358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:12.926296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:12.972486 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 HTTP/1.1 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7ec7cc75-03d5-4298-9569-b66ce3f1ed10'} Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:12.974231 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:12.985786 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b0eb3ba-af05-467c-bf95-ce51fea86b95 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 404 len: 111 microversion: 2.1 time: 0.094208 Oct 16 01:26:12.990145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:12.991914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:12.998003 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2656/5180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:12 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:12.999740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.000227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.000657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.001549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.002002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.002607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.026841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 HTTP/1.1 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7ec7cc75-03d5-4298-9569-b66ce3f1ed10'} Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.032670 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16050ad2-85cf-422d-a47a-b7917321e4f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 404 len: 111 microversion: 2.1 time: 0.051875 Oct 16 01:26:13.040028 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2525/5181] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:12 2022] DELETE /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:26:13.046495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.047336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 7ec7cc75-03d5-4298-9569-b66ce3f1ed10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.057090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.059256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.061631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.063831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.064485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.065109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.081491 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 HTTP/1.1 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7ec7cc75-03d5-4298-9569-b66ce3f1ed10'} Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.083080 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 7ec7cc75-03d5-4298-9569-b66ce3f1ed10 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-07b72b83-d06d-406f-9d19-e9df89f88d01 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10" status: 404 len: 111 microversion: 2.1 time: 0.042171 Oct 16 01:26:13.088492 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2657/5182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:13 2022] GET /compute/v2.1/servers/7ec7cc75-03d5-4298-9569-b66ce3f1ed10 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.094819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.096413 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.109797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.110480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.111048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.111871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.113061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.113587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.137273 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 HTTP/1.1 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: exception: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'f7527a58-5949-446c-8c17-b1bebce85599'} Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.139278 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.145359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f91a8d41-9eee-43f8-b950-ee41190c2653 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 404 len: 111 microversion: 2.1 time: 0.053112 Oct 16 01:26:13.147506 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2526/5183] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:13 2022] DELETE /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.157846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.159741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: f7527a58-5949-446c-8c17-b1bebce85599] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.167718 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:13.170741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.171778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.172599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.173660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.174361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.175255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.180846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.185271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.202226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.202735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.203213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.203921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.204782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.204782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.205342 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 HTTP/1.1 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: exception: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'f7527a58-5949-446c-8c17-b1bebce85599'} Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.207426 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.216659 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.216659 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.216659 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.216659 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.216659 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.216659 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. Oct 16 01:26:13.216659 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.222911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance f7527a58-5949-446c-8c17-b1bebce85599 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.225000 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-095f2c27-61eb-4ba0-89d1-4ec7edc537af tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599" status: 404 len: 111 microversion: 2.1 time: 0.072849 Oct 16 01:26:13.226344 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2658/5184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:13 2022] GET /compute/v2.1/servers/f7527a58-5949-446c-8c17-b1bebce85599 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.233123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.234127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 37681f89-f769-4371-9f0f-b51aed53f622] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.244202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.245013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.245783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.247381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.249253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.249253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.281588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Instance 37681f89-f769-4371-9f0f-b51aed53f622 could not be found. Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 HTTP/1.1 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 37681f89-f769-4371-9f0f-b51aed53f622 could not be found. Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '37681f89-f769-4371-9f0f-b51aed53f622'} Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37681f89-f769-4371-9f0f-b51aed53f622 could not be found. Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37681f89-f769-4371-9f0f-b51aed53f622 could not be found. Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.284487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37681f89-f769-4371-9f0f-b51aed53f622 could not be found. Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.289621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 404 to user: Instance 37681f89-f769-4371-9f0f-b51aed53f622 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.292075 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ca28c64-6f9c-4269-9a57-e318a46ea94e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622" status: 404 len: 111 microversion: 2.1 time: 0.063726 Oct 16 01:26:13.296611 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2659/5185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:13 2022] GET /compute/v2.1/servers/37681f89-f769-4371-9f0f-b51aed53f622 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.310358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.314626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.325945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.326563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.327253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.328068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.328852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.330012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.354676 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 HTTP/1.1 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '3132186d-4372-4b1c-a4c3-618f2c9a0c62'} Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.357032 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.361652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.364160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.365945 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-706f2e8e-6a9a-4fe9-87f4-14c3716537b9 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 404 len: 111 microversion: 2.1 time: 0.070657 Oct 16 01:26:13.367333 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2660/5186] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:13 2022] DELETE /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.375214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.376084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.385736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.386633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.387939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.388810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.389395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.389919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.424847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:26:13.517008 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7c44c6c-1da5-4eb7-ad6d-adfe0cb2295d tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 204 len: 0 microversion: 2.1 time: 0.147551 Oct 16 01:26:13.518038 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2661/5187] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:13 2022] DELETE /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:26:13.526644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.527911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 3132186d-4372-4b1c-a4c3-618f2c9a0c62] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.534342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.535270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.535922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.536629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.537803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.538422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.554089 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 HTTP/1.1 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '3132186d-4372-4b1c-a4c3-618f2c9a0c62'} Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.555804 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.561393 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.561393 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.561393 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.561393 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.561393 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.561393 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. Oct 16 01:26:13.561393 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.562843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 3132186d-4372-4b1c-a4c3-618f2c9a0c62 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.563778 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-39a1198c-caf6-4c59-b877-4063eb24ef66 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62" status: 404 len: 111 microversion: 2.1 time: 0.044273 Oct 16 01:26:13.564362 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2662/5188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:13 2022] GET /compute/v2.1/servers/3132186d-4372-4b1c-a4c3-618f2c9a0c62 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.572470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.573085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.579450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.580157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.580596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.581295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.581753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.582177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.718730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:13.729852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:13.731525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:13.732881 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7f2ac858-43f0-4a20-8052-3e98cb24e476 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1406 microversion: 2.20 time: 0.568316 Oct 16 01:26:13.733443 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2527/5189] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:13 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1406 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:13.738197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.738891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.746017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.746825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.747320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.748093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.748568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.748979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.763794 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 HTTP/1.1 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: exception: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'cbc1403e-9703-433b-9e7e-05ad0d3b0531'} Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.765783 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.771044 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.773499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.775399 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ea2e1e7-79a2-496a-a897-08ffd39ba1f8 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 404 len: 111 microversion: 2.1 time: 0.040719 Oct 16 01:26:13.776153 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2528/5190] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:13 2022] DELETE /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.786846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.788604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: cbc1403e-9703-433b-9e7e-05ad0d3b0531] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.798528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.799346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.800104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.800989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:13.801649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:13.802242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:13.819016 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 HTTP/1.1 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: exception: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'cbc1403e-9703-433b-9e7e-05ad0d3b0531'} Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.820968 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance cbc1403e-9703-433b-9e7e-05ad0d3b0531 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.826352 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-274e1fab-13f0-466b-8f07-648050df2f45 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531" status: 404 len: 111 microversion: 2.1 time: 0.044818 Oct 16 01:26:13.830565 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2529/5191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:13 2022] GET /compute/v2.1/servers/cbc1403e-9703-433b-9e7e-05ad0d3b0531 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.836276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1354db95-9cff-40b6-ac8d-60124681aea2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.837012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1354db95-9cff-40b6-ac8d-60124681aea2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: d28cc0f7-b36b-4d02-9b64-3a02ed241f30] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.843646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-1354db95-9cff-40b6-ac8d-60124681aea2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1354db95-9cff-40b6-ac8d-60124681aea2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30 HTTP/1.1 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: exception: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'd28cc0f7-b36b-4d02-9b64-3a02ed241f30'} Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.845178 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1354db95-9cff-40b6-ac8d-60124681aea2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1354db95-9cff-40b6-ac8d-60124681aea2 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30" status: 404 len: 111 microversion: 2.1 time: 0.014848 Oct 16 01:26:13.852124 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2530/5192] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:13 2022] DELETE /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.859980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6187e9a6-3e6d-44aa-b125-133452f4c7c3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:13.861095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6187e9a6-3e6d-44aa-b125-133452f4c7c3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: d28cc0f7-b36b-4d02-9b64-3a02ed241f30] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:13.874618 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-6187e9a6-3e6d-44aa-b125-133452f4c7c3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6187e9a6-3e6d-44aa-b125-133452f4c7c3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30 HTTP/1.1 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: exception: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'd28cc0f7-b36b-4d02-9b64-3a02ed241f30'} Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:13.876622 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:13.888192 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:13.888192 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:13.888192 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:13.888192 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. Oct 16 01:26:13.888192 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:13.888192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6187e9a6-3e6d-44aa-b125-133452f4c7c3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance d28cc0f7-b36b-4d02-9b64-3a02ed241f30 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:13.888192 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6187e9a6-3e6d-44aa-b125-133452f4c7c3 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30" status: 404 len: 111 microversion: 2.1 time: 0.024895 Oct 16 01:26:13.888192 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2531/5193] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:13 2022] GET /compute/v2.1/servers/d28cc0f7-b36b-4d02-9b64-3a02ed241f30 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:13.923713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:13.937311 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83c6ecbc-c703-497f-9f33-2e23835aea5e tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.368725 Oct 16 01:26:13.938478 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2663/5194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:13 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:14.762391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:14.763106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:14.785756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:14.787959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:14.788625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:14.791932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:14.793446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:14.794503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:15.254483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-8701d03e-4edd-45e5-a06e-4d18d9e459ad req-79b5e2a4-736a-4c2e-a861-f7b754f30cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa8ed22-d042-41d4-84a6-63e1b1ac9b2a", "name": "network-vif-plugged", "status": "completed", "tag": "1753d20a-a3ba-48cb-b791-16b43c88ff56"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:15.283405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8701d03e-4edd-45e5-a06e-4d18d9e459ad req-79b5e2a4-736a-4c2e-a861-f7b754f30cc4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:15.283924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8701d03e-4edd-45e5-a06e-4d18d9e459ad req-79b5e2a4-736a-4c2e-a861-f7b754f30cc4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:15.284364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8701d03e-4edd-45e5-a06e-4d18d9e459ad req-79b5e2a4-736a-4c2e-a861-f7b754f30cc4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:15.331393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-8701d03e-4edd-45e5-a06e-4d18d9e459ad req-79b5e2a4-736a-4c2e-a861-f7b754f30cc4 service nova] Creating event network-vif-plugged:1753d20a-a3ba-48cb-b791-16b43c88ff56 for instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a on n-h1-master-1 Oct 16 01:26:15.341348 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-8701d03e-4edd-45e5-a06e-4d18d9e459ad req-79b5e2a4-736a-4c2e-a861-f7b754f30cc4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.526885 Oct 16 01:26:15.341984 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2664/5195] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:26:15.356990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:15.362166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:15.379621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:15.381999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:15.385832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:15.386837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:15.387502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:15.388130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:15.675784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:15.690961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:15.692429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:15.694205 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b5682e42-da45-4dbf-9599-dd9664ec0d66 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1406 microversion: 2.20 time: 0.935408 Oct 16 01:26:15.723179 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2532/5196] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:14 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1406 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:15.752188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:15.767670 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e5fe06c-2014-4b89-9495-3e6795445725 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.419585 Oct 16 01:26:15.768722 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2665/5197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:15 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:16.019466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1c069817-a334-4b1e-a17e-efa3400fdaa3 req-01f31a9f-844a-4d60-9365-6b2639b429da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d0190-b646-45ec-bc90-5b09fb541a10", "tag": "9f8f68e3-bf9d-4291-8222-c7190f91aac8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:16.042844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1c069817-a334-4b1e-a17e-efa3400fdaa3 req-01f31a9f-844a-4d60-9365-6b2639b429da service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:16.043664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1c069817-a334-4b1e-a17e-efa3400fdaa3 req-01f31a9f-844a-4d60-9365-6b2639b429da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:16.044272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1c069817-a334-4b1e-a17e-efa3400fdaa3 req-01f31a9f-844a-4d60-9365-6b2639b429da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:16.057258 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:16.067214 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1c069817-a334-4b1e-a17e-efa3400fdaa3 req-01f31a9f-844a-4d60-9365-6b2639b429da service nova] Creating event network-changed:9f8f68e3-bf9d-4291-8222-c7190f91aac8 for instance e57d0190-b646-45ec-bc90-5b09fb541a10 on n-h2-master-1 Oct 16 01:26:16.087500 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1c069817-a334-4b1e-a17e-efa3400fdaa3 req-01f31a9f-844a-4d60-9365-6b2639b429da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068465 Oct 16 01:26:16.088407 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2533/5198] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:16.723806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:16.724410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:16.748477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:16.748979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:16.749417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:16.756711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:16.763728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:16.764420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:16.809604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:16.813301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:16.829916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:16.830821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:16.831550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:16.833316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:16.835099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:16.835845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:17.424348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:17.434487 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c21d8ea2-f723-4f0e-b7da-6e6219cc0e1a tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1522 microversion: 2.1 time: 0.646942 Oct 16 01:26:17.440053 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2534/5199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:16 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1522 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:17.492977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:17.505648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:17.510367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:17.511602 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d7b4761-9704-4254-9d6c-3da67dea055f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1406 microversion: 2.20 time: 0.793715 Oct 16 01:26:17.526302 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2666/5200] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:16 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1406 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:18.417084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:18.417602 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:18.441300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:18.442744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:18.452196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:18.453232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:18.455607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:18.465277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:18.466551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:18.473047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:18.489673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:18.490216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:18.491253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:18.506110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:18.506743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:18.509603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:18.543711 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 HTTP/1.1 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '57546d04-76c2-4d2d-9c2c-0a5f736417e7'} Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:18.550092 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:18.554789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:18.571741 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-84d93ce8-944f-4b3c-99f8-c75f0468886e tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 404 len: 111 microversion: 2.1 time: 0.157620 Oct 16 01:26:18.573933 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2535/5201] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:18 2022] DELETE /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:19.092261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e7cdaa2d85d4ce698950075b98d5eb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07213ca67c6a4616babc77d721d2cae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:19.101819 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1734ae18-45e2-4efd-a2cb-53fb35743654 tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 200 len: 1480 microversion: 2.1 time: 0.640795 Oct 16 01:26:19.121473 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2667/5202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:18 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 1480 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:19.131922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:19.143737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:19.168935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.169487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.169940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.171131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.171605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.172046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.174625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6684ea89-42c6-4b64-ba36-7bb6f8b5be13 req-b5416d90-5cc3-446d-bd61-9a1b65196ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3", "name": "network-vif-deleted", "tag": "595c74cb-9d14-4532-89c6-65f21df76a64"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:19.197864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6684ea89-42c6-4b64-ba36-7bb6f8b5be13 req-b5416d90-5cc3-446d-bd61-9a1b65196ba5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.198480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6684ea89-42c6-4b64-ba36-7bb6f8b5be13 req-b5416d90-5cc3-446d-bd61-9a1b65196ba5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.199317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6684ea89-42c6-4b64-ba36-7bb6f8b5be13 req-b5416d90-5cc3-446d-bd61-9a1b65196ba5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.277760 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6684ea89-42c6-4b64-ba36-7bb6f8b5be13 req-b5416d90-5cc3-446d-bd61-9a1b65196ba5 service nova] Creating event network-vif-deleted:595c74cb-9d14-4532-89c6-65f21df76a64 for instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 on n-h2-master-1 Oct 16 01:26:19.298724 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6684ea89-42c6-4b64-ba36-7bb6f8b5be13 req-b5416d90-5cc3-446d-bd61-9a1b65196ba5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.721922 Oct 16 01:26:19.300190 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2536/5203] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:19.314092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:19.316484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: 57546d04-76c2-4d2d-9c2c-0a5f736417e7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:19.331373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.335065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.335536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.336316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.340061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.340812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.357270 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 HTTP/1.1 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '57546d04-76c2-4d2d-9c2c-0a5f736417e7'} Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:19.359787 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.364943 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.364943 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:19.364943 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:19.364943 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:19.364943 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:19.364943 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. Oct 16 01:26:19.364943 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.368187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance 57546d04-76c2-4d2d-9c2c-0a5f736417e7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:19.369458 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-18d8345e-35c8-490d-a366-eafe916a34ef tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7" status: 404 len: 111 microversion: 2.1 time: 0.064945 Oct 16 01:26:19.370404 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2537/5204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:19 2022] GET /compute/v2.1/servers/57546d04-76c2-4d2d-9c2c-0a5f736417e7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:19.382283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:19.383172 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:19.393484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.394262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.395317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.397228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.399016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.399756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.422308 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb HTTP/1.1 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a195d226-a688-446c-baad-0350c08f9abb'} Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:19.424845 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.429873 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.433917 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:19.435173 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5359d25d-6dc2-47a8-98fe-6cc1d1db4ee1 tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 404 len: 111 microversion: 2.1 time: 0.058397 Oct 16 01:26:19.439643 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2538/5205] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:19 2022] DELETE /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:19.446877 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:19.448261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] [instance: a195d226-a688-446c-baad-0350c08f9abb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:19.455851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.456693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.457409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.458360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.459164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.459894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.478085 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] HTTP exception thrown: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Request method failure captured: Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb HTTP/1.1 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1yRnos3AO3Eadzp_22j-7R8bvwl9cpHb4OyBet1hNQEXAC28ImP-OODlfDthEc9vXw-3uADHplj8SPAJACVZkncHlePa4S7paAOgQw7HFpyTOK3d5JsKJw5kHwI2Nxb0jEK36kca5jxjMJ-HVdibuSBK3kbaddTKZvQWivzvKD9zyA Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0304839bb0f444a9786183ba8b4e446", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0304839bb0f444a9786183ba8b4e446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b0304839bb0f444a9786183ba8b4e446 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-174900367 Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a3ac1408c91c4db59f4639abdca2c98f Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-174900367-project Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a195d226-a688-446c-baad-0350c08f9abb'} Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:19.484012 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.489314 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:19.489314 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:19.489314 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:19.489314 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:19.489314 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:19.489314 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. Oct 16 01:26:19.489314 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:19.492608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] Returning 404 to user: Instance a195d226-a688-446c-baad-0350c08f9abb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:19.493782 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-34c837b9-5f42-4a22-b89d-7b41bc3dec0b tempest-DeleteServersTestJSON-174900367 tempest-DeleteServersTestJSON-174900367-project] 10.222.0.39 "GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb" status: 404 len: 111 microversion: 2.1 time: 0.052852 Oct 16 01:26:19.494633 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2539/5206] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:19 2022] GET /compute/v2.1/servers/a195d226-a688-446c-baad-0350c08f9abb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:19.790836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:19.804738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:19.808937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:19.810499 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ba1818b-b3fa-4efe-a8a1-e3e68fc49555 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1597 microversion: 2.20 time: 0.687672 Oct 16 01:26:19.811597 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2668/5207] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:19 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1597 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:19.843387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:19.843897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:19.852221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.852984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.853621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:19.854508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:19.855168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:19.855783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:20.139786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:20.143131 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d28f018-9741-4a55-95db-463a2a9331c2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.306641 Oct 16 01:26:20.144418 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2540/5208] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Oct 16 01:26:19 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:26:20.144878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] [instance: 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:20.152172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:20.153127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:20.153900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:20.155160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:20.155867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:20.156468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:20.177775 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] HTTP exception thrown: Instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 could not be found. Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Request method failure captured: Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 HTTP/1.1 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1yAK6nDd68JuYOMgzCHRHbnges7UQ1suXRWn2xDaEk-r-I0CdGNeuWgi7DJt_L6pv4TdsbEQ_FNCJGt0ebQzmPzi49LQp47imWIctH9f56W9WGpITLcomPV0ZYmkJEeU4lZHIOreaFA5HwSOWImteGE4kWALjBf_Grrg-sIhcZfjF4 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_07213ca67c6a4616babc77d721d2cae5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/07213ca67c6a4616babc77d721d2cae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 07213ca67c6a4616babc77d721d2cae5 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117078880 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7e7cdaa2d85d4ce698950075b98d5eb8 Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117078880-project Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 could not be found. Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3'} Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 could not be found. Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 could not be found. Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:20.182539 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:20.188185 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:20.188185 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:20.188185 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:20.188185 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:20.188185 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:20.188185 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:20.188185 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 could not be found. Oct 16 01:26:20.188185 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:26:20.189767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Returning 404 to user: Instance 0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:20.192457 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3" status: 404 len: 111 microversion: 2.1 time: 0.056746 Oct 16 01:26:20.193367 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2669/5209] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:20 2022] GET /compute/v2.1/servers/0258bb4d-1a11-4e8a-ab97-dd6707c4b0f3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:26:24.350978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ad80a06a-b527-49e4-858d-0fa4072b1bdc req-2e10395e-b809-4d2f-9bc7-bf6bc3a1b9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa8ed22-d042-41d4-84a6-63e1b1ac9b2a", "tag": "1753d20a-a3ba-48cb-b791-16b43c88ff56"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:24.373779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ad80a06a-b527-49e4-858d-0fa4072b1bdc req-2e10395e-b809-4d2f-9bc7-bf6bc3a1b9a3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:24.376363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ad80a06a-b527-49e4-858d-0fa4072b1bdc req-2e10395e-b809-4d2f-9bc7-bf6bc3a1b9a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:24.379391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ad80a06a-b527-49e4-858d-0fa4072b1bdc req-2e10395e-b809-4d2f-9bc7-bf6bc3a1b9a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:24.404036 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ad80a06a-b527-49e4-858d-0fa4072b1bdc req-2e10395e-b809-4d2f-9bc7-bf6bc3a1b9a3 service nova] Creating event network-changed:1753d20a-a3ba-48cb-b791-16b43c88ff56 for instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a on n-h1-master-1 Oct 16 01:26:24.415050 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ad80a06a-b527-49e4-858d-0fa4072b1bdc req-2e10395e-b809-4d2f-9bc7-bf6bc3a1b9a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075648 Oct 16 01:26:24.417333 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2541/5210] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:32.782052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:32.783482 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9867da03-d24e-4647-ae89-79f4e1794c6b tempest-ServerRescueNegativeTestJSON-117078880 tempest-ServerRescueNegativeTestJSON-117078880-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001880 Oct 16 01:26:32.784201 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2670/5211] 10.222.0.39 () {56 vars in 886 bytes} [Sun Oct 16 01:26:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 16 01:26:37.129246 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=35 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:37.132756 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=22 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:37.138417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:37.141468 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:37.152827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:37.155025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:37.156056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:37.158639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:37.159364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:37.160377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:37.264470 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-237e899d-fdda-4851-a4f4-8365123957b2 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10/action" status: 200 len: 24566 microversion: 2.1 time: 0.135593 Oct 16 01:26:37.276545 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2542/5212] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:26:37 2022] POST /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10/action => generated 24566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 01:26:40.816903 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:40.819537 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:41.063059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1215236113", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c8f01f70-5b50-4765-95a7-374d0e0d8fe3"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:41.178253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] validate_networks() for [('c8f01f70-5b50-4765-95a7-374d0e0d8fe3', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:26:41.834895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:26:41.836725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:26:41.838108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:26:41.838961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:26:41.840119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:26:41.862160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:41.863660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:41.864393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:41.866103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:41.866943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:41.867933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:41.896197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Getting quotas for project e0ad8ba45c374500b4224168c73793b8. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:26:41.904699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Getting quotas for user fe6f97cacf104ff19ada4bc7e4fe0e01 and project e0ad8ba45c374500b4224168c73793b8. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:26:41.935069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:26:41.939516 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:26:42.066084 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d15e1eaf-b55b-4fc0-915b-662bddde25bb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.257521 Oct 16 01:26:42.069361 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2671/5213] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:26:42.081452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ac35558-b990-44c8-8509-bc7330ec86f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:42.083265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ac35558-b990-44c8-8509-bc7330ec86f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:42.175752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2ac35558-b990-44c8-8509-bc7330ec86f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:42.202932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2ac35558-b990-44c8-8509-bc7330ec86f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:42.206402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2ac35558-b990-44c8-8509-bc7330ec86f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:42.209108 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2ac35558-b990-44c8-8509-bc7330ec86f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1262 microversion: 2.26 time: 0.132342 Oct 16 01:26:42.210411 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2543/5214] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:42 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1262 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:26:43.237549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d5eafc7-e72c-47b7-8e97-fb083f35b261 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:43.238738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d5eafc7-e72c-47b7-8e97-fb083f35b261 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:43.391274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d5eafc7-e72c-47b7-8e97-fb083f35b261 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:43.423770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d5eafc7-e72c-47b7-8e97-fb083f35b261 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:43.432697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d5eafc7-e72c-47b7-8e97-fb083f35b261 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:43.435961 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d5eafc7-e72c-47b7-8e97-fb083f35b261 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1262 microversion: 2.26 time: 0.202190 Oct 16 01:26:43.437378 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2672/5215] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:43 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1262 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:44.466424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:44.467556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:44.517421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:44.518252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:44.525697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:44.532740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:44.534556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:44.535511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:44.824801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:44.850677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:44.857245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:44.862470 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3d0676de-d409-47fb-90a5-c24c790956dc tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1314 microversion: 2.26 time: 0.396072 Oct 16 01:26:44.867917 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2544/5216] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:44 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:45.901102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:45.901709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:45.914260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:45.917834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:45.920680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:45.924735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:45.925976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:45.926532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:46.124115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:46.150799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:46.156495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:46.158978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1320 microversion: 2.26 time: 0.262996 Oct 16 01:26:46.171994 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2673/5217] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:45 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:47.215236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:47.217809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:47.262323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:47.262853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:47.263337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:47.264031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:47.264527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:47.264941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:47.536985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:47.538935 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc2f2872-d142-43f0-a30a-880f17a020a8 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002328 Oct 16 01:26:47.539360 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2674/5218] 10.222.0.39 () {56 vars in 886 bytes} [Sun Oct 16 01:26:47 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 16 01:26:48.028197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:48.049910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:48.059096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:48.069747 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b46536f3-3cf0-468f-b003-509bffa55e4b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1362 microversion: 2.26 time: 0.882435 Oct 16 01:26:48.070365 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2545/5219] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:47 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1362 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:48.985832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:48.988733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:49.011708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:49.014143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:49.016120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:49.018971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:49.020295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:49.024741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:49.104585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:49.105181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:49.116184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:49.116681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:49.117120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:49.121651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:49.122184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:49.122633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:49.165036 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b337a302-2001-4893-bbbc-bcf0b021c3c7 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "POST /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10/action" status: 200 len: 32642 microversion: 2.1 time: 0.183058 Oct 16 01:26:49.166277 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2675/5220] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:26:48 2022] POST /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10/action => generated 32642 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:26:49.892639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:49.902968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:49.911391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:49.915408 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e13905b-95ed-4778-a80b-58b003b42c38 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1362 microversion: 2.26 time: 0.814962 Oct 16 01:26:49.921499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-118426719", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "a574349b-5967-4085-81c8-e874ad9d23a1"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:49.927091 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2546/5221] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:49 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1362 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:49.940660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:49.941209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:49.953067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:49.953862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:49.954509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:49.958901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:49.959647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:49.966598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:50.008092 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-418986b5-6e9a-4165-8db3-3bd4365c9061 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/ips" status: 200 len: 151 microversion: 2.20 time: 0.072413 Oct 16 01:26:50.013223 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2547/5222] 10.222.0.39 () {60 vars in 1289 bytes} [Sun Oct 16 01:26:49 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/ips => generated 151 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 01:26:50.032732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] validate_networks() for [('a574349b-5967-4085-81c8-e874ad9d23a1', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:26:50.947266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:50.947979 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:50.968146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:50.971561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:50.973500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:50.977969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:50.978847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:50.979959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:51.879163 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:52.202301 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:26:52.293706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:52.319916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:52.324547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:52.325943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6f1b7e9f-f09b-4ca5-b559-080285b7a3d3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1362 microversion: 2.26 time: 1.384221 Oct 16 01:26:52.331070 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2548/5223] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:50 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1362 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:26:52.856579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f63d78f1-3221-4cb5-908a-20308dc57829 req-9397d274-cd13-4359-b0c9-e7a028257787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7d3781-9e23-4efe-958f-f17fd8cca1cc", "tag": "2f814b90-287a-49cd-94bc-e4ad8e0af786"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:52.868775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f63d78f1-3221-4cb5-908a-20308dc57829 req-9397d274-cd13-4359-b0c9-e7a028257787 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:52.869266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f63d78f1-3221-4cb5-908a-20308dc57829 req-9397d274-cd13-4359-b0c9-e7a028257787 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:52.869700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f63d78f1-3221-4cb5-908a-20308dc57829 req-9397d274-cd13-4359-b0c9-e7a028257787 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:52.886619 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f63d78f1-3221-4cb5-908a-20308dc57829 req-9397d274-cd13-4359-b0c9-e7a028257787 service nova] Creating event network-changed:2f814b90-287a-49cd-94bc-e4ad8e0af786 for instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc on n-h1-master-1 Oct 16 01:26:52.892399 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f63d78f1-3221-4cb5-908a-20308dc57829 req-9397d274-cd13-4359-b0c9-e7a028257787 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.559890 Oct 16 01:26:52.893560 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2549/5224] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:53.291012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:26:53.292855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:26:53.293609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:26:53.294630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:26:53.295832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:26:53.325860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:53.327311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:53.328021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:53.330103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:53.331750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:53.332444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:53.367070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Getting quotas for project 3eaf7d9670874e5d92db84283b262d57. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:26:53.374726 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Getting quotas for user 04fa49711754440c9e889ad13dc4d7d3 and project 3eaf7d9670874e5d92db84283b262d57. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:26:53.379133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:53.382942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:53.395580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:26:53.398127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:53.401112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:53.402532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:53.404657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:53.405862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:53.408576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:53.409961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:26:53.529362 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c88b43f9-f40b-48b1-ba8f-e66c8fc07228 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.911192 Oct 16 01:26:53.530197 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2676/5225] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:26:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:26:53.580983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8780a71f-5d97-4995-916c-68436bb02d2d tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:53.585397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8780a71f-5d97-4995-916c-68436bb02d2d tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:54.011036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8780a71f-5d97-4995-916c-68436bb02d2d tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:54.024255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8780a71f-5d97-4995-916c-68436bb02d2d tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1216 microversion: 2.1 time: 0.484616 Oct 16 01:26:54.025645 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2677/5226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:53 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1216 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:54.038979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:54.039851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:54.050319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:54.055863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:54.057125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:54.058115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:54.059103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:54.059541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:54.133467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lazy-loading 'flavor' on Instance uuid baa8ed22-d042-41d4-84a6-63e1b1ac9b2a {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:26:54.161075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:54.173140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:54.176148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:54.182587 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-600dcd63-5bb0-4997-b7e4-2f5fc25694df tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1362 microversion: 2.26 time: 0.826146 Oct 16 01:26:54.187321 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2550/5227] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:53 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1362 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:26:54.205096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:54.209800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:54.239515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:54.241533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:54.242153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:54.245255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:54.247994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:54.250215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:54.328048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:26:54.495579 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f88d0cda-dbd1-418d-a298-1d5fa341b7b3 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 204 len: 0 microversion: 2.1 time: 0.305398 Oct 16 01:26:54.497687 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2551/5228] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:26:54 2022] DELETE /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:26:54.511774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:54.514523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:54.528078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:54.529802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:54.530454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:54.533752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:54.534448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:54.535122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:54.714304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cbd6e1b6-d782-47cc-81e1-154d8352f9ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/action" status: 202 len: 0 microversion: 2.20 time: 0.679028 Oct 16 01:26:54.715606 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2678/5229] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:26:54 2022] POST /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:26:54.728402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:54.732249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:54.747277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:54.748110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:54.750242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:54.753090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:54.754131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:54.758485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:55.223882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:55.250114 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-044ed8e5-449d-4b24-a7d3-94db5212151b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1671 microversion: 2.1 time: 0.746646 Oct 16 01:26:55.251996 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2552/5230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:54 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1671 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:55.261990 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a1eba4c9-635c-4d19-b917-3c78217d406c req-91d96657-17a4-4979-8440-d2336d2101e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d0190-b646-45ec-bc90-5b09fb541a10", "tag": "9f8f68e3-bf9d-4291-8222-c7190f91aac8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:55.285984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a1eba4c9-635c-4d19-b917-3c78217d406c req-91d96657-17a4-4979-8440-d2336d2101e6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:55.286832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a1eba4c9-635c-4d19-b917-3c78217d406c req-91d96657-17a4-4979-8440-d2336d2101e6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:55.287764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a1eba4c9-635c-4d19-b917-3c78217d406c req-91d96657-17a4-4979-8440-d2336d2101e6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:55.302850 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a1eba4c9-635c-4d19-b917-3c78217d406c req-91d96657-17a4-4979-8440-d2336d2101e6 service nova] Creating event network-changed:9f8f68e3-bf9d-4291-8222-c7190f91aac8 for instance e57d0190-b646-45ec-bc90-5b09fb541a10 on n-h2-master-1 Oct 16 01:26:55.310662 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a1eba4c9-635c-4d19-b917-3c78217d406c req-91d96657-17a4-4979-8440-d2336d2101e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053426 Oct 16 01:26:55.311695 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2553/5231] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:55.330747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:55.331789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:55.339693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:55.340415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:55.341283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:55.342333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:55.343029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:55.343660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:55.962848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:55.970575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba0a6622-3716-49fe-9945-a896b0d9ef0a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1220 microversion: 2.1 time: 0.657467 Oct 16 01:26:55.986790 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2554/5232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:55 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1220 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:55.990553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:55.992200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:55.992819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:56.000870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:56.006661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:56.007182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:56.007616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:56.010148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:56.010566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:56.011343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:56.012015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:56.012218 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3398dd8e-3e4e-4577-8ce0-03c7bbfd53a9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 1.291149 Oct 16 01:26:56.013511 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2679/5233] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:54 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:26:56.281172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:56.282540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:56.290847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:56.294809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:56.295586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:56.299954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:56.300595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:56.301148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:57.014784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:57.038406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:57.045181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:57.047775 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-556a81ab-1840-46ef-b42d-f9b0bfc10bf9 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1362 microversion: 2.26 time: 1.059840 Oct 16 01:26:57.048362 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2555/5234] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:55 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1362 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:57.067120 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:57.075767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:57.078980 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6c551be8-1dea-4d3a-ab08-c2a17feef8f1 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1671 microversion: 2.1 time: 0.802173 Oct 16 01:26:57.083285 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2680/5235] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:56 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1671 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:26:57.088357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:57.092209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:57.096629 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:57.106166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:57.110091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:57.112793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:57.113564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:57.114038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:57.114474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:57.122344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:57.122846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:57.124363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:57.125096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:57.125568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:57.126004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:57.418748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:57.428282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c0029cf1-5a5f-4b66-b29a-1d50111dcfd6 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1268 microversion: 2.1 time: 0.355685 Oct 16 01:26:57.429658 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2556/5236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:57 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1268 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:57.450725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ba264f2d-4f00-491b-9b03-a7283bd88bfd req-a4f4decd-65a8-46aa-8fb1-2bb1f709fec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d0190-b646-45ec-bc90-5b09fb541a10", "name": "network-vif-deleted", "tag": "9f8f68e3-bf9d-4291-8222-c7190f91aac8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:57.463385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ba264f2d-4f00-491b-9b03-a7283bd88bfd req-a4f4decd-65a8-46aa-8fb1-2bb1f709fec8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:57.465061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ba264f2d-4f00-491b-9b03-a7283bd88bfd req-a4f4decd-65a8-46aa-8fb1-2bb1f709fec8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:57.466185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ba264f2d-4f00-491b-9b03-a7283bd88bfd req-a4f4decd-65a8-46aa-8fb1-2bb1f709fec8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:57.486381 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ba264f2d-4f00-491b-9b03-a7283bd88bfd req-a4f4decd-65a8-46aa-8fb1-2bb1f709fec8 service nova] Creating event network-vif-deleted:9f8f68e3-bf9d-4291-8222-c7190f91aac8 for instance e57d0190-b646-45ec-bc90-5b09fb541a10 on n-h2-master-1 Oct 16 01:26:57.493187 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ba264f2d-4f00-491b-9b03-a7283bd88bfd req-a4f4decd-65a8-46aa-8fb1-2bb1f709fec8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048871 Oct 16 01:26:57.494896 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2557/5237] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:57.675971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:57.695619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:57.700500 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:57.705230 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de7ba774-6f09-48a3-ae9e-3d089a73eb07 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.618732 Oct 16 01:26:57.707045 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2681/5238] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:57 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:58.078904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:58.079744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:58.089360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.089853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.090288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:58.102936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.104196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.104665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:58.109806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:58.110425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:58.118770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.119995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.120532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:58.121139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.121603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.122031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:58.195712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.196626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.197414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:58.198038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lazy-loading 'fault' on Instance uuid e57d0190-b646-45ec-bc90-5b09fb541a10 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:26:58.425801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88d5c0890ae64fd6aa7e7e547e9bf736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d53034488714fc8980132211d0d5c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:58.435724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-577195ae-e893-4f90-bb9a-5fd49cc37252 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 200 len: 1339 microversion: 2.1 time: 0.329670 Oct 16 01:26:58.436820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2682/5239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:58 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 1339 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:26:58.464529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:58.465669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:58.475972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.477135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.478169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:58.479269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.480068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.480671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:58.632055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:58.640508 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85d98c6d-fa9b-439c-ba1c-fe894018beed tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1274 microversion: 2.1 time: 0.181224 Oct 16 01:26:58.641097 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2683/5240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:58 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:26:58.672176 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:58.684958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:58.689401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:58.693273 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3474c5bd-f189-4b9f-a3c4-62ca3f23653b tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1362 microversion: 2.26 time: 0.618031 Oct 16 01:26:58.694206 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2558/5241] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:58 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1362 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:58.745464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:58.748513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:58.767573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.771319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.772063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:58.775534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:58.777520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:58.779923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:59.105660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f866fbfc-911c-40b0-93bd-3258277d55df req-5585cff6-fe4c-4020-885a-ba81c5985707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7d3781-9e23-4efe-958f-f17fd8cca1cc", "name": "network-vif-plugged", "status": "completed", "tag": "2f814b90-287a-49cd-94bc-e4ad8e0af786"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:26:59.122983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f866fbfc-911c-40b0-93bd-3258277d55df req-5585cff6-fe4c-4020-885a-ba81c5985707 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:59.124610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f866fbfc-911c-40b0-93bd-3258277d55df req-5585cff6-fe4c-4020-885a-ba81c5985707 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:59.125284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f866fbfc-911c-40b0-93bd-3258277d55df req-5585cff6-fe4c-4020-885a-ba81c5985707 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:59.154423 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f866fbfc-911c-40b0-93bd-3258277d55df req-5585cff6-fe4c-4020-885a-ba81c5985707 service nova] Creating event network-vif-plugged:2f814b90-287a-49cd-94bc-e4ad8e0af786 for instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc on n-h1-master-1 Oct 16 01:26:59.171220 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f866fbfc-911c-40b0-93bd-3258277d55df req-5585cff6-fe4c-4020-885a-ba81c5985707 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069143 Oct 16 01:26:59.180059 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2559/5242] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:26:59.246634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:59.274962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:59.279355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:26:59.282978 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-af4d77a4-47b2-40b9-893d-efc31efcba4e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.548576 Oct 16 01:26:59.284803 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2684/5243] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:58 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:26:59.467316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:59.468637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] [instance: e57d0190-b646-45ec-bc90-5b09fb541a10] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:59.476338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:59.477378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:59.478058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:59.479775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:59.480780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:59.481604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:59.504798 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] HTTP exception thrown: Instance e57d0190-b646-45ec-bc90-5b09fb541a10 could not be found. Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Request method failure captured: Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 HTTP/1.1 Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1ziAuG6j_JD8guND5I1dGsK1Rfw0fPM_1wwTb1CqSapss852Ff5ibwYBdkHyh2EDS_dqE1LI_4GZcCidmN0LYZi7Y20DCYMzOhuqbvNW1k48vjIjg-mF0E9fyyhLVFqqL-gCxrOoW124VDirWjYaWldknrg-51licReGw9SEOSTuOk Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 0d53034488714fc8980132211d0d5c0b Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestNetworkBasicOps-225643155 Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0d53034488714fc8980132211d0d5c0b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0d53034488714fc8980132211d0d5c0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestNetworkBasicOps-225643155 Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 0d53034488714fc8980132211d0d5c0b Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestNetworkBasicOps-225643155 Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestNetworkBasicOps-225643155-project Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 88d5c0890ae64fd6aa7e7e547e9bf736 Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestNetworkBasicOps-225643155-project Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: exception: Instance e57d0190-b646-45ec-bc90-5b09fb541a10 could not be found. Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'e57d0190-b646-45ec-bc90-5b09fb541a10'} Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57d0190-b646-45ec-bc90-5b09fb541a10 could not be found. Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57d0190-b646-45ec-bc90-5b09fb541a10 could not be found. Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:26:59.508035 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:59.513082 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:26:59.513082 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:26:59.513082 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:26:59.513082 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:26:59.513082 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:26:59.513082 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57d0190-b646-45ec-bc90-5b09fb541a10 could not be found. Oct 16 01:26:59.513082 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:26:59.516939 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Returning 404 to user: Instance e57d0190-b646-45ec-bc90-5b09fb541a10 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:26:59.518590 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-236ba42a-e4e2-4d05-9a0c-1a1b2f19b640 tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10" status: 404 len: 111 microversion: 2.1 time: 0.056163 Oct 16 01:26:59.525099 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2560/5244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:59 2022] GET /compute/v2.1/servers/e57d0190-b646-45ec-bc90-5b09fb541a10 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:26:59.665238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:59.666027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:59.674221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:59.674733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:59.675195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:59.676176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:59.676577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:59.677009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:59.719258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:26:59.720751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:26:59.731729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:59.732374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:59.732947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:26:59.733772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:26:59.738078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:26:59.738670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:00.055315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:00.063444 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d9eec5db-20ef-485f-a0e2-da6aa477c4d1 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1316 microversion: 2.1 time: 0.402707 Oct 16 01:27:00.064332 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2685/5245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:26:59 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:00.071154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5457026e-1742-4353-b4cb-94e748eafd3b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] Calling method '.version_select at 0x7fd64df1b4c0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:00.094247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5457026e-1742-4353-b4cb-94e748eafd3b tempest-TestNetworkBasicOps-225643155 tempest-TestNetworkBasicOps-225643155-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1360423187" status: 202 len: 0 microversion: 2.1 time: 0.028123 Oct 16 01:27:00.095392 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2686/5246] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Oct 16 01:27:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1360423187 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:27:00.210542 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:00.214718 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:00.227931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:00.230847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:00.234486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bb15f5c-4ff3-43fc-9ac1-ee84498a1389 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1362 microversion: 2.26 time: 0.518592 Oct 16 01:27:00.277490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2561/5247] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:26:59 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:00.321779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:00.323204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:00.348503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:00.350680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:00.353967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:00.356180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:00.357894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:00.359583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:00.586890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0f3cad41-b93f-497c-afd6-e754e4f6b37b req-284c4769-beab-439f-ba04-861361f300be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e41c84-90ab-4ce3-b872-291acf4c3532", "tag": "b6ee2f7a-80eb-4dd4-9001-c9cbfc862cc2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:00.603351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0f3cad41-b93f-497c-afd6-e754e4f6b37b req-284c4769-beab-439f-ba04-861361f300be service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:00.604443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0f3cad41-b93f-497c-afd6-e754e4f6b37b req-284c4769-beab-439f-ba04-861361f300be service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:00.605120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0f3cad41-b93f-497c-afd6-e754e4f6b37b req-284c4769-beab-439f-ba04-861361f300be service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:00.624512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0f3cad41-b93f-497c-afd6-e754e4f6b37b req-284c4769-beab-439f-ba04-861361f300be service nova] Creating event network-changed:b6ee2f7a-80eb-4dd4-9001-c9cbfc862cc2 for instance 57e41c84-90ab-4ce3-b872-291acf4c3532 on n-h2-master-1 Oct 16 01:27:00.630735 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0f3cad41-b93f-497c-afd6-e754e4f6b37b req-284c4769-beab-439f-ba04-861361f300be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047997 Oct 16 01:27:00.632027 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2562/5248] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:27:00.967023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:00.984564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:00.987258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:00.989428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-efc609c3-8cfa-4070-8e46-05048a58e40c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.678682 Oct 16 01:27:00.993133 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2687/5249] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:00 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:01.092079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:01.093581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:01.119495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.120365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.121040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:01.122052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.123156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.125882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:01.267129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:01.267129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:01.276994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.277668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.278116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:01.278834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.279330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.279765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:01.739514 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:01.761223 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30728fef-00bc-4d8f-9eaa-4ade48256f5c tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1316 microversion: 2.1 time: 0.674648 Oct 16 01:27:01.762732 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2563/5250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:01 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:01.791311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:01.823100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:01.826411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:01.831229 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3414d975-5ef2-4307-b3bd-e732b0f63e97 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1547 microversion: 2.26 time: 0.569445 Oct 16 01:27:01.835660 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2688/5251] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:01 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1547 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:01.864247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d075310>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:01.886278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.887146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.889138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:01.890461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:01.901076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.902065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.902816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:01.904032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.904759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.905329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:01.951606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.952622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.953207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:01.970884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:01.971816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:01.972446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.022268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.022881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:02.024128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:02.033162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.033674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.034117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.034832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.044237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.044717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.045978 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-26856ee2-2fe9-4f19-ba21-4bc7e9d07386 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-564620234" status: 201 len: 0 microversion: 2.26 time: 0.186984 Oct 16 01:27:02.047469 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2564/5252] 10.222.0.39 () {62 vars in 1377 bytes} [Sun Oct 16 01:27:01 2022] PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-564620234 => generated 0 bytes in 189 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 16 01:27:02.069102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c800959d-0d6d-4d0c-9a82-4c0db4630d6c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d093430>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.084279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c800959d-0d6d-4d0c-9a82-4c0db4630d6c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.084684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c800959d-0d6d-4d0c-9a82-4c0db4630d6c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.085125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c800959d-0d6d-4d0c-9a82-4c0db4630d6c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.097747 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c800959d-0d6d-4d0c-9a82-4c0db4630d6c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-564620234" status: 204 len: 0 microversion: 2.26 time: 0.041968 Oct 16 01:27:02.099682 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2565/5253] 10.222.0.39 () {60 vars in 1358 bytes} [Sun Oct 16 01:27:02 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-564620234 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:27:02.108395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d07fee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.124498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.125420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.126474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.127479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:02.134708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.135458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.136068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.136905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.138315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.139534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.175433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.176186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.176772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.210868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:02.243656 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-13af6cc3-7fd7-4f10-af42-14199707873a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.139215 Oct 16 01:27:02.245222 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2566/5254] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Oct 16 01:27:02 2022] DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:27:02.281138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ec86d56-accd-49c0-82f7-2af69b60dec0 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d0b3790>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.291634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ec86d56-accd-49c0-82f7-2af69b60dec0 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.292329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ec86d56-accd-49c0-82f7-2af69b60dec0 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.292907 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ec86d56-accd-49c0-82f7-2af69b60dec0 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.309732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ec86d56-accd-49c0-82f7-2af69b60dec0 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 200 len: 12 microversion: 2.26 time: 0.055339 Oct 16 01:27:02.312389 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2567/5255] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 01:27:02 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:02.330419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d09b9d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.358030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:02.363844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.364883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.375804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.376773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:02.382530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:02.385263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.385904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.386644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.387529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.387908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:02.388468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.389035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.389964 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e288ed6-fed4-4b9e-8651-123c02a4228e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.372065 Oct 16 01:27:02.392453 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2689/5256] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:02 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:27:02.447399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.448083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.448680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.462057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.462826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.463484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.509839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:02.537548 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6ae251c7-34e0-4238-b1c3-566cca5f4927 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-401802141" status: 201 len: 0 microversion: 2.26 time: 0.211623 Oct 16 01:27:02.539576 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2568/5257] 10.222.0.39 () {62 vars in 1377 bytes} [Sun Oct 16 01:27:02 2022] PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-401802141 => generated 0 bytes in 215 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 16 01:27:02.556970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4cd0ed70-9330-4010-8526-fc00cb8893b4 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64ddecc10>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.572292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed70-9330-4010-8526-fc00cb8893b4 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.573110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed70-9330-4010-8526-fc00cb8893b4 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.574048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4cd0ed70-9330-4010-8526-fc00cb8893b4 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.592394 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4cd0ed70-9330-4010-8526-fc00cb8893b4 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 200 len: 35 microversion: 2.26 time: 0.045631 Oct 16 01:27:02.598171 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2690/5258] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 01:27:02 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 35 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:02.604896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d093670>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.615245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.616141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.616856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.617528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:02.625706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.626369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.626960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.627776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.628469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.629148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.655237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.655946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.656472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.692658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:02.727717 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4edef668-99a4-4276-abf7-9d772ca36f4a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-401802141" status: 204 len: 0 microversion: 2.26 time: 0.127681 Oct 16 01:27:02.728526 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2569/5259] 10.222.0.39 () {60 vars in 1361 bytes} [Sun Oct 16 01:27:02 2022] DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-401802141 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:27:02.738162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6d05684-2ea0-43e6-bdd1-24f82bfa8e31 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64de02d30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.748630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6d05684-2ea0-43e6-bdd1-24f82bfa8e31 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.749182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6d05684-2ea0-43e6-bdd1-24f82bfa8e31 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.750062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6d05684-2ea0-43e6-bdd1-24f82bfa8e31 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.766221 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:02.774564 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6d05684-2ea0-43e6-bdd1-24f82bfa8e31 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 200 len: 12 microversion: 2.26 time: 0.040824 Oct 16 01:27:02.781910 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2691/5260] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 01:27:02 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 12 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:02.788699 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.789263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64ddbc3a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.790832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:02.801799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.803713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.804418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.805433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.806257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.807858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.811066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.814594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.815484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.819619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:02.838059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.840362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.840986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.841881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.843084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.843763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.878826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.879656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.882266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.902323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:02.929168 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e381d031-daa8-48c1-98ef-fd2d9e8fe7f1 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.144725 Oct 16 01:27:02.930307 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2692/5261] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Oct 16 01:27:02 2022] DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:27:02.945810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64df2a820>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:02.961716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.963225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.964884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.966057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:02.978577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.980009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.981420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:02.992608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:02.993438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:02.994074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.033847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.034677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.035573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.057180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.059514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.060973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.113025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:03.150281 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-594287c5-e62f-42fa-9ec5-e5dc746ee1af tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-225495172" status: 201 len: 0 microversion: 2.26 time: 0.210569 Oct 16 01:27:03.152145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2693/5262] 10.222.0.39 () {62 vars in 1377 bytes} [Sun Oct 16 01:27:02 2022] PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-225495172 => generated 0 bytes in 217 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 16 01:27:03.168919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64de02790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:03.189833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.190317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.198386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:03.202879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.208014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:03.215554 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-12c0399b-3493-4392-8db0-8f87b71543d5 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1316 microversion: 2.1 time: 0.433314 Oct 16 01:27:03.215632 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2570/5263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:02 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:03.227603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.228432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.229079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.230351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.231058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.231691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.312104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.312826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.313401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.327187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.327965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.329498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.350893 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:03.388447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:03.418064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:03.418677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:03.426440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.427113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.427618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.428456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.428950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.429463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.436336 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5bc5027b-131b-461c-b0ac-1e8a699b059a tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-1505560333" status: 201 len: 0 microversion: 2.26 time: 0.278611 Oct 16 01:27:03.437575 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2694/5264] 10.222.0.39 () {62 vars in 1380 bytes} [Sun Oct 16 01:27:03 2022] PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-1505560333 => generated 0 bytes in 280 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 16 01:27:03.447553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64e0bbf70>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:03.468710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.476102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.478811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.479423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:03.495066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.495809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.496412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.498644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.500229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.502034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.570238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.570756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.571382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.603408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:03.629355 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f87dabc8-508b-4ff0-835a-a58b54cb1b78 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.185963 Oct 16 01:27:03.632821 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2695/5265] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Oct 16 01:27:03 2022] DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 16 01:27:03.643062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9664d762-fe07-43aa-a88a-96d2d146aa90 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64e112820>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:03.661419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9664d762-fe07-43aa-a88a-96d2d146aa90 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.662247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9664d762-fe07-43aa-a88a-96d2d146aa90 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.663014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9664d762-fe07-43aa-a88a-96d2d146aa90 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.674195 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9664d762-fe07-43aa-a88a-96d2d146aa90 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 200 len: 12 microversion: 2.26 time: 0.036850 Oct 16 01:27:03.675660 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2696/5266] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 01:27:03 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:03.689173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64e0bb9d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:03.702625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.703520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.704149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.705093 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:03.714982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.716564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.717467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.719382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.720652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.721756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.770878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.772541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.773053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.787476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:03.810543 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6de7fc4-98ee-4756-8032-41de1f84c8ad tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.127995 Oct 16 01:27:03.815743 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2697/5267] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Oct 16 01:27:03 2022] DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:27:03.832118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64ddecd30>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:03.854941 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:03.862257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.867206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.867750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.868584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:03.887050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.887628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.888120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.888891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.894126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:03.899390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.899942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.910751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:03.912509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:03.914173 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64afe476-480f-401a-9351-9aafc42f7295 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.500137 Oct 16 01:27:03.921685 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2571/5268] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:03 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:27:03.932511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.933018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.933469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:03.961263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:03.961978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:03.963261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.026872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:04.030631 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:04.073696 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a480cd4-5ac6-4ac3-8d56-66770c0bdcf3 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-240644883" status: 201 len: 0 microversion: 2.26 time: 0.256734 Oct 16 01:27:04.078452 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2698/5269] 10.222.0.39 () {62 vars in 1377 bytes} [Sun Oct 16 01:27:03 2022] PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-240644883 => generated 0 bytes in 262 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 16 01:27:04.088030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d0d6d30>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:04.119391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.119902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.120352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.120843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:04.155446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.155957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.156539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.162352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.162933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.163313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.242892 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:04.243541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:04.259563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.260123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.260578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.261484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.261776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.262209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.294777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.296363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.297765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.310589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.312075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.312827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.349370 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:04.367665 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd52b5cf-74f6-4e09-9da8-8d63eb9c252d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-1773583106" status: 201 len: 0 microversion: 2.26 time: 0.285177 Oct 16 01:27:04.369024 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2572/5270] 10.222.0.39 () {62 vars in 1380 bytes} [Sun Oct 16 01:27:04 2022] PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags/tempest-tag-1773583106 => generated 0 bytes in 288 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 16 01:27:04.386332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Action: 'update_all', calling method: .version_select at 0x7fd64d074af0>, body: {"tags": ["tempest-tag-326590135", "tempest-tag-210028721"]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:04.413389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.414029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.414558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.417354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:04.432910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.438702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.441996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.445563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.446974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.452096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.460593 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:04.520336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.521491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.523997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.578559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:04.633164 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d3015a72-f61f-404f-a574-5e2e60fe4f47 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 200 len: 60 microversion: 2.26 time: 0.258218 Oct 16 01:27:04.642564 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2573/5271] 10.222.0.39 () {62 vars in 1312 bytes} [Sun Oct 16 01:27:04 2022] PUT /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 60 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:04.669233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-291f8a15-0869-43ea-83c4-6b9502e53b06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d093280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:04.694198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-291f8a15-0869-43ea-83c4-6b9502e53b06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.700622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-291f8a15-0869-43ea-83c4-6b9502e53b06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.702240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-291f8a15-0869-43ea-83c4-6b9502e53b06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.732689 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-291f8a15-0869-43ea-83c4-6b9502e53b06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 200 len: 60 microversion: 2.26 time: 0.088222 Oct 16 01:27:04.751448 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2574/5272] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Oct 16 01:27:04 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 60 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:04.770955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '.version_select at 0x7fd64d0373a0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:04.779355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.779900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.780345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.780828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:04.788445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.788945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.789388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.790201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.790554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.791013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.827643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.827643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.827643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.845036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lazy-loading 'flavor' on Instance uuid 1e7d3781-9e23-4efe-958f-f17fd8cca1cc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:27:04.869063 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32cc06d5-d703-4de6-a73b-54ae9f9c97eb tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.108247 Oct 16 01:27:04.869763 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2575/5273] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Oct 16 01:27:04 2022] DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc/tags => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:27:04.881789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:04.882134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:04.889871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.890472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.890822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.892393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:04.892866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:04.893304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:04.924284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:27:04.965166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:04.980442 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6d53ed4f-3ad7-4e47-8360-17979dd0e7a2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1316 microversion: 2.1 time: 0.742712 Oct 16 01:27:04.981274 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2699/5274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:04 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1316 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:04.995344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:04.996354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:05.007612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:05.008316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:05.010091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:05.016246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:05.018194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:05.018884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:05.073576 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8a9dfd4-39fe-44a9-8332-77c2696eb2fd tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 204 len: 0 microversion: 2.26 time: 0.197937 Oct 16 01:27:05.077859 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2576/5275] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:27:04 2022] DELETE /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 16 01:27:05.084718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:05.085430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:05.092237 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:05.094685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:05.094874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:05.095370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:05.096112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:05.096686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:05.097408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:05.628180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:05.635374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:05.643071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:05.647780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:05.649007 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e3300c1-b663-4765-9692-6f6d4c7cdd3d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1553 microversion: 2.26 time: 0.569745 Oct 16 01:27:05.649421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:05.651984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:05.654414 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2577/5276] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:05 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1553 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:05.656870 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bc39889d-0c92-45cd-93ff-f4fb19df8941 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.672791 Oct 16 01:27:05.657485 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2700/5277] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:04 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:06.006052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:06.006677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:06.013037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:06.014516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:06.015268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:06.016256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:06.016943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:06.017575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:06.491454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:06.509320 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e677b65c-21ff-4a0a-b762-598332d5fcab tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1316 microversion: 2.1 time: 0.505675 Oct 16 01:27:06.511970 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2578/5278] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:06 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:06.679846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:06.680331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:06.684652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:06.686311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:06.690947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:06.691781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:06.692302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:06.693824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:06.694356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:06.694839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:06.698359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:06.698861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:06.699319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:06.700030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:06.700486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:06.700906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:07.472200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:07.481073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:07.485160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:07.488723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:07.494619 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a9c29501-5658-41c3-b136-aa76f9989a06 tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1553 microversion: 2.26 time: 0.818916 Oct 16 01:27:07.495334 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2701/5279] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:06 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1553 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:07.513148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:07.513148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:07.513148 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-027c438a-c88e-4bc0-955c-16b48e4716f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.821173 Oct 16 01:27:07.513148 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2579/5280] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:06 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:07.533810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:07.534494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:07.566644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:07.567754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:07.568473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:07.571334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:07.572161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:07.572840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:07.745853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3c168891-47aa-4d57-a2ff-894e07210e1f req-a2f0b326-12b0-4068-8421-fc394f91c01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e41c84-90ab-4ce3-b872-291acf4c3532", "name": "network-vif-plugged", "status": "completed", "tag": "b6ee2f7a-80eb-4dd4-9001-c9cbfc862cc2"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:07.758953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3c168891-47aa-4d57-a2ff-894e07210e1f req-a2f0b326-12b0-4068-8421-fc394f91c01b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:07.759186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3c168891-47aa-4d57-a2ff-894e07210e1f req-a2f0b326-12b0-4068-8421-fc394f91c01b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:07.759921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3c168891-47aa-4d57-a2ff-894e07210e1f req-a2f0b326-12b0-4068-8421-fc394f91c01b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:07.766552 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=88,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:07.781072 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3c168891-47aa-4d57-a2ff-894e07210e1f req-a2f0b326-12b0-4068-8421-fc394f91c01b service nova] Creating event network-vif-plugged:b6ee2f7a-80eb-4dd4-9001-c9cbfc862cc2 for instance 57e41c84-90ab-4ce3-b872-291acf4c3532 on n-h2-master-1 Oct 16 01:27:07.788018 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3c168891-47aa-4d57-a2ff-894e07210e1f req-a2f0b326-12b0-4068-8421-fc394f91c01b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046346 Oct 16 01:27:07.789150 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2702/5281] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:27:08.012574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:08.033680 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4f280b5-166f-4864-a5e2-146de7a0619b tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1316 microversion: 2.1 time: 0.503771 Oct 16 01:27:08.034842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2580/5282] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:07 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:08.505782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-40674fb5-b3cb-4a82-8367-eb3294d0aed4 req-4359e699-4aee-4199-a210-423446a94bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7d3781-9e23-4efe-958f-f17fd8cca1cc", "name": "network-vif-deleted", "tag": "2f814b90-287a-49cd-94bc-e4ad8e0af786"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:08.523278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:08.537289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:08.538159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-40674fb5-b3cb-4a82-8367-eb3294d0aed4 req-4359e699-4aee-4199-a210-423446a94bf9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:08.541111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-40674fb5-b3cb-4a82-8367-eb3294d0aed4 req-4359e699-4aee-4199-a210-423446a94bf9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:08.541644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-40674fb5-b3cb-4a82-8367-eb3294d0aed4 req-4359e699-4aee-4199-a210-423446a94bf9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:08.575392 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-40674fb5-b3cb-4a82-8367-eb3294d0aed4 req-4359e699-4aee-4199-a210-423446a94bf9 service nova] Creating event network-vif-deleted:2f814b90-287a-49cd-94bc-e4ad8e0af786 for instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc on n-h1-master-1 Oct 16 01:27:08.585133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:08.585554 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-40674fb5-b3cb-4a82-8367-eb3294d0aed4 req-4359e699-4aee-4199-a210-423446a94bf9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084783 Oct 16 01:27:08.586384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:08.587015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:08.587320 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2703/5283] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:27:08.588108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:08.590941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:08.591704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:08.603396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:08.604112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:08.623191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:08.625318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:08.626978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:08.629252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:08.631216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:08.631822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:08.880999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:08.896300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:08.898520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe6f97cacf104ff19ada4bc7e4fe0e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ad8ba45c374500b4224168c73793b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:08.900816 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80347acf-216f-4395-a93f-7b0cb610157c tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 200 len: 1347 microversion: 2.26 time: 0.383968 Oct 16 01:27:08.907993 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2581/5284] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:08 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 1347 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:09.059714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:09.060412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:09.071253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:09.082578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:09.085215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:09.085746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:09.087271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:09.088199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:09.090001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:09.090255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:09.091641 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca1f7970-9f2f-48dc-89de-3f4b0590d55b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.501793 Oct 16 01:27:09.092286 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2704/5285] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:08 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:09.092614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:09.423065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:09.433489 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5de22af0-7d63-4c55-9123-09ec09326d70 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1316 microversion: 2.1 time: 0.378530 Oct 16 01:27:09.443221 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2582/5286] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:09 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:27:09.928482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:09.929697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] [instance: 1e7d3781-9e23-4efe-958f-f17fd8cca1cc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:09.959103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:09.959103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:09.959103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:09.959103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:09.959513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:09.961115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:09.995305 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] HTTP exception thrown: Instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc could not be found. Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Request method failure captured: Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc HTTP/1.1 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS13Q3W8fiffeKicZ1i4enAMMoZ2kbOXBh-fUpbjRG7oj-JXpftNCzkyYLOiiPsQHZkN15dfOXvKjbmRI6IyvuDJYzmvoC5cp3iu2ROAuKp5AQSseOd4t9kbb0FFDwico1YqgWOwZj7pp2yt-ciNi8VCpfIW5eaDVM9pr45c_wtbqLCI Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.26 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e0ad8ba45c374500b4224168c73793b8 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerTagsTestJSON-1090997814 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e0ad8ba45c374500b4224168c73793b8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e0ad8ba45c374500b4224168c73793b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0ad8ba45c374500b4224168c73793b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e0ad8ba45c374500b4224168c73793b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerTagsTestJSON-1090997814 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e0ad8ba45c374500b4224168c73793b8 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerTagsTestJSON-1090997814 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerTagsTestJSON-1090997814-project Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: fe6f97cacf104ff19ada4bc7e4fe0e01 Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerTagsTestJSON-1090997814-project Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc could not be found. Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1e7d3781-9e23-4efe-958f-f17fd8cca1cc'} Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc could not be found. Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc could not be found. Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:09.997051 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:10.000591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:10.000591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:10.000591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:10.000591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:27:10.000591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:27:10.000591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc could not be found. Oct 16 01:27:10.000591 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:10.000591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] Returning 404 to user: Instance 1e7d3781-9e23-4efe-958f-f17fd8cca1cc could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:27:10.001563 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-053dcc26-8f98-40c8-a66d-791df845020d tempest-ServerTagsTestJSON-1090997814 tempest-ServerTagsTestJSON-1090997814-project] 10.222.0.39 "GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc" status: 404 len: 111 microversion: 2.26 time: 0.077472 Oct 16 01:27:10.003218 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2705/5287] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:09 2022] GET /compute/v2.1/servers/1e7d3781-9e23-4efe-958f-f17fd8cca1cc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:27:10.122932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:10.124232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:10.144748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:10.146598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:10.147422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:10.150453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:10.154558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:10.155255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:10.466908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:10.467566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:10.475937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:10.481661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:10.482867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:10.483782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:10.484895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:10.485486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:10.590126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:10.601218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:10.602909 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:10.604961 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f1e8ffe6-596e-48f8-bf63-7fe40d5a39c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.487318 Oct 16 01:27:10.606947 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2583/5288] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:10 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:11.047325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:11.077895 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7cfe0c21-3a6a-4930-a7f3-b4492a36037a tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1504 microversion: 2.1 time: 0.611331 Oct 16 01:27:11.080855 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2706/5289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:10 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1504 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:27:11.105024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:11.105535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:11.112625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.119810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.122014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.124502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.125649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.126306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.184961 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-256feb79-7107-4250-b841-34fc5831d212 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532/ips" status: 200 len: 108 microversion: 2.1 time: 0.083997 Oct 16 01:27:11.190120 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2584/5290] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:11 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532/ips => generated 108 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:27:11.206328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:11.207158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:11.220526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.221244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.221894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.223024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.223705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.224376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.255974 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9918a57f-a594-4c98-8cd2-6c39e1508934 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532/ips" status: 200 len: 108 microversion: 2.1 time: 0.053337 Oct 16 01:27:11.257483 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2707/5291] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:11 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532/ips => generated 108 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:27:11.273037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:11.273960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:11.282115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.283004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.283582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.285223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.285824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.286553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.332839 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd44d687-f89c-47f0-84d4-5009f8e6de42 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532/ips/tempest-ServerAddressesTestJSON-200988136-network" status: 200 len: 93 microversion: 2.1 time: 0.066928 Oct 16 01:27:11.334865 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2585/5292] 10.222.0.39 () {58 vars in 1398 bytes} [Sun Oct 16 01:27:11 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532/ips/tempest-ServerAddressesTestJSON-200988136-network => generated 93 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:27:11.348506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:11.349199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:11.359225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.364794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.365297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.366043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.366513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.367068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.434489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:27:11.591618 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1ab36ce9-3fde-4acb-9c82-37b869b45bda tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "DELETE /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 204 len: 0 microversion: 2.1 time: 0.248384 Oct 16 01:27:11.593314 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2708/5293] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:27:11 2022] DELETE /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:27:11.602750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:11.603385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:11.613624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.614127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.620619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.621480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.621974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.622496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.635441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:11.636390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:11.648203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.649205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.649802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:11.650733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:11.652603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:11.653196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:12.077031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:12.085778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:12.087260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:12.088455 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7a2c7b1b-dfd9-4e12-b264-4b1c6213dc21 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1743 microversion: 2.20 time: 0.459758 Oct 16 01:27:12.099899 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2709/5294] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:11 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1743 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:12.135384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:12.156968 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7ded77e8-881c-4df7-9988-7d96a99db1f9 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1510 microversion: 2.1 time: 0.557888 Oct 16 01:27:12.158536 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2586/5295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:11 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1510 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:13.121557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:13.122185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:13.130143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:13.130683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:13.131156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:13.131865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:13.132328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:13.132754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:13.184363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:13.184971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:13.198466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:13.199203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:13.200950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:13.205670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:13.209541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:13.210702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:13.657008 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:13.668454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:13.690418 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:13.697162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:13.703331 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c68b3d45-2836-4f94-b19e-8f1c002d1d00 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1510 microversion: 2.1 time: 0.518784 Oct 16 01:27:13.705129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:13.706134 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2587/5296] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:13 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:27:13.708162 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-06a95cb0-66bc-4906-b245-afab9fc509c3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.591600 Oct 16 01:27:13.731826 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2710/5297] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:13 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:14.729569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:14.730169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:14.743681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:14.744318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:14.758413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:14.759104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:14.759664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:14.760440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:14.760919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:14.761356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:14.776609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:14.778414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:14.780864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:14.787521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:14.789302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:14.790669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:15.110823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04fa49711754440c9e889ad13dc4d7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eaf7d9670874e5d92db84283b262d57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:15.127695 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ab8681b-7ca8-4b5b-9964-6d59c9ed0da2 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 200 len: 1301 microversion: 2.1 time: 0.403810 Oct 16 01:27:15.155055 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2588/5298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:14 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 1301 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:15.178388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-88ca0389-dea8-4774-af71-570f582667f4 req-bf71d7ad-4431-485b-b518-5888659212bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e41c84-90ab-4ce3-b872-291acf4c3532", "name": "network-vif-deleted", "tag": "b6ee2f7a-80eb-4dd4-9001-c9cbfc862cc2"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:15.219109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-88ca0389-dea8-4774-af71-570f582667f4 req-bf71d7ad-4431-485b-b518-5888659212bc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:15.219603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-88ca0389-dea8-4774-af71-570f582667f4 req-bf71d7ad-4431-485b-b518-5888659212bc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:15.220040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-88ca0389-dea8-4774-af71-570f582667f4 req-bf71d7ad-4431-485b-b518-5888659212bc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:15.257147 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-88ca0389-dea8-4774-af71-570f582667f4 req-bf71d7ad-4431-485b-b518-5888659212bc service nova] Creating event network-vif-deleted:b6ee2f7a-80eb-4dd4-9001-c9cbfc862cc2 for instance 57e41c84-90ab-4ce3-b872-291acf4c3532 on n-h2-master-1 Oct 16 01:27:15.273123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-88ca0389-dea8-4774-af71-570f582667f4 req-bf71d7ad-4431-485b-b518-5888659212bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116611 Oct 16 01:27:15.273684 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2589/5299] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:27:15.325676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-05219a24-8782-4169-8bea-472e6efe8f39 req-b921b446-cb34-4eab-982c-ea1948b101c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa8ed22-d042-41d4-84a6-63e1b1ac9b2a", "name": "network-vif-plugged", "status": "completed", "tag": "1753d20a-a3ba-48cb-b791-16b43c88ff56"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:15.350824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-05219a24-8782-4169-8bea-472e6efe8f39 req-b921b446-cb34-4eab-982c-ea1948b101c1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:15.358977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:15.372063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-05219a24-8782-4169-8bea-472e6efe8f39 req-b921b446-cb34-4eab-982c-ea1948b101c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:15.372948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-05219a24-8782-4169-8bea-472e6efe8f39 req-b921b446-cb34-4eab-982c-ea1948b101c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:15.374585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:15.383803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:15.385483 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3c3ad1d0-0542-4f43-ba1e-c4b0b44bf593 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.647722 Oct 16 01:27:15.395051 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2711/5300] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:14 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:27:15.410236 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-05219a24-8782-4169-8bea-472e6efe8f39 req-b921b446-cb34-4eab-982c-ea1948b101c1 service nova] Creating event network-vif-plugged:1753d20a-a3ba-48cb-b791-16b43c88ff56 for instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a on n-h1-master-1 Oct 16 01:27:15.419354 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-05219a24-8782-4169-8bea-472e6efe8f39 req-b921b446-cb34-4eab-982c-ea1948b101c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097776 Oct 16 01:27:15.420603 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2590/5301] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:27:16.155273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:16.160678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] [instance: 57e41c84-90ab-4ce3-b872-291acf4c3532] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:16.176384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:16.186680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:16.189032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:16.191789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:16.193481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:16.194084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:16.252099 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] HTTP exception thrown: Instance 57e41c84-90ab-4ce3-b872-291acf4c3532 could not be found. Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Request method failure captured: Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 HTTP/1.1 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS13ZJgka5kbqYMzM_sLQsGXYrm4Gixgzl_UoYeRyPJudgEPXetSTxROoyzLDTpGjjnseZYQCcjTlJ5zbH3geX4PTSwSM08Dv24mQPivhKOw-xICPQxNp8FI321GxdHjks7BbeTr_Rb6rXmkdUmz75uZuCepGFfKHQTj5ohnk6llO-zQ Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3eaf7d9670874e5d92db84283b262d57 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerAddressesTestJSON-1037903698 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3eaf7d9670874e5d92db84283b262d57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3eaf7d9670874e5d92db84283b262d57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3eaf7d9670874e5d92db84283b262d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3eaf7d9670874e5d92db84283b262d57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerAddressesTestJSON-1037903698 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3eaf7d9670874e5d92db84283b262d57 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1037903698 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerAddressesTestJSON-1037903698-project Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 04fa49711754440c9e889ad13dc4d7d3 Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerAddressesTestJSON-1037903698-project Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 57e41c84-90ab-4ce3-b872-291acf4c3532 could not be found. Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '57e41c84-90ab-4ce3-b872-291acf4c3532'} Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e41c84-90ab-4ce3-b872-291acf4c3532 could not be found. Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e41c84-90ab-4ce3-b872-291acf4c3532 could not be found. Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:16.253832 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e41c84-90ab-4ce3-b872-291acf4c3532 could not be found. Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] Returning 404 to user: Instance 57e41c84-90ab-4ce3-b872-291acf4c3532 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:27:16.257447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-06499ecf-0f0c-42a8-b596-6103f6872849 tempest-ServerAddressesTestJSON-1037903698 tempest-ServerAddressesTestJSON-1037903698-project] 10.222.0.39 "GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532" status: 404 len: 111 microversion: 2.1 time: 0.106115 Oct 16 01:27:16.257972 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2712/5302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:16 2022] GET /compute/v2.1/servers/57e41c84-90ab-4ce3-b872-291acf4c3532 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:27:16.414846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:16.416071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:16.426462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:16.427377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:16.427867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:16.429873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:16.439277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:16.446089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:16.858273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:16.869598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:16.884509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:16.887111 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1746c06e-ac19-417a-87c6-9db413003263 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.477490 Oct 16 01:27:16.914570 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2591/5303] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:16 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:17.918434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:17.919710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:17.933365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:17.936245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:17.937930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:17.938870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:17.940960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:17.941946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:18.182989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:18.196875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:18.199318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:18.201467 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-72f9047d-35e8-40c1-bebf-34c33ba31c57 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.286891 Oct 16 01:27:18.202753 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2713/5304] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:17 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:18.568823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-014e1163-b674-4d41-94d2-9a6b00954276 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Action: 'create', calling method: .version_select at 0x7fd64d0d6280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-499898819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKU8rK4c4yj9sCP7Fzggz2mHeywf4gGYafY+NjYwl1aslqonbTV+Fn2Hs9q7+GkN9zSoGJHtH4yOmJcQIDamgIDn8camFbMDfvYhHswJZMPLhwS/lflCHGjd1zJFW6TmA=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:18.609007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-014e1163-b674-4d41-94d2-9a6b00954276 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Getting quotas for project 24191805b45e4a9b9575e5d989a6c6f9. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:27:18.621455 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-014e1163-b674-4d41-94d2-9a6b00954276 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Getting quotas for user f5f42a99ffbe407bb43f8aee0091f130 and project 24191805b45e4a9b9575e5d989a6c6f9. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:27:18.664729 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-014e1163-b674-4d41-94d2-9a6b00954276 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.407154 Oct 16 01:27:18.666720 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2592/5305] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:27:18 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:27:19.230279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:19.231232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:19.241645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:19.247541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:19.248577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:19.250015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:19.250704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:19.255973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:20.523290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:20.531770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:20.533229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:20.534419 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65301e5d-091f-463c-9d9b-8dee633f3e9e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 1.310812 Oct 16 01:27:20.555733 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2714/5306] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:19 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:21.565870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:21.567008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:21.588391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:21.588897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:21.589339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:21.590052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:21.590513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:21.600619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:22.246205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e3d3769-d4a9-4c89-a71f-831ef207d02f tempest-ExtensionsTest-186991517 tempest-ExtensionsTest-186991517-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:22.248805 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e3d3769-d4a9-4c89-a71f-831ef207d02f tempest-ExtensionsTest-186991517 tempest-ExtensionsTest-186991517-project] 10.222.0.39 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.302236 Oct 16 01:27:22.249898 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2715/5307] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Oct 16 01:27:21 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:27:22.260739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b73ea666-07e1-450d-a754-b7d565deb0f8 tempest-ExtensionsTest-186991517 tempest-ExtensionsTest-186991517-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:22.277633 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b73ea666-07e1-450d-a754-b7d565deb0f8 tempest-ExtensionsTest-186991517 tempest-ExtensionsTest-186991517-project] 10.222.0.39 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.020391 Oct 16 01:27:22.278482 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2716/5308] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Oct 16 01:27:22 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:27:22.423734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:22.443757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:22.446171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:22.448198 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-93b97d59-f390-414f-8605-ae7e9cd0bc54 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.887233 Oct 16 01:27:22.451951 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2593/5309] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:21 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:23.483479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:23.484738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:23.499610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:23.500111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:23.500554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:23.501270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:23.501732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:23.502170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:24.316282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:24.336744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:24.344314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:24.345579 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-709d3022-2b44-4b45-a351-698e4d0bb3f2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.866028 Oct 16 01:27:24.346161 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2717/5310] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:23 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:25.375431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:25.376092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:25.400619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:25.401118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:25.401563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:25.402278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:25.402740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:25.403194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:26.233423 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:26.248737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:26.250692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:26.263824 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b95b9a2-c8e5-42eb-9d20-51eb43dec569 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.892646 Oct 16 01:27:26.267414 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2594/5311] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:25 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:27.297564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:27.298173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:27.331132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:27.331937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:27.332706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:27.334519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:27.338579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:27.339479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:27.375195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6c9b6f13-f662-464c-90d5-3a0659b95f5b tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Action: 'create', calling method: .version_select at 0x7fd64dee84c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1361124292", "metadata": {"Type": "work"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6c9b6f13-f662-464c-90d5-3a0659b95f5b tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Request method failure captured: Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 122 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS13-KC7dvk0IdUh8H-yTftnAwQEG1AAx-P7frW-WZllxAGKxfnELdGItTeQQQB3_1Jk2e-PMPkn29ITp4q__9XjMX0eY1bcfqKsqYHuIdRKgOZSg0hkRs6mGaJMkLFz2Pwwu3kd_knj09m_U0uXBB_WbMGYXghaSpNDtt7sh66DY3n0 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c252bf00834246ba8d36805a95102d18", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c252bf00834246ba8d36805a95102d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2aed1959b8ff44d897abd7da41226452 Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1361124292", "metadata": {"Type": "work"}}} Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1361124292', 'metadata': {'Type': 'work'}}}} Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi '#$%' Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:27:27.380927 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 16 01:27:27.385095 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.387802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6c9b6f13-f662-464c-90d5-3a0659b95f5b tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:27:27.391665 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6c9b6f13-f662-464c-90d5-3a0659b95f5b tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.490546 Oct 16 01:27:27.398054 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2718/5312] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:27:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 498 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:27:27.404860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1dd0a2ee-2ce9-4cc4-9030-5152027a2eab tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Action: 'create', calling method: .version_select at 0x7fd6526dbca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1912230812", "metadata": {"Type": "work"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1dd0a2ee-2ce9-4cc4-9030-5152027a2eab tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Request method failure captured: Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 120 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS13-KC7dvk0IdUh8H-yTftnAwQEG1AAx-P7frW-WZllxAGKxfnELdGItTeQQQB3_1Jk2e-PMPkn29ITp4q__9XjMX0eY1bcfqKsqYHuIdRKgOZSg0hkRs6mGaJMkLFz2Pwwu3kd_knj09m_U0uXBB_WbMGYXghaSpNDtt7sh66DY3n0 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c252bf00834246ba8d36805a95102d18", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c252bf00834246ba8d36805a95102d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2aed1959b8ff44d897abd7da41226452 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1912230812", "metadata": {"Type": "work"}}} Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1912230812', 'metadata': {'Type': 'work'}}}} Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi '0' Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:27:27.432747 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.437305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1dd0a2ee-2ce9-4cc4-9030-5152027a2eab tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:27:27.442015 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1dd0a2ee-2ce9-4cc4-9030-5152027a2eab tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.042820 Oct 16 01:27:27.448591 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2719/5313] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:27:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:27:27.463376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-51e48540-b542-4599-9ffa-e3c3988537a2 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Action: 'create', calling method: .version_select at 0x7fd64de4fa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-991772273", "metadata": {"Type": "work"}}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-51e48540-b542-4599-9ffa-e3c3988537a2 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Request method failure captured: Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 118 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS13-KC7dvk0IdUh8H-yTftnAwQEG1AAx-P7frW-WZllxAGKxfnELdGItTeQQQB3_1Jk2e-PMPkn29ITp4q__9XjMX0eY1bcfqKsqYHuIdRKgOZSg0hkRs6mGaJMkLFz2Pwwu3kd_knj09m_U0uXBB_WbMGYXghaSpNDtt7sh66DY3n0 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c252bf00834246ba8d36805a95102d18", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c252bf00834246ba8d36805a95102d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2aed1959b8ff44d897abd7da41226452 Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-991772273", "metadata": {"Type": "work"}}} Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-991772273', 'metadata': {'Type': 'work'}}}} Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise error Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi '' Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 01:27:27.478971 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 16 01:27:27.483268 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.485409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-51e48540-b542-4599-9ffa-e3c3988537a2 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:27:27.486576 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-51e48540-b542-4599-9ffa-e3c3988537a2 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.036658 Oct 16 01:27:27.492333 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2720/5314] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Oct 16 01:27:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:27:27.498642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4593b640-513a-4cf3-8dca-507cdf3fd898 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Calling method '.version_select at 0x7fd6526db280>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:27.539272 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4593b640-513a-4cf3-8dca-507cdf3fd898 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] HTTP exception thrown: Volume tempest-invalid-928639967 could not be found. Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4593b640-513a-4cf3-8dca-507cdf3fd898 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Request method failure captured: Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-928639967 HTTP/1.1 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS13-KC7dvk0IdUh8H-yTftnAwQEG1AAx-P7frW-WZllxAGKxfnELdGItTeQQQB3_1Jk2e-PMPkn29ITp4q__9XjMX0eY1bcfqKsqYHuIdRKgOZSg0hkRs6mGaJMkLFz2Pwwu3kd_knj09m_U0uXBB_WbMGYXghaSpNDtt7sh66DY3n0 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c252bf00834246ba8d36805a95102d18", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c252bf00834246ba8d36805a95102d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2aed1959b8ff44d897abd7da41226452 Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: exception: Volume tempest-invalid-928639967 could not be found. Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'tempest-invalid-928639967'} Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-928639967 could not be found. (HTTP 404) (Request-ID: req-ddd8dae9-f813-4742-9dc1-f22bb01d5cf6) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:27:27.541713 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-928639967 could not be found. Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-928639967 could not be found. Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-928639967 could not be found. Oct 16 01:27:27.546117 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.555350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4593b640-513a-4cf3-8dca-507cdf3fd898 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Returning 404 to user: Volume tempest-invalid-928639967 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:27:27.555350 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4593b640-513a-4cf3-8dca-507cdf3fd898 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-928639967" status: 404 len: 98 microversion: 2.1 time: 0.055019 Oct 16 01:27:27.555350 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2721/5315] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Oct 16 01:27:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-928639967 => generated 98 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 16 01:27:27.567904 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b2bc86a3-ea82-4b4c-8d08-dd5029caffd5 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003842 Oct 16 01:27:27.567904 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2722/5316] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Oct 16 01:27:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 16 01:27:27.579292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52f39e6d-77c2-444d-9393-af545e4b7c44 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004034 Oct 16 01:27:27.579292 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2723/5317] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Oct 16 01:27:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 16 01:27:27.585156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcb102ec-efa3-484a-95d6-69d01c93ae5a tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Calling method '.version_select at 0x7fd64df95ee0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:27.659616 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-fcb102ec-efa3-484a-95d6-69d01c93ae5a tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] HTTP exception thrown: Volume df0e8e28-3221-4220-b4e1-527ca8746320 could not be found. Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcb102ec-efa3-484a-95d6-69d01c93ae5a tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Request method failure captured: Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/os-volumes/df0e8e28-3221-4220-b4e1-527ca8746320 HTTP/1.1 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS13-KC7dvk0IdUh8H-yTftnAwQEG1AAx-P7frW-WZllxAGKxfnELdGItTeQQQB3_1Jk2e-PMPkn29ITp4q__9XjMX0eY1bcfqKsqYHuIdRKgOZSg0hkRs6mGaJMkLFz2Pwwu3kd_knj09m_U0uXBB_WbMGYXghaSpNDtt7sh66DY3n0 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c252bf00834246ba8d36805a95102d18", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c252bf00834246ba8d36805a95102d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2aed1959b8ff44d897abd7da41226452 Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: exception: Volume df0e8e28-3221-4220-b4e1-527ca8746320 could not be found. Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'df0e8e28-3221-4220-b4e1-527ca8746320'} Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df0e8e28-3221-4220-b4e1-527ca8746320 could not be found. (HTTP 404) (Request-ID: req-619255c8-9eaf-43d0-9d47-56250f5bfeec) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:27:27.661652 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df0e8e28-3221-4220-b4e1-527ca8746320 could not be found. Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df0e8e28-3221-4220-b4e1-527ca8746320 could not be found. Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df0e8e28-3221-4220-b4e1-527ca8746320 could not be found. Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcb102ec-efa3-484a-95d6-69d01c93ae5a tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Returning 404 to user: Volume df0e8e28-3221-4220-b4e1-527ca8746320 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcb102ec-efa3-484a-95d6-69d01c93ae5a tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/df0e8e28-3221-4220-b4e1-527ca8746320" status: 404 len: 109 microversion: 2.1 time: 0.087584 Oct 16 01:27:27.665376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2724/5318] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:27:27 2022] DELETE /compute/v2.1/os-volumes/df0e8e28-3221-4220-b4e1-527ca8746320 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:27:27.675566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e9f2cfa-e83f-4cb6-a9a4-ee415189d961 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Calling method '.version_select at 0x7fd64df955e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:27.755389 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-4e9f2cfa-e83f-4cb6-a9a4-ee415189d961 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] HTTP exception thrown: Volume 64ecc2d4-0000-463d-9792-9b47bb03d4e2 could not be found. Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e9f2cfa-e83f-4cb6-a9a4-ee415189d961 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Request method failure captured: Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/os-volumes/64ecc2d4-0000-463d-9792-9b47bb03d4e2 HTTP/1.1 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS13-KC7dvk0IdUh8H-yTftnAwQEG1AAx-P7frW-WZllxAGKxfnELdGItTeQQQB3_1Jk2e-PMPkn29ITp4q__9XjMX0eY1bcfqKsqYHuIdRKgOZSg0hkRs6mGaJMkLFz2Pwwu3kd_knj09m_U0uXBB_WbMGYXghaSpNDtt7sh66DY3n0 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c252bf00834246ba8d36805a95102d18", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c252bf00834246ba8d36805a95102d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c252bf00834246ba8d36805a95102d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: c252bf00834246ba8d36805a95102d18 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesNegativeTest-416911123 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2aed1959b8ff44d897abd7da41226452 Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesNegativeTest-416911123-project Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: method: Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: exception: Volume 64ecc2d4-0000-463d-9792-9b47bb03d4e2 could not be found. Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '64ecc2d4-0000-463d-9792-9b47bb03d4e2'} Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64ecc2d4-0000-463d-9792-9b47bb03d4e2 could not be found. (HTTP 404) (Request-ID: req-5ff7d22c-acb0-4a5a-b5b9-15463652fab4) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 16 01:27:27.757697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64ecc2d4-0000-463d-9792-9b47bb03d4e2 could not be found. Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64ecc2d4-0000-463d-9792-9b47bb03d4e2 could not be found. Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64ecc2d4-0000-463d-9792-9b47bb03d4e2 could not be found. Oct 16 01:27:27.761322 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:27:27.765480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4e9f2cfa-e83f-4cb6-a9a4-ee415189d961 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] Returning 404 to user: Volume 64ecc2d4-0000-463d-9792-9b47bb03d4e2 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:27:27.766586 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4e9f2cfa-e83f-4cb6-a9a4-ee415189d961 tempest-VolumesNegativeTest-416911123 tempest-VolumesNegativeTest-416911123-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/64ecc2d4-0000-463d-9792-9b47bb03d4e2" status: 404 len: 109 microversion: 2.1 time: 0.097264 Oct 16 01:27:27.767455 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2725/5319] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:27:27 2022] GET /compute/v2.1/os-volumes/64ecc2d4-0000-463d-9792-9b47bb03d4e2 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:27:28.642703 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:28.834266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:28.864285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:28.866537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:28.868045 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-49f0f1b9-f058-49f5-bf57-a9977d50dcb2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 1.574429 Oct 16 01:27:28.868976 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2595/5320] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:27 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:27:29.897981 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:29.898501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:29.907142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:29.921776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:29.922406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:29.925307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:29.926019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:29.926609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:31.050457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:31.061725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:31.069052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:31.091656 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e2b4d48-d11d-47bc-9ca5-897214934f7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 1.196961 Oct 16 01:27:31.111162 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2726/5321] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:29 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:32.127123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:32.128687 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:32.139443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:32.140389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:32.141068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:32.141951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:32.143185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:32.143802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:33.314168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:33.331192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:33.339269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:33.341932 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-77b7521e-48a3-4daf-b655-dcc8a2b12058 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 1.220176 Oct 16 01:27:33.349185 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2596/5322] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:32 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:34.375862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:34.376395 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:34.383602 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:34.385600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:34.386480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:34.387207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:34.388226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:34.390165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:34.390887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:35.406206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:35.423488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:35.440138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:35.447347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-357dd6e5-c9ef-4f1f-8484-b65786274c7c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 1.074084 Oct 16 01:27:35.468778 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2727/5323] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:34 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:36.485554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:36.487876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:36.505156 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:36.514432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:36.526578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:36.528325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:36.530253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:36.530745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:36.532320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:37.541955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:37.554276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:37.555768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:37.565121 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a677e02d-c24f-4699-8fdf-e1537c2991e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 1.085773 Oct 16 01:27:37.565846 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2597/5324] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:36 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:38.595320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:38.596822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:38.609313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:38.618429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:38.619237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:38.620971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:38.621771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:38.622464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:38.673950 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:39.571439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:39.585134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:39.586732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:39.588112 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e2ca1ec-554a-4e9a-8a23-faaec0f30c70 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.997138 Oct 16 01:27:39.591711 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2728/5325] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:38 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:40.626334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:40.626984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:40.643201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:40.644154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:40.644771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:40.646020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:40.646697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:40.650890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:41.276795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:41.287860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:41.293518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:41.296718 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59e0b295-a6ed-44a4-8e6e-7a132ac46727 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.674589 Oct 16 01:27:41.300081 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2598/5326] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:40 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:27:42.331902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:42.339393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:42.356669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:42.357984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:42.360145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:42.361316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:42.363364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:42.368197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:42.669395 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:42.692870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:42.695732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:42.697683 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fcaff322-303b-4b1c-a012-c6b9afa3f95f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1738 microversion: 2.20 time: 0.374776 Oct 16 01:27:42.715622 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2729/5327] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:42 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1738 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:43.725922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:43.726539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:43.736383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:43.740328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:43.740995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:43.743401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:43.743875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:43.744315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:44.369249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:44.402274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:44.412190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:44.413432 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e82bd32-575b-4aff-86bf-37e790356330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1720 microversion: 2.20 time: 0.691669 Oct 16 01:27:44.434891 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2599/5328] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:43 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1720 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:45.462166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:45.462767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:45.479192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:45.479694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:45.480140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:45.480858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:45.481323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:45.481758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:46.517383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:46.537186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:46.547477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:46.549051 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f631683-ca2c-45ee-8dc3-c9afe55822b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1720 microversion: 2.20 time: 1.092190 Oct 16 01:27:46.580247 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2730/5329] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:45 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1720 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:47.590438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:47.591804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:47.635229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:47.643150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:47.643638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:47.648978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:47.651192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:47.651845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:47.672980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-442732223-access_point-1029298308", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "b43d2a8d-e675-4454-b1a5-1aaaf4bb6d0c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-499898819", "security_groups": [{"name": "tempest-secgroup_access--482069974"}, {"name": "tempest-secgroup_general--430199410"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:47.713404 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=59 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:27:48.279352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:48.295781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:48.299245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:48.302195 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-137397dc-f8ba-44ee-bee4-bc4119187d71 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1720 microversion: 2.20 time: 0.719863 Oct 16 01:27:48.321814 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2600/5330] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:47 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1720 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:48.339043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-24085599-5486-4d64-bea3-1e3922f3a36e req-9e709e6f-cec3-4665-980f-080d8fdde0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa8ed22-d042-41d4-84a6-63e1b1ac9b2a", "name": "network-vif-unplugged", "status": "completed", "tag": "1753d20a-a3ba-48cb-b791-16b43c88ff56"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:48.362555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-24085599-5486-4d64-bea3-1e3922f3a36e req-9e709e6f-cec3-4665-980f-080d8fdde0ec service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:48.363849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-24085599-5486-4d64-bea3-1e3922f3a36e req-9e709e6f-cec3-4665-980f-080d8fdde0ec service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:48.365150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-24085599-5486-4d64-bea3-1e3922f3a36e req-9e709e6f-cec3-4665-980f-080d8fdde0ec service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:48.386326 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-24085599-5486-4d64-bea3-1e3922f3a36e req-9e709e6f-cec3-4665-980f-080d8fdde0ec service nova] Creating event network-vif-unplugged:1753d20a-a3ba-48cb-b791-16b43c88ff56 for instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a on n-h1-master-1 Oct 16 01:27:48.396128 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-24085599-5486-4d64-bea3-1e3922f3a36e req-9e709e6f-cec3-4665-980f-080d8fdde0ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070620 Oct 16 01:27:48.397220 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2601/5331] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:27:48.442827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] validate_networks() for [('b43d2a8d-e675-4454-b1a5-1aaaf4bb6d0c', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:27:49.336427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:49.337790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:49.349953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:49.354195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:49.355015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:49.358056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:49.358795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:49.359431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:49.739806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:49.749183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:49.757042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:49.759553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:27:49.760351 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e9a23352-f4a5-4227-8e4a-a27489669c8c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1663 microversion: 2.20 time: 0.431515 Oct 16 01:27:49.760665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:27:49.774943 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2602/5332] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:49 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1663 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:27:49.775802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:27:49.776488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:27:49.782830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:27:49.791782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afe2fccf-1ca4-41bd-a0d2-cbd032e2ecf4"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:49.793330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:49.793985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:49.794228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:49.794732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:49.795834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:49.796448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:49.797099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:49.812796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:49.813307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:49.813747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:49.816404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:49.816901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:49.821014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Getting quotas for project 24191805b45e4a9b9575e5d989a6c6f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:27:49.821434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:49.827521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Getting quotas for user f5f42a99ffbe407bb43f8aee0091f130 and project 24191805b45e4a9b9575e5d989a6c6f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:27:49.844011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:27:49.846693 n-d-master-1 devstack@n-api.service[120545]: WARNING nova.utils [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-442732223-access_point-1029298308 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-442732223-acc Oct 16 01:27:49.847816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:27:49.936661 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b159a7b8-4482-4c58-a9d6-74872d2d3fe1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.266993 Oct 16 01:27:49.941025 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2731/5333] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:47 2022] POST /compute/v2.1/servers => generated 456 bytes in 2274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:27:49.949635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22ce1ed6-2cde-40ff-8485-1819df43e3e2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:49.951549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22ce1ed6-2cde-40ff-8485-1819df43e3e2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:50.082432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22ce1ed6-2cde-40ff-8485-1819df43e3e2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:50.102778 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22ce1ed6-2cde-40ff-8485-1819df43e3e2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1293 microversion: 2.1 time: 0.157250 Oct 16 01:27:50.105625 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2732/5334] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:49 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:27:50.442668 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98e911d4-13cf-4824-84bd-667b7f9120a6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.657098 Oct 16 01:27:50.451189 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2603/5335] 10.222.0.39 () {62 vars in 1364 bytes} [Sun Oct 16 01:27:49 2022] POST /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments => generated 188 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:27:50.724317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:50.725751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:50.748678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:50.750200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:50.752541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:50.753527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:50.763199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:50.764699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:50.854791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120545) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 01:27:51.088140 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a036e4d-b26a-4a13-868a-d479d096b594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/action" status: 202 len: 0 microversion: 2.20 time: 0.368507 Oct 16 01:27:51.091410 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2733/5336] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:27:50 2022] POST /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:27:51.099698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:51.100803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:51.114931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:51.118789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:51.121576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:51.124736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:51.128496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:51.130645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ada64216-d0a2-456f-b6b5-61c7f051e2c2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:51.131736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ada64216-d0a2-456f-b6b5-61c7f051e2c2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:51.132766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:51.412113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ada64216-d0a2-456f-b6b5-61c7f051e2c2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:51.420026 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ada64216-d0a2-456f-b6b5-61c7f051e2c2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1293 microversion: 2.1 time: 0.294165 Oct 16 01:27:51.423699 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2734/5337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:51 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1293 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:51.734069 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:51.750595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:51.752081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:51.758132 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7ecdcb1-14bc-440b-80ea-04af757063b0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1749 microversion: 2.20 time: 0.663590 Oct 16 01:27:51.759873 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2604/5338] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:51 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1749 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:52.450702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:52.451343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:52.467018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:52.468027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:52.473002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:52.474078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:52.474747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:52.475564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:52.787913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:52.788584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:52.793103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:52.802210 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4abf9a20-54a3-4c8a-9271-d6d1a19e205d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1363 microversion: 2.1 time: 0.355541 Oct 16 01:27:52.806802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:52.807311 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2735/5339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:52 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:52.807978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:52.808631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:52.809782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:52.810395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:52.811075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:53.613636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:53.625265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:53.630906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:53.632330 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e0427e2e-adef-443b-b117-68870b692f32 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1751 microversion: 2.20 time: 0.848258 Oct 16 01:27:53.646849 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2605/5340] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:52 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1751 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:53.828895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:53.829464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:53.845143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:53.845641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:53.846081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:53.846799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:53.847298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:53.847725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:54.038869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:54.046742 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eca676af-81f4-454c-aed8-064954820440 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1351 microversion: 2.1 time: 0.221682 Oct 16 01:27:54.047371 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2736/5341] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:53 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1351 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:54.667662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:54.668415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:54.686223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:54.686820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:54.688143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:54.688981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:54.691006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:54.691693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:55.073547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:55.074170 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:55.095371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:55.095876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:55.101261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:55.107286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:55.110064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:55.112875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:55.208226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:55.228580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:55.238632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:55.246588 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19f41454-2231-494c-a88d-18d078c75d4a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1751 microversion: 2.20 time: 0.586132 Oct 16 01:27:55.247848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2606/5342] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:54 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1751 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:55.261683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:55.288737 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8a21f4bb-0e8d-425f-97ba-a3e35df000da tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1351 microversion: 2.1 time: 0.218451 Oct 16 01:27:55.290686 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2737/5343] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:55 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:56.283016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:56.284448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:56.313878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:56.314790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:56.318106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:56.322035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:56.322466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:56.322927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:56.683229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:56.722375 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:56.728185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:56.729452 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-784358e1-61a7-4e9f-816d-579f6bd74265 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1751 microversion: 2.20 time: 0.452208 Oct 16 01:27:56.730053 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2738/5344] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:56 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1751 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:27:56.769544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:56.779347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:56.800795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:56.803095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:56.807417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:56.809942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:56.810537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:56.811142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:56.928895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-842839720", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:57.036602 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] validate_networks() for [('38d0b485-79b5-4e4d-87e8-86979f094fca', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:27:57.360518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:57.373821 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-63a548cb-abdc-45bb-bdbd-59bb03f6c333 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1469 microversion: 2.1 time: 0.642683 Oct 16 01:27:57.384885 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2739/5345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:56 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1469 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:57.760635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:57.761400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:57.770746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:57.779804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:57.780382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:57.790177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:57.795537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:57.799251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:59.070765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:27:59.071458 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:27:59.071944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:27:59.072401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:27:59.072889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:27:59.101666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:59.104057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:59.104564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:59.105347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:59.105807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:59.109287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:59.115616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:59.128387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:59.132281 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:59.137829 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d011c9a1-e103-4f68-af5d-603dbe695810 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1751 microversion: 2.20 time: 1.381098 Oct 16 01:27:59.138662 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2740/5346] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:27:57 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1751 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:27:59.154663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-de8dc50c-a71b-45d9-ad0f-9333a8d972e1 req-128f0573-0d81-46b4-9f3f-17752e3d3fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9e8016-b524-495e-ae54-dca14a143c68", "tag": "35699b25-6801-49a8-9783-423ccbca634e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:27:59.186050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-de8dc50c-a71b-45d9-ad0f-9333a8d972e1 req-128f0573-0d81-46b4-9f3f-17752e3d3fdb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:59.187627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-de8dc50c-a71b-45d9-ad0f-9333a8d972e1 req-128f0573-0d81-46b4-9f3f-17752e3d3fdb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:59.189030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-de8dc50c-a71b-45d9-ad0f-9333a8d972e1 req-128f0573-0d81-46b4-9f3f-17752e3d3fdb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:59.200528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Getting quotas for project 4ec864865dde4a4fa13a54a5057867f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:27:59.219404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Getting quotas for user 4d4086e3f9784454a0ccfe87cc54a2b2 and project 4ec864865dde4a4fa13a54a5057867f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:27:59.243142 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-de8dc50c-a71b-45d9-ad0f-9333a8d972e1 req-128f0573-0d81-46b4-9f3f-17752e3d3fdb service nova] Creating event network-changed:35699b25-6801-49a8-9783-423ccbca634e for instance 5c9e8016-b524-495e-ae54-dca14a143c68 on n-h1-master-1 Oct 16 01:27:59.264052 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-de8dc50c-a71b-45d9-ad0f-9333a8d972e1 req-128f0573-0d81-46b4-9f3f-17752e3d3fdb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122890 Oct 16 01:27:59.270562 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2741/5347] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:27:59.271966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:27:59.280140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:27:59.294139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:59.295185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:59.311305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:59.313144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:59.319133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:59.320477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:27:59.322770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:27:59.327555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:27:59.537867 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-42981021-699e-4fef-a7b2-b3a1fdbef31f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.338954 Oct 16 01:27:59.540167 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2607/5348] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:27:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:27:59.553867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-635c17a6-d076-4120-ab0a-086d38384bea tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:27:59.561359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-635c17a6-d076-4120-ab0a-086d38384bea tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:27:59.768480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-635c17a6-d076-4120-ab0a-086d38384bea tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:27:59.788554 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-635c17a6-d076-4120-ab0a-086d38384bea tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1213 microversion: 2.1 time: 0.234456 Oct 16 01:27:59.798951 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2608/5349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:59 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1213 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:27:59.810986 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:00.173775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:00.175385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:00.206175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:00.228010 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-96376b66-104c-4084-821c-3dd9d5347dd2 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1469 microversion: 2.1 time: 0.953527 Oct 16 01:28:00.230819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:00.231713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:00.231963 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2742/5350] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:27:59 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1469 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:00.242171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:00.242907 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:00.243440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:00.249215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:00.730200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:00.741765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:00.752745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:00.763705 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fcb3ff6b-44f7-46e4-b31a-e302b660a2ac tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1751 microversion: 2.20 time: 0.596432 Oct 16 01:28:00.772241 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2609/5351] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:00 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1751 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:28:00.814961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89cd6a03-e3a8-40bf-803f-9ece27973cea tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:00.815648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89cd6a03-e3a8-40bf-803f-9ece27973cea tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:00.996455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-89cd6a03-e3a8-40bf-803f-9ece27973cea tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:01.008211 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89cd6a03-e3a8-40bf-803f-9ece27973cea tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1213 microversion: 2.1 time: 0.197592 Oct 16 01:28:01.024686 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2743/5352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:00 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:01.257428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:01.258051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:01.278507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:01.280682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:01.281600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:01.285199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:01.286862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:01.287500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:01.795502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:01.796221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:01.811873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:01.820092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:01.820952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:01.824139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:01.825352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:01.826018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:02.169895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:02.182384 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f30a8eec-5fc5-4e38-b000-6d71b815d450 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1469 microversion: 2.1 time: 0.929678 Oct 16 01:28:02.191530 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2610/5353] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:01 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1469 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:02.209131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:02.211576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:02.232666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:02.233282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:02.233734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:02.234488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:02.234975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:02.235414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:02.283117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:02.309418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:02.324383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:02.326063 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa6c1222-df1f-4bae-bd2d-a05b493ed34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1751 microversion: 2.20 time: 0.535140 Oct 16 01:28:02.350451 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2744/5354] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:01 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1751 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:02.532283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:02.541966 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01c08e33-eced-4a47-9966-f40e94676a8f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1265 microversion: 2.1 time: 0.345458 Oct 16 01:28:02.545801 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2611/5355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:02 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:03.222408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:03.222408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:03.245522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:03.247816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:03.248406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:03.249233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:03.250499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:03.251708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:03.358070 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:03.359745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:03.381653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:03.382537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:03.384362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:03.386807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:03.387513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:03.389872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:03.595140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:03.604213 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-43856e93-265a-4580-9b42-e25fe8b31be9 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1469 microversion: 2.1 time: 0.388572 Oct 16 01:28:03.608889 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2745/5356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:03 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1469 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:03.617717 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:03.618343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:03.642533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:03.643063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:03.643714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:03.644443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:03.644909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:03.645417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:03.743682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:03.753501 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be5a5d3a-6c33-4d0f-8795-8b0bfdb02b1e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1271 microversion: 2.1 time: 0.143505 Oct 16 01:28:03.760030 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2746/5357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:03 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:03.764787 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:03.785601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:03.788301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:03.789538 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6bef644f-f24d-4f29-8350-e6d7a9c9cfdc tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1751 microversion: 2.20 time: 0.436058 Oct 16 01:28:03.792466 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2612/5358] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:03 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1751 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:28:04.634190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:04.635709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:04.643918 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:04.646131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:04.647123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:04.648121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:04.649167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:04.650489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:04.651409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:04.800447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:04.801728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:04.823785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:04.824381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:04.824813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:04.825614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:04.828274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:04.829526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:05.529712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:05.538120 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c3e5c3f-e80c-4279-833a-47a151f67d5a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1469 microversion: 2.1 time: 0.910699 Oct 16 01:28:05.544002 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2747/5359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:04 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1469 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:05.553245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:05.555477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:05.575712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:05.577368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:05.578890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:05.582386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:05.583654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:05.584195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:05.591636 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:05.700612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:05.711907 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a2eba2a9-7465-4c28-9293-ca915910bd17 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1313 microversion: 2.1 time: 0.931190 Oct 16 01:28:05.716346 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2613/5360] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:04 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1313 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:06.079202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-57e2e148-c6d1-4e06-8e3d-b8c415d57559 req-ebe4f5b7-bac1-474e-8ded-1691477288d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9e8016-b524-495e-ae54-dca14a143c68", "name": "network-vif-plugged", "status": "completed", "tag": "35699b25-6801-49a8-9783-423ccbca634e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:28:06.101507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-57e2e148-c6d1-4e06-8e3d-b8c415d57559 req-ebe4f5b7-bac1-474e-8ded-1691477288d7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:06.102371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-57e2e148-c6d1-4e06-8e3d-b8c415d57559 req-ebe4f5b7-bac1-474e-8ded-1691477288d7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:06.102985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-57e2e148-c6d1-4e06-8e3d-b8c415d57559 req-ebe4f5b7-bac1-474e-8ded-1691477288d7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:06.132680 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-57e2e148-c6d1-4e06-8e3d-b8c415d57559 req-ebe4f5b7-bac1-474e-8ded-1691477288d7 service nova] Creating event network-vif-plugged:35699b25-6801-49a8-9783-423ccbca634e for instance 5c9e8016-b524-495e-ae54-dca14a143c68 on n-h1-master-1 Oct 16 01:28:06.144411 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-57e2e148-c6d1-4e06-8e3d-b8c415d57559 req-ebe4f5b7-bac1-474e-8ded-1691477288d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068921 Oct 16 01:28:06.146132 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2614/5361] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:28:06.157014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:06.180798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:06.191031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:06.199550 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0089b821-5aec-4216-9073-22d207671213 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.652860 Oct 16 01:28:06.226260 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2748/5362] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:05 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:06.563811 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:06.564846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:06.568763 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:06.584239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:06.584904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:06.585574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:06.587269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:06.587952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:06.588586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:06.754105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:06.758701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:06.771400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:06.780238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:06.780925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:06.782602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:06.783307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:06.783963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:07.419155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:07.429564 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7bea4dc4-fd8e-424b-adb8-f93895511e6d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1469 microversion: 2.1 time: 0.870229 Oct 16 01:28:07.439723 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2615/5363] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:06 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1469 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:07.445643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9140c02f-df9a-467a-95a0-77ede48d0770 req-7fb982af-7a14-4d6e-8476-9e8b8b372674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cf38f8-36c6-4b96-8aa2-b04acc7123da", "tag": "27f5a3da-a008-457c-9603-057b3e1dcd1c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:28:07.468980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9140c02f-df9a-467a-95a0-77ede48d0770 req-7fb982af-7a14-4d6e-8476-9e8b8b372674 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:07.469461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9140c02f-df9a-467a-95a0-77ede48d0770 req-7fb982af-7a14-4d6e-8476-9e8b8b372674 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:07.469897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9140c02f-df9a-467a-95a0-77ede48d0770 req-7fb982af-7a14-4d6e-8476-9e8b8b372674 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:07.503743 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9140c02f-df9a-467a-95a0-77ede48d0770 req-7fb982af-7a14-4d6e-8476-9e8b8b372674 service nova] Creating event network-changed:27f5a3da-a008-457c-9603-057b3e1dcd1c for instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da on n-h2-master-1 Oct 16 01:28:07.511028 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9140c02f-df9a-467a-95a0-77ede48d0770 req-7fb982af-7a14-4d6e-8476-9e8b8b372674 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069409 Oct 16 01:28:07.512161 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2616/5364] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:28:07.520871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:07.521779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:07.530368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:07.531120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:07.531664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:07.532456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:07.532996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:07.533560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:07.546313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:07.556741 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-95c23668-4aa1-48e7-bd05-a6391f99712f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1313 microversion: 2.1 time: 0.818491 Oct 16 01:28:07.571351 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2749/5365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:06 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1313 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:08.402788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:08.405122 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:08.425731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:08.429529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:08.430776 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a5c804c2-d6c3-49d9-b02e-d3b05a00f6c5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.917449 Oct 16 01:28:08.449073 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2617/5366] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:07 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:08.464905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:08.466319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:08.482205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:08.484096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:08.485936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:08.487215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:08.490613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:08.493926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:08.581946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:08.583325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:08.594076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:08.595291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:08.598885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:08.600367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:08.601249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:08.602211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:08.865254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:08.881538 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4579e98a-174d-4997-b83e-86cdac20dfc5 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1641 microversion: 2.1 time: 0.421493 Oct 16 01:28:08.882634 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2750/5367] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:08 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1641 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:08.892647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ad595e79-9893-4a08-a06a-e5ab89475233 req-06d402f2-16d5-412b-be40-bebae6af6d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa8ed22-d042-41d4-84a6-63e1b1ac9b2a", "tag": "1753d20a-a3ba-48cb-b791-16b43c88ff56"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:28:08.915349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:08.915541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ad595e79-9893-4a08-a06a-e5ab89475233 req-06d402f2-16d5-412b-be40-bebae6af6d77 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:08.915916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ad595e79-9893-4a08-a06a-e5ab89475233 req-06d402f2-16d5-412b-be40-bebae6af6d77 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:08.916556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ad595e79-9893-4a08-a06a-e5ab89475233 req-06d402f2-16d5-412b-be40-bebae6af6d77 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:08.928876 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ad595e79-9893-4a08-a06a-e5ab89475233 req-06d402f2-16d5-412b-be40-bebae6af6d77 service nova] Creating event network-changed:1753d20a-a3ba-48cb-b791-16b43c88ff56 for instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a on n-h2-master-1 Oct 16 01:28:08.931034 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b358be02-6423-46dc-96e9-dd7df7820e36 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1313 microversion: 2.1 time: 0.353283 Oct 16 01:28:08.934505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ad595e79-9893-4a08-a06a-e5ab89475233 req-06d402f2-16d5-412b-be40-bebae6af6d77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049520 Oct 16 01:28:08.935844 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2751/5368] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:28:08.945679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:08.946622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:08.949177 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2618/5369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:08 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:08.953671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:08.954367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:08.954812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:08.955544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:08.956196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:08.956626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:09.243136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:09.260381 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f42fc7e3-a13c-47d9-ad53-1b28a46474bb tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1641 microversion: 2.1 time: 0.323000 Oct 16 01:28:09.281531 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2752/5370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:08 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1641 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:09.286423 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:09.287206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:09.289746 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:09.304436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:09.304940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:09.305382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:09.306092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:09.306552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:09.308017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:09.458985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:09.459962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:09.466293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:09.467085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:09.467769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:09.468713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:09.469389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:09.470030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:09.779175 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:09.838841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:09.848945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:09.850591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:09.851923 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bfc5f566-4e8f-4a2c-88a4-6610580b805a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.396991 Oct 16 01:28:09.852575 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2753/5371] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:09 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:28:09.958758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:09.960483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:09.967640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:09.968143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:09.969148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:09.970484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:09.970877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:09.971336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:10.097835 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01ac8e01-fd0d-47fc-b627-f1ac9c0a9f46 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1792 microversion: 2.1 time: 0.815281 Oct 16 01:28:10.104238 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2619/5372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:09 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1792 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:10.408274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:10.421762 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5adec9e5-765d-4789-97ae-46dbe366c4fc tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1313 microversion: 2.1 time: 0.465179 Oct 16 01:28:10.435677 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2754/5373] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:09 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:10.880918 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:10.882246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:10.900855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:10.903580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:10.904264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:10.907682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:10.908406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:10.910097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:11.450498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:11.452275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:11.466125 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:11.475992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:11.476786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:11.477467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:11.478586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:11.480236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:11.482665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:11.982583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:11.998686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:12.001932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:12.008599 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfa6af09-45a6-4582-86ba-ad07447dc621 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 1.127187 Oct 16 01:28:12.010798 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2620/5374] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:10 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:12.421362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:12.430114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-278ab5c2-23a4-41e6-ac23-09e0a4fdb55b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1313 microversion: 2.1 time: 0.988189 Oct 16 01:28:12.435742 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2755/5375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:11 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1313 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:13.047561 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:13.048826 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:13.069970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:13.073494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:13.074876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:13.075808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:13.076438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:13.079848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:13.457565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:13.459520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:13.471091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:13.471596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:13.472084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:13.472798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:13.473583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:13.474499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:14.331963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:14.349098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:14.358144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:14.360593 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bd79ef0-f8cd-4d49-b724-ce8080b9610c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 1.318780 Oct 16 01:28:14.363476 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2621/5376] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:13 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:14.695898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ddd87cfb-0228-4bb6-abd8-fd5276864870 req-44ad6c9c-c749-4d67-9c8b-ad3399fe8067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cf38f8-36c6-4b96-8aa2-b04acc7123da", "name": "network-vif-plugged", "status": "completed", "tag": "27f5a3da-a008-457c-9603-057b3e1dcd1c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:28:14.710995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ddd87cfb-0228-4bb6-abd8-fd5276864870 req-44ad6c9c-c749-4d67-9c8b-ad3399fe8067 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:14.711840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ddd87cfb-0228-4bb6-abd8-fd5276864870 req-44ad6c9c-c749-4d67-9c8b-ad3399fe8067 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:14.712520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ddd87cfb-0228-4bb6-abd8-fd5276864870 req-44ad6c9c-c749-4d67-9c8b-ad3399fe8067 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:14.762462 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ddd87cfb-0228-4bb6-abd8-fd5276864870 req-44ad6c9c-c749-4d67-9c8b-ad3399fe8067 service nova] Creating event network-vif-plugged:27f5a3da-a008-457c-9603-057b3e1dcd1c for instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da on n-h2-master-1 Oct 16 01:28:14.769331 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ddd87cfb-0228-4bb6-abd8-fd5276864870 req-44ad6c9c-c749-4d67-9c8b-ad3399fe8067 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084461 Oct 16 01:28:14.772156 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2622/5377] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 16 01:28:14.827686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:14.835905 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9b05b64f-4252-4a1b-af5f-0564d62c2d2a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1313 microversion: 2.1 time: 1.382194 Oct 16 01:28:14.836508 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2756/5378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:13 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1313 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:15.393275 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:15.394802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:15.408431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:15.411542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:15.412242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:15.413344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:15.422441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:15.423748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:15.864216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:15.865448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:15.873473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:15.873967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:15.874404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:15.875742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:15.876379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:15.877039 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:15.974334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:15.995362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:15.996817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:16.010696 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-92f60daf-026f-4789-ae54-1e44112a933d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.612084 Oct 16 01:28:16.011381 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2623/5379] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:15 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:17.044198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:17.045231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:17.048245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:17.065102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:17.067647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:17.068871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:17.070292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68e12de9-c503-4762-a173-f2b002420b08 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1313 microversion: 2.1 time: 1.211503 Oct 16 01:28:17.070425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:17.071536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:17.073340 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2757/5380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:15 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1313 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:17.079134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:17.485569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:17.497078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:17.501634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:17.512811 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c9cfacde-7c26-48a3-9911-6ef7a7fbb5e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.477439 Oct 16 01:28:17.513920 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2624/5381] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:17 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:28:18.098716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:18.100063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:18.116525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:18.119539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:18.120225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:18.122063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:18.123601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:18.125815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:18.545396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:18.546686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:18.555778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:18.557465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:18.558156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:18.559198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:18.560327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:18.563363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:18.938370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:18.960187 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ba4bad6-b40c-4488-9418-eb54b2b2ac37 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1499 microversion: 2.1 time: 0.861744 Oct 16 01:28:18.963896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2758/5382] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:18 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1499 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:18.983192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-02aa7fb7-c520-43ba-b362-62658192209b req-aabc7d57-d110-4e78-bef0-8b613990410b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9e8016-b524-495e-ae54-dca14a143c68", "tag": "35699b25-6801-49a8-9783-423ccbca634e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:28:19.026674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-02aa7fb7-c520-43ba-b362-62658192209b req-aabc7d57-d110-4e78-bef0-8b613990410b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:19.029735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-02aa7fb7-c520-43ba-b362-62658192209b req-aabc7d57-d110-4e78-bef0-8b613990410b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:19.030314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-02aa7fb7-c520-43ba-b362-62658192209b req-aabc7d57-d110-4e78-bef0-8b613990410b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:19.057807 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-02aa7fb7-c520-43ba-b362-62658192209b req-aabc7d57-d110-4e78-bef0-8b613990410b service nova] Creating event network-changed:35699b25-6801-49a8-9783-423ccbca634e for instance 5c9e8016-b524-495e-ae54-dca14a143c68 on n-h1-master-1 Oct 16 01:28:19.071834 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-02aa7fb7-c520-43ba-b362-62658192209b req-aabc7d57-d110-4e78-bef0-8b613990410b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103492 Oct 16 01:28:19.074359 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2759/5383] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:28:19.085341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:28:19.092290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:19.115988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:19.116639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:19.117310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:19.122712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:19.123778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:19.124336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:19.173885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lazy-loading 'flavor' on Instance uuid e9cf38f8-36c6-4b96-8aa2-b04acc7123da {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:28:19.347849 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-042c7deb-1df6-4867-a653-7d458b15a132 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "POST /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da/action" status: 200 len: 32 microversion: 2.1 time: 0.270196 Oct 16 01:28:19.352154 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2760/5384] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:28:19 2022] POST /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:28:19.364412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:19.367961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:19.379942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:19.387553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:19.388158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:19.389013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:19.389716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:19.390371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:19.542488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:19.574204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:19.584125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:19.585804 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-111b6696-9eea-4bea-8540-68d3ba840330 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 1.045810 Oct 16 01:28:19.603829 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2625/5385] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:18 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:20.614681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:20.618888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:20.631249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:20.635491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:20.636266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:20.647991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:20.649107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:20.650084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:20.652014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:20.653960 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1fc51604-c3bf-4e13-94f3-bb9c26f36352 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 1.296773 Oct 16 01:28:20.654965 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2761/5386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:19 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:21.685523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:21.686245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:21.705031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:21.707133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:21.714676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:21.715673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:21.716181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:21.716622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:22.431664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:22.468385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:22.470253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:22.477646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d36056c-669d-480c-84f4-2cb8cd711175 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 1.867744 Oct 16 01:28:22.481745 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2626/5387] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:20 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:22.821381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:22.829338 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-818c3174-1c07-41a5-9032-59533864cdb3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 1.151263 Oct 16 01:28:22.829934 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2762/5388] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:21 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:23.513222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:23.514525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:23.528066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:23.528960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:23.532494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:23.533364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:23.533897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:23.534408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:23.859065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:23.859818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:23.882382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:23.883141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:23.883882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:23.884716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:23.885292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:23.886625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:24.334843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:24.363510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:24.373237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:24.376245 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7a5296b-5ab9-4675-9531-1a1e374150ec tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.867205 Oct 16 01:28:24.378790 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2627/5389] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:23 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:24.565253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:24.575005 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-297f88b1-945b-4b5b-b68d-6b48a008f26b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.719686 Oct 16 01:28:24.576154 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2763/5390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:23 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:25.406386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:25.407116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:25.425394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:25.425898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:25.426420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:25.432370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:25.447751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:25.453795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:25.606444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:25.607729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:25.618694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:25.619507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:25.620223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:25.622010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:25.622670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:25.624196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:25.632267 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:26.151743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:26.200142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:26.204499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:26.206394 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d7fc7db9-93be-44f2-933f-14a638aadd2d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.804249 Oct 16 01:28:26.208358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2628/5391] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:25 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:26.814253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:26.835400 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e69c021f-dd6c-4b73-a8f3-4e26b82598e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 1.233439 Oct 16 01:28:26.868763 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2764/5392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:25 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:27.241656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:27.242407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:27.256699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:27.259532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:27.260231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:27.262943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:27.263961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:27.264653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:27.866113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:27.866738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:27.881097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:27.881505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:27.881947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:27.882678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:27.883169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:27.883602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:28.154084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:28.164467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:28.169446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:28.193037 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5c4bfd7-7d1b-4309-a624-c03016e6ca7e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.959007 Oct 16 01:28:28.194262 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2629/5393] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:27 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:28.317452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:28.325716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eaa65d36-257f-464c-b921-eb1d931e4a0c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.463544 Oct 16 01:28:28.326316 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2765/5394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:27 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:29.224216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:29.225972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:29.242274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:29.242785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:29.243256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:29.243985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:29.244426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:29.245037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:29.356931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:29.358487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:29.369331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:29.370194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:29.370785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:29.372155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:29.372897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:29.373671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:29.819331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:29.827477 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f235e818-3c8c-4215-bbd8-31d028d187d4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.477660 Oct 16 01:28:29.828058 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2766/5395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:29 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:29.854484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:29.868640 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:29.875396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:29.877143 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-06c699d4-14fd-4ea4-908f-5a39c92291e6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.659254 Oct 16 01:28:29.877725 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2630/5396] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:29 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:28:30.856424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:30.857667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:30.877586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:30.880308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:30.881051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:30.882082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:30.883081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:30.884965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:30.903036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:30.905258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:30.917910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:30.918790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:30.924163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:30.948011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:30.950696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:30.959543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:31.592524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:31.603471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:31.605828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:31.613446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:31.615519 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fde68459-6d39-4197-910e-97a5a167b68c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.763581 Oct 16 01:28:31.619330 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9f27fc56-5ff7-40a1-a01e-e1414f8ac624 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.720183 Oct 16 01:28:31.628702 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2631/5397] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:30 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:28:31.636027 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2767/5398] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:30 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:32.642306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:32.642844 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:32.658894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:32.659553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:32.666449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:32.679870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:32.680828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:32.683764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:32.684713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:32.686429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:32.687290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:32.687899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:32.689018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:32.693620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:32.695266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:32.698752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:33.337681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:33.348957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:33.357826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:33.359833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:33.361370 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52e7fa5e-7fc8-4a27-b9bb-ed65e11abe12 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.706481 Oct 16 01:28:33.362503 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2768/5399] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:32 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:28:33.367681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d02358f2-1b82-4a84-bf44-861481e81af2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.728963 Oct 16 01:28:33.369241 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2632/5400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:32 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:34.389156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:34.389775 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:34.394145 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:34.396023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:34.398627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:34.401053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:34.401505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:34.402435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:34.402708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:34.403221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:34.415015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:34.417116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:34.417674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:34.418296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:34.422029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:34.422537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:35.438001 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:35.459083 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:35.480389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:35.481942 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-005e35e9-f471-484c-a373-f01864a3de2f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 1.092082 Oct 16 01:28:35.485043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:35.485345 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2633/5401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:34 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:35.487217 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0df16344-eb0a-45ba-aed0-dcbe5b4740d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 1.102345 Oct 16 01:28:35.488772 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2769/5402] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:34 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:36.452330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-8c49af2f-a7f5-4dfb-9154-b38ef4546966 req-9f057085-260a-43ea-a8bc-a9c53dba0126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa8ed22-d042-41d4-84a6-63e1b1ac9b2a", "name": "network-vif-plugged", "status": "completed", "tag": "1753d20a-a3ba-48cb-b791-16b43c88ff56"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:28:36.471776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8c49af2f-a7f5-4dfb-9154-b38ef4546966 req-9f057085-260a-43ea-a8bc-a9c53dba0126 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:36.472455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8c49af2f-a7f5-4dfb-9154-b38ef4546966 req-9f057085-260a-43ea-a8bc-a9c53dba0126 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:36.472592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8c49af2f-a7f5-4dfb-9154-b38ef4546966 req-9f057085-260a-43ea-a8bc-a9c53dba0126 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:36.499282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-8c49af2f-a7f5-4dfb-9154-b38ef4546966 req-9f057085-260a-43ea-a8bc-a9c53dba0126 service nova] Creating event network-vif-plugged:1753d20a-a3ba-48cb-b791-16b43c88ff56 for instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a on n-h2-master-1 Oct 16 01:28:36.505861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:36.507051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:36.521629 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=46 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:36.523974 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-8c49af2f-a7f5-4dfb-9154-b38ef4546966 req-9f057085-260a-43ea-a8bc-a9c53dba0126 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075597 Oct 16 01:28:36.526228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:36.530905 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2634/5403] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:28:36.531154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:36.531880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:36.533951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:36.535353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:36.541962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:36.565934 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:36.567260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:36.587131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:36.590520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:36.591180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:36.594955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:36.596916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:36.598967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:37.095665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:37.111277 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:37.115926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:37.117645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:37.117893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:37.119493 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0fb56d0e-4d23-4bdd-afbd-879058d2abd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.585799 Oct 16 01:28:37.120303 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2635/5404] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:36 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:37.136045 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cdee2d61-7d8a-45b8-9f9a-dde3a99d14b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.625546 Oct 16 01:28:37.136045 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2770/5405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:36 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:38.150880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:38.152277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:38.152805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:38.153524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:38.166309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:38.166557 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=41 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:38.167237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:38.169314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:38.170286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:38.170446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:38.172854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:38.173607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:38.175777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:38.176596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:38.177584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:38.178280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:38.178781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:38.668640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:38.688635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:38.698252 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:38.701448 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5aec91a5-bd06-4932-9138-85cebaf416d6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.555061 Oct 16 01:28:38.702047 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2771/5406] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:38 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:38.760474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:38.778720 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9816b40b-dee1-48c9-b248-9f44f29a7637 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.630580 Oct 16 01:28:38.783617 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2636/5407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:38 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:39.732005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:39.732944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:39.753432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:39.755211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:39.756062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:39.768506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:39.769402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:39.772935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:39.804044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:39.805348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:39.821637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:39.822466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:39.823244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:39.828493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:39.829328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:39.829928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:40.417521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:40.431032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:40.432526 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:40.444477 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-312e4bb1-f2cb-478c-846f-850bb41da09f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1807 microversion: 2.20 time: 0.718997 Oct 16 01:28:40.450672 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2772/5408] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:39 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1807 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:28:40.688485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:40.700356 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4eb99a83-5f07-4aac-95cc-dce7b84152f5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.901480 Oct 16 01:28:40.703191 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2637/5409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:39 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:41.474498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:41.475076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:41.487375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:41.489956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:41.490615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:41.492781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:41.493523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:41.497138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:41.730357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:41.732574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:41.743207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:41.743835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:41.744456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:41.746213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:41.746854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:41.747452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:41.922480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:41.944246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:41.947832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:41.949619 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f275ec8-e213-4d0c-bec3-237867b191af tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1794 microversion: 2.20 time: 0.479664 Oct 16 01:28:41.950634 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2773/5410] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:28:41 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1794 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:28:42.009389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:42.021990 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0f6b556a-8c6b-415d-b851-465c83474a8a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.293581 Oct 16 01:28:42.026999 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2638/5411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:41 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:28:43.047323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:43.047943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:43.059480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:43.062362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:43.064759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:43.067183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:43.067868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:43.069814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:43.420503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:43.429943 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7a1743b2-accc-4d00-a058-b2c61bbe8ca2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.386809 Oct 16 01:28:43.439898 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2774/5412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:43 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:44.458051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:44.458663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:44.467810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:44.468215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:44.469294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:44.470236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:44.471059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:44.471774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:45.299964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:45.318225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d5c9e823-26e2-4661-96fd-39289959e4f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.864341 Oct 16 01:28:45.319508 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2639/5413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:44 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:46.345738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:46.347016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:46.365813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:46.366322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:46.366770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:46.367527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:46.367998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:46.368432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:47.076914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:47.116033 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-50e4d7a1-f1c1-4462-8249-9517bbb21f33 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.770506 Oct 16 01:28:47.118061 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2775/5414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:46 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:48.144097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:48.146350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:48.158414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:48.166622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:48.166958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:48.168466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:48.169497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:48.170159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:48.892372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:48.921095 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2f37d056-9d8e-45d2-89c9-8574ce9b08c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1505 microversion: 2.1 time: 0.773573 Oct 16 01:28:48.930645 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2640/5415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:48 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:49.952341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:49.953260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:49.978485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:49.982297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:49.985130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:49.989807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:49.991195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:49.993917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:50.514979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:50.539615 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-767e5496-bcce-429a-9384-12c62c69aac7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1485 microversion: 2.1 time: 0.590931 Oct 16 01:28:50.555907 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2776/5416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:49 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1485 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:50.788551 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-229997172", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:28:50.898023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] validate_networks() for [('38d0b485-79b5-4e4d-87e8-86979f094fca', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:28:52.450835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:28:52.455847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:28:52.457783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:28:52.458478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:28:52.459086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:28:52.475653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:52.484855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:52.485503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:52.486602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:52.487248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:52.487846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:52.533401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Getting quotas for project 4ec864865dde4a4fa13a54a5057867f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:28:52.552219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Getting quotas for user 4d4086e3f9784454a0ccfe87cc54a2b2 and project 4ec864865dde4a4fa13a54a5057867f1. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:28:52.596108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:28:52.599557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:28:52.719370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d61e7b6c-98a4-4940-95c2-6bb58d0531ab tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.938842 Oct 16 01:28:52.727330 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2641/5417] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:28:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:28:52.731853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca8d652d-2e46-417e-8a66-8d3b33e11f1c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:52.732472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca8d652d-2e46-417e-8a66-8d3b33e11f1c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:52.969144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca8d652d-2e46-417e-8a66-8d3b33e11f1c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:52.982460 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca8d652d-2e46-417e-8a66-8d3b33e11f1c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1213 microversion: 2.1 time: 0.254355 Oct 16 01:28:52.984029 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2777/5418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:52 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1213 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:54.014556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:54.015205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:54.034139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:54.036605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:54.037250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:54.053120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:54.054143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:54.055599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:54.351480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:54.377136 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-625801a6-83ca-4e74-bc24-f7f49615a310 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1265 microversion: 2.1 time: 0.372977 Oct 16 01:28:54.379317 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2642/5419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:54 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:55.407166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:55.407874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:55.424829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:55.424829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:55.427445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:55.428318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:55.429137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:55.440725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:56.353805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:56.361389 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=82 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:28:56.368207 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80cd5105-6130-4814-91f4-cd1699b987a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1271 microversion: 2.1 time: 0.969573 Oct 16 01:28:56.404991 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2778/5420] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:55 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1271 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:57.419600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:57.420823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:57.452476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:57.453168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:57.456625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:57.459688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:57.460312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:57.460856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:57.695891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:57.713324 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba721bcd-ad26-46ab-9756-fd1c7011f8d6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1271 microversion: 2.1 time: 0.309519 Oct 16 01:28:57.719331 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2643/5421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:57 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:28:58.742687 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:28:58.743334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:28:58.763652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:58.764357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:58.764792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:58.765492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:28:58.765988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:28:58.766381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:28:59.322581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:28:59.333914 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f075ab64-3104-4bb5-a756-a7b0851cfb32 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1271 microversion: 2.1 time: 0.596356 Oct 16 01:28:59.334791 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2779/5422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:28:58 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1271 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:00.357781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:00.358397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:00.368837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:00.369335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:00.369773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:00.370484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:00.370962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:00.371556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:01.135144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:01.149024 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb5c25d9-98bc-4fc4-bb75-405171d850ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 0.795035 Oct 16 01:29:01.150587 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2644/5423] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:00 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:02.176946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:02.178844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:02.187285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:02.188143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:02.188895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:02.189867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:02.190551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:02.191377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:02.850443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:02.860477 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-299bc7e6-e77f-4d3d-8d3f-da9392fb86a8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 0.687968 Oct 16 01:29:02.862747 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2780/5424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:02 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:03.543028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-bd9fbbeb-0833-410e-9339-ceeeb11567b0 req-788cfbea-9bdf-430a-9f8f-0b8ff9dbeebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a745110-bf97-4b08-b317-ee448d622368", "tag": "b69e09a4-e27b-4ea8-8370-034554195284"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:03.565135 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:03.566035 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:03.567938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bd9fbbeb-0833-410e-9339-ceeeb11567b0 req-788cfbea-9bdf-430a-9f8f-0b8ff9dbeebb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:03.568488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bd9fbbeb-0833-410e-9339-ceeeb11567b0 req-788cfbea-9bdf-430a-9f8f-0b8ff9dbeebb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:03.569110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bd9fbbeb-0833-410e-9339-ceeeb11567b0 req-788cfbea-9bdf-430a-9f8f-0b8ff9dbeebb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:03.594681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-bd9fbbeb-0833-410e-9339-ceeeb11567b0 req-788cfbea-9bdf-430a-9f8f-0b8ff9dbeebb service nova] Creating event network-changed:b69e09a4-e27b-4ea8-8370-034554195284 for instance 3a745110-bf97-4b08-b317-ee448d622368 on n-h1-master-1 Oct 16 01:29:03.613224 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-bd9fbbeb-0833-410e-9339-ceeeb11567b0 req-788cfbea-9bdf-430a-9f8f-0b8ff9dbeebb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073782 Oct 16 01:29:03.613850 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2645/5425] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:03.892592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:03.893961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:03.907171 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:03.910630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:03.911623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:03.912137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:03.914185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:03.915938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:03.919732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:04.414886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:04.428243 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-12ad3dc0-0e95-44cb-b1f6-2fe5b3fcfab2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 0.545542 Oct 16 01:29:04.443956 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2781/5426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:03 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:04.867404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-593561596", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "4126c5cc-9774-4c2c-a9b2-2cba908e9075"}], "key_name": "tempest-TestSecurityGroupsBasicOps-499898819", "security_groups": []}, "os:scheduler_hints": {"different_host": ["5c9e8016-b524-495e-ae54-dca14a143c68"]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:04.944459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] validate_networks() for [('4126c5cc-9774-4c2c-a9b2-2cba908e9075', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:29:05.458866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:05.461097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:05.477976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:05.485164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:05.485882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:05.486852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:05.487527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:05.488738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:06.124013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:06.140999 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-913f90a7-59ab-4dff-b11e-4d000b6de1f8 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 0.687974 Oct 16 01:29:06.145863 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2782/5427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:05 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:06.304300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:29:06.306446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:29:06.307284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:29:06.307929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:29:06.308579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:29:06.335911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:06.338929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:06.352986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:06.357786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:06.361219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:06.361921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:06.430308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Getting quotas for project 24191805b45e4a9b9575e5d989a6c6f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:29:06.449013 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Getting quotas for user f5f42a99ffbe407bb43f8aee0091f130 and project 24191805b45e4a9b9575e5d989a6c6f9. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:29:06.512547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:29:06.515126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:29:06.679574 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b40221e-a4fe-40cc-ab79-e4864b7e7a4b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.813867 Oct 16 01:29:06.692973 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2646/5428] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:29:04 2022] POST /compute/v2.1/servers => generated 361 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:29:06.713756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0345bf4b-1759-494d-9174-3cd893dbed63 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:06.715800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0345bf4b-1759-494d-9174-3cd893dbed63 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:06.729661 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=28 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:07.172246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:07.173249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:07.190418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:07.191801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:07.194210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:07.195240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:07.195951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:07.199140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:08.014343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0345bf4b-1759-494d-9174-3cd893dbed63 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:08.042315 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0345bf4b-1759-494d-9174-3cd893dbed63 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1240 microversion: 2.1 time: 1.341030 Oct 16 01:29:08.065937 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2783/5429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:06 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1240 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:08.553301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:08.564778 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=60 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:08.581433 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-120815a1-dcf5-43f8-a982-afe9d9a3065d tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 1.413024 Oct 16 01:29:08.595368 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2647/5430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:07 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:09.072869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:09.073581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:09.087846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:09.089550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:09.091997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:09.093726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:09.095494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:09.096326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:09.274934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:09.288677 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cccf2b6-806a-4e0b-9b50-f4a1368c0426 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1310 microversion: 2.1 time: 0.222620 Oct 16 01:29:09.306533 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2784/5431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:09 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1310 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:09.606890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:09.607635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:09.611342 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:09.625594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:09.626331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:09.626994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:09.628306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:09.629578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:09.630168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:09.797432 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:09.807090 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d7837146-fd26-4083-98b7-24c2ea9975e0 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 0.205886 Oct 16 01:29:09.807699 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2648/5432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:09 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:10.314414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:10.316549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:10.334809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:10.335382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:10.335912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:10.336693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:10.337149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:10.337637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:10.442659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:10.455267 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-746edf3d-ef7a-43ac-8eac-54975380f449 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.144742 Oct 16 01:29:10.458439 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2785/5433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:10 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:10.831628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:10.832448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:10.839855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:10.840676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:10.841304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:10.842350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:10.843710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:10.844320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:11.184342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:11.209307 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be6db9c1-62d1-4e40-894a-1df6387336c5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 0.370149 Oct 16 01:29:11.211290 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2649/5434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:10 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:11.407592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Calling method '.version_select at 0x7fd64e154dc0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:11.410603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:11.411471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:11.412085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:11.437947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:11.438251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:11.439190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:11.465588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:11.466407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:11.471721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:11.483418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:11.484037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:11.486348 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77ca48c0-1dcb-4aa9-839d-9528380a1050 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573 tempest-PortsAdminExtendedAttrsIpV6TestJSON-337949573-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.333983 Oct 16 01:29:11.495085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:11.495900 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2786/5435] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:29:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:29:11.502290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:11.503228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:11.504240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:11.504945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:11.505577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:11.769339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:11.777050 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fdd66ca2-8c3b-4de7-a61e-a847e5ba2955 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.297308 Oct 16 01:29:11.799896 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2650/5436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:11 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:12.241663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:12.243059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:12.256696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:12.259583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:12.260545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:12.266272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:12.270118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:12.271088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:12.790678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b6d233d0-e825-418f-8ad7-b46a32f21ba0 req-304dfc66-09cc-468c-9ca9-55f9d2400dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a745110-bf97-4b08-b317-ee448d622368", "name": "network-vif-plugged", "status": "completed", "tag": "b69e09a4-e27b-4ea8-8370-034554195284"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:12.813995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b6d233d0-e825-418f-8ad7-b46a32f21ba0 req-304dfc66-09cc-468c-9ca9-55f9d2400dbd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:12.816646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b6d233d0-e825-418f-8ad7-b46a32f21ba0 req-304dfc66-09cc-468c-9ca9-55f9d2400dbd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:12.817537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b6d233d0-e825-418f-8ad7-b46a32f21ba0 req-304dfc66-09cc-468c-9ca9-55f9d2400dbd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:12.846854 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b6d233d0-e825-418f-8ad7-b46a32f21ba0 req-304dfc66-09cc-468c-9ca9-55f9d2400dbd service nova] Creating event network-vif-plugged:b69e09a4-e27b-4ea8-8370-034554195284 for instance 3a745110-bf97-4b08-b317-ee448d622368 on n-h1-master-1 Oct 16 01:29:12.853732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b6d233d0-e825-418f-8ad7-b46a32f21ba0 req-304dfc66-09cc-468c-9ca9-55f9d2400dbd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079703 Oct 16 01:29:12.856183 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2651/5437] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:12.864423 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:12.866445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:12.871851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:12.893812 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3ecdfccd-89ad-430b-85db-f1872d6a5b2b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 0.660497 Oct 16 01:29:12.902217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:12.902599 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2787/5438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:12 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:12.907225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:12.907688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:12.908470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:12.908936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:12.909377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:13.205502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:13.213705 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-babb1f80-5e5e-4879-b1be-3e6f534cca22 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.355638 Oct 16 01:29:13.214276 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2652/5439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:12 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:13.921559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:13.922955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:13.932993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:13.933427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:13.933891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:13.934586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:13.935081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:13.947710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:14.241523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:14.242764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:14.259876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:14.267771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:14.268722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:14.270248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:14.270940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:14.271608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:14.700528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:14.712615 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1de560e9-d49a-4f6c-8421-d98dbf501b18 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.473364 Oct 16 01:29:14.716287 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2653/5440] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:14 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:14.721554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:14.727144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:14.740697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:14.747811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:14.749222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:14.750667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:14.751491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:14.752183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:14.823292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:14.831122 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e27f8d23-d2a0-45a6-9b18-3c5ff8add9b7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1313 microversion: 2.1 time: 0.913314 Oct 16 01:29:14.831801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2788/5441] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:13 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1313 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:14.833597 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8bb23c4-8e80-4ed6-9343-48faa4f5efd5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments/afe2fccf-1ca4-41bd-a0d2-cbd032e2ecf4" status: 200 len: 194 microversion: 2.20 time: 0.113498 Oct 16 01:29:14.834339 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2654/5442] 10.222.0.39 () {60 vars in 1454 bytes} [Sun Oct 16 01:29:14 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments/afe2fccf-1ca4-41bd-a0d2-cbd032e2ecf4 => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:29:14.873680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-eba4ddae-cf6a-454c-b321-9ab2e485c777 req-e4843354-d5f4-4d81-8f7b-27fe70685b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039b3f8d-1913-48de-9aab-a5b5cdf92615", "tag": "7e3a6165-eaf4-46bf-bcfe-4ab321ba49a0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:14.920539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-eba4ddae-cf6a-454c-b321-9ab2e485c777 req-e4843354-d5f4-4d81-8f7b-27fe70685b00 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:14.921384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-eba4ddae-cf6a-454c-b321-9ab2e485c777 req-e4843354-d5f4-4d81-8f7b-27fe70685b00 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:14.922750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-eba4ddae-cf6a-454c-b321-9ab2e485c777 req-e4843354-d5f4-4d81-8f7b-27fe70685b00 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:14.961580 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-eba4ddae-cf6a-454c-b321-9ab2e485c777 req-e4843354-d5f4-4d81-8f7b-27fe70685b00 service nova] Creating event network-changed:7e3a6165-eaf4-46bf-bcfe-4ab321ba49a0 for instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 on n-h2-master-1 Oct 16 01:29:14.979626 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-eba4ddae-cf6a-454c-b321-9ab2e485c777 req-e4843354-d5f4-4d81-8f7b-27fe70685b00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112501 Oct 16 01:29:14.981323 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2789/5443] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:15.003101 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:15.003662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:15.010315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:15.010879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:15.011408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:15.012116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:15.012630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:15.013051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:15.254485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lazy-loading 'services' on Instance uuid baa8ed22-d042-41d4-84a6-63e1b1ac9b2a {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:29:15.439603 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-efcc07b9-9f75-41f0-9316-35aa42a468f3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "DELETE /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments/afe2fccf-1ca4-41bd-a0d2-cbd032e2ecf4" status: 202 len: 0 microversion: 2.20 time: 0.437022 Oct 16 01:29:15.451578 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2655/5444] 10.222.0.39 () {60 vars in 1457 bytes} [Sun Oct 16 01:29:14 2022] DELETE /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments/afe2fccf-1ca4-41bd-a0d2-cbd032e2ecf4 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:29:15.467097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:15.469508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:15.511419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:15.512497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:15.513162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:15.514112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:15.515325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:15.516239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:15.598603 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-647cc92d-8d81-4f78-b3f5-346cc7a0a067 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143420 Oct 16 01:29:15.599458 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2790/5445] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:29:15 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:29:15.751630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:15.754241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:15.772071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:15.772631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:15.775245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:15.776274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:15.778542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:15.779215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:15.862719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:15.863978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:15.893183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:15.893841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:15.895190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:15.896143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:15.896838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:15.897498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:16.151972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:16.162390 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ff7acf2-dbd3-4588-9236-4d73eabab55a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.421015 Oct 16 01:29:16.163008 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2656/5446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:15 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:16.261329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:16.273353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1a54aa03-d437-49ca-837a-909aed6193c1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1499 microversion: 2.1 time: 0.412807 Oct 16 01:29:16.275288 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2791/5447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:15 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1499 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:16.305303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:16.308135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:16.321719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:16.322212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:16.322656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:16.323394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:16.323848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:16.324276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:16.386819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lazy-loading 'flavor' on Instance uuid 3a745110-bf97-4b08-b317-ee448d622368 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:29:16.415827 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:16.499490 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:16.576146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d2226a5c-a76e-4ef3-987b-0a2b8e4bc02a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "POST /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368/action" status: 200 len: 32 microversion: 2.1 time: 0.275239 Oct 16 01:29:16.584326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2657/5448] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:29:16 2022] POST /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:29:16.593762 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:16.594732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:16.608445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:16.609244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:16.612108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:16.613305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:16.614421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:16.616140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:16.618773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:16.622457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:16.633530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:16.634307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:16.634907 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:16.635912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:16.636559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:16.637334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:16.710743 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-754a7ed2-5441-4e32-8410-b13845011a3e tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100780 Oct 16 01:29:16.711838 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2658/5449] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:29:16 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:29:17.190004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:17.191510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:17.201258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:17.202929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:17.208284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:17.209515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:17.210316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:17.211006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:17.346283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:17.355422 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f78b620-a4f5-43e1-9fda-de427798ba0a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.765516 Oct 16 01:29:17.362411 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2792/5450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:16 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:17.579664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:17.589882 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef29b12c-8090-4a7b-80f8-a5ff98cb170b tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.404033 Oct 16 01:29:17.594321 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2659/5451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:17 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:17.724529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:17.727297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:17.734686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:17.735645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:17.736415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:17.737388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:17.738226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:17.739021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:17.784317 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7139e88c-54d6-4938-ad52-ebb60963df38 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064623 Oct 16 01:29:17.785931 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2793/5452] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:29:17 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:29:18.385829 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:18.387192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:18.405372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:18.405931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:18.406788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:18.407807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:18.408415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:18.408991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:18.578660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:18.588017 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a112be9-f3a6-4419-ae41-3d865a6ced54 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.206778 Oct 16 01:29:18.589685 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2660/5453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:18 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:18.621972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:18.622655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:18.625902 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:18.634049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:18.634955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:18.635593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:18.636502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:18.637184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:18.637805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:18.733625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:18.746073 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f28fa642-c0bc-435d-aa17-feb7c59a7403 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.127825 Oct 16 01:29:18.747238 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2794/5454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:18 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:18.802635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:18.807205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:18.818190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:18.819034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:18.820475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:18.822739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:18.824069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:18.824961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:18.874561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37a77dd7-4fbb-4109-b576-0dd892a534a7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078678 Oct 16 01:29:18.875683 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2661/5455] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:29:18 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:29:19.612230 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:19.612876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:19.619737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:19.620237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:19.620677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:19.621389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:19.621848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:19.622275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:19.776448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:19.777699 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:19.787154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:19.787982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:19.788683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:19.789608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:19.790280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:19.790962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:19.807710 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:19.915033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:19.929695 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ac6848d5-800f-4e64-9859-79dc014aea9e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.321206 Oct 16 01:29:19.930310 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2795/5456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:19 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:19.935210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:19.945494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:19.953888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:19.959077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:19.959689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:19.961090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:19.961427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:19.966473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:19.967109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:19.970512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9f223b31-e7b0-461e-b5fa-d299328d3d61 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.198194 Oct 16 01:29:19.975920 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2662/5457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:19 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:20.024507 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0cbf5db9-69c8-4006-b1c3-93474d6f53e3 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092882 Oct 16 01:29:20.034244 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2796/5458] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:29:19 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:29:20.958764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:20.959412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:20.978562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:20.979349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:20.979947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:20.980823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:20.981452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:20.982071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:21.006262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:21.007611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:21.022259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:21.026075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:21.030234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:21.031293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:21.031939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:21.032530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:21.053157 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:21.430948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:21.441122 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-20c38e8b-c1b0-4bbe-bef2-fba498a93782 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.443177 Oct 16 01:29:21.441736 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2797/5459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:20 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:21.459363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:21.463415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:21.470456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:21.471248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:21.471867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:21.473540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:21.474253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:21.474864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:21.523567 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6e1b0fa-01b2-407a-8f76-bb39fe6d5de0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077430 Oct 16 01:29:21.524791 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2798/5460] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:29:21 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:29:21.570797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:21.582106 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f2a533a-7d6a-4f8e-8ad6-19c34f6a58b5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.627338 Oct 16 01:29:21.583605 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2663/5461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:20 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:22.465457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:22.466032 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:22.473698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.474731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.475462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.476594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.477277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.477981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.540952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:22.545677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:22.562499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.563446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.566598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.568515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.570143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.572041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.627698 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-067969f4-927f-402a-920a-2a88bd2c4853 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.094823 Oct 16 01:29:22.630236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2664/5462] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:29:22 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:22.649127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:22.649750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:22.660009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.660881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.662245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.666189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.679783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.690145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:22.704234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.725080 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-35060030-dab4-4aa3-9791-3db668c69ebc tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.259542 Oct 16 01:29:22.729525 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2799/5463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:22 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:22.744767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9b347472-a893-49d0-a778-59802a8e3853 req-3dc91689-b75c-446a-8497-c002ec5fdc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039b3f8d-1913-48de-9aab-a5b5cdf92615", "name": "network-vif-plugged", "status": "completed", "tag": "7e3a6165-eaf4-46bf-bcfe-4ab321ba49a0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:22.806505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9b347472-a893-49d0-a778-59802a8e3853 req-3dc91689-b75c-446a-8497-c002ec5fdc07 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.807210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9b347472-a893-49d0-a778-59802a8e3853 req-3dc91689-b75c-446a-8497-c002ec5fdc07 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.809511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9b347472-a893-49d0-a778-59802a8e3853 req-3dc91689-b75c-446a-8497-c002ec5fdc07 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.842680 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9b347472-a893-49d0-a778-59802a8e3853 req-3dc91689-b75c-446a-8497-c002ec5fdc07 service nova] Creating event network-vif-plugged:7e3a6165-eaf4-46bf-bcfe-4ab321ba49a0 for instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 on n-h2-master-1 Oct 16 01:29:22.851946 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9b347472-a893-49d0-a778-59802a8e3853 req-3dc91689-b75c-446a-8497-c002ec5fdc07 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117349 Oct 16 01:29:22.853184 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2800/5464] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:22.861331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:22.862163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:22.872319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.873210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.874174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.876836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:22.877733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:22.878382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:22.931181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:29:23.060694 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-874e08cc-0b51-42d7-87fa-db34245f3ba6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "DELETE /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 204 len: 0 microversion: 2.20 time: 0.205698 Oct 16 01:29:23.062177 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2801/5465] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:29:22 2022] DELETE /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:29:23.075260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:23.078005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:23.090462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:23.091288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:23.092027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:23.093288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:23.094432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:23.095960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:23.383195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:23.413090 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98850852-c944-4bcc-ac61-dcc4f86d65e4 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.776798 Oct 16 01:29:23.432180 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2665/5466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:22 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:23.711701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:23.721647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:23.724162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:23.725356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbe50a2e-a23f-4983-a107-6646a9cfae37 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.657353 Oct 16 01:29:23.725923 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2802/5467] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:23 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:23.755310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:23.756079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:23.762587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:23.763331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:23.763970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:23.764658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:23.765115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:23.765538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:23.916031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:23.950710 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c0359e5d-6615-4cb9-99ab-3e7d8acf5668 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.200773 Oct 16 01:29:23.951960 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2666/5468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:23 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:24.453848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:24.455326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:24.467362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:24.468511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:24.469642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:24.471016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:24.472849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:24.474271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:24.752631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:24.754189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:24.773726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:24.778202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:24.782422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:24.785829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:24.787315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:24.787758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:25.474600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:25.501130 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2e4bfa6-01fd-48a6-aaec-d81c68be5858 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 1.051742 Oct 16 01:29:25.501784 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2803/5469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:24 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:25.519103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:25.519824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:25.532613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:25.537636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:25.538330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:25.540214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:25.542517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:25.566720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:25.711313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:25.724004 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-81eb517f-d942-47c2-8029-cf56ea65410e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1298 microversion: 2.1 time: 0.221097 Oct 16 01:29:25.724622 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2804/5470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:25 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1298 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:25.736052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:25.754020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:25.761818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:25.766237 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ae4e22d5-172b-4b69-973a-702d8d3a5b59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 1.018308 Oct 16 01:29:25.787903 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2667/5471] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:24 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:26.529497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:26.530843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:26.541142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:26.553806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:26.554624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:26.556248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:26.559128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:26.560060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:26.748613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:26.749230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:26.763675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:26.764254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:26.764699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:26.765429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:26.768061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:26.768515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:27.036255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:27.046545 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5462125-d76d-4588-8c82-9d25559ed424 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1470 microversion: 2.1 time: 0.302523 Oct 16 01:29:27.064667 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2668/5472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:26 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:27.069876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:27.084255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f176b8b4-8fba-4d59-9e79-a22d0f1b2783 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.559654 Oct 16 01:29:27.084957 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2805/5473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:26 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:27.085987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:27.088215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:27.095845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:27.098510 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:27.102160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:27.103252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:27.105043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:27.107172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:27.109013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:27.109552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:27.111115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:27.115386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:27.115938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:27.116777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:27.119490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:27.120037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:27.357768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:27.376465 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58f2ac3a-98dd-411c-a28d-d4b4d08187e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1470 microversion: 2.1 time: 0.288302 Oct 16 01:29:27.379025 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2806/5474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:27 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:27.401016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:27.402218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:27.412744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:27.413576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:27.414248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:27.415226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:27.415701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:27.416277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:27.659000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:27.660702 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d8bac0c8-b6fb-4e60-a9ae-06043a3d7013 tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1621 microversion: 2.1 time: 0.264156 Oct 16 01:29:27.668992 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2807/5475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:27 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1621 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:27.685217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:27.687964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:27.688774 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:27.689404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:27.692550 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64de0fd8-8289-46da-a8be-99633c302749 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1722 microversion: 2.20 time: 0.625911 Oct 16 01:29:27.697183 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2669/5476] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:27 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1722 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:27.700312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:27.700811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:27.701253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:27.701970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:27.702430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:27.702859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.007356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-987bb5b8-f219-4a8d-8f86-46622414f7ac tempest-TestSecurityGroupsBasicOps-523916371 tempest-TestSecurityGroupsBasicOps-523916371-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1910 microversion: 2.1 time: 0.322088 Oct 16 01:29:28.019642 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2808/5477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:27 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1910 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:28.113428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:28.114059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:28.130339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:28.130939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:28.131312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.132044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:28.132506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:28.132939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.171540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:28.172363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:28.182223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:28.186266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:28.186834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.195417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:28.196030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:28.196580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.251407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:29:28.389023 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-38502fd1-4f1d-4121-8634-1afd298952d1 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "DELETE /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 204 len: 0 microversion: 2.1 time: 0.221659 Oct 16 01:29:28.396946 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2809/5478] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:29:28 2022] DELETE /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:29:28.404997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:28.407251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:28.424435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:28.425388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:28.426153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.427708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:28.428347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:28.428927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.601541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:28.609927 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f66633a8-a2a7-4113-b8a9-a10e6abfcf8a tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1476 microversion: 2.1 time: 0.210010 Oct 16 01:29:28.610528 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2810/5479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:28 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:28.633663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:28.646437 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-13bbf44c-2cbc-4ff1-97fb-d0bd93eecb21 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.537382 Oct 16 01:29:28.664438 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2670/5480] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:28 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:28.725688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:28.727173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:28.744682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:28.745855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:28.748055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.751512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:28.752250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:28.753082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:28.819047 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:28.981679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:28.990663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:28.992151 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:28.993347 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-07a2fad0-2d99-4c46-91b4-0ead9ae21f05 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1655 microversion: 2.20 time: 0.274018 Oct 16 01:29:29.002317 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2811/5481] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:28 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1655 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:29:29.625806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-3e7a5de7-dc58-4293-9933-3220298a1c49 req-8e2bce46-98e1-49a7-b215-97f205347d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa8ed22-d042-41d4-84a6-63e1b1ac9b2a", "name": "network-vif-deleted", "tag": "1753d20a-a3ba-48cb-b791-16b43c88ff56"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:29.640187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:29.642323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:29.644745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3e7a5de7-dc58-4293-9933-3220298a1c49 req-8e2bce46-98e1-49a7-b215-97f205347d97 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:29.645281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3e7a5de7-dc58-4293-9933-3220298a1c49 req-8e2bce46-98e1-49a7-b215-97f205347d97 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:29.653982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3e7a5de7-dc58-4293-9933-3220298a1c49 req-8e2bce46-98e1-49a7-b215-97f205347d97 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:29.658667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:29.669087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:29.672679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:29.674183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:29.676317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:29.677046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:29.683371 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-3e7a5de7-dc58-4293-9933-3220298a1c49 req-8e2bce46-98e1-49a7-b215-97f205347d97 service nova] Creating event network-vif-deleted:1753d20a-a3ba-48cb-b791-16b43c88ff56 for instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a on n-h2-master-1 Oct 16 01:29:29.705601 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-3e7a5de7-dc58-4293-9933-3220298a1c49 req-8e2bce46-98e1-49a7-b215-97f205347d97 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082640 Oct 16 01:29:29.707285 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2671/5482] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:29.720367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:29.721543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:29.743764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:29.744637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:29.748337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:29.751160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:29.763204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:29.768923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:29.923982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:29.935858 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc28dc14-1360-497f-a575-24c3ec9762e3 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1476 microversion: 2.1 time: 0.304200 Oct 16 01:29:29.937286 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2812/5483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:29 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:30.038235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:30.039291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:30.065650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:30.066558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:30.067246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:30.068551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:30.069273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:30.069864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:30.117859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:30.118604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:30.119586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:30.120459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lazy-loading 'fault' on Instance uuid baa8ed22-d042-41d4-84a6-63e1b1ac9b2a {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:29:30.698572 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:30.706280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:30.711166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:30.716369 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f31d9ec2-ed9d-428f-a1fb-6be523ba5ed2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 200 len: 1371 microversion: 2.20 time: 0.686626 Oct 16 01:29:30.717213 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2813/5484] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:30 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 1371 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:29:30.923757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:30.933722 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5c164611-100a-460f-9f35-bad3f2a61d6f tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 1.224802 Oct 16 01:29:30.934332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2672/5485] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:29 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:30.963990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:30.964720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:30.973330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:30.973954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:30.974655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:30.975534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:30.976114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:30.976653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:31.186473 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:31.205791 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e7f9543-2b2c-46bb-bdb4-fa1aa74ac5e8 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1476 microversion: 2.1 time: 0.244937 Oct 16 01:29:31.209441 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2814/5486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:30 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1476 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:31.753032 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:31.754225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:31.773222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:31.773753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:31.777758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:31.778537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:31.779212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:31.779648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:31.801736 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] HTTP exception thrown: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Request method failure captured: Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a HTTP/1.1 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS12hZYgHQPHWfZkzSQ803ow9Ez1F50YaZm51hhv1nWqnwbogUcPT4hw2Agng3-TVJBoT_g2zMC0zqanvIC3OgkI0xBvcGQ5s55shAEODz9iA4UAyRZfF0eomVXJ-L9pI_G86_jjkYq3OSYsTteLZ_-Ljn-uGZWByq9AF7IExeNk7vWQ Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cff8886e6a5f4728806b806cb3459ac5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1fbc6af4172d4f3d95ae57485bf6d7a2 Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: exception: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'baa8ed22-d042-41d4-84a6-63e1b1ac9b2a'} Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:31.805297 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:29:31.809833 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:31.809833 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:29:31.809833 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:29:31.809833 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:29:31.809833 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:29:31.809833 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:29:31.809833 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:29:31.809833 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:31.810375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Returning 404 to user: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:29:31.813131 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1941146-a987-4d6c-a9a7-e3760d0d19e2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 404 len: 111 microversion: 2.20 time: 0.066996 Oct 16 01:29:31.815534 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2673/5487] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:31 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:29:31.828627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1fcea010-89b4-49dc-a716-c90298834fbf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '.version_select at 0x7fd64e0e50d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:31.839350 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1fcea010-89b4-49dc-a716-c90298834fbf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [ec6dcd63-931a-496e-9c1a-3696545ec620] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 16 01:29:31.958827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:31.960589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:31.973896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:31.974399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:31.974845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:31.976544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:31.977013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:31.979388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:32.283474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:32.298638 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81a59dff-23bb-4d39-b02e-3030f6e0d7b1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.338476 Oct 16 01:29:32.301813 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2674/5488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:31 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:32.309379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f219b4e3-1795-4206-9f5c-0cacc44794d2 req-d38e32eb-d2bb-41d9-a3e0-d8b65f6ff8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039b3f8d-1913-48de-9aab-a5b5cdf92615", "name": "network-vif-deleted", "tag": "7e3a6165-eaf4-46bf-bcfe-4ab321ba49a0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:32.336179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f219b4e3-1795-4206-9f5c-0cacc44794d2 req-d38e32eb-d2bb-41d9-a3e0-d8b65f6ff8af service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:32.336840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f219b4e3-1795-4206-9f5c-0cacc44794d2 req-d38e32eb-d2bb-41d9-a3e0-d8b65f6ff8af service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:32.337453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f219b4e3-1795-4206-9f5c-0cacc44794d2 req-d38e32eb-d2bb-41d9-a3e0-d8b65f6ff8af service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:32.350646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f219b4e3-1795-4206-9f5c-0cacc44794d2 req-d38e32eb-d2bb-41d9-a3e0-d8b65f6ff8af service nova] Creating event network-vif-deleted:7e3a6165-eaf4-46bf-bcfe-4ab321ba49a0 for instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 on n-h2-master-1 Oct 16 01:29:32.356395 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f219b4e3-1795-4206-9f5c-0cacc44794d2 req-d38e32eb-d2bb-41d9-a3e0-d8b65f6ff8af service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053036 Oct 16 01:29:32.357588 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2675/5489] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:32.363429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:32.365045 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:32.373631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:32.374347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:32.375026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:32.375915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:32.376537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:32.377298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:32.425866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:32.426372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:32.426815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:32.427918 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lazy-loading 'fault' on Instance uuid 039b3f8d-1913-48de-9aab-a5b5cdf92615 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:29:32.523525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:32.534370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-69f9bf4c-f2bb-4881-9ef5-94fb79a81bce tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1330 microversion: 2.1 time: 0.175096 Oct 16 01:29:32.535396 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2676/5490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:32 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1330 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:32.849371 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [None req-1fcea010-89b4-49dc-a716-c90298834fbf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [ec6dcd63-931a-496e-9c1a-3696545ec620] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 33058. Oct 16 01:29:32.880966 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1fcea010-89b4-49dc-a716-c90298834fbf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021252464" status: 204 len: 0 microversion: 2.20 time: 1.061501 Oct 16 01:29:32.884072 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2815/5491] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Oct 16 01:29:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021252464 => generated 0 bytes in 1065 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:29:33.325038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:33.326226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:33.336106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:33.337876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:33.338479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:33.339529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:33.340189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:33.340817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:33.559206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:33.560177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:33.572475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:33.583735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:33.584391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:33.585386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:33.586109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:33.586544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:33.667362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:33.667992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:33.668440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:33.668999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lazy-loading 'fault' on Instance uuid 039b3f8d-1913-48de-9aab-a5b5cdf92615 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:29:33.752748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:33.760776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a478d817-b9a3-47bc-8b2c-760b695bd16e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 200 len: 1330 microversion: 2.1 time: 0.205770 Oct 16 01:29:33.762037 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2816/5492] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:33 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 1330 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:33.778510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:33.790035 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e9f637c-11ac-4578-91dc-326666707551 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.469047 Oct 16 01:29:33.803622 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2677/5493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:33 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:34.144713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bf767039-7db1-402e-81bb-92d9bfbe709f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'create', calling method: .version_select at 0x7fd64df5d0d0>, body: {"keypair": {"name": "tempest-keypair-81951215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQGeLy4AYKpFNUBZkj1+gAseB8H8jK2Pps9EMDK98vaSMWmI1CX70fofwHRjE0hqQ2Im152rtfQmmhxrkavj+9iZ1UIcyJ+Bk6nZJbmjVINuFZkwE4jdzPLvN3M5GUNqA=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:34.165575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-bf767039-7db1-402e-81bb-92d9bfbe709f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Getting quotas for project cff8886e6a5f4728806b806cb3459ac5. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:29:34.177440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-bf767039-7db1-402e-81bb-92d9bfbe709f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Getting quotas for user 1fbc6af4172d4f3d95ae57485bf6d7a2 and project cff8886e6a5f4728806b806cb3459ac5. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:29:34.196911 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:34.208933 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bf767039-7db1-402e-81bb-92d9bfbe709f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.069436 Oct 16 01:29:34.211214 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2817/5494] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Oct 16 01:29:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 16 01:29:34.788980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:34.789609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 039b3f8d-1913-48de-9aab-a5b5cdf92615] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:34.807119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:34.807846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:34.809850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:34.809850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:34.809850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:34.810457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:34.819216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:34.820138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:34.829176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:34.830978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:34.832703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:34.833728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:34.834440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:34.835809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:34.843087 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] HTTP exception thrown: Instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 could not be found. Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Request method failure captured: Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 HTTP/1.1 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS13x-B6Tb2X05meuFqZRCR26AjRk2ePXws9pLg3f7iGga0VoUx28EtJ4b6aZQID9QtAdzkFzbIP42USU1VmNQPNAb4tfz-vMoRNVlQrIPXu-eCSY5pLbfNxGncIw2NseVGSZ4Y2tY5m4WUgrqERlKNXtm5_FxPAZ1OsLzcgSkK10yK8 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 24191805b45e4a9b9575e5d989a6c6f9 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-442732223 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24191805b45e4a9b9575e5d989a6c6f9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24191805b45e4a9b9575e5d989a6c6f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24191805b45e4a9b9575e5d989a6c6f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24191805b45e4a9b9575e5d989a6c6f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestSecurityGroupsBasicOps-442732223 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 24191805b45e4a9b9575e5d989a6c6f9 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-442732223 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestSecurityGroupsBasicOps-442732223-project Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: f5f42a99ffbe407bb43f8aee0091f130 Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestSecurityGroupsBasicOps-442732223-project Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 could not be found. Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '039b3f8d-1913-48de-9aab-a5b5cdf92615'} Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 could not be found. Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 could not be found. Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:29:34.844868 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:34.848778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:29:34.848778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:29:34.848778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:29:34.848778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:29:34.848778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:29:34.848778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 could not be found. Oct 16 01:29:34.848778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:29:34.869858 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Returning 404 to user: Instance 039b3f8d-1913-48de-9aab-a5b5cdf92615 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:29:34.871510 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c400d05-9c0a-43d1-8758-52f07b049927 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615" status: 404 len: 111 microversion: 2.1 time: 0.086829 Oct 16 01:29:34.873146 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2678/5495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:34 2022] GET /compute/v2.1/servers/039b3f8d-1913-48de-9aab-a5b5cdf92615 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:29:35.323506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:35.345017 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d8be10b-bbca-45d2-8291-b5a4eb41c9ef tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.532399 Oct 16 01:29:35.347364 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2818/5496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:34 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:36.373416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:36.374653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:36.393013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:36.393522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:36.394015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:36.394825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:36.395388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:36.395816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:37.128350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:37.137772 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-05bdc81b-5905-4115-8f90-4d3a44552a6b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.768177 Oct 16 01:29:37.149134 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2679/5497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:36 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:38.165885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:38.167195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:38.184535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:38.188931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:38.193273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:38.203108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:38.203945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:38.204326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:38.709749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-29036952", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b61e752-e41f-4213-806a-ad45c0ea73a1"}], "security_groups": [{"name": "tempest-securitygroup--721491502"}], "key_name": "tempest-keypair-81951215", "user_data": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:39.001167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:39.014127 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f658abcc-7556-4c32-8287-a82d28318648 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.853597 Oct 16 01:29:39.031953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2819/5498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:38 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:39.264095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] validate_networks() for [('8b61e752-e41f-4213-806a-ad45c0ea73a1', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:29:40.038524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:40.039887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:40.068403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:40.072248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:40.075556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:40.078013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:40.081657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:40.087894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:40.636542 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=68 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:41.142802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:41.158852 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2acbba83-2178-470d-8fe5-75a2820c2ca3 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 1.125202 Oct 16 01:29:41.176950 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2820/5499] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:40 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:41.264675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:29:41.266387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:29:41.267850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:29:41.270240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:29:41.271232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:29:41.293256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:41.299192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:41.299970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:41.302624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:41.304827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:41.306175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:41.372310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Getting quotas for project cff8886e6a5f4728806b806cb3459ac5. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:29:41.383156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Getting quotas for user 1fbc6af4172d4f3d95ae57485bf6d7a2 and project cff8886e6a5f4728806b806cb3459ac5. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:29:41.401064 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:29:41.403680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:29:41.509105 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-07c08137-38e6-4d1d-88ac-16dc6e068018 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.801757 Oct 16 01:29:41.509964 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2680/5500] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:29:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 2807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:29:41.539877 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d516e286-52ca-4747-a112-46a86fc0c4a2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:41.568321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d516e286-52ca-4747-a112-46a86fc0c4a2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:41.755795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d516e286-52ca-4747-a112-46a86fc0c4a2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:41.765088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d516e286-52ca-4747-a112-46a86fc0c4a2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:41.771242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d516e286-52ca-4747-a112-46a86fc0c4a2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:41.775695 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d516e286-52ca-4747-a112-46a86fc0c4a2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1278 microversion: 2.20 time: 0.256279 Oct 16 01:29:41.788687 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2821/5501] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:41 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1278 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:42.186060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:42.187573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:42.203489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:42.211526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:42.212296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:42.213215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:42.219041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:42.219768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:42.803957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:42.805045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:42.806282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:42.820579 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7762f94f-9f26-46ac-82ea-75fad0ea3e7c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.639779 Oct 16 01:29:42.824540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:42.826092 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2681/5502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:42 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:42.831636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:42.834339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:42.835756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:42.850304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:42.851204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:43.013385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:43.030557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:43.032043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:43.033407 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-19c6b1b6-5715-4001-be6f-5b36029687ef tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1330 microversion: 2.20 time: 0.234283 Oct 16 01:29:43.035310 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2822/5503] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:42 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1330 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:29:43.862827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:43.863605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:43.886010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:43.888265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:43.888929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:43.898099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:43.899697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:43.900359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:43.906717 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:44.065848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:44.067138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:44.073990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:44.074709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:44.075930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:44.076873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:44.077606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:44.078250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:44.309986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:44.322484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:44.324825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:44.326439 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bbb8a838-e17c-48f7-8eac-2d64cd6f5ab2 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1336 microversion: 2.20 time: 0.264601 Oct 16 01:29:44.328987 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2823/5504] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:44 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1336 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:29:44.414874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:44.423009 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-594de5bf-9f2c-4562-b611-42dff7cad1e5 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.576418 Oct 16 01:29:44.424172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2682/5505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:43 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:45.354715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:45.355999 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:45.365539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:45.366278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:45.367537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:45.368731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:45.369570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:45.370198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:45.450666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:45.452290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:45.468441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:45.469045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:45.469593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:45.470395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:45.471229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:45.471874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:46.057431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:46.072275 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e599c89-8559-4643-95f2-041930151bfb tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.627977 Oct 16 01:29:46.073216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:46.085941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:46.090409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:46.090594 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2683/5506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:45 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:46.094216 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4ec7772-bc79-4054-9ae1-b83b22b8ba45 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.744072 Oct 16 01:29:46.094811 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2824/5507] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:45 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:47.098698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:47.100157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:47.107954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:47.108686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:47.109279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:47.110665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:47.111296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:47.112114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:47.123558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:47.124757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:47.134789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:47.135314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:47.135754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:47.136465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:47.136923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:47.137345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:47.651869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:47.667754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:47.673089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:47.677776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ffa1161-12a3-40a7-adc8-53e866ee6d58 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.556047 Oct 16 01:29:47.688146 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2825/5508] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:47 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:47.930250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:47.941748 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e76cab54-1196-4264-a728-e972f87fa40a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1485 microversion: 2.1 time: 0.847897 Oct 16 01:29:47.943264 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2684/5509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:47 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1485 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:47.969485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:47.970148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:47.983377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:47.983900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:47.984354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:47.985502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:47.988984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:47.989494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:48.010995 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e89f9ac5-95dd-4c45-9e81-91f1641a2b46 req-69462559-d1fe-47b2-b705-ae8fc1feab8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79a1b93-16d9-4003-aa38-d137cbf2e743", "tag": "7eaf7f6a-cef8-485e-b3ac-7efc80279c54"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:48.072632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e89f9ac5-95dd-4c45-9e81-91f1641a2b46 req-69462559-d1fe-47b2-b705-ae8fc1feab8d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:48.075215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e89f9ac5-95dd-4c45-9e81-91f1641a2b46 req-69462559-d1fe-47b2-b705-ae8fc1feab8d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:48.077738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e89f9ac5-95dd-4c45-9e81-91f1641a2b46 req-69462559-d1fe-47b2-b705-ae8fc1feab8d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:48.112283 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e89f9ac5-95dd-4c45-9e81-91f1641a2b46 req-69462559-d1fe-47b2-b705-ae8fc1feab8d service nova] Creating event network-changed:7eaf7f6a-cef8-485e-b3ac-7efc80279c54 for instance e79a1b93-16d9-4003-aa38-d137cbf2e743 on n-h2-master-1 Oct 16 01:29:48.126811 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e89f9ac5-95dd-4c45-9e81-91f1641a2b46 req-69462559-d1fe-47b2-b705-ae8fc1feab8d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124766 Oct 16 01:29:48.132027 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2685/5510] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:29:48.156349 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-218a15fe-9360-4ebe-bbdb-10c94e69412c tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "POST /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368/action" status: 202 len: 0 microversion: 2.1 time: 0.189996 Oct 16 01:29:48.161493 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2826/5511] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:29:47 2022] POST /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:29:48.167402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:48.168250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:48.176475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:48.177377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:48.178087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:48.179103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:48.179777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:48.180444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:48.717813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:48.719005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:48.726762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:48.727711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:48.728371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:48.729339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:48.730059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:48.730713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:49.248412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:49.268997 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f09bfcee-111a-424e-a037-e886db62621e tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1493 microversion: 2.1 time: 1.105627 Oct 16 01:29:49.289859 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2686/5512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:48 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1493 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:49.590428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:49.604854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:49.614822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:49.617258 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2133d5c1-d8d9-49f8-be95-d5a868d69a48 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.907048 Oct 16 01:29:49.618423 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2827/5513] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:48 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:29:50.299289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:50.303110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:50.315446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:50.324073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:50.324799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:50.325927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:50.327636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:50.329945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:50.605052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:50.615213 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cf953421-86b3-473d-a6dc-a3cdd91c0ad2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1493 microversion: 2.1 time: 0.321803 Oct 16 01:29:50.616514 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2687/5514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:50 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1493 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:50.644237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:50.645014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:50.656522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:50.657384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:50.658052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:50.658841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:50.659508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:50.660258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:50.907241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:50.923367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:50.925957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:50.927418 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30fb8423-955f-4762-bb3d-645a1b7dea78 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.287436 Oct 16 01:29:50.947758 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2828/5515] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:50 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:51.642335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:51.643134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:51.663089 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:51.665568 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:51.667416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:51.668176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:51.669060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:51.670504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:51.671373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:51.672053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:51.955570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:51.956222 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:51.959928 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:51.974446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:51.975217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:51.975814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:51.976717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:51.977186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:51.977617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:51.982118 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:52.171271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:52.183990 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d2c70cb-c9c5-4d80-98b3-ded8a5c0f55a tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1493 microversion: 2.1 time: 0.545865 Oct 16 01:29:52.185151 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2688/5516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:51 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1493 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:52.190175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:52.190720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:52.199001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:52.205312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:52.205985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:52.207992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:52.208641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:52.209228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:52.259670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:29:52.390517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:52.410058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:52.415280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:52.421259 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-feb1ba67-d0d6-45c9-ba19-0ab915f54449 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.467310 Oct 16 01:29:52.422050 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2829/5517] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:51 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:52.439215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e463f9e7-8f94-47d8-8c8e-7ff86d35a5fe req-402e71ca-6a27-4764-b14a-125293fdb3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9e8016-b524-495e-ae54-dca14a143c68", "tag": "35699b25-6801-49a8-9783-423ccbca634e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:52.445363 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c654536-8aa4-45d8-a6e5-4e32ac027626 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 204 len: 0 microversion: 2.1 time: 0.257716 Oct 16 01:29:52.447366 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2689/5518] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:29:52 2022] DELETE /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:29:52.462055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:52.463189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:52.467521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e463f9e7-8f94-47d8-8c8e-7ff86d35a5fe req-402e71ca-6a27-4764-b14a-125293fdb3a7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:52.470146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e463f9e7-8f94-47d8-8c8e-7ff86d35a5fe req-402e71ca-6a27-4764-b14a-125293fdb3a7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:52.470705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e463f9e7-8f94-47d8-8c8e-7ff86d35a5fe req-402e71ca-6a27-4764-b14a-125293fdb3a7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:52.481701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:52.482111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:52.482549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:52.483281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:52.483737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:52.484156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:52.510788 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e463f9e7-8f94-47d8-8c8e-7ff86d35a5fe req-402e71ca-6a27-4764-b14a-125293fdb3a7 service nova] Creating event network-changed:35699b25-6801-49a8-9783-423ccbca634e for instance 5c9e8016-b524-495e-ae54-dca14a143c68 on n-h1-master-1 Oct 16 01:29:52.522743 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e463f9e7-8f94-47d8-8c8e-7ff86d35a5fe req-402e71ca-6a27-4764-b14a-125293fdb3a7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099306 Oct 16 01:29:52.525470 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2830/5519] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:53.214599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:53.216145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:53.224007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:53.224851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:53.225503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:53.226429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:53.227155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:53.227799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:53.274317 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:53.285593 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f805fb04-b6c5-4b27-857e-2f5592f1de0d tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1765 microversion: 2.1 time: 0.833040 Oct 16 01:29:53.286780 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2690/5520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:52 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1765 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:53.469703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:53.470567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:53.479832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:53.514298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:53.515556 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fd0e29c0-b4ec-49ac-8e19-dd227bf1ef55 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1499 microversion: 2.1 time: 0.306641 Oct 16 01:29:53.517300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:53.517982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:53.518436 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2831/5521] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:53 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1499 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:53.521181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:53.522276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:53.523103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:53.571046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:53.571649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:53.613351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:53.616737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:53.617846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:53.629434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:53.630518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:53.631808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:53.684150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:29:53.827651 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4bcd2648-da76-4df0-8d98-ecb7eb5e7326 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 204 len: 0 microversion: 2.1 time: 0.284825 Oct 16 01:29:53.829198 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2832/5522] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:29:53 2022] DELETE /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:29:53.847565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:53.849629 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:53.870149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:53.872818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:53.873707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:53.876859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:53.883265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:53.883866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:54.056197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:54.071908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:54.074117 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:54.078888 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88f0524c-63fe-4f47-8317-c031d2a3a44f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.625034 Oct 16 01:29:54.110634 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2691/5523] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:53 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:54.189841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:54.199467 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0a2cabb7-0d1a-415e-b52e-bd544232cc63 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.363591 Oct 16 01:29:54.200128 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2833/5524] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:53 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:54.310019 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:54.310710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:54.321951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:54.322511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:54.322979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:54.323839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:54.324819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:54.325258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:54.663021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:54.672979 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be812096-2f76-425a-9512-2b52e6293eed tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1765 microversion: 2.1 time: 0.366220 Oct 16 01:29:54.673968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2692/5525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:54 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1765 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:55.113905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:55.115332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:55.132469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:55.132469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:55.132469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:55.133570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:55.138249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:55.139064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:55.231379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:55.232325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:55.240562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:55.241363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:55.241965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:55.242901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:55.244270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:55.244968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:55.649833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:55.658007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:55.668438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:55.674413 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f69f561f-c20b-4a9a-b862-547661872a4b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.562855 Oct 16 01:29:55.677866 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2834/5526] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:55 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:55.703075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:55.703989 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:55.715402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:55.716772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:55.717079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:55.719090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:55.720194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:55.720866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:55.721603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:55.726129 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6c24c212-89ce-497f-b220-f8a668dae3b6 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.499892 Oct 16 01:29:55.731719 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2693/5527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:55 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:56.121806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:56.137790 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd88fd46-f1f7-44b1-bfbb-3a43214e19a6 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1765 microversion: 2.1 time: 0.439065 Oct 16 01:29:56.139025 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2835/5528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:55 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1765 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:56.705720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:56.706474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:56.714036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:56.714800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:56.715438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:56.716403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:56.717108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:56.718261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:56.760003 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:56.760968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:56.768543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:56.769478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:56.770146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:56.771138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:56.771863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:56.772527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:57.024363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:57.032919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:57.035579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:57.037262 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6630140-80d0-4e04-82fb-a7069e3f38ad tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.335464 Oct 16 01:29:57.055964 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2694/5529] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:56 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:57.056765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:57.065286 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-514e6c88-b9d0-4ccf-9810-d03e42750a18 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.309849 Oct 16 01:29:57.066580 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2836/5530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:56 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:57.163267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:57.164033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:57.172020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:57.172848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:57.173518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:57.174485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:57.175925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:57.176590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:57.387498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d642197d-1195-4491-9237-74ecc5117b29 req-b5a1435e-bfc0-4dde-9687-eb960f7da233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79a1b93-16d9-4003-aa38-d137cbf2e743", "name": "network-vif-plugged", "status": "completed", "tag": "7eaf7f6a-cef8-485e-b3ac-7efc80279c54"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:57.403951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d642197d-1195-4491-9237-74ecc5117b29 req-b5a1435e-bfc0-4dde-9687-eb960f7da233 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:57.407595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d642197d-1195-4491-9237-74ecc5117b29 req-b5a1435e-bfc0-4dde-9687-eb960f7da233 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:57.408053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d642197d-1195-4491-9237-74ecc5117b29 req-b5a1435e-bfc0-4dde-9687-eb960f7da233 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:57.427646 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d642197d-1195-4491-9237-74ecc5117b29 req-b5a1435e-bfc0-4dde-9687-eb960f7da233 service nova] Creating event network-vif-plugged:7eaf7f6a-cef8-485e-b3ac-7efc80279c54 for instance e79a1b93-16d9-4003-aa38-d137cbf2e743 on n-h2-master-1 Oct 16 01:29:57.434955 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d642197d-1195-4491-9237-74ecc5117b29 req-b5a1435e-bfc0-4dde-9687-eb960f7da233 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050488 Oct 16 01:29:57.437010 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2837/5531] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:57.452813 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:57.490151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2378be6f-d027-4bda-8b89-740872f3b861 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1765 microversion: 2.1 time: 0.331357 Oct 16 01:29:57.504559 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2695/5532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:57 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1765 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:58.063950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:58.066904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:58.073538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:58.074973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:58.078217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:58.080858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:58.081919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:58.084201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:58.088620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:58.089316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:58.097704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:58.098776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:58.099545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:58.100593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:58.101277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:58.101934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:58.509616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:58.521394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:58.528821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:58.530286 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e14fb9b-aa2e-4d9f-8432-0944cb90f876 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1403 microversion: 2.20 time: 0.470880 Oct 16 01:29:58.531098 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2838/5533] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:58 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1403 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:29:58.541798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:58.542699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:58.562800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:58.563603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:58.566106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:58.566896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:58.567390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:58.568265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:58.585155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:58.598617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c0e42555-21f6-4faa-968d-9ced849c37a9 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1505 microversion: 2.1 time: 0.513741 Oct 16 01:29:58.600932 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2696/5534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:58 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:29:58.672686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:58.691852 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-24d07eb4-b99e-4063-a823-f906e877c24c tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1529 microversion: 2.1 time: 0.159333 Oct 16 01:29:58.692750 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2839/5535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:58 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1529 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:59.476545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2aaffd53-aa7b-48bd-bd5e-ca9539d91cac req-fb8c42db-3ecd-4c83-ab2e-0d1464a5badc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9e8016-b524-495e-ae54-dca14a143c68", "name": "network-vif-unplugged", "status": "completed", "tag": "35699b25-6801-49a8-9783-423ccbca634e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:59.545709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e2b27407-c191-4f48-a306-da11bd9c536c req-fd2fce8f-dc77-4faf-b9b7-440eaf29b2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9e8016-b524-495e-ae54-dca14a143c68", "name": "network-vif-deleted", "tag": "35699b25-6801-49a8-9783-423ccbca634e"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:29:59.558594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2aaffd53-aa7b-48bd-bd5e-ca9539d91cac req-fb8c42db-3ecd-4c83-ab2e-0d1464a5badc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:59.559109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2aaffd53-aa7b-48bd-bd5e-ca9539d91cac req-fb8c42db-3ecd-4c83-ab2e-0d1464a5badc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:59.559545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2aaffd53-aa7b-48bd-bd5e-ca9539d91cac req-fb8c42db-3ecd-4c83-ab2e-0d1464a5badc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:59.588216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2b27407-c191-4f48-a306-da11bd9c536c req-fd2fce8f-dc77-4faf-b9b7-440eaf29b2c1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:59.588705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2b27407-c191-4f48-a306-da11bd9c536c req-fd2fce8f-dc77-4faf-b9b7-440eaf29b2c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:59.589136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e2b27407-c191-4f48-a306-da11bd9c536c req-fd2fce8f-dc77-4faf-b9b7-440eaf29b2c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:59.624530 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2aaffd53-aa7b-48bd-bd5e-ca9539d91cac req-fb8c42db-3ecd-4c83-ab2e-0d1464a5badc service nova] Creating event network-vif-unplugged:35699b25-6801-49a8-9783-423ccbca634e for instance 5c9e8016-b524-495e-ae54-dca14a143c68 on n-h1-master-1 Oct 16 01:29:59.641476 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e2b27407-c191-4f48-a306-da11bd9c536c req-fd2fce8f-dc77-4faf-b9b7-440eaf29b2c1 service nova] Creating event network-vif-deleted:35699b25-6801-49a8-9783-423ccbca634e for instance 5c9e8016-b524-495e-ae54-dca14a143c68 on n-h1-master-1 Oct 16 01:29:59.650702 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e2b27407-c191-4f48-a306-da11bd9c536c req-fd2fce8f-dc77-4faf-b9b7-440eaf29b2c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110617 Oct 16 01:29:59.651915 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2aaffd53-aa7b-48bd-bd5e-ca9539d91cac req-fb8c42db-3ecd-4c83-ab2e-0d1464a5badc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171721 Oct 16 01:29:59.655176 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2697/5536] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:29:59.661912 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2840/5537] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:29:59.692520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:59.693280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:59.694717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:59.696639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:29:59.708005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:59.708507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:59.708938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:59.709824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:59.710438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:59.712019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:59.712358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:59.713110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:59.713570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:59.714400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:29:59.715847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:29:59.716296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:29:59.829435 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:29:59.930995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:29:59.965597 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4bb8f8a7-70de-463f-bfdb-d6c3001caa83 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 200 len: 1463 microversion: 2.1 time: 0.302263 Oct 16 01:29:59.966292 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2841/5538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:59 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:29:59.984666 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:29:59.985735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:00.006565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:00.007156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:00.007600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:00.008324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:00.009490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:00.011334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:00.076877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:00.077644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:00.078297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:00.078934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lazy-loading 'fault' on Instance uuid 5c9e8016-b524-495e-ae54-dca14a143c68 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:30:00.233469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f42a99ffbe407bb43f8aee0091f130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24191805b45e4a9b9575e5d989a6c6f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:00.275558 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0b9c0e5-f719-4dba-a06a-0b6b4c3e3fa7 tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 200 len: 1383 microversion: 2.1 time: 0.307378 Oct 16 01:30:00.295954 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2842/5539] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:29:59 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 1383 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:30:00.438683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:00.457335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:00.458938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:00.460027 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5cede059-b52b-416e-8569-3fb85bda7c59 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1594 microversion: 2.20 time: 0.797445 Oct 16 01:30:00.460597 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2698/5540] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:29:59 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1594 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:00.492630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:00.493533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:00.513585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:00.514377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:00.515648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:00.529273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:00.533174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:00.533885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:00.874905 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1b16df9e-1bcb-4ff0-8da2-67e3f2bc6281 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.387287 Oct 16 01:30:00.879767 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2843/5541] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Oct 16 01:30:00 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/os-interface => generated 284 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:30:01.016318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:01.020681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: 3a745110-bf97-4b08-b317-ee448d622368] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:01.045530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.049364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.055281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.058096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.058874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.059574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.122659 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] HTTP exception thrown: Instance 3a745110-bf97-4b08-b317-ee448d622368 could not be found. Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Request method failure captured: Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 HTTP/1.1 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS14bi8Qvc7j9rzRl5m-n0FPdSit2KodP2tEjiPiomA3gtUsMjFkqhZiaEdxjqss2lnUw7k6BM9iZOzAI8y4kzIrAx9hGb0zZvsYtxPbC9cD8amlfhtSJnAXR2rt7r8d6TCl_w3Y9cwksxU0NyDv82O3WkwG4kAtBSvDNVQEIvsNutss Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 4ec864865dde4a4fa13a54a5057867f1 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerRescueTestJSON-932317592 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4ec864865dde4a4fa13a54a5057867f1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4ec864865dde4a4fa13a54a5057867f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4ec864865dde4a4fa13a54a5057867f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4ec864865dde4a4fa13a54a5057867f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerRescueTestJSON-932317592 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 4ec864865dde4a4fa13a54a5057867f1 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerRescueTestJSON-932317592 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerRescueTestJSON-932317592-project Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 4d4086e3f9784454a0ccfe87cc54a2b2 Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerRescueTestJSON-932317592-project Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3a745110-bf97-4b08-b317-ee448d622368 could not be found. Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3a745110-bf97-4b08-b317-ee448d622368'} Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a745110-bf97-4b08-b317-ee448d622368 could not be found. Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a745110-bf97-4b08-b317-ee448d622368 could not be found. Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:30:01.126057 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.130852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:01.130852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:30:01.130852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:30:01.130852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:30:01.130852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:30:01.130852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a745110-bf97-4b08-b317-ee448d622368 could not be found. Oct 16 01:30:01.130852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.134689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Returning 404 to user: Instance 3a745110-bf97-4b08-b317-ee448d622368 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:30:01.135811 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c241076c-ea9f-48f3-a54b-1d5a3c7772e2 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368" status: 404 len: 111 microversion: 2.1 time: 0.147778 Oct 16 01:30:01.137019 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2699/5542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:30:00 2022] GET /compute/v2.1/servers/3a745110-bf97-4b08-b317-ee448d622368 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:30:01.146276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:01.147225 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:01.157478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.158379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.159145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.160141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.160842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.161477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.203528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:30:01.298248 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:01.313372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:01.314224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] [instance: 5c9e8016-b524-495e-ae54-dca14a143c68] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:01.322689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.324236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.324901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.326507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.327292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.327935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.347534 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] HTTP exception thrown: Instance 5c9e8016-b524-495e-ae54-dca14a143c68 could not be found. Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Request method failure captured: Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 HTTP/1.1 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS13x-B6Tb2X05meuFqZRCR26AjRk2ePXws9pLg3f7iGga0VoUx28EtJ4b6aZQID9QtAdzkFzbIP42USU1VmNQPNAb4tfz-vMoRNVlQrIPXu-eCSY5pLbfNxGncIw2NseVGSZ4Y2tY5m4WUgrqERlKNXtm5_FxPAZ1OsLzcgSkK10yK8 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 24191805b45e4a9b9575e5d989a6c6f9 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-442732223 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24191805b45e4a9b9575e5d989a6c6f9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24191805b45e4a9b9575e5d989a6c6f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24191805b45e4a9b9575e5d989a6c6f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24191805b45e4a9b9575e5d989a6c6f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestSecurityGroupsBasicOps-442732223 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 24191805b45e4a9b9575e5d989a6c6f9 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-442732223 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestSecurityGroupsBasicOps-442732223-project Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: f5f42a99ffbe407bb43f8aee0091f130 Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestSecurityGroupsBasicOps-442732223-project Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 5c9e8016-b524-495e-ae54-dca14a143c68 could not be found. Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '5c9e8016-b524-495e-ae54-dca14a143c68'} Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9e8016-b524-495e-ae54-dca14a143c68 could not be found. Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9e8016-b524-495e-ae54-dca14a143c68 could not be found. Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:30:01.351707 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.356249 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:01.356249 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:30:01.356249 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:30:01.356249 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:30:01.356249 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:30:01.356249 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9e8016-b524-495e-ae54-dca14a143c68 could not be found. Oct 16 01:30:01.356249 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:01.358869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Returning 404 to user: Instance 5c9e8016-b524-495e-ae54-dca14a143c68 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:30:01.360457 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d48d3543-829e-4272-b457-d77fa6241c5e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68" status: 404 len: 111 microversion: 2.1 time: 0.053209 Oct 16 01:30:01.361669 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2700/5543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:30:01 2022] GET /compute/v2.1/servers/5c9e8016-b524-495e-ae54-dca14a143c68 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:30:01.373581 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d2eb6aa8-9e47-41ab-beb6-36f108446385 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 204 len: 0 microversion: 2.1 time: 0.231994 Oct 16 01:30:01.374800 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2844/5544] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:30:01 2022] DELETE /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:30:01.387763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:01.388665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:01.409857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.412927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.413562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.415772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.416257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.416954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.715271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f7280570-e76e-4ed5-aafe-9e7cb7567814 req-58f67833-5e04-4c1c-8052-cb047c16c37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a745110-bf97-4b08-b317-ee448d622368", "name": "network-vif-deleted", "tag": "b69e09a4-e27b-4ea8-8370-034554195284"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:30:01.734259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f7280570-e76e-4ed5-aafe-9e7cb7567814 req-58f67833-5e04-4c1c-8052-cb047c16c37c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:01.734765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f7280570-e76e-4ed5-aafe-9e7cb7567814 req-58f67833-5e04-4c1c-8052-cb047c16c37c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:01.740312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f7280570-e76e-4ed5-aafe-9e7cb7567814 req-58f67833-5e04-4c1c-8052-cb047c16c37c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:01.770435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f7280570-e76e-4ed5-aafe-9e7cb7567814 req-58f67833-5e04-4c1c-8052-cb047c16c37c service nova] Creating event network-vif-deleted:b69e09a4-e27b-4ea8-8370-034554195284 for instance 3a745110-bf97-4b08-b317-ee448d622368 on n-h1-master-1 Oct 16 01:30:01.780275 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f7280570-e76e-4ed5-aafe-9e7cb7567814 req-58f67833-5e04-4c1c-8052-cb047c16c37c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071104 Oct 16 01:30:01.781673 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2845/5545] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:30:02.086210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:02.098729 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-72dfffed-f56f-452e-ae3e-bfabfda53aa1 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1491 microversion: 2.1 time: 0.716812 Oct 16 01:30:02.117466 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2701/5546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:30:01 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1491 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:30:03.133471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:03.134317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:03.148125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:03.154108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:03.154702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:03.157330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:03.157677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:03.158211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:04.616522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:04.626495 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ae0f97e9-5c77-4935-a949-bd8df509d09b tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1491 microversion: 2.1 time: 1.499240 Oct 16 01:30:04.646295 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2846/5547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:30:03 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1491 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:30:05.168748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ea4a3491-ae47-496f-8080-68102f6fec1e req-a882d959-b3b2-4201-8243-1896bc252b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79a1b93-16d9-4003-aa38-d137cbf2e743", "tag": "7eaf7f6a-cef8-485e-b3ac-7efc80279c54"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:30:05.190059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ea4a3491-ae47-496f-8080-68102f6fec1e req-a882d959-b3b2-4201-8243-1896bc252b86 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:05.192357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ea4a3491-ae47-496f-8080-68102f6fec1e req-a882d959-b3b2-4201-8243-1896bc252b86 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:05.193212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ea4a3491-ae47-496f-8080-68102f6fec1e req-a882d959-b3b2-4201-8243-1896bc252b86 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:05.237072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ea4a3491-ae47-496f-8080-68102f6fec1e req-a882d959-b3b2-4201-8243-1896bc252b86 service nova] Creating event network-changed:7eaf7f6a-cef8-485e-b3ac-7efc80279c54 for instance e79a1b93-16d9-4003-aa38-d137cbf2e743 on n-h2-master-1 Oct 16 01:30:05.249649 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ea4a3491-ae47-496f-8080-68102f6fec1e req-a882d959-b3b2-4201-8243-1896bc252b86 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084533 Oct 16 01:30:05.255338 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2702/5548] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:30:05.651063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:05.651746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:05.663275 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:05.664913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:05.668549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:05.669787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:05.672212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:05.673798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:05.679464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:05.826075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4086e3f9784454a0ccfe87cc54a2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec864865dde4a4fa13a54a5057867f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:05.837668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-df929072-20a5-4671-8ed2-9d1f764fc989 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 200 len: 1284 microversion: 2.1 time: 0.190612 Oct 16 01:30:05.851802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2847/5549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:30:05 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 1284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:30:06.871998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:06.873454 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] [instance: e9cf38f8-36c6-4b96-8aa2-b04acc7123da] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:06.890873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:06.907849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:06.908666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:06.910189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:06.910905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:06.911573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:06.939354 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] HTTP exception thrown: Instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da could not be found. Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Request method failure captured: Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da HTTP/1.1 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS14bi8Qvc7j9rzRl5m-n0FPdSit2KodP2tEjiPiomA3gtUsMjFkqhZiaEdxjqss2lnUw7k6BM9iZOzAI8y4kzIrAx9hGb0zZvsYtxPbC9cD8amlfhtSJnAXR2rt7r8d6TCl_w3Y9cwksxU0NyDv82O3WkwG4kAtBSvDNVQEIvsNutss Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 4ec864865dde4a4fa13a54a5057867f1 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerRescueTestJSON-932317592 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4ec864865dde4a4fa13a54a5057867f1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4ec864865dde4a4fa13a54a5057867f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4ec864865dde4a4fa13a54a5057867f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4ec864865dde4a4fa13a54a5057867f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerRescueTestJSON-932317592 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 4ec864865dde4a4fa13a54a5057867f1 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerRescueTestJSON-932317592 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerRescueTestJSON-932317592-project Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 4d4086e3f9784454a0ccfe87cc54a2b2 Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerRescueTestJSON-932317592-project Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: exception: Instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da could not be found. Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'e9cf38f8-36c6-4b96-8aa2-b04acc7123da'} Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da could not be found. Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da could not be found. Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:30:06.942732 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:06.946653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:30:06.946653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:30:06.946653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:30:06.946653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:30:06.946653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:30:06.946653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da could not be found. Oct 16 01:30:06.946653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:30:06.949589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] Returning 404 to user: Instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:30:06.951053 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4ac4c9a3-d997-4549-8452-31530b8087f7 tempest-ServerRescueTestJSON-932317592 tempest-ServerRescueTestJSON-932317592-project] 10.222.0.39 "GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da" status: 404 len: 111 microversion: 2.1 time: 0.086165 Oct 16 01:30:06.956896 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2703/5550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:30:06 2022] GET /compute/v2.1/servers/e9cf38f8-36c6-4b96-8aa2-b04acc7123da => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:30:07.326696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-bbe293dd-889e-4ec7-9d76-b15f1bb562cb req-5daeb80e-669a-4aef-a895-47fd050f5350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cf38f8-36c6-4b96-8aa2-b04acc7123da", "name": "network-vif-deleted", "tag": "27f5a3da-a008-457c-9603-057b3e1dcd1c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:30:07.346400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bbe293dd-889e-4ec7-9d76-b15f1bb562cb req-5daeb80e-669a-4aef-a895-47fd050f5350 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:07.349013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bbe293dd-889e-4ec7-9d76-b15f1bb562cb req-5daeb80e-669a-4aef-a895-47fd050f5350 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:07.349645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bbe293dd-889e-4ec7-9d76-b15f1bb562cb req-5daeb80e-669a-4aef-a895-47fd050f5350 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:07.363114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-bbe293dd-889e-4ec7-9d76-b15f1bb562cb req-5daeb80e-669a-4aef-a895-47fd050f5350 service nova] Creating event network-vif-deleted:27f5a3da-a008-457c-9603-057b3e1dcd1c for instance e9cf38f8-36c6-4b96-8aa2-b04acc7123da on n-h2-master-1 Oct 16 01:30:07.368687 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-bbe293dd-889e-4ec7-9d76-b15f1bb562cb req-5daeb80e-669a-4aef-a895-47fd050f5350 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046396 Oct 16 01:30:07.369888 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2848/5551] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:30:12.993314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-891fa419-ce8a-472c-970f-6a074260c50e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] Calling method '.version_select at 0x7fd64cf80040>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:13.012525 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:13.039790 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-891fa419-ce8a-472c-970f-6a074260c50e tempest-TestSecurityGroupsBasicOps-442732223 tempest-TestSecurityGroupsBasicOps-442732223-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-499898819" status: 202 len: 0 microversion: 2.1 time: 0.051057 Oct 16 01:30:13.043900 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2704/5552] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-499898819 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:30:25.683315 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:30:25.683915 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 01:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 16 01:30:25.684973 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:25.686023 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:25.926429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1330643203", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": "none"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:30:26.070847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:30:26.071577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:30:26.072221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:30:26.072813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:30:26.073392 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:30:26.118279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:26.119354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:26.119995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:26.121172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:26.122026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:26.122738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:26.176051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Getting quotas for project a1ca1a983a354c86a943358b08cc7b4a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:30:26.185935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Getting quotas for user c7809ba59fea42acae2d413125e1e5c0 and project a1ca1a983a354c86a943358b08cc7b4a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:30:26.220557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:30:26.224615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:30:26.362409 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-73caeac3-bad6-4346-8531-7d25e7e45338 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.678220 Oct 16 01:30:26.368136 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2849/5553] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Oct 16 01:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 16 01:30:26.376761 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=17 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:26.382029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d43224d9-d4f7-4861-ac9f-b30670eb37bb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:26.385581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d43224d9-d4f7-4861-ac9f-b30670eb37bb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:27.019416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d43224d9-d4f7-4861-ac9f-b30670eb37bb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:27.042516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d43224d9-d4f7-4861-ac9f-b30670eb37bb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:27.049599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d43224d9-d4f7-4861-ac9f-b30670eb37bb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:27.056827 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d43224d9-d4f7-4861-ac9f-b30670eb37bb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1278 microversion: 2.57 time: 0.682055 Oct 16 01:30:27.060136 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2705/5554] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:26 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1278 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:28.091539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:28.092501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:28.111083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:28.111902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:28.112987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:28.115335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:28.119111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:28.119915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:28.252590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:28.279334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:28.281237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:28.288620 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f11d73ad-4a7f-435d-89d2-c3bc0a8cb7b4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1330 microversion: 2.57 time: 0.202609 Oct 16 01:30:28.289903 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2850/5555] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:28 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1330 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:29.325702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:29.326316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:29.343748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:29.344470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:29.345296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:29.348750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:29.349546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:29.350137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:30.186718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:30.205442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:30.210084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:30.220423 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce6d5e19-6e0d-4307-af08-b40cee84bfde tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1336 microversion: 2.57 time: 0.893901 Oct 16 01:30:30.224360 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2706/5556] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:29 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1336 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:31.261359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:31.263462 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:31.281913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:31.282980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:31.306698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:31.308368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:31.309005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:31.309950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:31.638117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:31.657560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:31.665730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:31.667301 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ceabc50-2f2f-4327-ba03-567e22e96bb2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1357 microversion: 2.57 time: 0.419751 Oct 16 01:30:31.688320 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2851/5557] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:31 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1357 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:30:31.717879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:30:31.747710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:31.784799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:31.785316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:31.785764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:31.786519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:31.787204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:31.787454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:31.989534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:30:31.991649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:30:31.992308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:30:31.992916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:30:31.993749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:30:32.172581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:32.188359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:32.188359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:32.188665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:32.189289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:32.189829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:32.190339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:32.274380 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d23dd063-ffc0-4407-8a99-eb2c38cd06fd tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "POST /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3/action" status: 202 len: 1138 microversion: 2.57 time: 0.584308 Oct 16 01:30:32.293469 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2707/5558] 10.222.0.39 () {62 vars in 1320 bytes} [Sun Oct 16 01:30:31 2022] POST /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3/action => generated 1138 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 16 01:30:32.300668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:32.301296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:32.340600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:32.341555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:32.353501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:32.356038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:32.356504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:32.358191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:32.520530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:32.538639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:32.546301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:32.550833 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-256b3598-8f2e-4ec4-8352-119e04c05161 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.252411 Oct 16 01:30:32.552998 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2852/5559] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:32 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:33.584715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:33.585616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:33.597950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:33.607669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:33.612808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:33.614260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:33.614758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:33.615212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:33.791974 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:33.809806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:33.811402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:33.813102 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81959874-6652-4458-8e57-0b6112194a4d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.234646 Oct 16 01:30:33.813682 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2708/5560] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:33 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:34.842646 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:34.843745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:34.863857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:34.865664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:34.866511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:34.875274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:34.876048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:34.880710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:35.044049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:35.053791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:35.061599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:35.063706 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05537962-397a-4775-8d3b-fa3078f26c13 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.226254 Oct 16 01:30:35.064342 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2853/5561] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:34 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:36.092541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:36.093274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:36.108606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:36.109266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:36.109945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:36.110905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:36.111604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:36.112322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:36.279319 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:36.299949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:36.305968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:36.309420 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-302fc997-7c71-44cb-ab22-14dfc5db7ac8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.221296 Oct 16 01:30:36.330513 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2709/5562] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:36 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:37.341301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:37.342329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:37.366158 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:37.372293 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:37.379671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:37.385416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:37.387377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:37.388343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:37.390208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:37.391498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:37.674150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:37.695512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:37.699293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:37.703480 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8aa69936-9756-4341-ab93-80ece89ff5d2 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.368414 Oct 16 01:30:37.708788 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2854/5563] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:37 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:38.472144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:38.476723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:38.494251 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:38.501085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:38.504769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:38.506363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:38.510949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:38.511640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:38.512239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:38.548890 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f418d63f-b00b-4a82-8c72-9141e73365cf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/ips" status: 200 len: 151 microversion: 2.20 time: 0.084842 Oct 16 01:30:38.555531 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2710/5564] 10.222.0.39 () {60 vars in 1289 bytes} [Sun Oct 16 01:30:38 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/ips => generated 151 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:30:38.741777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:38.743439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:38.758457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:38.759080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:38.759496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:38.760837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:38.773027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:38.773771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:39.346228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:39.364333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:39.366243 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:39.367812 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6634b72f-d167-4486-b0f5-4b8446bbba31 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.630134 Oct 16 01:30:39.383779 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2855/5565] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:38 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:40.401465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:40.405957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:40.430292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:40.440933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:40.444506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:40.449253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:40.450609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:40.453490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:40.771492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:40.788193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:40.793906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:40.797484 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5131d13-01d6-40ae-b4b3-d67b47c503a7 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.404785 Oct 16 01:30:40.801286 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2711/5566] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:40 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:41.830831 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:41.832349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:41.862969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:41.863698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:41.867668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:41.868639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:41.869337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:41.870000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:41.907312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:30:41.908699 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:41.919517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:41.923459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:41.925129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:41.927637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:41.929922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:41.930553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:41.983651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lazy-loading 'flavor' on Instance uuid e79a1b93-16d9-4003-aa38-d137cbf2e743 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:30:42.039097 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:42.070099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:42.078724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:42.092838 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4efd7458-3611-422c-9fc8-614440709387 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.261404 Oct 16 01:30:42.095098 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2856/5567] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:41 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:42.528442 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d4a408b-b59d-4279-b195-8343a8689fb7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/action" status: 202 len: 0 microversion: 2.20 time: 0.625843 Oct 16 01:30:42.531324 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2712/5568] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:30:41 2022] POST /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:30:42.561264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:42.562662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:42.593135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:42.594553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:42.595822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:42.596946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:42.598803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:42.601085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:42.986144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:43.002010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:43.004022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:43.007918 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d1cfdace-f0e7-49db-988c-e11c319ab40d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.467823 Oct 16 01:30:43.011601 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2857/5569] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:42 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:43.133296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:43.134028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:43.156587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:43.163335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:43.163874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:43.168866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:43.169571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:43.170078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:43.376090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:43.391202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:43.397693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:43.402488 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7deedd6f-add1-48d8-9207-709f0691d375 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.279573 Oct 16 01:30:43.405020 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2713/5570] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:43 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:44.042314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:44.043729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:44.055214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:44.056180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:44.056832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:44.057764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:44.059097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:44.060330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:44.308173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:44.317714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:44.319314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:44.320662 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-928f9b9c-6b54-4385-b853-e771d921720b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.286533 Oct 16 01:30:44.321381 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2858/5571] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:44 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:44.439636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:44.441926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:44.450686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:44.451594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:44.452127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:44.453479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:44.453941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:44.454564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:44.528946 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:44.541049 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:44.542876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:44.544906 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74e262cc-ebef-4c27-9ef6-b9994085c447 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.111006 Oct 16 01:30:44.569086 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2714/5572] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:44 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:30:45.352325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:45.354351 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:45.365261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:45.366157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:45.367708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:45.368698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:45.369438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:45.370776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:45.578906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:45.580099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:45.589287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:45.590585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:45.591994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:45.593318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:45.594084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:45.594539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:45.722577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:45.739351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:45.741208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:45.744486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d6f51f5d-9448-4330-8fd6-2a9753d692f4 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.176309 Oct 16 01:30:45.746788 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2715/5573] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:45 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:30:46.036580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:46.045789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:46.050505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:46.056487 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7fd1ed9f-bad4-4f01-9f8b-bdeb0c02bdaf tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.710395 Oct 16 01:30:46.057451 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2859/5574] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:45 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:46.779133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:46.781897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:46.799242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:46.800188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:46.801394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:46.802368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:46.804795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:46.805553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:46.980364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:46.992405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:46.995306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:46.997695 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d6e43cad-277c-4da9-ba62-d5c69b0e859d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.226044 Oct 16 01:30:47.000497 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2716/5575] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:46 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:47.085614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:47.086222 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:47.098272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:47.099195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:47.100846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:47.102204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:47.102559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:47.103223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:47.586978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:47.596066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:47.597583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:47.598810 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca1bd004-0ae4-4c82-8c55-10f039cb0527 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.518788 Oct 16 01:30:47.618690 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2860/5576] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:47 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:48.039451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:48.040964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:48.064883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:48.066664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:48.067374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:48.068454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:48.070669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:48.071521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:48.289514 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:48.299882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:48.309014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:48.314002 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bf93c71f-6386-4e20-8ab2-ef6b551405c5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.287919 Oct 16 01:30:48.316393 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2717/5577] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:48 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:48.635060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:48.642378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:48.673902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:48.676270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:48.677480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:48.678431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:48.679200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:48.680115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:49.172115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:49.183507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:49.185118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:49.186466 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7515f799-2739-4e4f-874d-c213a07a287a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.564619 Oct 16 01:30:49.203648 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2861/5578] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:48 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:49.345958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:49.348229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:49.359829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:49.360503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:49.361002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:49.362059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:49.363586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:49.364142 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:49.594882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:49.599111 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:49.624522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:49.626094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:49.628074 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-873b41b3-bc80-4ec9-b36c-992bac1030da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.285685 Oct 16 01:30:49.643944 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2718/5579] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:49 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:30:50.222201 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:50.223620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:50.233310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:50.234375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:50.235409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:50.237637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:50.242961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:50.243584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:50.548207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:50.565002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:50.568202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:50.574424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cce0ea48-ee20-4913-9e28-70fa6ca89900 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.354515 Oct 16 01:30:50.577655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2862/5580] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:50 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:50.660131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:50.660757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:50.672791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:50.676277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:50.680097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:50.690213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:50.691403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:50.692288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:50.803661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:50.840111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:50.842563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:50.844763 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a970db75-2fb1-4250-9d3d-7751691f68da tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.189076 Oct 16 01:30:50.845778 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2719/5581] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:50 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:51.607352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:51.607968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:51.616400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:51.617137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:51.617724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:51.618727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:51.619357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:51.619930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:51.873427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:51.875207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:51.891052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:51.891847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:51.892387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:51.897796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:51.899540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:51.900193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:52.453993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:52.467236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:52.468638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:52.470463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:52.472359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-025a7667-7dc3-46b7-8e95-9b8c496364ba tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.604432 Oct 16 01:30:52.487569 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2720/5582] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:51 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:30:52.506313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:52.509244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:52.510692 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-779bfeaf-b2c1-450b-8248-320efdfcd22a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.907684 Oct 16 01:30:52.515248 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2863/5583] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:51 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:53.503743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:53.504425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:53.526900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:53.527765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:53.528462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:53.532412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:53.533167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:53.535363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:53.544479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:53.545799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:53.561631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:53.562841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:53.564597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:53.565427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:53.565914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:53.566342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:53.722477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:53.743065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:53.752061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:53.755325 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0626db2d-3a01-4a3c-b994-2fe6be7acf3b tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.258308 Oct 16 01:30:53.756653 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2721/5584] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:53 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:54.121217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:54.132552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:54.134262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:54.135691 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a501536c-df4f-4979-bf42-25d4a5970143 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.595967 Oct 16 01:30:54.154180 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2864/5585] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:53 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:30:54.793803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:54.794559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:54.808613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:54.813608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:54.816628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:54.818053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:54.819595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:54.821912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:55.148928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:55.168808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:55.169433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:55.191881 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:55.195498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:55.195999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:55.196440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:55.197159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:55.197620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:55.198042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:55.199885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:55.201316 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-24ff29ba-995f-49f6-adc2-4ff920ac12eb tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.418919 Oct 16 01:30:55.206991 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2722/5586] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:54 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:55.651236 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:55.662152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:55.672413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:55.675730 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a764350a-5c65-4239-aa51-ce5ef12369f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.516107 Oct 16 01:30:55.677227 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2865/5587] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:55 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:56.233375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:56.234608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:56.242176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:56.242950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:56.243694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:56.244577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:56.245220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:56.245802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:56.368318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:56.380838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:56.382718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:56.387976 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b57c3e3-9346-48a7-908a-d222ce00015d tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.158500 Oct 16 01:30:56.391036 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2723/5588] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:56 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:56.726900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:56.728874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:56.734046 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:56.759335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:56.762017 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:56.762471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:56.763434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:56.766259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:56.766531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:56.774587 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=99 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:57.156066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:57.170576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:57.176034 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:57.177332 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5d59e08c-ec79-42a3-8965-05697b8bb7ce tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.469361 Oct 16 01:30:57.178149 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2866/5589] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:56 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:57.416061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:57.417941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:57.421221 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:30:57.449296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:57.449808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:57.450258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:57.451012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:57.451494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:57.451926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:57.584115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:57.598156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:57.598156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:57.598851 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c4313965-3bea-4933-9b02-5795e14fcb97 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.186964 Oct 16 01:30:57.613195 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2724/5590] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:57 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:58.205100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:58.206285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:58.217554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:58.218048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:58.218481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:58.231453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:58.232027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:58.232477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:58.568977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:58.578349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:58.580047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:58.582113 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-344f38fd-4a31-4b78-8c8f-ec466f372bbe tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.380887 Oct 16 01:30:58.598016 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2867/5591] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:58 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:58.640244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:58.642271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:58.652650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:58.653587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:58.654603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:58.655741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:58.656527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:58.657122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:58.859881 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:58.880236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:58.881999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:30:58.883476 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fa93642c-2a74-42cd-b64f-6af1ef946c9e tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1366 microversion: 2.57 time: 0.258907 Oct 16 01:30:58.884847 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2725/5592] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:58 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:30:59.609913 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:59.610628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:59.619934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:59.621817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:59.622804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:59.625539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:59.626326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:59.627028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:59.913794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:30:59.915147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:30:59.928693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:59.929109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:59.929557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:59.930275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:30:59.934519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:30:59.935983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:30:59.998123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:00.016538 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:00.018974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:00.020386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec0025e6-8660-454a-acac-5badf5e475b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1740 microversion: 2.20 time: 0.414508 Oct 16 01:31:00.021628 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2868/5593] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:59 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:00.037655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:00.057261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:00.059794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:00.061953 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-02d974c0-15e0-4981-9fbd-692171ab96a8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1372 microversion: 2.57 time: 0.152742 Oct 16 01:31:00.073293 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2726/5594] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:30:59 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:01.047111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:01.048131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:01.072967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:01.076093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:01.082932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:01.084109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:01.084768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:01.085446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:01.093577 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:01.095075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:01.110384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:01.111376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:01.117489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:01.118510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:01.119217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:01.120625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:01.361296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:01.376481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:01.379371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:01.385296 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bed2e975-ee45-47ea-a417-d43befa961d8 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1372 microversion: 2.57 time: 0.293849 Oct 16 01:31:01.387272 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2727/5595] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:01 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1372 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:01.608065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:01.623334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:01.631200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:01.633824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e5090293-63eb-4ec6-b00b-8d7eaac68552 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.590163 Oct 16 01:31:01.636384 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2869/5596] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:01 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:02.417048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:02.418487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:02.428718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:02.434181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:02.434800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:02.435692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:02.437921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:02.439356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:02.664139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:02.664943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:02.678731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:02.679395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:02.679931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:02.683665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:02.684262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:02.685176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:02.693991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:02.707816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:02.709860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:02.711516 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-38f3e922-2549-4bd9-9a30-c0b0e2970741 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1357 microversion: 2.57 time: 0.299518 Oct 16 01:31:02.740785 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2728/5597] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:02 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1357 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:02.751768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:02.753168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:02.770811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:02.771628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:02.772238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:02.773128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:02.773796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:02.774803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:02.805982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:31:02.986395 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d694af1b-56b4-4319-8170-0cac8559ffad tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 204 len: 0 microversion: 2.57 time: 0.239096 Oct 16 01:31:02.991060 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2729/5598] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:31:02 2022] DELETE /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:31:02.996784 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:02.997503 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:03.006652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:03.011275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:03.012249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:03.015355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:03.016065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:03.016829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:03.174866 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:03.185238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:03.190699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:03.197141 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f2e931e-0c88-41ab-be2f-69827d84adda tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.537839 Oct 16 01:31:03.197998 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2870/5599] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:02 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:03.208358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:03.223962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:03.227669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:03.233002 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-14f1130a-85b1-4dc7-9230-b6f61b4b4887 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1363 microversion: 2.57 time: 0.240523 Oct 16 01:31:03.233699 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2730/5600] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:02 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:03.518376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-fd4e6ced-00a9-46cf-9443-d085f463f750 req-e5c84ba7-32ba-46d2-a5c0-f3cfa23b5d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79a1b93-16d9-4003-aa38-d137cbf2e743", "name": "network-vif-plugged", "status": "completed", "tag": "7eaf7f6a-cef8-485e-b3ac-7efc80279c54"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:31:03.540091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fd4e6ced-00a9-46cf-9443-d085f463f750 req-e5c84ba7-32ba-46d2-a5c0-f3cfa23b5d1e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:03.541873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fd4e6ced-00a9-46cf-9443-d085f463f750 req-e5c84ba7-32ba-46d2-a5c0-f3cfa23b5d1e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:03.545865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fd4e6ced-00a9-46cf-9443-d085f463f750 req-e5c84ba7-32ba-46d2-a5c0-f3cfa23b5d1e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:03.571217 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-fd4e6ced-00a9-46cf-9443-d085f463f750 req-e5c84ba7-32ba-46d2-a5c0-f3cfa23b5d1e service nova] Creating event network-vif-plugged:7eaf7f6a-cef8-485e-b3ac-7efc80279c54 for instance e79a1b93-16d9-4003-aa38-d137cbf2e743 on n-h2-master-1 Oct 16 01:31:03.591138 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-fd4e6ced-00a9-46cf-9443-d085f463f750 req-e5c84ba7-32ba-46d2-a5c0-f3cfa23b5d1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078588 Oct 16 01:31:03.592263 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2871/5601] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:31:04.223619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:04.224846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:04.243217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:04.244238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:04.244881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:04.245820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:04.246474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:04.247132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:04.267419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:04.268468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:04.279475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:04.283258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:04.283834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:04.284896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:04.286567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:04.287099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:04.867769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:04.880099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:04.881841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:04.882947 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f4e97509-5d94-4c9f-b14e-bdb216f3fab9 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1363 microversion: 2.57 time: 0.621599 Oct 16 01:31:04.883599 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2872/5602] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:04 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1363 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:05.521884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:05.530403 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:05.531879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:05.533080 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6b43cad-78e6-4c44-b463-6e997f65ed24 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 1.314030 Oct 16 01:31:05.559367 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2731/5603] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:04 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:05.918418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:05.919148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:05.931490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:05.931993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:05.932436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:05.933181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:05.941215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:05.941806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:06.036481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:06.039315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:06.039777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:06.043007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lazy-loading 'fault' on Instance uuid d722f831-28e0-4389-a8ae-30158b82b2d3 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:31:06.197950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:06.213672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:06.218186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7809ba59fea42acae2d413125e1e5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ca1a983a354c86a943358b08cc7b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:06.219482 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f20084f-87a4-4932-8e20-c17ea2369c0a tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 200 len: 1368 microversion: 2.57 time: 0.307055 Oct 16 01:31:06.220062 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2873/5604] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:05 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 1368 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:06.565541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:06.566325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:06.624767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:06.625280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:06.625729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:06.626488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:06.627014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:06.628181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:07.251918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:07.253639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] [instance: d722f831-28e0-4389-a8ae-30158b82b2d3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:07.271490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:07.273068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:07.275992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:07.278440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:07.279120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:07.279715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:07.343202 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] HTTP exception thrown: Instance d722f831-28e0-4389-a8ae-30158b82b2d3 could not be found. Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Request method failure captured: Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 HTTP/1.1 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS16xy-xF08JQd_v8J-EB1HOkmjuxM11sq6mmy0WB491B--IrSaH7iGPuA14EmUOsPvNGiac58FhTzKTdp2vbGnO5sahhDJbFoigOe9nZZnkIacpuPVSYECJWcQRn700XEO-ORMbP4TbVyQj3QZzoHUdYeggivLb80p-13pGmU1t_gxc Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.57 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: a1ca1a983a354c86a943358b08cc7b4a Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerShowV257Test-1981769269 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a1ca1a983a354c86a943358b08cc7b4a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a1ca1a983a354c86a943358b08cc7b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1ca1a983a354c86a943358b08cc7b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1ca1a983a354c86a943358b08cc7b4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerShowV257Test-1981769269 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: a1ca1a983a354c86a943358b08cc7b4a Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerShowV257Test-1981769269 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerShowV257Test-1981769269-project Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c7809ba59fea42acae2d413125e1e5c0 Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerShowV257Test-1981769269-project Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: exception: Instance d722f831-28e0-4389-a8ae-30158b82b2d3 could not be found. Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'd722f831-28e0-4389-a8ae-30158b82b2d3'} Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d722f831-28e0-4389-a8ae-30158b82b2d3 could not be found. Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d722f831-28e0-4389-a8ae-30158b82b2d3 could not be found. Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:31:07.345549 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d722f831-28e0-4389-a8ae-30158b82b2d3 could not be found. Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] Returning 404 to user: Instance d722f831-28e0-4389-a8ae-30158b82b2d3 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:31:07.351460 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b348e11-5428-433b-af29-ed7a2559f1e5 tempest-ServerShowV257Test-1981769269 tempest-ServerShowV257Test-1981769269-project] 10.222.0.39 "GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3" status: 404 len: 111 microversion: 2.57 time: 0.103842 Oct 16 01:31:07.352062 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2874/5605] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:07 2022] GET /compute/v2.1/servers/d722f831-28e0-4389-a8ae-30158b82b2d3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:31:07.362008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:07.371262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:07.380135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:07.389816 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0df90814-7eff-480f-9fd3-07fbf6c4982d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.828986 Oct 16 01:31:07.390772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2732/5606] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:06 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:08.422280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:08.423077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:08.435874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:08.436918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:08.439234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:08.441261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:08.448419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:08.449965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:09.382596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:09.397782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:09.399326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:09.400546 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77f18df0-3b71-4179-9a48-c4cc4ec96c95 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.982170 Oct 16 01:31:09.401119 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2875/5607] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:08 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:10.432599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:10.433223 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:10.454762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:10.455958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:10.457500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:10.458390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:10.459053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:10.459779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:11.097487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:11.110109 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:11.128929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:11.135671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:11.184086 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3c2b439c-7838-4ea5-b7db-f370a876b1e5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.755595 Oct 16 01:31:11.186649 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2733/5608] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:10 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:12.217262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:12.217884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:12.240495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:12.241005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:12.246807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:12.250213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:12.257887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:12.258400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:12.716973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:12.726169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:12.735366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:12.739458 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fb8118e9-6c84-4967-8b42-44aa1b5109f6 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.526763 Oct 16 01:31:12.740245 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2876/5609] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:12 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:13.771363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:13.771981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:13.795053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:13.796215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:13.796878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:13.800364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:13.801180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:13.801872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:14.507733 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:14.517493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:14.519748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:14.520949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e5fb7e3c-3ae1-4911-96db-981ea7451df9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.754846 Oct 16 01:31:14.531062 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2734/5610] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:13 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:15.559520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:15.560369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:15.586011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:15.586668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:15.587313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:15.588207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:15.590170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:15.590730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:16.054592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:16.068909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:16.071918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:16.075901 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f3d8e775-6c71-4d94-b699-957818dea64c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.518076 Oct 16 01:31:16.077900 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2877/5611] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:15 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:17.108801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:17.124050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:17.165324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:17.167075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:17.173117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:17.174007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:17.174590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:17.175237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:17.787688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:17.799727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:17.804748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:17.807908 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-82791da6-2fab-494b-87b5-58d82da0f2ea tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.703058 Oct 16 01:31:17.823274 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2735/5612] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:17 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:18.837681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:18.841941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:18.853441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:18.854268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:18.854900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:18.858622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:18.859294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:18.860062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:19.718476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:19.746612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:19.750024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:19.752009 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b4983df5-c331-425d-ad6b-8c185a67059c tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.918150 Oct 16 01:31:19.753382 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2878/5613] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:18 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:20.785753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:20.788278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:20.806003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:20.807788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:20.811487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:20.812332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:20.814438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:20.815584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:22.135643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:22.145875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:22.151939 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:22.157202 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aecc89db-7c47-47f9-b06b-b4f39633c34f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 1.378067 Oct 16 01:31:22.180960 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2736/5614] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:20 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:23.189069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:23.190490 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:23.202241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:23.207327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:23.214490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:23.216151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:23.216840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:23.218318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:23.894370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:23.926878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:23.928484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:23.933435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9598779c-66a6-4ea5-ac6e-7422a531738f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1735 microversion: 2.20 time: 0.749236 Oct 16 01:31:23.934738 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2879/5615] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:23 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1735 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:24.963571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:24.968639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:24.983836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:24.984558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:24.985394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:24.988464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:24.989372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:24.990213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:26.012321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:26.029977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:26.031458 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:26.032676 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-edb464bb-3227-47b6-81fd-3b87775c7b7b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1717 microversion: 2.20 time: 1.074683 Oct 16 01:31:26.043356 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2737/5616] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:24 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1717 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:27.064387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:27.066401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:27.077166 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=30 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:27.081783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:27.086542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:27.087270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:27.089922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:27.090605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:27.091266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:27.105315 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=78 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:28.115037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:28.128363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:28.134204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:28.136397 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a1da24ea-4e69-4f8e-8f8c-70a75c9dd258 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1717 microversion: 2.20 time: 1.076230 Oct 16 01:31:28.152294 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2880/5617] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:27 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1717 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:29.169868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:29.170483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:29.188732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:29.193212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:29.194779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:29.197649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:29.199221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:29.201436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:29.345015 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-663450ef-922b-4432-98b0-01fb2c180f3a req-3b51a217-6512-4466-8fe2-65b7419ca8bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79a1b93-16d9-4003-aa38-d137cbf2e743", "name": "network-vif-unplugged", "status": "completed", "tag": "7eaf7f6a-cef8-485e-b3ac-7efc80279c54"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:31:29.350650 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:29.371018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-663450ef-922b-4432-98b0-01fb2c180f3a req-3b51a217-6512-4466-8fe2-65b7419ca8bb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:29.374262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-663450ef-922b-4432-98b0-01fb2c180f3a req-3b51a217-6512-4466-8fe2-65b7419ca8bb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:29.374898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-663450ef-922b-4432-98b0-01fb2c180f3a req-3b51a217-6512-4466-8fe2-65b7419ca8bb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:29.436332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.compute.server_external_events [req-663450ef-922b-4432-98b0-01fb2c180f3a req-3b51a217-6512-4466-8fe2-65b7419ca8bb service nova] Unable to find a host for instance e79a1b93-16d9-4003-aa38-d137cbf2e743. Dropping event network-vif-unplugged {{(pid=120546) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 16 01:31:29.437829 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-663450ef-922b-4432-98b0-01fb2c180f3a req-3b51a217-6512-4466-8fe2-65b7419ca8bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.410734 Oct 16 01:31:29.439183 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2738/5618] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 412 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 16 01:31:29.622113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:29.636599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:29.642140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:29.645258 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad9959cd-10d7-421e-bfd2-9054e0daad0b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1660 microversion: 2.20 time: 0.478510 Oct 16 01:31:29.646220 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2881/5619] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:29 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1660 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:29.679062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67e957ed-9687-456d-a516-4866cdd8be1b"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:31:29.682012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:29.699787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:29.700559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:29.702806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:29.704121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:29.707336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:29.707898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:30.228253 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2a0f449-fcb3-476d-84e2-3505ee9853d4 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.554509 Oct 16 01:31:30.235294 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2739/5620] 10.222.0.39 () {62 vars in 1364 bytes} [Sun Oct 16 01:31:29 2022] POST /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/os-volume_attachments => generated 188 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:31:30.433456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:30.434158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:30.447971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:30.448775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:30.449378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:30.450483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:30.451134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:30.451726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:30.850164 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2b5dc3eb-e002-4262-b41d-4ea5a361d47b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/os-volume_attachments/67e957ed-9687-456d-a516-4866cdd8be1b" status: 202 len: 0 microversion: 2.20 time: 0.422258 Oct 16 01:31:30.851394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2882/5621] 10.222.0.39 () {60 vars in 1457 bytes} [Sun Oct 16 01:31:30 2022] DELETE /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/os-volume_attachments/67e957ed-9687-456d-a516-4866cdd8be1b => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:31:30.972762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:31:30.975233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:30.998826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:31.011730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:31.012451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:31.013577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:31.014281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:31.014945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:31.089336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120546) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 01:31:31.244191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b5863085-07c1-4743-988e-1997c93a060d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "POST /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/action" status: 202 len: 0 microversion: 2.20 time: 0.276181 Oct 16 01:31:31.253850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:31.254519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:31.261840 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2740/5622] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Oct 16 01:31:30 2022] POST /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:31:31.269183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:31.269917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:31.270616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:31.271851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:31.272470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:31.273055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:31.695307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:31.708088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:31.709817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:31.711269 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e15c89d2-944a-4078-b164-85199a5990f9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1668 microversion: 2.20 time: 0.461991 Oct 16 01:31:31.712095 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2883/5623] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:31 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1668 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:32.754879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:32.755751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:32.769308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:32.769949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:32.770490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:32.771333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:32.771892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:32.772598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:33.209231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:33.244093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:33.249087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:33.252098 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b04790bd-ee4c-4964-916c-cfe9b62665c7 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1668 microversion: 2.20 time: 0.507595 Oct 16 01:31:33.253229 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2741/5624] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:32 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1668 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:34.280904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:34.281519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:34.295645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:34.311705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:34.312169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:34.312922 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:34.313648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:34.314075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:34.783205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:34.800040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:34.801757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:34.803688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5aa539d8-64ce-49b6-bae0-f58ee1cae498 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.526830 Oct 16 01:31:34.818956 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2884/5625] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:34 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:35.845342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:35.847467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:35.858741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:35.860849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:35.861932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:35.866381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:35.867827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:35.869004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:36.448133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:36.458789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:36.460638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:36.462055 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c3a965b-a42f-443b-9615-4d01ad49375a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.621818 Oct 16 01:31:36.463140 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2742/5626] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:35 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:37.495299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:37.496508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:37.528057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:37.536923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:37.541345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:37.541990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:37.542526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:37.542989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:38.092876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2a5f3eef-131d-49c4-89c0-dcd065cf783e req-24003a0b-9698-4c11-9acf-0e00812abca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79a1b93-16d9-4003-aa38-d137cbf2e743", "tag": "7eaf7f6a-cef8-485e-b3ac-7efc80279c54"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:31:38.106527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a5f3eef-131d-49c4-89c0-dcd065cf783e req-24003a0b-9698-4c11-9acf-0e00812abca7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:38.107369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a5f3eef-131d-49c4-89c0-dcd065cf783e req-24003a0b-9698-4c11-9acf-0e00812abca7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:38.108047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a5f3eef-131d-49c4-89c0-dcd065cf783e req-24003a0b-9698-4c11-9acf-0e00812abca7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:38.128545 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2a5f3eef-131d-49c4-89c0-dcd065cf783e req-24003a0b-9698-4c11-9acf-0e00812abca7 service nova] Creating event network-changed:7eaf7f6a-cef8-485e-b3ac-7efc80279c54 for instance e79a1b93-16d9-4003-aa38-d137cbf2e743 on n-h1-master-1 Oct 16 01:31:38.135923 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2a5f3eef-131d-49c4-89c0-dcd065cf783e req-24003a0b-9698-4c11-9acf-0e00812abca7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309812 Oct 16 01:31:38.136854 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2743/5627] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:31:38.168681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:38.187548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:38.189652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:38.191256 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0a1f961-4bf8-48d9-b51a-c619bb76d4ee tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.701312 Oct 16 01:31:38.191838 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2885/5628] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:37 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:39.222906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:39.223647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:39.230589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:39.231355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:39.231806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:39.232525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:39.233264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:39.233862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:39.795547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:39.820041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:39.823257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:39.827146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-99dc8497-597e-4fb7-9710-a78fd4f5e276 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.610450 Oct 16 01:31:39.832549 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2744/5629] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:39 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:40.860208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:40.861743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:40.880808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:40.891025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:40.891760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:40.893170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:40.902162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:40.904529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:41.919198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:41.937033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:41.941880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:41.955460 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d099f6e-0717-4ebb-a9e3-9f1566f49bfd tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 1.100157 Oct 16 01:31:41.974859 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2886/5630] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:40 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:43.000728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:43.008053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:43.035661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:43.047830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:43.051164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:43.053166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:43.059639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:43.060656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:43.228915 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-2129321292", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "ae710778-7669-4262-a4eb-42693f199d8b"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:31:43.396771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] validate_networks() for [('ae710778-7669-4262-a4eb-42693f199d8b', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:31:44.269446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:44.292005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:44.296179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:44.302254 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a00fd289-f580-49be-a9fa-70fd44ff894d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 1.318716 Oct 16 01:31:44.305349 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2887/5631] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:42 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:45.072237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:31:45.072770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:31:45.073358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:31:45.074053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:31:45.074761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:31:45.094815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:45.096122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:45.097102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:45.098144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:45.100192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:45.105275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:45.125382 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:45.165316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Getting quotas for project d136775e094041b4bc669a95c11dd1e4. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:31:45.184159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Getting quotas for user 1d6d6b9af8af4d399c78e0b22b0da004 and project d136775e094041b4bc669a95c11dd1e4. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:31:45.218318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:31:45.226780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:31:45.337668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:45.339554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:45.355058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:45.356635 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e9f312c0-2c33-48c2-b6e9-b87b179277e9 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.884002 Oct 16 01:31:45.362014 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2745/5632] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:31:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:31:45.363645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:45.369365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:45.372828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:45.375140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:45.377627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:45.386888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-20ad454f-afa0-404b-bb18-da27cfc75092 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:45.402999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-20ad454f-afa0-404b-bb18-da27cfc75092 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:45.581707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-20ad454f-afa0-404b-bb18-da27cfc75092 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:45.613027 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-20ad454f-afa0-404b-bb18-da27cfc75092 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1228 microversion: 2.1 time: 0.244011 Oct 16 01:31:45.613638 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2746/5633] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:45 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1228 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:31:46.023824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:46.033656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:46.046594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:46.052346 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbef277a-029d-4a68-8991-b2b83f82e79b tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.719038 Oct 16 01:31:46.055534 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2888/5634] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:45 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:46.653552 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ff6b802-b7e7-465e-87a0-ee22728fee7c tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:46.657062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ff6b802-b7e7-465e-87a0-ee22728fee7c tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:46.863837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ff6b802-b7e7-465e-87a0-ee22728fee7c tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:46.873860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ff6b802-b7e7-465e-87a0-ee22728fee7c tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1228 microversion: 2.1 time: 0.235945 Oct 16 01:31:46.885683 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2747/5635] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:46 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1228 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:31:47.086244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:47.086858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:47.121661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:47.122173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:47.122694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:47.140061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:47.147878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:47.148594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:47.604006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:47.613627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:47.620729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:47.622536 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cdb8929c-45e2-4c91-9322-63d321f96d43 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.540170 Oct 16 01:31:47.642232 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2889/5636] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:47 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:47.909126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:47.910513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:47.935795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:47.936543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:47.939017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:47.940625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:47.942895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:47.944136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:48.260896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:48.274852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-002c5134-fdb6-4052-85e2-d7763a10f8e0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1280 microversion: 2.1 time: 0.370821 Oct 16 01:31:48.275910 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2748/5637] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:47 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1280 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:31:48.654452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:48.655175 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:48.671337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:48.671894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:48.685182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:48.686346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:48.687006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:48.687573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:49.257579 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:49.271722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:49.277952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:49.277952 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c3e2e92c-4d08-4d65-b0b2-c7d89b4f3656 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.625175 Oct 16 01:31:49.303770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:49.304399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:49.310193 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2890/5638] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:48 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:49.328766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:49.329367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:49.342793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:49.344788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:49.349154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:49.350893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:49.640085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:49.659894 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d0afa79-fd60-4b8a-8390-3c318e98f59e tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1286 microversion: 2.1 time: 0.355230 Oct 16 01:31:49.662976 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2749/5639] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:49 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1286 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:31:50.313168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:50.315008 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:50.324527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:50.326883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:50.327516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:50.328397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:50.329112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:50.330593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:50.693109 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:50.695900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:50.711420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:50.717398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:50.732742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:50.733995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:50.735511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:50.737156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:51.014592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:51.057319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-570adcef-785d-4baa-b71e-f07c1dbb210b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1286 microversion: 2.1 time: 0.372041 Oct 16 01:31:51.059331 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2750/5640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:50 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1286 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:31:51.127808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:51.143930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:51.149656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:51.151138 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8fd915be-85fb-4bb6-add2-25aa447e850d tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.843089 Oct 16 01:31:51.156932 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2891/5641] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:50 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:52.089202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:52.089872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:52.106909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:52.118187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:52.123593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:52.124683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:52.127974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:52.128669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:52.193850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:52.195257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:52.212904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:52.215140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:52.216975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:52.228439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:52.229982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:52.235935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:52.646312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:52.658128 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3c0e4d70-2e7d-4a74-b6fe-2667cd27f4d6 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1286 microversion: 2.1 time: 0.572713 Oct 16 01:31:52.670349 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2751/5642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:52 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1286 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:31:52.873315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:52.887345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:52.888800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:52.895903 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d0b10b2-3bdb-47fe-a2af-261d2a55601f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.707451 Oct 16 01:31:52.896510 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2892/5643] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:52 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 16 01:31:53.697009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:53.698542 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:53.753483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:53.760095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:53.760841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:53.761954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:53.763221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:53.765527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:53.929323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:53.930788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:53.952731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:53.958009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:53.958676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:53.969184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:53.971851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:53.972586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:54.940344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:54.956524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:54.961894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:54.962213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:54.963949 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7d861119-d87e-4be5-8f3f-cf18f6697501 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 1.038901 Oct 16 01:31:54.971041 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1bb192c8-8570-417e-9fc6-d42e17aaadca tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1328 microversion: 2.1 time: 1.278044 Oct 16 01:31:54.974075 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2752/5644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:53 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1328 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:31:54.980942 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2893/5645] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:53 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:56.002576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:56.003754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:56.004342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:56.007228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:56.033436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:56.034231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:56.034428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:56.035291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:56.035781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:56.036238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:56.040223 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:56.045783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:56.046319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:56.046828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:56.047639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:56.048128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:56.049104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:56.066644 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:56.473063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:56.485911 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:56.488200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:56.491679 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af36f8f0-0e4c-46e6-9b32-5cb5e5f1f3e0 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.501852 Oct 16 01:31:56.492541 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2753/5646] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:55 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:56.493855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:56.498164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-84ae1930-4539-4fc1-9ed0-27f6e531ea44 req-ffd77861-da25-4072-840c-9b9c31fa69c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1981f33a-f45a-4b07-8105-fa1dd10d88dd", "tag": "d029bc6d-e840-493b-9ab1-fff7418fc50c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:31:56.502898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7d8e405-a6c5-4c94-b681-827634690f5a tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1328 microversion: 2.1 time: 0.506494 Oct 16 01:31:56.503592 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2894/5647] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:55 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1328 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:31:56.521832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-84ae1930-4539-4fc1-9ed0-27f6e531ea44 req-ffd77861-da25-4072-840c-9b9c31fa69c3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:56.523348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-84ae1930-4539-4fc1-9ed0-27f6e531ea44 req-ffd77861-da25-4072-840c-9b9c31fa69c3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:56.524028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-84ae1930-4539-4fc1-9ed0-27f6e531ea44 req-ffd77861-da25-4072-840c-9b9c31fa69c3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:56.559139 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-84ae1930-4539-4fc1-9ed0-27f6e531ea44 req-ffd77861-da25-4072-840c-9b9c31fa69c3 service nova] Creating event network-changed:d029bc6d-e840-493b-9ab1-fff7418fc50c for instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd on n-h2-master-1 Oct 16 01:31:56.566947 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-84ae1930-4539-4fc1-9ed0-27f6e531ea44 req-ffd77861-da25-4072-840c-9b9c31fa69c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072123 Oct 16 01:31:56.569490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2754/5648] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:31:57.520691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:57.521297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:57.527660 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=30 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:57.532457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:57.532999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:57.540976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:57.541972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:57.542660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:57.543330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:57.552161 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=10 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:31:57.561271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:57.562368 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:57.588187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:57.588962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:57.591304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:57.592343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:57.596607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:57.597304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:57.750908 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:57.759517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:57.760973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:57.762203 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-86c8af7b-db11-4649-8a88-319930b71fdb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.245540 Oct 16 01:31:57.775226 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2895/5649] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:57 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:31:57.828940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:57.837622 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9026748-8533-4427-ab90-2fe8b33b2ae8 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1328 microversion: 2.1 time: 0.294945 Oct 16 01:31:57.838019 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2755/5650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:57 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:31:58.790146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:58.792635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:58.818170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:58.820215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:58.821963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:58.826088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:58.827782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:58.828524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:58.864148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:31:58.865782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:31:58.899895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:58.900766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:58.901563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:58.906354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:31:58.909981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:31:58.910667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:31:59.373511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:59.383853 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39119a0f-5ed2-4f00-a3af-70572b14a7ad tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1328 microversion: 2.1 time: 0.526605 Oct 16 01:31:59.384448 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2756/5651] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:31:58 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1328 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:31:59.403116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:59.423383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:59.428137 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:31:59.431824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22b0f366-884b-4a3a-9a5e-ea7824d52c2a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.644799 Oct 16 01:31:59.433410 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2896/5652] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:31:58 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:00.415820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:00.417114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:00.432714 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:00.434663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:00.442674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:00.443253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:00.444015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:00.444484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:00.444919 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:00.469644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:00.472241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:00.500535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:00.505625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:00.507324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:00.508454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:00.509150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:00.509865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:00.762483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:00.789515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:00.801227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:00.803260 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-96517ce6-6cb7-4c98-830c-696eb499bcb5 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.337783 Oct 16 01:32:00.805480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:00.807797 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2897/5653] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:00 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:00.824405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6e79c650-88dc-442c-b6fd-3b1fb0754645 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1328 microversion: 2.1 time: 0.404527 Oct 16 01:32:00.825627 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2757/5654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:00 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1328 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:00.832610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-aa3d00db-d59f-4553-bc76-4b74e7874bca req-27755eec-af89-4842-a704-d03379caa66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79a1b93-16d9-4003-aa38-d137cbf2e743", "name": "network-vif-plugged", "status": "completed", "tag": "7eaf7f6a-cef8-485e-b3ac-7efc80279c54"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:32:00.861508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-aa3d00db-d59f-4553-bc76-4b74e7874bca req-27755eec-af89-4842-a704-d03379caa66f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:00.862203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-aa3d00db-d59f-4553-bc76-4b74e7874bca req-27755eec-af89-4842-a704-d03379caa66f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:00.862203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-aa3d00db-d59f-4553-bc76-4b74e7874bca req-27755eec-af89-4842-a704-d03379caa66f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:00.876311 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-aa3d00db-d59f-4553-bc76-4b74e7874bca req-27755eec-af89-4842-a704-d03379caa66f service nova] Creating event network-vif-plugged:7eaf7f6a-cef8-485e-b3ac-7efc80279c54 for instance e79a1b93-16d9-4003-aa38-d137cbf2e743 on n-h1-master-1 Oct 16 01:32:00.882160 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-aa3d00db-d59f-4553-bc76-4b74e7874bca req-27755eec-af89-4842-a704-d03379caa66f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070767 Oct 16 01:32:00.883187 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2898/5655] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:32:01.831965 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:01.832572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:01.860506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:01.861605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:01.862076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:01.862950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:01.863425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:01.863861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:01.865489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:01.866267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:01.882576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:01.884802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:01.885912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:01.887890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:01.888419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:01.892088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:02.256506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:02.270488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:02.271970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:02.273375 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2aa051e-21a1-4704-8fb4-2fc1fccd13b8 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.445620 Oct 16 01:32:02.295822 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2758/5656] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:01 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:02.308503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:02.320758 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22562ceb-dece-43f7-a44a-501f6632af96 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1328 microversion: 2.1 time: 0.462769 Oct 16 01:32:02.332409 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2899/5657] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:01 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1328 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:02.902700 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-7491eb9d-46c9-4251-aa9b-075ec45f0100 req-71cf65bc-0d85-4d89-aa09-c911216b95df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1981f33a-f45a-4b07-8105-fa1dd10d88dd", "name": "network-vif-plugged", "status": "completed", "tag": "d029bc6d-e840-493b-9ab1-fff7418fc50c"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:32:02.920465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7491eb9d-46c9-4251-aa9b-075ec45f0100 req-71cf65bc-0d85-4d89-aa09-c911216b95df service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:02.920960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7491eb9d-46c9-4251-aa9b-075ec45f0100 req-71cf65bc-0d85-4d89-aa09-c911216b95df service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:02.921395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7491eb9d-46c9-4251-aa9b-075ec45f0100 req-71cf65bc-0d85-4d89-aa09-c911216b95df service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:02.956129 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-7491eb9d-46c9-4251-aa9b-075ec45f0100 req-71cf65bc-0d85-4d89-aa09-c911216b95df service nova] Creating event network-vif-plugged:d029bc6d-e840-493b-9ab1-fff7418fc50c for instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd on n-h2-master-1 Oct 16 01:32:02.962771 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-7491eb9d-46c9-4251-aa9b-075ec45f0100 req-71cf65bc-0d85-4d89-aa09-c911216b95df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065584 Oct 16 01:32:02.963936 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2759/5658] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:32:03.303921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:03.304766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:03.317665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:03.318170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:03.318640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:03.322332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:03.322818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:03.323331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:03.348390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:03.349107 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:03.360854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:03.361543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:03.361994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:03.375767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:03.376382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:03.377205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:03.741697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:03.748255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:03.756724 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-96a9fbb7-3e3a-41ae-85c5-cc92dc244f68 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1328 microversion: 2.1 time: 0.412551 Oct 16 01:32:03.758470 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2760/5659] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:03 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1328 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:32:03.759822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:03.761484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:03.763089 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0cc6c893-3fa3-47fe-b72e-ae5388044099 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1726 microversion: 2.20 time: 0.463551 Oct 16 01:32:03.764096 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2900/5660] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:03 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1726 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:04.804599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:04.806037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:04.809412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:04.810711 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:04.820240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:04.822860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:04.823851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:04.825433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:04.826435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:04.827479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:04.827951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:04.828651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:04.829377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:04.833464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:04.834253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:04.834985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:05.106905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:05.114537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:05.126087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:05.139384 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74f886bd-e608-40f1-83a0-589b0e3d1d27 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1528 microversion: 2.1 time: 0.335803 Oct 16 01:32:05.140287 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2761/5661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:04 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1528 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:05.148139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:05.163013 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f60e733-f835-4ad2-8bb5-ac8afcc32588 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1713 microversion: 2.20 time: 0.362491 Oct 16 01:32:05.163762 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2901/5662] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:04 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1713 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:05.195607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:05.196156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:05.213299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:05.216484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:05.217127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:05.220186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:05.221941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:05.224912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:05.531606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:05.552417 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a15c697-a70d-46da-8b45-b7bb1168d4ed tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1528 microversion: 2.1 time: 0.389319 Oct 16 01:32:05.567273 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2762/5663] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:05 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1528 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:06.132463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:06.133133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:06.139911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.140854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.141502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.142430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.143767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.145162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.169150 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] HTTP exception thrown: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Request method failure captured: Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd HTTP/1.1 Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS179xqRqZJhXIpsd9r74uLkVkaSdEO0ULL6EIRPYKCJZWcbyxrifjLmaoEgYA3bhcOyPkt3Xdx1Rm-SQ4dQn6Cprh_h4jFAapWmmQpdM-rPwUaTfGQo5GgxqyHQfzo1yJnIUVtqwVc3qZJR8s-99EjEn78xOJBhufEm95LJ-tr4klZc Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e4d0965b1cdc4667b3436cf8d16397fd Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1683423246 Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e4d0965b1cdc4667b3436cf8d16397fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e4d0965b1cdc4667b3436cf8d16397fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e4d0965b1cdc4667b3436cf8d16397fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e4d0965b1cdc4667b3436cf8d16397fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1683423246 Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e4d0965b1cdc4667b3436cf8d16397fd Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1683423246 Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1683423246-project Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: bd696a109e84412ea51e920b1b2cb01c Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1683423246-project Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1981f33a-f45a-4b07-8105-fa1dd10d88dd'} Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:32:06.172266 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.177996 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.180088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Returning 404 to user: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:32:06.181876 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a1d2e22a-625b-4371-958e-c84a494b2438 tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 404 len: 111 microversion: 2.1 time: 0.602618 Oct 16 01:32:06.182620 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2902/5664] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:32:05 2022] DELETE /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 111 bytes in 606 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:32:06.204786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:06.205414 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:06.225846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.236035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.239134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.243190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.243925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.247468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.515384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:06.526465 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-99f8bee1-321a-4940-ab50-1abf41670dd0 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1528 microversion: 2.1 time: 0.327212 Oct 16 01:32:06.544205 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2763/5665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:06 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1528 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:06.555798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Action: 'update', calling method: >, body: {"server": {"name": "1981f33a-f45a-4b07-8105-fa1dd10d88dd_new"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:32:06.559444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:06.573209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.573996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.575483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.580398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.581346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.582006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.614957 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] HTTP exception thrown: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Request method failure captured: Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: request: PUT /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd HTTP/1.1 Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 64 Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS179xqRqZJhXIpsd9r74uLkVkaSdEO0ULL6EIRPYKCJZWcbyxrifjLmaoEgYA3bhcOyPkt3Xdx1Rm-SQ4dQn6Cprh_h4jFAapWmmQpdM-rPwUaTfGQo5GgxqyHQfzo1yJnIUVtqwVc3qZJR8s-99EjEn78xOJBhufEm95LJ-tr4klZc Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: e4d0965b1cdc4667b3436cf8d16397fd Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1683423246 Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e4d0965b1cdc4667b3436cf8d16397fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e4d0965b1cdc4667b3436cf8d16397fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e4d0965b1cdc4667b3436cf8d16397fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e4d0965b1cdc4667b3436cf8d16397fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1683423246 Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: e4d0965b1cdc4667b3436cf8d16397fd Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1683423246 Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1683423246-project Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: bd696a109e84412ea51e920b1b2cb01c Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1683423246-project Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: {"server": {"name": "1981f33a-f45a-4b07-8105-fa1dd10d88dd_new"}} Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1981f33a-f45a-4b07-8105-fa1dd10d88dd', 'body': {'server': {'name': '1981f33a-f45a-4b07-8105-fa1dd10d88dd_new'}}} Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:32:06.619688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:06.623494 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:06.626372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] Returning 404 to user: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:32:06.631935 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a3187555-ed43-4e35-a09f-02413ee1be8a tempest-ServersNegativeTestMultiTenantJSON-1683423246 tempest-ServersNegativeTestMultiTenantJSON-1683423246-project] 10.222.0.39 "PUT /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 404 len: 111 microversion: 2.1 time: 0.080017 Oct 16 01:32:06.637197 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2903/5666] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:32:06 2022] PUT /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:32:06.646438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:06.646979 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:06.671285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.671919 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.672463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.673274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.674016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.675272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.743560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:32:06.835973 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:06.912832 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73af83c5-1e5b-44c1-a66d-7e3be92d5e43 tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 204 len: 0 microversion: 2.1 time: 0.270992 Oct 16 01:32:06.917045 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2764/5667] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:32:06 2022] DELETE /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:32:06.924978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:06.925652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:06.933496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.934095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.934543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:06.935415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:06.936002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:06.936500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:07.326344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:07.360465 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6cff2192-9c74-4321-8268-17c996056a8b tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1534 microversion: 2.1 time: 0.440349 Oct 16 01:32:07.362878 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2904/5668] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:06 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1534 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:08.397566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:08.398180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:08.407544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:08.412226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:08.413076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:08.415549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:08.416250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:08.421502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:08.812968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:08.830273 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f6911935-226e-4497-9dc7-534eeaa75d4d tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1534 microversion: 2.1 time: 0.437243 Oct 16 01:32:08.831155 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2765/5669] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:08 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1534 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:09.179221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0f91c9da-1814-4ca0-97af-fb0a67fad0fa req-0c4bfb51-b971-480a-8f54-763012864e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1981f33a-f45a-4b07-8105-fa1dd10d88dd", "name": "network-vif-deleted", "tag": "d029bc6d-e840-493b-9ab1-fff7418fc50c"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:32:09.198799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0f91c9da-1814-4ca0-97af-fb0a67fad0fa req-0c4bfb51-b971-480a-8f54-763012864e49 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:09.217527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0f91c9da-1814-4ca0-97af-fb0a67fad0fa req-0c4bfb51-b971-480a-8f54-763012864e49 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:09.218371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0f91c9da-1814-4ca0-97af-fb0a67fad0fa req-0c4bfb51-b971-480a-8f54-763012864e49 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:09.240647 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0f91c9da-1814-4ca0-97af-fb0a67fad0fa req-0c4bfb51-b971-480a-8f54-763012864e49 service nova] Creating event network-vif-deleted:d029bc6d-e840-493b-9ab1-fff7418fc50c for instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd on n-h2-master-1 Oct 16 01:32:09.271389 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0f91c9da-1814-4ca0-97af-fb0a67fad0fa req-0c4bfb51-b971-480a-8f54-763012864e49 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096019 Oct 16 01:32:09.272856 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2905/5670] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:32:09.870993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:09.870993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:09.877945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:09.878800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:09.879524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:09.880489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:09.881178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:09.882138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:09.931722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:09.932578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:09.935623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:09.936546 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lazy-loading 'fault' on Instance uuid 1981f33a-f45a-4b07-8105-fa1dd10d88dd {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:32:10.038688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d6d6b9af8af4d399c78e0b22b0da004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd136775e094041b4bc669a95c11dd1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:10.049753 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e19f9156-a32a-4ff7-80ae-f81d7309473f tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 200 len: 1318 microversion: 2.1 time: 0.183061 Oct 16 01:32:10.053837 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2766/5671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:09 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:11.086341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:11.087816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] [instance: 1981f33a-f45a-4b07-8105-fa1dd10d88dd] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:11.096130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:11.096975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:11.097614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:11.098525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:11.099177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:11.099774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:11.117157 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] HTTP exception thrown: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Request method failure captured: Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd HTTP/1.1 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS17sapNCnZIXCYVpSZq01_0NVEbUvvWk9_7fUHJxbuGqnnYkTHEepKaJ1R6kDZ4szxAB5waIaMAB0gHO_2QfZ5nVxMs1KuH0rwK0Crf6lXQAUZqSlbFSGvA0amP2hYBR8fznPdhRdUZHQub3Go8sbgNwBDm5oiJWD6W3aUmGZmQNcXY Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: d136775e094041b4bc669a95c11dd1e4 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1081102893 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d136775e094041b4bc669a95c11dd1e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d136775e094041b4bc669a95c11dd1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d136775e094041b4bc669a95c11dd1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d136775e094041b4bc669a95c11dd1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1081102893 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: d136775e094041b4bc669a95c11dd1e4 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1081102893 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1081102893-project Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1d6d6b9af8af4d399c78e0b22b0da004 Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1081102893-project Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1981f33a-f45a-4b07-8105-fa1dd10d88dd'} Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:11.119121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. Oct 16 01:32:11.123684 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:11.125195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] Returning 404 to user: Instance 1981f33a-f45a-4b07-8105-fa1dd10d88dd could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:32:11.126229 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd90eca6-b29d-4621-847f-6a7ac7a864eb tempest-ServersNegativeTestMultiTenantJSON-1081102893 tempest-ServersNegativeTestMultiTenantJSON-1081102893-project] 10.222.0.39 "GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd" status: 404 len: 111 microversion: 2.1 time: 0.045014 Oct 16 01:32:11.133204 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2906/5672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:11 2022] GET /compute/v2.1/servers/1981f33a-f45a-4b07-8105-fa1dd10d88dd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:32:31.859315 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:31.860081 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:32.475043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-09990e00-c826-46f7-a0b0-a89f9f72d34d tempest-ComputeTenantNetworksTest-1958842423 tempest-ComputeTenantNetworksTest-1958842423-project] Calling method '.version_select at 0x7fd64d075040>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:32.740584 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-09990e00-c826-46f7-a0b0-a89f9f72d34d tempest-ComputeTenantNetworksTest-1958842423 tempest-ComputeTenantNetworksTest-1958842423-project] 10.222.0.39 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.887075 Oct 16 01:32:32.741558 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2767/5673] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:32:31 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:32:32.753341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6956fdf6-052d-4787-a39f-33bb03b5240f tempest-ComputeTenantNetworksTest-1958842423 tempest-ComputeTenantNetworksTest-1958842423-project] Calling method '.version_select at 0x7fd64d2e1790>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:32.761702 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=23 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:32.764142 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=56 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:32:32.907070 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6956fdf6-052d-4787-a39f-33bb03b5240f tempest-ComputeTenantNetworksTest-1958842423 tempest-ComputeTenantNetworksTest-1958842423-project] 10.222.0.39 "GET /compute/v2.1/os-tenant-networks/e648e231-569b-4570-af7a-4dca5080109b" status: 200 len: 140 microversion: 2.1 time: 0.158256 Oct 16 01:32:32.907859 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2907/5674] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:32:32 2022] GET /compute/v2.1/os-tenant-networks/e648e231-569b-4570-af7a-4dca5080109b => generated 140 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:32:34.919411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:34.922269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:34.958334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:34.959321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:34.960002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:34.960958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:34.963723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:34.972330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:35.095654 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a69886c8-e506-45d6-88b8-477dff95f23a tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.179497 Oct 16 01:32:35.096311 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2768/5675] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Oct 16 01:32:34 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:35.228493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:35.229078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:35.244875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:35.246729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:35.247260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:35.248003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:35.248474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:35.248907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:35.313341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:32:35.570542 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e5444868-2df0-4984-965a-da515b1cc594 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 204 len: 0 microversion: 2.20 time: 0.344059 Oct 16 01:32:35.572197 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2908/5676] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:32:35 2022] DELETE /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:32:35.585339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:35.587751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:35.603500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:35.605907 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:35.607139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:35.609276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:35.613715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:35.614397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:35.813901 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:35.837625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:35.841773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:35.848523 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b754d91d-645a-4697-b7d5-8377d51bdd25 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.266516 Oct 16 01:32:35.869797 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2769/5677] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:35 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:36.926741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:36.927644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:36.938123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:36.939560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:36.940079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:36.943243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:36.945891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:36.946697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:37.541409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:37.583856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:37.596212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:37.597666 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e58f76d0-d292-4c91-bf46-803aecde8409 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1719 microversion: 2.20 time: 0.701882 Oct 16 01:32:37.598265 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2909/5678] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:36 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1719 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:38.631306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:38.632062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:38.641640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:38.645597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:38.646174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:38.659660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:38.660355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:38.660947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:38.897797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:38.924943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:38.931119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:38.932893 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f8f70dcf-540c-4b2b-9958-60ef05e21d93 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1652 microversion: 2.20 time: 0.305679 Oct 16 01:32:38.958322 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2770/5679] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:38 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1652 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:39.383822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f07354a0-743c-4100-83c2-f1e23aeabf18 req-d643f444-27bc-4a59-8818-80348f66476e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79a1b93-16d9-4003-aa38-d137cbf2e743", "name": "network-vif-deleted", "tag": "7eaf7f6a-cef8-485e-b3ac-7efc80279c54"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:32:39.411301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f07354a0-743c-4100-83c2-f1e23aeabf18 req-d643f444-27bc-4a59-8818-80348f66476e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:39.413235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f07354a0-743c-4100-83c2-f1e23aeabf18 req-d643f444-27bc-4a59-8818-80348f66476e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:39.425761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f07354a0-743c-4100-83c2-f1e23aeabf18 req-d643f444-27bc-4a59-8818-80348f66476e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:39.472419 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f07354a0-743c-4100-83c2-f1e23aeabf18 req-d643f444-27bc-4a59-8818-80348f66476e service nova] Creating event network-vif-deleted:7eaf7f6a-cef8-485e-b3ac-7efc80279c54 for instance e79a1b93-16d9-4003-aa38-d137cbf2e743 on n-h1-master-1 Oct 16 01:32:39.480290 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f07354a0-743c-4100-83c2-f1e23aeabf18 req-d643f444-27bc-4a59-8818-80348f66476e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102117 Oct 16 01:32:39.488338 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2910/5680] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:32:39.975467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:39.989659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:40.108952 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:40.109809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:40.110487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:40.112143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:40.112854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:40.113610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:40.181072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:40.181575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:40.182020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:40.182484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lazy-loading 'fault' on Instance uuid e79a1b93-16d9-4003-aa38-d137cbf2e743 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:32:40.444150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:40.464691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:40.468691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fbc6af4172d4f3d95ae57485bf6d7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cff8886e6a5f4728806b806cb3459ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:40.470456 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d9083e5c-e330-4288-9b53-65ad2548c1bb tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 200 len: 1368 microversion: 2.20 time: 0.504417 Oct 16 01:32:40.489529 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2771/5681] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:39 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 1368 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 16 01:32:41.506869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:41.507755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:41.528501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:41.528758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:41.529205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:41.534004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:41.534565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:41.535043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:41.592220 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] HTTP exception thrown: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Request method failure captured: Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 HTTP/1.1 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS12hZYgHQPHWfZkzSQ803ow9Ez1F50YaZm51hhv1nWqnwbogUcPT4hw2Agng3-TVJBoT_g2zMC0zqanvIC3OgkI0xBvcGQ5s55shAEODz9iA4UAyRZfF0eomVXJ-L9pI_G86_jjkYq3OSYsTteLZ_-Ljn-uGZWByq9AF7IExeNk7vWQ Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cff8886e6a5f4728806b806cb3459ac5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1fbc6af4172d4f3d95ae57485bf6d7a2 Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e79a1b93-16d9-4003-aa38-d137cbf2e743'} Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:41.593914 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:41.599208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Returning 404 to user: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:32:41.608063 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c1c45e2c-90ca-4f9c-907d-657a03b901e1 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 404 len: 111 microversion: 2.20 time: 0.092964 Oct 16 01:32:41.608711 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2911/5682] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:41 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:32:41.622499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8dad142c-ef5f-40b2-8336-b6bded5f4a27 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '.version_select at 0x7fd64db039d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:41.691469 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8dad142c-ef5f-40b2-8336-b6bded5f4a27 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81951215" status: 204 len: 0 microversion: 2.20 time: 0.074948 Oct 16 01:32:41.696511 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2772/5683] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:32:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81951215 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 16 01:32:48.908520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae212d08-cefa-4fd9-8a57-5f4a4bd0974a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'create', calling method: .version_select at 0x7fd64d2d4d30>, body: {"keypair": {"name": "tempest-keypair-1490448375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYvuWwyz6TqIMX6b3hjuF6DnAHLwixGO3WjGpojkfNQ7sjSLWx+PbLcIOOE6pszVIfO1lfCHVw5+eX+nInPiPH2awi8n+ON9fcSVJIS/7TF7UmKYp81RrK3+1OTrVFZ5Q=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:32:48.945085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ae212d08-cefa-4fd9-8a57-5f4a4bd0974a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Getting quotas for project 3bf371ee661342e193e6d9d4aacda40d. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:32:48.958652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ae212d08-cefa-4fd9-8a57-5f4a4bd0974a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Getting quotas for user 6a10008a2a4e41c5be09552821db8fad and project 3bf371ee661342e193e6d9d4aacda40d. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:32:49.023704 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ae212d08-cefa-4fd9-8a57-5f4a4bd0974a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.531187 Oct 16 01:32:49.024764 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2912/5684] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:32:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:32:49.092000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:49.093387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:49.109282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:49.111203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:49.112540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:49.113608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:49.118799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:49.119434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:49.160557 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] HTTP exception thrown: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Request method failure captured: Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 HTTP/1.1 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS12hZYgHQPHWfZkzSQ803ow9Ez1F50YaZm51hhv1nWqnwbogUcPT4hw2Agng3-TVJBoT_g2zMC0zqanvIC3OgkI0xBvcGQ5s55shAEODz9iA4UAyRZfF0eomVXJ-L9pI_G86_jjkYq3OSYsTteLZ_-Ljn-uGZWByq9AF7IExeNk7vWQ Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cff8886e6a5f4728806b806cb3459ac5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1fbc6af4172d4f3d95ae57485bf6d7a2 Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: exception: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'e79a1b93-16d9-4003-aa38-d137cbf2e743'} Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:32:49.168887 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.173349 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.181576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Returning 404 to user: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:32:49.182719 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0ec6ff1f-180b-4ea0-82db-f95ac4999637 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 404 len: 111 microversion: 2.20 time: 0.096181 Oct 16 01:32:49.186769 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2773/5685] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:32:49 2022] DELETE /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:32:49.193692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:49.194471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: e79a1b93-16d9-4003-aa38-d137cbf2e743] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:49.210697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:49.211542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:49.213785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:49.217188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:49.217860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:49.218484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:49.257062 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] HTTP exception thrown: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Request method failure captured: Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 HTTP/1.1 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS12hZYgHQPHWfZkzSQ803ow9Ez1F50YaZm51hhv1nWqnwbogUcPT4hw2Agng3-TVJBoT_g2zMC0zqanvIC3OgkI0xBvcGQ5s55shAEODz9iA4UAyRZfF0eomVXJ-L9pI_G86_jjkYq3OSYsTteLZ_-Ljn-uGZWByq9AF7IExeNk7vWQ Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cff8886e6a5f4728806b806cb3459ac5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1fbc6af4172d4f3d95ae57485bf6d7a2 Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e79a1b93-16d9-4003-aa38-d137cbf2e743'} Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.260381 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Returning 404 to user: Instance e79a1b93-16d9-4003-aa38-d137cbf2e743 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1cf7ccfb-9727-49be-b89f-60b5c92c1846 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743" status: 404 len: 111 microversion: 2.20 time: 0.073866 Oct 16 01:32:49.265083 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2913/5686] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:49 2022] GET /compute/v2.1/servers/e79a1b93-16d9-4003-aa38-d137cbf2e743 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 16 01:32:54.662609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-791237227", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b2d38f5-a0ff-48ac-8d65-321cf81e635b"}], "security_groups": [{"name": "tempest-securitygroup--1566670772"}], "key_name": "tempest-keypair-1490448375", "user_data": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:32:54.989989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] validate_networks() for [('4b2d38f5-a0ff-48ac-8d65-321cf81e635b', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:32:55.809341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:32:55.809341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:32:55.809341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:32:55.809341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:32:55.809341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:32:55.829846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:55.831203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:55.832968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:55.843647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:55.845470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:55.846331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:55.909954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Getting quotas for project 3bf371ee661342e193e6d9d4aacda40d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:32:55.922587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Getting quotas for user 6a10008a2a4e41c5be09552821db8fad and project 3bf371ee661342e193e6d9d4aacda40d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:32:55.968983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:32:55.975935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:32:56.102400 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-99cee125-c9cd-41ab-ba71-acb68fa43768 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.444768 Oct 16 01:32:56.103700 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2774/5687] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:32:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:32:56.115410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-84e0dc47-256e-435d-92db-6f6c38bb3f86 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:56.116603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-84e0dc47-256e-435d-92db-6f6c38bb3f86 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:56.217261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-84e0dc47-256e-435d-92db-6f6c38bb3f86 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:56.227014 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-84e0dc47-256e-435d-92db-6f6c38bb3f86 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1237 microversion: 2.1 time: 0.115737 Oct 16 01:32:56.228222 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2914/5688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:56 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1237 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:32:57.260142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:57.261006 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:57.285010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:57.286313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:57.288325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:57.290679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:57.294479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:57.295267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:57.438080 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:57.448952 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-070177a5-066a-4855-92b9-391901aeef88 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1241 microversion: 2.1 time: 0.200821 Oct 16 01:32:57.454250 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2775/5689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:57 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1241 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:57.599176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:57.599678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:57.616564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:57.617068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:57.617508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:57.618217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:57.618670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:57.619122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:57.661196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] HTTP exception thrown: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Request method failure captured: Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a HTTP/1.1 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS12hZYgHQPHWfZkzSQ803ow9Ez1F50YaZm51hhv1nWqnwbogUcPT4hw2Agng3-TVJBoT_g2zMC0zqanvIC3OgkI0xBvcGQ5s55shAEODz9iA4UAyRZfF0eomVXJ-L9pI_G86_jjkYq3OSYsTteLZ_-Ljn-uGZWByq9AF7IExeNk7vWQ Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cff8886e6a5f4728806b806cb3459ac5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1fbc6af4172d4f3d95ae57485bf6d7a2 Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: exception: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'baa8ed22-d042-41d4-84a6-63e1b1ac9b2a'} Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:32:57.662803 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Returning 404 to user: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:32:57.667428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-242b18d2-275d-4055-a2a5-7bad1fcfeb5f tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "DELETE /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 404 len: 111 microversion: 2.20 time: 0.069726 Oct 16 01:32:57.673817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:57.675072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] [instance: baa8ed22-d042-41d4-84a6-63e1b1ac9b2a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:57.682309 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2915/5690] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Oct 16 01:32:57 2022] DELETE /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:32:57.686379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:57.687367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:57.687367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:57.688047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:57.688550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:57.689642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:57.728084 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] HTTP exception thrown: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Request method failure captured: Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a HTTP/1.1 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS12hZYgHQPHWfZkzSQ803ow9Ez1F50YaZm51hhv1nWqnwbogUcPT4hw2Agng3-TVJBoT_g2zMC0zqanvIC3OgkI0xBvcGQ5s55shAEODz9iA4UAyRZfF0eomVXJ-L9pI_G86_jjkYq3OSYsTteLZ_-Ljn-uGZWByq9AF7IExeNk7vWQ Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Openstack-Nova-Api-Version: 2.20 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cff8886e6a5f4728806b806cb3459ac5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cff8886e6a5f4728806b806cb3459ac5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: cff8886e6a5f4728806b806cb3459ac5 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-540537831 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1fbc6af4172d4f3d95ae57485bf6d7a2 Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeShelveTestJSON-540537831-project Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: exception: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'baa8ed22-d042-41d4-84a6-63e1b1ac9b2a'} Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.736328 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:32:57.741434 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.741434 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:32:57.741434 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:32:57.741434 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:32:57.741434 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:32:57.741434 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:32:57.741434 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. Oct 16 01:32:57.741434 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:32:57.742856 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] Returning 404 to user: Instance baa8ed22-d042-41d4-84a6-63e1b1ac9b2a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:32:57.744284 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58590901-98f1-41a3-92d7-f02c6f12c4b9 tempest-AttachVolumeShelveTestJSON-540537831 tempest-AttachVolumeShelveTestJSON-540537831-project] 10.222.0.39 "GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a" status: 404 len: 111 microversion: 2.20 time: 0.074969 Oct 16 01:32:57.748859 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2776/5691] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Oct 16 01:32:57 2022] GET /compute/v2.1/servers/baa8ed22-d042-41d4-84a6-63e1b1ac9b2a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 16 01:32:58.474140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:58.475325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:58.496556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:58.499108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:58.507354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:58.508842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:58.511758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:58.512429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:58.713420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:32:58.727349 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-21e97abf-434e-4f02-9fad-e377d842ea42 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1295 microversion: 2.1 time: 0.257509 Oct 16 01:32:58.728343 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2916/5692] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:58 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1295 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:32:59.764767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:32:59.766062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:32:59.792188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:59.800981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:59.801757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:32:59.804921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:32:59.805584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:32:59.815668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:00.234474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:00.252782 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-31ecb30b-9790-4aa2-8508-8b3c0bbd6fe0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1295 microversion: 2.1 time: 0.494367 Oct 16 01:33:00.254300 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2777/5693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:32:59 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1295 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:01.279670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:01.280278 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:01.292833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:01.293316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:01.293938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:01.294840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:01.295478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:01.296084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:01.576636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:01.590300 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fbe53648-d9e2-441b-9916-fb537f2ea6f6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1295 microversion: 2.1 time: 0.314396 Oct 16 01:33:01.608786 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2917/5694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:01 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1295 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:02.617562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:02.618216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:02.621325 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:02.635781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:02.636338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:02.636959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:02.637761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:02.638165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:02.638603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:02.654473 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=45 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:03.147328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:03.160765 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6696c33c-04ef-45ea-97c4-ff11ddef697d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.545449 Oct 16 01:33:03.164513 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2778/5695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:02 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:04.195144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:04.195144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:04.208892 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:04.211331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:04.219171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:04.220631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:04.221626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:04.222263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:04.222901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:04.246170 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:04.623003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2d13ca38-66d3-4211-86c7-56c1ac5ffd98 req-ce33ec10-00f8-4d72-a6ba-141b2389742b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c0fbbc-ac3c-4217-8b5b-1555b683137c", "tag": "82402e6f-2f86-4c6b-9466-f9a33eddf0ce"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:04.628671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:04.639522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5bccad59-5340-4b8a-8f3b-5f4d0467d60a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.455999 Oct 16 01:33:04.653042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d13ca38-66d3-4211-86c7-56c1ac5ffd98 req-ce33ec10-00f8-4d72-a6ba-141b2389742b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:04.654063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d13ca38-66d3-4211-86c7-56c1ac5ffd98 req-ce33ec10-00f8-4d72-a6ba-141b2389742b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:04.654662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d13ca38-66d3-4211-86c7-56c1ac5ffd98 req-ce33ec10-00f8-4d72-a6ba-141b2389742b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:04.660340 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2918/5696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:04 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:04.687232 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2d13ca38-66d3-4211-86c7-56c1ac5ffd98 req-ce33ec10-00f8-4d72-a6ba-141b2389742b service nova] Creating event network-changed:82402e6f-2f86-4c6b-9466-f9a33eddf0ce for instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c on n-h1-master-1 Oct 16 01:33:04.705065 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2d13ca38-66d3-4211-86c7-56c1ac5ffd98 req-ce33ec10-00f8-4d72-a6ba-141b2389742b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092191 Oct 16 01:33:04.706360 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2779/5697] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:33:05.215276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-599532671", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "2637bbd7-1b67-44af-a80c-29276b5f66ab"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:05.317564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] validate_networks() for [('2637bbd7-1b67-44af-a80c-29276b5f66ab', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:33:05.669649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:05.670333 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:05.687591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:05.688393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:05.689810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:05.691053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:05.691690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:05.702869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:05.873567 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:05.956642 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:06.027374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:06.043319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ec8026d7-5e3e-4219-982d-3c2f76a09418 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.379108 Oct 16 01:33:06.059826 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2780/5698] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:05 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:06.222660 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:07.071801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:07.072383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:07.089732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:07.090238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:07.090681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:07.097905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:07.098420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:07.098863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:07.531594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:33:07.533211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:33:07.533863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:33:07.535611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:33:07.536559 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:33:07.556117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:07.557230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:07.568567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:07.570872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:07.572990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:07.575185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:07.624696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Getting quotas for project 297a0eb860444023b67aa53333a88a9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:33:07.634651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Getting quotas for user 6dfd2de312f74480b4026fb1eff0a4b3 and project 297a0eb860444023b67aa53333a88a9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:33:07.652138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:33:07.654821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:33:07.713290 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4d06b71-f9bc-452b-bcd1-6933c26cb5c6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.502299 Oct 16 01:33:07.714748 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2919/5699] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:33:07.735923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:07.758218 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac7a2c3f-7bdf-4f0e-bab3-6a4af0344d16 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.691342 Oct 16 01:33:07.770938 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2781/5700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:07 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:33:07.771173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83b77a5e-d3ca-44d2-98c3-ad171f0b11a9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:07.771173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83b77a5e-d3ca-44d2-98c3-ad171f0b11a9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:08.128971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-83b77a5e-d3ca-44d2-98c3-ad171f0b11a9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:08.140556 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83b77a5e-d3ca-44d2-98c3-ad171f0b11a9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1213 microversion: 2.1 time: 0.388409 Oct 16 01:33:08.143518 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2920/5701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:07 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1213 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:08.787457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:08.790155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:08.807547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:08.810447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:08.811668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:08.814878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:08.815775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:08.817947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:09.098041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:09.117723 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a9b29ce-79dd-4bcc-9077-4fd70c2c8087 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.336885 Oct 16 01:33:09.121236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2782/5702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:08 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:09.167719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:09.175074 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:09.196834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:09.197344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:09.198945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:09.199879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:09.203073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:09.208021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:09.413584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:09.445154 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be7b4c51-ad10-4907-97ed-3ce26aac353d tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1265 microversion: 2.1 time: 0.280107 Oct 16 01:33:09.447958 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2921/5703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:09 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:10.143357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:10.143968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:10.180376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:10.180947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:10.181413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:10.182183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:10.182659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:10.183180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:10.480520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:10.481171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:10.494806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:10.502066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:10.502478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:10.508445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:10.508960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:10.509405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:10.622238 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:10.632805 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0afd2b7b-5aa9-4478-8b00-c92c4232727e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.494469 Oct 16 01:33:10.638197 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2783/5704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:10 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:10.737665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:10.767915 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d2ad3ea-1cf3-4ec7-94de-fa0fb8c26aed tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1271 microversion: 2.1 time: 0.298263 Oct 16 01:33:10.801481 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2922/5705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:10 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1271 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:11.661833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:11.662649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:11.688062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:11.690372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:11.692682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:11.698750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:11.699879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:11.700729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:11.796909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:11.797628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:11.826632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:11.827338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:11.827793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:11.828541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:11.829270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:11.829667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:12.114449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:12.145174 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-038e79f0-c6e2-445c-b8b2-a302fee85b66 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1271 microversion: 2.1 time: 0.357383 Oct 16 01:33:12.156301 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2923/5706] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:11 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1271 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:12.326804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:12.337540 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-838763c7-27db-4279-97e6-a059fa3a5b55 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.680557 Oct 16 01:33:12.339362 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2784/5707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:11 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:13.174752 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:13.175436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:13.193460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:13.197353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:13.198639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:13.200186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:13.200661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:13.206679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:13.367894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:13.368850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:13.390681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:13.395427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:13.397020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:13.398333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:13.403390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:13.405583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:13.486643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:13.497622 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d7a6179-ae15-4b80-990c-674bf3f7bb88 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1271 microversion: 2.1 time: 0.330190 Oct 16 01:33:13.525760 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2924/5708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:13 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1271 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:13.896779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:13.910331 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4758c966-ab99-478b-8e8f-16b23bf9c7d8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.547616 Oct 16 01:33:13.919131 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2785/5709] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:13 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:14.530173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:14.530789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:14.545470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:14.545969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:14.546408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:14.547163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:14.547622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:14.548102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:14.916038 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:14.931866 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e7fa381a-84a5-4b58-9ebd-fe14148f4c87 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1313 microversion: 2.1 time: 0.405715 Oct 16 01:33:14.935077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:14.937449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:14.948562 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2925/5710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:14 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:14.962413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:14.968641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:14.971608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:14.976917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:14.977650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:14.981794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:15.320420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:15.329816 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7de97d18-c677-4fa8-86f4-705667de3b0d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.400135 Oct 16 01:33:15.330759 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2786/5711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:14 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:33:15.553304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1b79ccc4-e956-4054-83d5-1a9fc19960c4 req-dcd16ca5-41b3-4853-abcb-75f4a1884d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c0fbbc-ac3c-4217-8b5b-1555b683137c", "name": "network-vif-plugged", "status": "completed", "tag": "82402e6f-2f86-4c6b-9466-f9a33eddf0ce"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:15.587052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1b79ccc4-e956-4054-83d5-1a9fc19960c4 req-dcd16ca5-41b3-4853-abcb-75f4a1884d0c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:15.589772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1b79ccc4-e956-4054-83d5-1a9fc19960c4 req-dcd16ca5-41b3-4853-abcb-75f4a1884d0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:15.591403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1b79ccc4-e956-4054-83d5-1a9fc19960c4 req-dcd16ca5-41b3-4853-abcb-75f4a1884d0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:15.641522 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1b79ccc4-e956-4054-83d5-1a9fc19960c4 req-dcd16ca5-41b3-4853-abcb-75f4a1884d0c service nova] Creating event network-vif-plugged:82402e6f-2f86-4c6b-9466-f9a33eddf0ce for instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c on n-h1-master-1 Oct 16 01:33:15.655838 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1b79ccc4-e956-4054-83d5-1a9fc19960c4 req-dcd16ca5-41b3-4853-abcb-75f4a1884d0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106605 Oct 16 01:33:15.662063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2926/5712] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:15.962361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:15.963169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:15.981817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:15.991857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:15.992876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:16.003883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:16.007241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:16.008861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:16.355253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:16.356251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:16.363854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:16.378598 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8fe1ff3-1873-4fc9-a680-119708905a97 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1313 microversion: 2.1 time: 0.415097 Oct 16 01:33:16.379382 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2787/5713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:15 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:16.383545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:16.384148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:16.384602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:16.385353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:16.394138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:16.394793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:16.932813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:16.942763 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c625406d-ecb9-4262-a16b-59c8139d1ac7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1363 microversion: 2.1 time: 0.592782 Oct 16 01:33:16.951338 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2927/5714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:16 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:33:17.414406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:17.419480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:17.447065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:17.447685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:17.448335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:17.452731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:17.453282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:17.457089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:17.658841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4d431f18-0786-4c37-adad-a18ff0b8cfcc req-2257b676-83e2-44dd-8b45-e964860660ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ea5e12-3696-4707-9a5b-a14d21154044", "tag": "cb19656c-c568-495c-9bd6-3855db157441"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:17.678673 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:17.680699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4d431f18-0786-4c37-adad-a18ff0b8cfcc req-2257b676-83e2-44dd-8b45-e964860660ce service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:17.681183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4d431f18-0786-4c37-adad-a18ff0b8cfcc req-2257b676-83e2-44dd-8b45-e964860660ce service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:17.681627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4d431f18-0786-4c37-adad-a18ff0b8cfcc req-2257b676-83e2-44dd-8b45-e964860660ce service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:17.750399 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4d431f18-0786-4c37-adad-a18ff0b8cfcc req-2257b676-83e2-44dd-8b45-e964860660ce service nova] Creating event network-changed:cb19656c-c568-495c-9bd6-3855db157441 for instance 09ea5e12-3696-4707-9a5b-a14d21154044 on n-h2-master-1 Oct 16 01:33:17.766245 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4d431f18-0786-4c37-adad-a18ff0b8cfcc req-2257b676-83e2-44dd-8b45-e964860660ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111606 Oct 16 01:33:17.767130 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2928/5715] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:33:17.830410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:17.839714 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-92fb0180-0953-4530-a3ee-c088bc28d5af tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1313 microversion: 2.1 time: 0.439826 Oct 16 01:33:17.840883 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2788/5716] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:17 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:17.974813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:17.976155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:17.991345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:17.992406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:17.993047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:17.993939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:17.994574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:17.995207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:18.133931 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:18.418869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:18.432053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91a57506-8ea4-4c8c-b571-d87bf12c195d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1550 microversion: 2.1 time: 0.461744 Oct 16 01:33:18.433225 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2929/5717] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:17 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1550 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:18.462289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:18.463643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:18.477785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:18.478440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:18.478875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:18.480971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:18.481679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:18.482166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:18.686739 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-13eeb8b2-119d-43d5-bdc4-9afb4c9cc94b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.228817 Oct 16 01:33:18.687692 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2789/5718] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:33:18 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:18.869289 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:18.870179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:18.879261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:18.880545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:18.881399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:18.882420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:18.883229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:18.885054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:19.572594 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:19.586402 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b94c9b2f-dae3-4c33-b839-78db19a48d05 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1313 microversion: 2.1 time: 0.722536 Oct 16 01:33:19.596333 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2930/5719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:18 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1313 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:20.617466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:20.618709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:20.645715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:20.646778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:20.647565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:20.648552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:20.651525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:20.652264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:21.600163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:21.608603 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1ff4953-009d-4b1f-bba2-c068528bdab9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1313 microversion: 2.1 time: 0.997879 Oct 16 01:33:21.613317 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2790/5720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:20 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1313 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:22.245845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-63f96175-e563-41f6-ae35-8d332078baa0 req-0c3fee82-43f3-4227-aca1-7403f8b9a613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c0fbbc-ac3c-4217-8b5b-1555b683137c", "tag": "82402e6f-2f86-4c6b-9466-f9a33eddf0ce"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:22.264732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-63f96175-e563-41f6-ae35-8d332078baa0 req-0c3fee82-43f3-4227-aca1-7403f8b9a613 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:22.267857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-63f96175-e563-41f6-ae35-8d332078baa0 req-0c3fee82-43f3-4227-aca1-7403f8b9a613 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:22.270253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-63f96175-e563-41f6-ae35-8d332078baa0 req-0c3fee82-43f3-4227-aca1-7403f8b9a613 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:22.294519 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-63f96175-e563-41f6-ae35-8d332078baa0 req-0c3fee82-43f3-4227-aca1-7403f8b9a613 service nova] Creating event network-changed:82402e6f-2f86-4c6b-9466-f9a33eddf0ce for instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c on n-h1-master-1 Oct 16 01:33:22.305779 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-63f96175-e563-41f6-ae35-8d332078baa0 req-0c3fee82-43f3-4227-aca1-7403f8b9a613 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386150 Oct 16 01:33:22.308255 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2931/5721] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:22.639390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:22.641113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:22.659862 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:22.661553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:22.663949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:22.666066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:22.666946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:22.668805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:23.172193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:23.187995 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f8f08b89-1ad0-47f4-b112-3c71856fcfc7 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1313 microversion: 2.1 time: 0.554099 Oct 16 01:33:23.188855 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2791/5722] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:22 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:24.185581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9e5ec9b3-e9d2-4eb6-9e1e-f8996b5a7776 req-ba940c8a-8e74-4383-8a2c-4e2a8dfef94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ea5e12-3696-4707-9a5b-a14d21154044", "name": "network-vif-plugged", "status": "completed", "tag": "cb19656c-c568-495c-9bd6-3855db157441"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:24.214763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:24.216103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:24.220073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9e5ec9b3-e9d2-4eb6-9e1e-f8996b5a7776 req-ba940c8a-8e74-4383-8a2c-4e2a8dfef94b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:24.222605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9e5ec9b3-e9d2-4eb6-9e1e-f8996b5a7776 req-ba940c8a-8e74-4383-8a2c-4e2a8dfef94b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:24.223304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9e5ec9b3-e9d2-4eb6-9e1e-f8996b5a7776 req-ba940c8a-8e74-4383-8a2c-4e2a8dfef94b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:24.229844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:24.232581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:24.233452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:24.236365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:24.239226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:24.239938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:24.263582 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9e5ec9b3-e9d2-4eb6-9e1e-f8996b5a7776 req-ba940c8a-8e74-4383-8a2c-4e2a8dfef94b service nova] Creating event network-vif-plugged:cb19656c-c568-495c-9bd6-3855db157441 for instance 09ea5e12-3696-4707-9a5b-a14d21154044 on n-h2-master-1 Oct 16 01:33:24.272690 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9e5ec9b3-e9d2-4eb6-9e1e-f8996b5a7776 req-ba940c8a-8e74-4383-8a2c-4e2a8dfef94b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092075 Oct 16 01:33:24.273310 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2932/5723] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:24.582863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:24.593859 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d46dac60-e438-413b-a01b-385b48315d16 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1313 microversion: 2.1 time: 0.384000 Oct 16 01:33:24.598500 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2792/5724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:24 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:25.621975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:25.623337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:25.640466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:25.640962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:25.641494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:25.642276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:25.642745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:25.643203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:26.020157 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:26.032009 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0228c74c-4531-4cb1-9c7e-e33d33468f1c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1313 microversion: 2.1 time: 0.414116 Oct 16 01:33:26.036103 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2933/5725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:25 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:27.058189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:27.058808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:27.072788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:27.073295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:27.073744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:27.074473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:27.074956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:27.085183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:27.481855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:27.493806 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e2acd26a-96fd-4c88-a714-15236ec16f24 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1498 microversion: 2.1 time: 0.436604 Oct 16 01:33:27.495229 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2793/5726] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:27 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1498 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:28.327756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-140997710", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "fd03867e-a9fe-4ec6-a6d7-a0456c2458e2"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:28.443316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:28.444381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:28.456488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:28.457327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:28.458069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:28.460008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:28.460844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:28.461818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:28.482502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] validate_networks() for [('fd03867e-a9fe-4ec6-a6d7-a0456c2458e2', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:33:28.530523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:33:28.639058 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:28.718183 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-974dd0d2-5e70-4987-b73a-a841d87b2aa3 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "DELETE /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 204 len: 0 microversion: 2.1 time: 0.278739 Oct 16 01:33:28.719259 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2794/5727] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:33:28 2022] DELETE /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:33:28.732592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:28.734632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:28.754568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:28.755111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:28.755554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:28.756285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:28.756735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:28.757363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:29.196173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:29.225958 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ac81e15-c34f-4525-a0b0-62f3a801b711 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1504 microversion: 2.1 time: 0.501874 Oct 16 01:33:29.228901 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2795/5728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:28 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:33:29.769923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:33:29.770485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:33:29.771128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:33:29.771546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:33:29.771963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:33:29.782327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:29.783217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:29.783905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:29.785018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:29.786430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:29.787129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:29.818643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Getting quotas for project aa44de13a18f4057a7aa203e99104468. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:33:29.825235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Getting quotas for user 3824035c58fc4119bd1e3a84f186d5cb and project aa44de13a18f4057a7aa203e99104468. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:33:29.840132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:33:29.856827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:33:29.935255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4b02824b-f1fb-4dd1-b5c5-5ebfbb50e57b tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.877884 Oct 16 01:33:29.936584 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2934/5729] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:33:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:33:29.950835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af482fb6-02e1-415a-9e7e-d2b80bd4f90d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:29.951788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-af482fb6-02e1-415a-9e7e-d2b80bd4f90d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:30.036597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af482fb6-02e1-415a-9e7e-d2b80bd4f90d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:30.048936 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af482fb6-02e1-415a-9e7e-d2b80bd4f90d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1213 microversion: 2.1 time: 0.102841 Oct 16 01:33:30.054724 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2796/5730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:29 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:30.253655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:30.254745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:30.276509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:30.277253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:30.277577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:30.278487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:30.296660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:30.297391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:30.596723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:30.607880 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e7e96116-de09-4ed4-ae70-6c6c1d276370 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1504 microversion: 2.1 time: 0.361882 Oct 16 01:33:30.624791 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2935/5731] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:30 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:31.081827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:31.083214 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:31.096093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:31.096699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:31.097382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:31.098347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:31.099087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:31.099740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:31.194105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:31.205213 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-02cc90d6-a3d8-47ba-a45d-3e199901e9bb tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1209 microversion: 2.1 time: 0.128971 Oct 16 01:33:31.206418 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2797/5732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:31 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:31.635270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:31.636610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:31.643982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:31.644757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:31.645322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:31.646414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:31.647310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:31.647966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:31.905732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-dfcc362a-3fd0-4429-b82d-7caffce8520f req-41de9f95-7ecc-4a8d-9996-506739635767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ea5e12-3696-4707-9a5b-a14d21154044", "name": "network-vif-deleted", "tag": "cb19656c-c568-495c-9bd6-3855db157441"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:31.926277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dfcc362a-3fd0-4429-b82d-7caffce8520f req-41de9f95-7ecc-4a8d-9996-506739635767 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:31.930368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dfcc362a-3fd0-4429-b82d-7caffce8520f req-41de9f95-7ecc-4a8d-9996-506739635767 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:31.931640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dfcc362a-3fd0-4429-b82d-7caffce8520f req-41de9f95-7ecc-4a8d-9996-506739635767 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:31.965983 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-dfcc362a-3fd0-4429-b82d-7caffce8520f req-41de9f95-7ecc-4a8d-9996-506739635767 service nova] Creating event network-vif-deleted:cb19656c-c568-495c-9bd6-3855db157441 for instance 09ea5e12-3696-4707-9a5b-a14d21154044 on n-h2-master-1 Oct 16 01:33:31.982316 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-dfcc362a-3fd0-4429-b82d-7caffce8520f req-41de9f95-7ecc-4a8d-9996-506739635767 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085944 Oct 16 01:33:31.984217 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2798/5733] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:32.120870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:32.133508 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67d58f90-5cac-456b-b920-999dcb257ce9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1504 microversion: 2.1 time: 0.502289 Oct 16 01:33:32.136760 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2936/5734] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:31 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:32.232771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:32.233655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:32.256395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:32.256889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:32.257525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:32.258521 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:32.259217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:32.259842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:32.357837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:32.369414 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d86de332-9208-42ce-96c9-87fb5af6d16a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1283 microversion: 2.1 time: 0.143339 Oct 16 01:33:32.374767 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2799/5735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:32 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:33.163801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:33.165143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:33.200794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:33.201902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:33.202492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:33.204355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:33.206743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:33.210079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:33.353413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:33.353930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:33.359299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:33.361725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lazy-loading 'fault' on Instance uuid 09ea5e12-3696-4707-9a5b-a14d21154044 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:33:33.398936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:33.399569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:33.431610 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:33.435088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:33.447464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:33.447925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:33.448670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:33.449132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:33.449558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:33.450537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:33.462583 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c88a74cd-eefe-471b-af3f-64aaddab6ae2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 200 len: 1303 microversion: 2.1 time: 0.306419 Oct 16 01:33:33.489396 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2937/5736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:33 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 1303 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:33.593985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:33.605257 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d58383e3-d6d1-45a6-8c38-48e6171363b0 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1271 microversion: 2.1 time: 0.210427 Oct 16 01:33:33.611150 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2800/5737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:33 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:34.493956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:34.494689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 09ea5e12-3696-4707-9a5b-a14d21154044] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:34.497377 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:34.511585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:34.513455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:34.513455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:34.513455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:34.513725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:34.514080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:34.525783 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=92 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:34.550764 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] HTTP exception thrown: Instance 09ea5e12-3696-4707-9a5b-a14d21154044 could not be found. Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Request method failure captured: Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 HTTP/1.1 Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS19NfT93Mj9Yj54AZUQwYSh6hMOMQmuSRVuH-Yu8giJFkSF9En5HcVi9G9CXXCWm-H4PVstD6ArShSBgBWUOhxMFKIR0QqOtW9rWH8bPMH3S-CtMzZMHNsA0KFkUNw7Ryv3l48v0HNIdPRfl_2w16EBLsBLl7WJW4r8PJJXszkuSg1w Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 297a0eb860444023b67aa53333a88a9a Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesActionsTest-1309144206 Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_297a0eb860444023b67aa53333a88a9a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/297a0eb860444023b67aa53333a88a9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/297a0eb860444023b67aa53333a88a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/297a0eb860444023b67aa53333a88a9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesActionsTest-1309144206 Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 297a0eb860444023b67aa53333a88a9a Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesActionsTest-1309144206 Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesActionsTest-1309144206-project Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 6dfd2de312f74480b4026fb1eff0a4b3 Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesActionsTest-1309144206-project Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 09ea5e12-3696-4707-9a5b-a14d21154044 could not be found. Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '09ea5e12-3696-4707-9a5b-a14d21154044'} Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ea5e12-3696-4707-9a5b-a14d21154044 could not be found. Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ea5e12-3696-4707-9a5b-a14d21154044 could not be found. Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:33:34.554447 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ea5e12-3696-4707-9a5b-a14d21154044 could not be found. Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Returning 404 to user: Instance 09ea5e12-3696-4707-9a5b-a14d21154044 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:33:34.567075 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3aeedb64-db09-48ff-8d16-764eaa2c0e13 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044" status: 404 len: 111 microversion: 2.1 time: 0.070026 Oct 16 01:33:34.583190 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2938/5738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:34 2022] GET /compute/v2.1/servers/09ea5e12-3696-4707-9a5b-a14d21154044 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:33:34.633508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:34.634179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:34.648645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:34.653306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:34.654153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:34.656489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:34.660023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:34.660716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:34.790424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-938735244", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "2637bbd7-1b67-44af-a80c-29276b5f66ab"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:34.939887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] validate_networks() for [('2637bbd7-1b67-44af-a80c-29276b5f66ab', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:33:35.027150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:35.039016 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a1d69b9-b428-45dc-a1a1-4f756bc8fff5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1313 microversion: 2.1 time: 0.410576 Oct 16 01:33:35.051714 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2801/5739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:34 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:35.717954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-023939dc-3709-47dc-b98e-3de4a5830664 req-77a78170-c109-4106-8a2e-be29a4d7af89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cab8cd4-f44e-4be8-a462-0872958821f6", "tag": "2a82d371-f272-4767-b38d-926fc4e976ec"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:35.743822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-023939dc-3709-47dc-b98e-3de4a5830664 req-77a78170-c109-4106-8a2e-be29a4d7af89 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:35.744610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-023939dc-3709-47dc-b98e-3de4a5830664 req-77a78170-c109-4106-8a2e-be29a4d7af89 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:35.745223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-023939dc-3709-47dc-b98e-3de4a5830664 req-77a78170-c109-4106-8a2e-be29a4d7af89 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:35.773517 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-023939dc-3709-47dc-b98e-3de4a5830664 req-77a78170-c109-4106-8a2e-be29a4d7af89 service nova] Creating event network-changed:2a82d371-f272-4767-b38d-926fc4e976ec for instance 8cab8cd4-f44e-4be8-a462-0872958821f6 on n-h1-master-1 Oct 16 01:33:35.786313 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-023939dc-3709-47dc-b98e-3de4a5830664 req-77a78170-c109-4106-8a2e-be29a4d7af89 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072697 Oct 16 01:33:35.787536 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2802/5740] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:35.838338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:33:35.838939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:33:35.840119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:33:35.840537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:33:35.840959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:33:35.859828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:35.861280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:35.862098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:35.863125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:35.863849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:35.864614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:35.886478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Getting quotas for project 297a0eb860444023b67aa53333a88a9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:33:35.893402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Getting quotas for user 6dfd2de312f74480b4026fb1eff0a4b3 and project 297a0eb860444023b67aa53333a88a9a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:33:35.909340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:33:35.912591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:33:35.980261 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d1b84f5-0927-43e9-b1fa-34f0c10d8eb0 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193699 Oct 16 01:33:35.988181 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2939/5741] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:33:35.994072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbd26dfd-e4cd-40d4-8d68-f20d6495f158 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:35.995023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fbd26dfd-e4cd-40d4-8d68-f20d6495f158 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:36.064117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:36.069647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:36.081576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:36.085032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:36.086187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:36.087048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:36.096279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:36.097012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:36.126969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fbd26dfd-e4cd-40d4-8d68-f20d6495f158 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:36.135030 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fbd26dfd-e4cd-40d4-8d68-f20d6495f158 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1213 microversion: 2.1 time: 0.145087 Oct 16 01:33:36.138693 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2803/5742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:35 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:36.364022 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:36.375632 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c4ac4b46-0497-42ba-85ff-0a9e86e55de6 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1313 microversion: 2.1 time: 0.315480 Oct 16 01:33:36.382953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2940/5743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:36 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:37.174200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:37.175567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:37.188532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:37.191044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:37.191725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:37.194209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:37.194860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:37.197944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:37.321181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:37.330215 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d900a01-585a-4cad-b3fb-a359779cd1f5 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1217 microversion: 2.1 time: 0.160913 Oct 16 01:33:37.343911 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2804/5744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:37 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:37.404910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:37.406057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:37.433251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:37.433739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:37.434196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:37.435436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:37.440373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:37.441421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:37.783401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:37.798165 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eb5f2cd9-27ad-4439-b11a-1c23f353bc84 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1313 microversion: 2.1 time: 0.396072 Oct 16 01:33:37.807947 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2941/5745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:37 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:38.354958 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:38.355598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:38.364831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:38.367372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:38.368882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:38.371263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:38.372032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:38.373173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:38.461927 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:38.479774 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-942b2795-5ba7-4958-b525-b308c80968e2 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1271 microversion: 2.1 time: 0.129555 Oct 16 01:33:38.484327 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2805/5746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:38 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:38.822565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:38.823245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:38.834655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:38.835386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:38.836074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:38.837035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:38.837501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:38.837938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:39.264497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:39.281014 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c35453bc-dd9a-4f7a-9204-4ef0b424882e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1313 microversion: 2.1 time: 0.463001 Oct 16 01:33:39.281622 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2942/5747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:38 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:39.506510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:39.507390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:39.524702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:39.527846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:39.527846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:39.527846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:39.527846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:39.527846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:39.700085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:39.710025 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ce0d2ac-45b1-4319-a47a-80a5db5b0249 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1271 microversion: 2.1 time: 0.209024 Oct 16 01:33:39.713570 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2806/5748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:39 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:40.303995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:40.305335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:40.312794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:40.313756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:40.314227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:40.315313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:40.316221 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:40.316971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:40.476844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:40.487764 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ed6e0e2-f005-4657-b455-c936e1db4084 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1313 microversion: 2.1 time: 0.187379 Oct 16 01:33:40.488658 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2943/5749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:40 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:40.742895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:40.743547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:40.753543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:40.754330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:40.755235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:40.756209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:40.757046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:40.757816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:41.020288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:41.029325 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bdec7977-0519-4cf6-89bc-266d9b2b9e39 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1313 microversion: 2.1 time: 0.294222 Oct 16 01:33:41.030510 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2807/5750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:40 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:41.518204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:41.520273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:41.567612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-4e2851d5-cacf-4b29-a72f-9a0e1fda0d36 req-bd45b333-2a32-4315-9447-bb149a7149c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a777143-ed09-4e20-b48c-b8e2e99c77a7", "tag": "ba0eb019-459d-45a5-ac80-aed8af1a77da"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:41.582419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4e2851d5-cacf-4b29-a72f-9a0e1fda0d36 req-bd45b333-2a32-4315-9447-bb149a7149c5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:41.583270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4e2851d5-cacf-4b29-a72f-9a0e1fda0d36 req-bd45b333-2a32-4315-9447-bb149a7149c5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:41.584860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4e2851d5-cacf-4b29-a72f-9a0e1fda0d36 req-bd45b333-2a32-4315-9447-bb149a7149c5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:41.602413 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-4e2851d5-cacf-4b29-a72f-9a0e1fda0d36 req-bd45b333-2a32-4315-9447-bb149a7149c5 service nova] Creating event network-changed:ba0eb019-459d-45a5-ac80-aed8af1a77da for instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 on n-h2-master-1 Oct 16 01:33:41.609095 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-4e2851d5-cacf-4b29-a72f-9a0e1fda0d36 req-bd45b333-2a32-4315-9447-bb149a7149c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049545 Oct 16 01:33:41.611858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:41.612714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:41.615220 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2808/5751] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:33:41.619286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:41.620470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:41.620961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:41.621395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:41.997237 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:42.006353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ffc55716-49e1-4e60-a26d-8e2660fc8814 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1313 microversion: 2.1 time: 0.497351 Oct 16 01:33:42.007553 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2944/5752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:41 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:42.054886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:42.055635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:42.067831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:42.068333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:42.068774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:42.069493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:42.074510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:42.075254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:42.569724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:42.580956 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-41ed65c6-05fa-4244-9f83-17568bf368f9 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1313 microversion: 2.1 time: 0.531519 Oct 16 01:33:42.584384 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2809/5753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:42 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:43.040918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:43.042082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:43.049733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:43.059805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:43.060612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:43.061519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:43.062146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:43.062905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:43.266449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9b8acc8f-452b-4d4d-aab6-b2e9028c5c3d req-0752de41-c23c-469b-a82e-703c57bea0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cab8cd4-f44e-4be8-a462-0872958821f6", "name": "network-vif-plugged", "status": "completed", "tag": "2a82d371-f272-4767-b38d-926fc4e976ec"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:43.286839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9b8acc8f-452b-4d4d-aab6-b2e9028c5c3d req-0752de41-c23c-469b-a82e-703c57bea0f4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:43.294338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9b8acc8f-452b-4d4d-aab6-b2e9028c5c3d req-0752de41-c23c-469b-a82e-703c57bea0f4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:43.294847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9b8acc8f-452b-4d4d-aab6-b2e9028c5c3d req-0752de41-c23c-469b-a82e-703c57bea0f4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:43.317748 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9b8acc8f-452b-4d4d-aab6-b2e9028c5c3d req-0752de41-c23c-469b-a82e-703c57bea0f4 service nova] Creating event network-vif-plugged:2a82d371-f272-4767-b38d-926fc4e976ec for instance 8cab8cd4-f44e-4be8-a462-0872958821f6 on n-h1-master-1 Oct 16 01:33:43.329947 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9b8acc8f-452b-4d4d-aab6-b2e9028c5c3d req-0752de41-c23c-469b-a82e-703c57bea0f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066346 Oct 16 01:33:43.330673 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:43.333169 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2810/5754] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:43.355436 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-46b7a16f-277b-4a3b-844e-70b1aa99ce9d tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1313 microversion: 2.1 time: 0.305937 Oct 16 01:33:43.356478 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2945/5755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:43 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:43.610443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:43.611184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:43.619838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:43.620338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:43.620782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:43.621497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:43.621961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:43.628000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:43.806769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:43.818146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1d4d2e0f-9dd3-44bd-b2f9-be77117e75bb tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1313 microversion: 2.1 time: 0.211710 Oct 16 01:33:43.832407 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2811/5756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:43 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:44.389146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:44.390231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:44.406578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:44.407145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:44.410653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:44.411643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:44.412118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:44.412551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:44.647273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:44.667549 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa2cd2c4-d10a-4e9d-a574-90bdd97fb1d5 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1313 microversion: 2.1 time: 0.281166 Oct 16 01:33:44.685282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2946/5757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:44 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:44.842216 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:44.842675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:44.860318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:44.861016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:44.861742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:44.862686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:44.863362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:44.864011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:45.160047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:45.170143 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c68bdb93-8f7a-49ea-88e3-421e2c578018 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1313 microversion: 2.1 time: 0.331570 Oct 16 01:33:45.199898 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2812/5758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:44 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:45.695924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:45.696622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:45.704713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:45.705305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:45.705858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:45.706864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:45.707440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:45.708385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:45.878964 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:45.904252 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:45.965418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:45.976437 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-202ab8f5-4be8-42b2-990b-7d1ed7fa8c6e tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1496 microversion: 2.1 time: 0.285903 Oct 16 01:33:45.982422 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2947/5759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:45 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1496 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:46.205815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:46.205815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:46.206478 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:46.217569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:46.219353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:46.220282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:46.222666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:46.223752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:46.225973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:46.464174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:46.481573 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-68e0748b-fa6a-4fc3-afc1-01b4d5033fdf tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1313 microversion: 2.1 time: 0.286130 Oct 16 01:33:46.504726 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2813/5760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:46 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:47.511249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:47.513332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:47.538867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:47.543158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:47.545353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:47.547104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:47.548893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:47.549626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:47.646507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-62e78c2e-9d4e-4d1c-8f32-1d8ac3443c79 req-cd18bc30-0b4c-4b25-8200-1d010657c62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a777143-ed09-4e20-b48c-b8e2e99c77a7", "name": "network-vif-plugged", "status": "completed", "tag": "ba0eb019-459d-45a5-ac80-aed8af1a77da"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:47.692123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-62e78c2e-9d4e-4d1c-8f32-1d8ac3443c79 req-cd18bc30-0b4c-4b25-8200-1d010657c62b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:47.692604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-62e78c2e-9d4e-4d1c-8f32-1d8ac3443c79 req-cd18bc30-0b4c-4b25-8200-1d010657c62b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:47.696655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-62e78c2e-9d4e-4d1c-8f32-1d8ac3443c79 req-cd18bc30-0b4c-4b25-8200-1d010657c62b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:47.736311 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-62e78c2e-9d4e-4d1c-8f32-1d8ac3443c79 req-cd18bc30-0b4c-4b25-8200-1d010657c62b service nova] Creating event network-vif-plugged:ba0eb019-459d-45a5-ac80-aed8af1a77da for instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 on n-h2-master-1 Oct 16 01:33:47.745554 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-62e78c2e-9d4e-4d1c-8f32-1d8ac3443c79 req-cd18bc30-0b4c-4b25-8200-1d010657c62b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105138 Oct 16 01:33:47.748097 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2814/5761] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:33:47.858148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:47.873733 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d87290e-0b0b-49a3-801b-ff09e69d16ef tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1313 microversion: 2.1 time: 0.367226 Oct 16 01:33:47.875063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2948/5762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:47 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:48.901103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:48.901836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:48.910132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:48.910836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:48.911462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:48.912343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:48.913021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:48.913638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:49.208131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:49.217070 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88044c09-cf5b-4419-943b-09649dc21294 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1313 microversion: 2.1 time: 0.322238 Oct 16 01:33:49.217664 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2815/5763] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:48 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:49.565403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:49.566699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:49.573252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:49.576608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:49.577669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:49.588254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:49.588946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:49.589642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:49.637984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:33:49.740497 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-328df26a-f2bd-47ad-9d4b-53be8d917e56 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 204 len: 0 microversion: 2.1 time: 0.182715 Oct 16 01:33:49.741569 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2949/5764] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:33:49 2022] DELETE /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:33:49.752972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:49.755084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:49.763106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:49.763603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:49.764048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:49.764755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:49.765673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:49.766757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:49.772020 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:49.975428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:49.986280 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f218f990-0cc5-488d-975d-bbdbc8a36bca tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1502 microversion: 2.1 time: 0.239945 Oct 16 01:33:49.987831 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2816/5765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:49 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:33:50.244226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:50.245109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:50.254812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:50.256040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:50.256724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:50.257972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:50.258673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:50.259369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:50.440229 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:50.449462 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-659092f0-5cc3-44c4-ad8a-7ee423e48b7e tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1498 microversion: 2.1 time: 0.211471 Oct 16 01:33:50.450405 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2950/5766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:50 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1498 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:50.947416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:50.947909 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:50.957014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:50.957517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:50.957954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:50.958656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:50.959352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:50.960463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:50.991904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:33:51.014307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:51.014982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:51.034697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:51.035893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:51.037364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:51.039635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:51.040608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:51.041878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:51.111443 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-41960e3c-2017-45e4-9b2c-0aa1e469ff8b tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 204 len: 0 microversion: 2.1 time: 0.166222 Oct 16 01:33:51.112370 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2817/5767] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:33:50 2022] DELETE /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:33:51.123883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:51.124684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:51.132099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:51.132669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:51.133443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:51.134217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:51.134739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:51.135272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:51.280136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:51.287916 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-769c3335-1070-4f38-9474-a2c527089d8a tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1502 microversion: 2.1 time: 0.279966 Oct 16 01:33:51.288740 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2951/5768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:51 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1502 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:51.398436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:51.409506 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85b0fa3e-f770-427f-93af-6541b1a559cd tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1504 microversion: 2.1 time: 0.291397 Oct 16 01:33:51.412751 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2818/5769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:51 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:33:52.044143 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-302273db-5e97-4a57-a3bb-c56dcc2afa79 req-19e0cb5e-6ba8-4dad-9e86-1b1e6cf826e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cab8cd4-f44e-4be8-a462-0872958821f6", "name": "network-vif-deleted", "tag": "2a82d371-f272-4767-b38d-926fc4e976ec"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:52.062500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-302273db-5e97-4a57-a3bb-c56dcc2afa79 req-19e0cb5e-6ba8-4dad-9e86-1b1e6cf826e5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:52.063728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-302273db-5e97-4a57-a3bb-c56dcc2afa79 req-19e0cb5e-6ba8-4dad-9e86-1b1e6cf826e5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:52.064589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-302273db-5e97-4a57-a3bb-c56dcc2afa79 req-19e0cb5e-6ba8-4dad-9e86-1b1e6cf826e5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:52.085062 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-302273db-5e97-4a57-a3bb-c56dcc2afa79 req-19e0cb5e-6ba8-4dad-9e86-1b1e6cf826e5 service nova] Creating event network-vif-deleted:2a82d371-f272-4767-b38d-926fc4e976ec for instance 8cab8cd4-f44e-4be8-a462-0872958821f6 on n-h1-master-1 Oct 16 01:33:52.092526 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-302273db-5e97-4a57-a3bb-c56dcc2afa79 req-19e0cb5e-6ba8-4dad-9e86-1b1e6cf826e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051966 Oct 16 01:33:52.107528 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2952/5770] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:52.314692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:52.315951 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:52.322551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:52.323266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:52.323896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:52.324767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:52.325392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:52.326000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:52.373772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:52.374656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:52.376038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:52.376936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lazy-loading 'fault' on Instance uuid 8cab8cd4-f44e-4be8-a462-0872958821f6 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:33:52.442494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3824035c58fc4119bd1e3a84f186d5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa44de13a18f4057a7aa203e99104468', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:52.443306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:52.444967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:52.454604 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1cffa92c-9206-4e01-bf4b-e386f3059445 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 200 len: 1303 microversion: 2.1 time: 0.143615 Oct 16 01:33:52.455309 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2819/5771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:52 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:52.471535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:52.472032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:52.472462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:52.479756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:52.481341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:52.483431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:52.667256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:52.690611 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9476037b-4337-4032-9d41-0e1ba7ad2073 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1504 microversion: 2.1 time: 0.245091 Oct 16 01:33:52.694775 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2953/5772] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:52 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:53.485560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:53.487018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] [instance: 8cab8cd4-f44e-4be8-a462-0872958821f6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:53.494644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:53.495491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:53.496158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:53.497118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:53.497953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:53.498635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:53.543286 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] HTTP exception thrown: Instance 8cab8cd4-f44e-4be8-a462-0872958821f6 could not be found. Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Request method failure captured: Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 HTTP/1.1 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS19k5pREYO5diekkIQpHKVVWJ8XJyh9Z7FJfTb7o0fna8dUS8ytTKLXjMWddkRAm8Zarij-L17IsUs8ZQ8AiHLz7M7YS66b7xmzgrZGwJvlG-kaJHe239lUAxn1HPJTJMKB4lNCfiQzfgDmDUN0LHkCuOqbQF2vIwZfnfSpaB1dOoYQ Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: aa44de13a18f4057a7aa203e99104468 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-VolumesActionsTest-269465075 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa44de13a18f4057a7aa203e99104468", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa44de13a18f4057a7aa203e99104468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa44de13a18f4057a7aa203e99104468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa44de13a18f4057a7aa203e99104468"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-VolumesActionsTest-269465075 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: aa44de13a18f4057a7aa203e99104468 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-VolumesActionsTest-269465075 Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-VolumesActionsTest-269465075-project Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 3824035c58fc4119bd1e3a84f186d5cb Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-VolumesActionsTest-269465075-project Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 8cab8cd4-f44e-4be8-a462-0872958821f6 could not be found. Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '8cab8cd4-f44e-4be8-a462-0872958821f6'} Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cab8cd4-f44e-4be8-a462-0872958821f6 could not be found. Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cab8cd4-f44e-4be8-a462-0872958821f6 could not be found. Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:33:53.556399 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:53.561411 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:53.561411 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:33:53.561411 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:33:53.561411 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:33:53.561411 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:33:53.561411 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cab8cd4-f44e-4be8-a462-0872958821f6 could not be found. Oct 16 01:33:53.561411 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:53.563179 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] Returning 404 to user: Instance 8cab8cd4-f44e-4be8-a462-0872958821f6 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:33:53.574791 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a7e8dd8-2989-44b8-86a9-e998e82f0095 tempest-VolumesActionsTest-269465075 tempest-VolumesActionsTest-269465075-project] 10.222.0.39 "GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6" status: 404 len: 111 microversion: 2.1 time: 0.084391 Oct 16 01:33:53.576172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2820/5773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:53 2022] GET /compute/v2.1/servers/8cab8cd4-f44e-4be8-a462-0872958821f6 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:33:53.714374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:53.714960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:53.740102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:53.742259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:53.742839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:53.744250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:53.745219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:53.746188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:53.826624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:53.827160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:53.828797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:53.832180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lazy-loading 'fault' on Instance uuid 1a777143-ed09-4e20-b48c-b8e2e99c77a7 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:33:53.905710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dfd2de312f74480b4026fb1eff0a4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297a0eb860444023b67aa53333a88a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:33:53.910411 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:33:53.937046 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e5bc09c9-27ef-4c34-a870-ea90767103d6 tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 200 len: 1303 microversion: 2.1 time: 0.226357 Oct 16 01:33:53.954134 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2954/5774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:53 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 1303 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:33:54.124855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9f493722-9741-4085-88ee-a0089dc8eb36 req-d16d8621-876a-4ddf-a41c-3ab5b4141134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a777143-ed09-4e20-b48c-b8e2e99c77a7", "name": "network-vif-deleted", "tag": "ba0eb019-459d-45a5-ac80-aed8af1a77da"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:54.164512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9f493722-9741-4085-88ee-a0089dc8eb36 req-d16d8621-876a-4ddf-a41c-3ab5b4141134 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:54.165299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9f493722-9741-4085-88ee-a0089dc8eb36 req-d16d8621-876a-4ddf-a41c-3ab5b4141134 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:54.165998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9f493722-9741-4085-88ee-a0089dc8eb36 req-d16d8621-876a-4ddf-a41c-3ab5b4141134 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:54.185596 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9f493722-9741-4085-88ee-a0089dc8eb36 req-d16d8621-876a-4ddf-a41c-3ab5b4141134 service nova] Creating event network-vif-deleted:ba0eb019-459d-45a5-ac80-aed8af1a77da for instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 on n-h2-master-1 Oct 16 01:33:54.195070 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9f493722-9741-4085-88ee-a0089dc8eb36 req-d16d8621-876a-4ddf-a41c-3ab5b4141134 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074779 Oct 16 01:33:54.196021 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2821/5775] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:54.677360 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:54.678029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:54.694729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:54.695837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:54.697026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:54.698345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:54.699795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:54.703519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:54.751113 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dba65144-884b-4474-9c0a-d086032d2630 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/ips" status: 200 len: 146 microversion: 2.1 time: 0.076990 Oct 16 01:33:54.753359 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2955/5776] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:33:54 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/ips => generated 146 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:33:54.975561 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:33:54.976618 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] [instance: 1a777143-ed09-4e20-b48c-b8e2e99c77a7] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:54.994653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:54.995201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:54.997789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:54.999652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:55.000598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:55.001659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:55.021355 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] HTTP exception thrown: Instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 could not be found. Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Request method failure captured: Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 HTTP/1.1 Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS19NfT93Mj9Yj54AZUQwYSh6hMOMQmuSRVuH-Yu8giJFkSF9En5HcVi9G9CXXCWm-H4PVstD6ArShSBgBWUOhxMFKIR0QqOtW9rWH8bPMH3S-CtMzZMHNsA0KFkUNw7Ryv3l48v0HNIdPRfl_2w16EBLsBLl7WJW4r8PJJXszkuSg1w Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 297a0eb860444023b67aa53333a88a9a Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-VolumesActionsTest-1309144206 Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_297a0eb860444023b67aa53333a88a9a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/297a0eb860444023b67aa53333a88a9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/297a0eb860444023b67aa53333a88a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/297a0eb860444023b67aa53333a88a9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-VolumesActionsTest-1309144206 Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 297a0eb860444023b67aa53333a88a9a Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-VolumesActionsTest-1309144206 Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-VolumesActionsTest-1309144206-project Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 6dfd2de312f74480b4026fb1eff0a4b3 Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-VolumesActionsTest-1309144206-project Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 could not be found. Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '1a777143-ed09-4e20-b48c-b8e2e99c77a7'} Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 could not be found. Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 could not be found. Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:33:55.023754 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 could not be found. Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] Returning 404 to user: Instance 1a777143-ed09-4e20-b48c-b8e2e99c77a7 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac0c948d-d394-49b4-b8d8-b22aefa8d11c tempest-VolumesActionsTest-1309144206 tempest-VolumesActionsTest-1309144206-project] 10.222.0.39 "GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7" status: 404 len: 111 microversion: 2.1 time: 0.057459 Oct 16 01:33:55.028304 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2822/5777] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:33:54 2022] GET /compute/v2.1/servers/1a777143-ed09-4e20-b48c-b8e2e99c77a7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:33:58.336665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d0164b2-2045-49e1-8387-0e7e93cd25c8"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:33:58.339186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:33:58.365367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:58.365953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:58.366404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:58.368190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:33:58.368877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:33:58.369619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:33:59.106110 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e7f64a5b-6418-4cb6-877a-ebc1c5d078bc tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773088 Oct 16 01:33:59.114266 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2956/5778] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:33:58 2022] POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:34:16.116061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cb82e49f-b839-4f69-9666-1391470e1c52 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:34:16.120612 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:16.121301 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:16.130309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb82e49f-b839-4f69-9666-1391470e1c52 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:16.130966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb82e49f-b839-4f69-9666-1391470e1c52 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:16.131695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb82e49f-b839-4f69-9666-1391470e1c52 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:16.173199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cb82e49f-b839-4f69-9666-1391470e1c52 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Going to try to stop instance {{(pid=120546) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:34:16.252417 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cb82e49f-b839-4f69-9666-1391470e1c52 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action" status: 202 len: 0 microversion: 2.1 time: 0.144321 Oct 16 01:34:16.254138 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2823/5779] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:34:16 2022] POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:34:16.261652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:16.262356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:16.267520 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:16.268568 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:16.310055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:16.310547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:16.311038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:16.311751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:16.312212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:16.312686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:16.713828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:16.744040 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff3c5c3e-12d5-4e5c-a28b-8d0ea2c8b010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.486106 Oct 16 01:34:16.747833 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2957/5780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:16 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:17.779262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:17.780742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:17.792953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:17.796610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:17.798049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:17.799792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:17.801193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:17.805836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:18.146636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:18.159852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e50678b1-c865-4ad3-880c-15d3773c43e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.388443 Oct 16 01:34:18.162198 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2824/5781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:17 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:19.185856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:19.186684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:19.196111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:19.196779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:19.218587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:19.218587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:19.218587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:19.218587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:19.496266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:19.511622 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f983895d-88c6-4044-b84d-20d27070d4df tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.327262 Oct 16 01:34:19.514328 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2958/5782] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:19 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:20.544333 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:20.545850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:20.559236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:20.574534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:20.575472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:20.582605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:20.583395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:20.584094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:20.890585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:20.901286 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2990322f-4cd6-4e33-8f1b-53c47d49491f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.364412 Oct 16 01:34:20.902568 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2825/5783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:20 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:21.927825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:21.929220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:21.942257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:21.943978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:21.946462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:21.947664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:21.949157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:21.951040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:22.353352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:22.365303 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-93a2979a-660d-40de-acb7-8238c99adaff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.443360 Oct 16 01:34:22.366447 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2959/5784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:21 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:23.396317 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:23.396995 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:23.427213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:23.427729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:23.428159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:23.428883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:23.429332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:23.429760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:23.881506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:23.891291 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a431d24e-50eb-43f6-aa39-9b34ca8f2932 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.498543 Oct 16 01:34:23.911957 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2826/5785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:23 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:24.915903 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:24.918120 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:24.934574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:24.951899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:24.951899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:24.951899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:24.951899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:24.951899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:25.286372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:25.297367 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bc15d2b3-ba91-40f5-b433-67a835c8e2b6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.383688 Oct 16 01:34:25.300017 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2960/5786] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:24 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:26.322630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:26.324467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:26.339349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:26.341159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:26.348196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:26.349660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:26.351856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:26.353565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:26.581592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:26.610465 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef18b0c4-ba23-4640-b75e-64015aa4b68b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.284077 Oct 16 01:34:26.613136 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2827/5787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:26 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:27.635857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:27.636459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:27.656456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:27.657355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:27.657486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:27.658108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:27.658567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:27.659021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:27.881815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:27.891156 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3cdfa9db-6893-4307-9bc1-df960e1a4427 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.259070 Oct 16 01:34:27.894095 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2961/5788] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:27 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:28.918943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:28.920162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:28.942739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:28.943516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:28.944148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:28.945841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:28.947246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:28.949075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:29.203649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:29.216962 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f7d9b2f2-81df-4066-b2fb-7de4c22bca60 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.301897 Oct 16 01:34:29.218261 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2828/5789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:28 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:30.246658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:30.247376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:30.274707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:30.275190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:30.277502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:30.278269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:30.278792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:30.279218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:30.647340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:30.672142 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba27c673-8445-4e08-9485-72a26ebdd8c9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.430725 Oct 16 01:34:30.678962 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2962/5790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:30 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:31.701974 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:31.702627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:31.715544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:31.719716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:31.720360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:31.721277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:31.722708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:31.723450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:31.997222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:32.010495 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c136fe64-8073-462d-aeea-9adeef204d28 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.314368 Oct 16 01:34:32.011712 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2829/5791] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:31 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:33.050512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:33.051356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:33.066870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:33.067454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:33.067901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:33.068621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:33.069085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:33.069507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:33.361376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:33.379595 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5f30326-5bc6-47e6-b3ec-e3bb8fa28470 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.337175 Oct 16 01:34:33.382232 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2963/5792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:33 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:34.414204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:34.415708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:34.443639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:34.461271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:34.462830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:34.463970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:34.464684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:34.466278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:34.720676 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:34.730786 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-da6bb949-659c-4311-8e2e-c03a23367c5e tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.324564 Oct 16 01:34:34.745981 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2830/5793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:34 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:35.777132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:35.778686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:35.786255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:35.787175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:35.787626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:35.788354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:35.788979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:35.789791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:36.061425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:36.071404 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2798a195-cad9-4dda-abff-b5fefec9e71c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.298637 Oct 16 01:34:36.072003 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2964/5794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:35 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:37.101704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:37.102968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:37.117640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:37.118143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:37.124771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:37.126107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:37.129269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:37.130036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:37.463116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:37.473231 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7516cc5a-1d5c-4a02-b12c-1bda38613eee tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.375557 Oct 16 01:34:37.489466 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2831/5795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:37 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:38.503726 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:38.504356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:38.535571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:38.536096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:38.538624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:38.543007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:38.543007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:38.543007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:38.885505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:38.894868 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0956a638-60b5-4bd4-b65c-40ef11ddfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.402364 Oct 16 01:34:38.898968 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2965/5796] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:38 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:39.927846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:39.929063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:39.943874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:39.944890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:39.952224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:39.957676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:39.959656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:39.961320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:40.300025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:40.310613 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e26d9e57-83a6-4cea-99bf-2b8247c58d29 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.388773 Oct 16 01:34:40.311797 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2832/5797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:39 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:41.335555 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:41.336271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:41.357786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:41.363538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:41.364090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:41.364921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:41.365632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:41.366136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:41.590716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:41.614993 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-faf2df50-6105-40ff-a743-802aaffd8c98 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1724 microversion: 2.1 time: 0.283547 Oct 16 01:34:41.615622 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2966/5798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:41 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:42.645488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:42.646100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:42.666610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:42.667603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:42.668150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:42.669101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:42.674310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:42.675212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:42.992435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:43.011653 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4009e4d-4706-4e97-aa88-d998a83ffe5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1701 microversion: 2.1 time: 0.369133 Oct 16 01:34:43.014679 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2833/5799] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:42 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1701 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:43.041591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05f251d2-3874-4479-8659-b91083f27362 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:34:43.059097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05f251d2-3874-4479-8659-b91083f27362 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:43.059742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05f251d2-3874-4479-8659-b91083f27362 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:43.060294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05f251d2-3874-4479-8659-b91083f27362 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:43.109039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05f251d2-3874-4479-8659-b91083f27362 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Going to try to start instance {{(pid=120545) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 01:34:43.172365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05f251d2-3874-4479-8659-b91083f27362 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action" status: 202 len: 0 microversion: 2.1 time: 0.134475 Oct 16 01:34:43.174010 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2967/5800] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:34:43 2022] POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:34:43.189308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:43.194967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:43.211490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:43.212272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:43.212886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:43.213740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:43.214345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:43.215068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:43.581966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:43.596758 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4ddbe32-5ab4-4378-83c6-a67b5e80d471 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1710 microversion: 2.1 time: 0.416882 Oct 16 01:34:43.598695 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2834/5801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:43 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1710 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:44.627527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:44.628916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:44.641282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:44.644305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:44.644962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:44.648868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:44.649371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:44.649859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:44.861873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:44.870195 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d60b93b5-abbd-4004-97d0-2f60bc2e980f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1710 microversion: 2.1 time: 0.247252 Oct 16 01:34:44.870781 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2968/5802] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:44 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1710 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:45.894872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:45.897148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:45.908235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:45.908940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:45.909701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:45.910947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:45.911807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:45.912685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:46.091077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:46.104952 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ff2bfe68-244d-4516-9acb-5907c15ec2b4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1714 microversion: 2.1 time: 0.214492 Oct 16 01:34:46.106375 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2835/5803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:45 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1714 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:53.558951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-897795979", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:34:53.585193 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=25 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:53.656881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:34:54.121575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:34:54.122244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:34:54.122806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:34:54.124354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:34:54.125800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:34:54.148684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:54.149330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:54.150694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:54.151826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:54.153702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:54.155042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:54.165813 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:54.188133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Getting quotas for project 59856008e5d1474a916e494267001984. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:34:54.195066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Getting quotas for user 94aefc3d45e24a2a90c1e4eac92b2697 and project 59856008e5d1474a916e494267001984. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:34:54.208605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:34:54.211056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:34:54.274442 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-26c8602b-91ab-44d2-a607-5821172006a4 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722972 Oct 16 01:34:54.275872 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2969/5804] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:34:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:34:54.292768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23af711d-6f7c-4187-8cfe-feefdda6cef3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:54.293474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-23af711d-6f7c-4187-8cfe-feefdda6cef3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:54.301142 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=27 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:54.431993 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-23af711d-6f7c-4187-8cfe-feefdda6cef3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:54.451578 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23af711d-6f7c-4187-8cfe-feefdda6cef3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1213 microversion: 2.1 time: 0.167286 Oct 16 01:34:54.455257 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2836/5805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:54 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:34:55.481987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:55.482791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:55.503469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:55.504847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:55.505478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:55.506400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:55.507073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:55.507710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:55.960240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:55.974388 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-782e19fc-b7d8-481d-b605-8c581d0630e9 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1265 microversion: 2.1 time: 0.496709 Oct 16 01:34:55.984028 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2970/5806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:55 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1265 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:57.001128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:57.001776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:57.006411 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:34:57.025635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:57.028358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:57.030057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:57.033164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:57.035662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:57.037289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:57.174267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:57.183095 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2a4c149e-11e2-441c-9e41-c5f4b53e2a43 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1271 microversion: 2.1 time: 0.190526 Oct 16 01:34:57.185832 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2837/5807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:56 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:34:58.209000 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:58.210205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:58.219760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:58.220266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:58.220703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:58.221417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:58.221880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:58.222311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:58.505875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:58.514708 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d43f2029-62cc-4f70-9adb-dc0fde5c1496 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1313 microversion: 2.1 time: 0.309822 Oct 16 01:34:58.517756 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2971/5808] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:58 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:34:58.929129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-773227cb-5671-485e-92f1-01d3bc0ccedb req-7e0627ae-7ef4-4df4-81c6-d74c002acdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4323f84e-b517-4f2a-a0c8-ff58f852626d", "tag": "38c43063-c9ad-4ea9-83ef-a27abed8ca49"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:34:58.951814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-773227cb-5671-485e-92f1-01d3bc0ccedb req-7e0627ae-7ef4-4df4-81c6-d74c002acdf0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:58.952395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-773227cb-5671-485e-92f1-01d3bc0ccedb req-7e0627ae-7ef4-4df4-81c6-d74c002acdf0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:58.952969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-773227cb-5671-485e-92f1-01d3bc0ccedb req-7e0627ae-7ef4-4df4-81c6-d74c002acdf0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:58.982145 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-773227cb-5671-485e-92f1-01d3bc0ccedb req-7e0627ae-7ef4-4df4-81c6-d74c002acdf0 service nova] Creating event network-changed:38c43063-c9ad-4ea9-83ef-a27abed8ca49 for instance 4323f84e-b517-4f2a-a0c8-ff58f852626d on n-h2-master-1 Oct 16 01:34:58.999347 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-773227cb-5671-485e-92f1-01d3bc0ccedb req-7e0627ae-7ef4-4df4-81c6-d74c002acdf0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072623 Oct 16 01:34:59.004134 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2838/5809] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:34:59.583315 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:34:59.585156 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:34:59.592865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:59.593586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:59.594828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:59.595933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:34:59.596559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:34:59.597138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:34:59.869563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:34:59.910778 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd26d58c-3b0f-4bd0-92f4-7f8c6a8beeb7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1313 microversion: 2.1 time: 0.370067 Oct 16 01:34:59.914533 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2972/5810] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:34:59 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:00.939598 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:00.940325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:00.969966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:00.970595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:00.970964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:00.978661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:00.980984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:00.985962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:01.334613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:01.348067 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4673343-4dc9-433a-9e10-c357dcecb6e7 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1313 microversion: 2.1 time: 0.414524 Oct 16 01:35:01.361225 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2839/5811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:00 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:02.373194 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:02.373810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:02.385134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:02.385622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:02.386059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:02.386772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:02.387266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:02.387693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:02.717827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:02.731380 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e436679-38f8-4e60-8d48-d7e535cdb9a6 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1313 microversion: 2.1 time: 0.361860 Oct 16 01:35:02.731972 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2973/5812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:02 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:03.755655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:03.756371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:03.764516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:03.765629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:03.770072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:03.772114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:03.774763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:03.775511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:04.063522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:04.073944 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eda981e2-52df-481d-a7a9-021d9394fb4b tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1313 microversion: 2.1 time: 0.322181 Oct 16 01:35:04.075785 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2840/5813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:03 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:05.099570 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:05.100233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:05.102823 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:05.103961 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:05.116180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:05.117553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:05.118197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:05.119293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:05.123905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:05.124957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:05.306199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:05.316286 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-38520fa9-38aa-4ff1-b55c-dbed35a71d15 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1313 microversion: 2.1 time: 0.220763 Oct 16 01:35:05.316884 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2974/5814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:05 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:05.730043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b4f05779-2ede-465c-9c01-a2533f542767 req-ccf7fbf7-a3bc-46b8-8096-2abed7edfc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4323f84e-b517-4f2a-a0c8-ff58f852626d", "name": "network-vif-plugged", "status": "completed", "tag": "38c43063-c9ad-4ea9-83ef-a27abed8ca49"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:35:05.748269 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:05.758326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b4f05779-2ede-465c-9c01-a2533f542767 req-ccf7fbf7-a3bc-46b8-8096-2abed7edfc34 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:05.761858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b4f05779-2ede-465c-9c01-a2533f542767 req-ccf7fbf7-a3bc-46b8-8096-2abed7edfc34 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:05.764138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b4f05779-2ede-465c-9c01-a2533f542767 req-ccf7fbf7-a3bc-46b8-8096-2abed7edfc34 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:05.781954 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b4f05779-2ede-465c-9c01-a2533f542767 req-ccf7fbf7-a3bc-46b8-8096-2abed7edfc34 service nova] Creating event network-vif-plugged:38c43063-c9ad-4ea9-83ef-a27abed8ca49 for instance 4323f84e-b517-4f2a-a0c8-ff58f852626d on n-h2-master-1 Oct 16 01:35:05.789160 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b4f05779-2ede-465c-9c01-a2533f542767 req-ccf7fbf7-a3bc-46b8-8096-2abed7edfc34 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064161 Oct 16 01:35:05.790178 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2841/5815] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:35:06.342980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:06.345287 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:06.352961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:06.353779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:06.354454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:06.355676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:06.356415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:06.357056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:06.534770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:06.553481 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7924a3e8-aeb8-4536-9b38-06e985bfbe64 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1313 microversion: 2.1 time: 0.217856 Oct 16 01:35:06.554625 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2975/5816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:06 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:07.580478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:07.581788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:07.588868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:07.589608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:07.590255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:07.591221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:07.591865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:07.592494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:07.770318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:07.781035 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3aa9956-7488-48c0-a5d8-c0a362602444 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1463 microversion: 2.1 time: 0.205081 Oct 16 01:35:07.800005 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2842/5817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:07 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:35:07.807814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4881bda-acb5-4a7a-9d76-3cf2fa163221", "device": "/dev/sdb"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:35:07.811428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:07.824204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:07.826017 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:07.826649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:07.828027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:07.828677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:07.829369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:08.160000 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8dd08955-97ae-4b42-8a7a-208a087202f3 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "POST /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356017 Oct 16 01:35:08.160548 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2976/5818] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:35:07 2022] POST /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:35:13.233262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Calling method '.version_select at 0x7fd6527a54c0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:13.236161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:13.236733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:13.237313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:13.254252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:13.255092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:13.255957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:13.269447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:13.270331 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:13.271009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:13.278688 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a25d4faa-867b-48c2-8f0a-aaf71bb85a43 tempest-PortsAdminExtendedAttrsTestJSON-1700134171 tempest-PortsAdminExtendedAttrsTestJSON-1700134171-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.193609 Oct 16 01:35:13.289401 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2843/5819] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:35:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:35:18.687408 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:18.688140 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:18.693775 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:18.695104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:18.711741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:18.713523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:18.713985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:18.716651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:18.717234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:18.720208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:18.893628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lazy-loading 'services' on Instance uuid 44c0fbbc-ac3c-4217-8b5b-1555b683137c {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:35:18.991062 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e904e952-ad79-4c6e-9832-1b7313a7ae63 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-volume_attachments/7d0164b2-2045-49e1-8387-0e7e93cd25c8" status: 202 len: 0 microversion: 2.1 time: 0.305773 Oct 16 01:35:18.991675 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2977/5820] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:35:18 2022] DELETE /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-volume_attachments/7d0164b2-2045-49e1-8387-0e7e93cd25c8 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:35:26.886684 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ded31314-613c-46f3-94d3-bf831ea8f489 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:35:26.902118 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=19 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:26.902118 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=34 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:35:26.902118 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:35:26.902118 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 01:35:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action (ip 10.222.0.39) !!! Oct 16 01:35:26.903721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded31314-613c-46f3-94d3-bf831ea8f489 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:26.904506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded31314-613c-46f3-94d3-bf831ea8f489 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:26.906450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ded31314-613c-46f3-94d3-bf831ea8f489 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:26.981557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ded31314-613c-46f3-94d3-bf831ea8f489 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Going to try to stop instance {{(pid=120546) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:35:27.109852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ded31314-613c-46f3-94d3-bf831ea8f489 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action" status: 202 len: 0 microversion: 2.1 time: 0.225448 Oct 16 01:35:27.111523 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2844/5821] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:35:26 2022] POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:35:27.125766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:27.128592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:27.153570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:27.154074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:27.154520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:27.155283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:27.156378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:27.156710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:27.508262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:27.519352 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-020fde35-9d4a-4e5a-b239-85c1a71b71b5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1678 microversion: 2.1 time: 0.403500 Oct 16 01:35:27.520576 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2978/5822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:27 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1678 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:28.557641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:28.561220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:28.602444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:28.610392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:28.613365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:28.614114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:28.617199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:28.617646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:29.464588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:29.477241 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03afef11-de30-4ccd-82b5-10619094bf0a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1678 microversion: 2.1 time: 0.935525 Oct 16 01:35:29.479129 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2845/5823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:28 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1678 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:30.515723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:30.522358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:30.543242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:30.544538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:30.546725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:30.552524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:30.553213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:30.557081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:30.883282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:30.893497 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-50e953fe-5087-4d30-8e44-5adeec618b67 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1678 microversion: 2.1 time: 0.395543 Oct 16 01:35:30.898958 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2979/5824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:30 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1678 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:31.922541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:31.923259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:31.938320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:31.938710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:31.939391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:31.940717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:31.942496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:31.943486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:32.179806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:32.188713 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb84844d-dc3b-455e-be0e-b8ad44ac244d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1678 microversion: 2.1 time: 0.269919 Oct 16 01:35:32.190190 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2846/5825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:31 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:33.217563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:33.219189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:33.227540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:33.228378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:33.229209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:33.230176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:33.231086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:33.231744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:33.642757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:33.661284 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58cc0027-7283-438a-9794-65bac8f1c5a5 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1678 microversion: 2.1 time: 0.447950 Oct 16 01:35:33.678996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2980/5826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:33 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1678 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:34.694018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:34.695799 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:34.714362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:34.721720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:34.725866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:34.731835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:34.743197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:34.745730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:35.039451 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:35.067174 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2cee637c-194e-4a53-bac4-ccb047c3e76f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1678 microversion: 2.1 time: 0.374866 Oct 16 01:35:35.069721 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2847/5827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:34 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1678 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:36.092246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:36.092853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:36.111771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:36.112285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:36.112731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:36.113604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:36.114158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:36.122266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:36.465770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:36.476223 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2ea5bd87-cdec-4c4f-b900-fe9e58a84719 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1678 microversion: 2.1 time: 0.387947 Oct 16 01:35:36.499115 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2981/5828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:36 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1678 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:37.507089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:37.515539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:37.536227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:37.536649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:37.537084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:37.537811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:37.559581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:37.560042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:38.147996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:38.181403 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c3315f9b-463e-4f68-bfb1-dad1d36d91d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1678 microversion: 2.1 time: 0.678765 Oct 16 01:35:38.186256 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2848/5829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:37 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1678 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:39.215453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:39.217694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:39.235251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:39.236190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:39.239376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:39.241900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:39.246632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:39.249902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:40.082686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:40.094388 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8cd9ece1-d4e5-4845-8103-19c569fdad58 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1655 microversion: 2.1 time: 0.886611 Oct 16 01:35:40.096447 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2982/5830] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:39 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1655 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:40.133556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23b369c6-a2f0-415d-9b0b-d1c18aa9a60b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:35:40.158322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b369c6-a2f0-415d-9b0b-d1c18aa9a60b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:40.158895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b369c6-a2f0-415d-9b0b-d1c18aa9a60b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:40.159367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b369c6-a2f0-415d-9b0b-d1c18aa9a60b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:40.258369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-23b369c6-a2f0-415d-9b0b-d1c18aa9a60b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Going to try to start instance {{(pid=120546) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 01:35:40.370309 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23b369c6-a2f0-415d-9b0b-d1c18aa9a60b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action" status: 202 len: 0 microversion: 2.1 time: 0.240479 Oct 16 01:35:40.373899 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2849/5831] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:35:40 2022] POST /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:35:40.382637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:40.383966 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:40.400872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:40.403164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:40.406469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:40.411452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:40.416426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:40.420405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:40.811356 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:40.833894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc1de052-d72b-4761-b6e6-3524a17e05c0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1664 microversion: 2.1 time: 0.453363 Oct 16 01:35:40.835697 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2983/5832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:40 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1664 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:41.864580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:41.865481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:41.898790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:41.900120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:41.903193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:41.907738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:41.908228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:41.908667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:42.149053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:42.163421 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8eb8376-d206-490e-b7f5-974735a1c5c8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1664 microversion: 2.1 time: 0.304507 Oct 16 01:35:42.165521 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2850/5833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:41 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1664 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:35:43.192645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:35:43.193510 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:35:43.205614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:43.206214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:43.206725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:43.207745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:35:43.208435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:35:43.209068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:35:43.557354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:35:43.583941 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f044c25-823d-4dd3-ba0d-4575dc783e17 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1668 microversion: 2.1 time: 0.395379 Oct 16 01:35:43.584537 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2984/5834] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:35:43 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1668 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:15.667535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:15.671408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:15.674964 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=14 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:15.718172 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:15.723154 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:36:15.723479 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 01:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-volume_attachments (ip 10.222.0.39) !!! Oct 16 01:36:15.749333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:15.750141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:15.752697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:15.753661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:15.755218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:15.756919 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:15.848249 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-da0d42c9-94b4-4c26-a03c-189b8163b8cd tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.185250 Oct 16 01:36:15.848898 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2851/5835] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:36:15 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:36:15.947847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:15.948965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:15.968509 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:15.978199 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:16.008266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:16.011401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:16.011939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:16.014400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:16.022387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:16.022958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:16.066102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:36:16.219181 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1159df35-4a44-4e1b-a47a-35dc606bf102 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 204 len: 0 microversion: 2.1 time: 0.291412 Oct 16 01:36:16.223698 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2985/5836] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:36:15 2022] DELETE /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:36:16.228488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:16.229103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:16.237763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:16.238266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:16.247071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:16.247906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:16.248552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:16.249713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:16.613008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:16.626432 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0b7e7cd8-75ea-447d-bf39-2d9cb786d4e2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1674 microversion: 2.1 time: 0.401087 Oct 16 01:36:16.638943 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2852/5837] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:16 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1674 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:17.656270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:17.657449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:17.675566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:17.676360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:17.676928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:17.677787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:17.678374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:17.678940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:17.961212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:17.970840 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f85797dc-3bcf-458d-ba26-94ce6f9b1b30 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1674 microversion: 2.1 time: 0.320652 Oct 16 01:36:17.978967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2986/5838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:17 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1674 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:36:19.005035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:19.006342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:19.027270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:19.032672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:19.033136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:19.033890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:19.034359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:19.034786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:19.271394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:19.282953 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80a0c666-ff25-4918-b449-1a3427eb34a1 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1674 microversion: 2.1 time: 0.281826 Oct 16 01:36:19.308539 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2853/5839] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:18 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1674 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:20.204056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a239b3a0-4d2a-4c7e-a594-19feb502313f req-be18bf14-4729-4309-977a-126fdc2fa622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c0fbbc-ac3c-4217-8b5b-1555b683137c", "name": "network-vif-deleted", "tag": "82402e6f-2f86-4c6b-9466-f9a33eddf0ce"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:20.226262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a239b3a0-4d2a-4c7e-a594-19feb502313f req-be18bf14-4729-4309-977a-126fdc2fa622 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:20.227037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a239b3a0-4d2a-4c7e-a594-19feb502313f req-be18bf14-4729-4309-977a-126fdc2fa622 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:20.229195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a239b3a0-4d2a-4c7e-a594-19feb502313f req-be18bf14-4729-4309-977a-126fdc2fa622 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:20.277770 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a239b3a0-4d2a-4c7e-a594-19feb502313f req-be18bf14-4729-4309-977a-126fdc2fa622 service nova] Creating event network-vif-deleted:82402e6f-2f86-4c6b-9466-f9a33eddf0ce for instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c on n-h1-master-1 Oct 16 01:36:20.294458 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a239b3a0-4d2a-4c7e-a594-19feb502313f req-be18bf14-4729-4309-977a-126fdc2fa622 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100914 Oct 16 01:36:20.295110 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2987/5840] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:36:20.307874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:20.308518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:20.325173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:20.326033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:20.331428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:20.332584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:20.335564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:20.339023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:20.404239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:20.406823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:20.408205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:20.408883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lazy-loading 'fault' on Instance uuid 44c0fbbc-ac3c-4217-8b5b-1555b683137c {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:36:20.463073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:20.473531 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-789ce101-aa67-4b1e-b8a4-f7b42dcfaaef tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 200 len: 1327 microversion: 2.1 time: 0.169584 Oct 16 01:36:20.474487 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2854/5841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:20 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 1327 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:21.503591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:21.504308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:21.513817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:21.514318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:21.515101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:21.515913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:21.516387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:21.516830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:21.564401 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] HTTP exception thrown: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Request method failure captured: Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c HTTP/1.1 Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS19A3zchT3-eXPzRtOyyjkDBfAP0Qbv9FzPLP1e30O6vNz6UdmPsN5boQwUfjwMOpYGzucQ9JL5eIWd3tI2lz5sm_pSZ2GILZis6z0yWNWZY4bxyHlMrWlA623Aqd2clBLY1cMEUfm9z4uXjeMd6OtxTt5BmaGe3POFjrx3ipmBCNTs Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3bf371ee661342e193e6d9d4aacda40d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 6a10008a2a4e41c5be09552821db8fad Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '44c0fbbc-ac3c-4217-8b5b-1555b683137c'} Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:36:21.573814 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Returning 404 to user: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:36:21.577878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a1705902-04e2-4dd2-bdaa-5f06f834a8e8 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 404 len: 111 microversion: 2.1 time: 0.078859 Oct 16 01:36:21.579583 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2988/5842] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:21 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:36:21.588273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6d1a294-d354-4efe-9e17-7cda7d16feff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '.version_select at 0x7fd64e7b9ee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:21.636652 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6d1a294-d354-4efe-9e17-7cda7d16feff tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1490448375" status: 202 len: 0 microversion: 2.1 time: 0.055160 Oct 16 01:36:21.640897 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2855/5843] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1490448375 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:36:23.053378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f7dc7b4-3df9-466f-873f-281ae3ab0f80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'create', calling method: .version_select at 0x7fd64d2628b0>, body: {"keypair": {"name": "tempest-keypair-2059157219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOLfLzPLWgKV104hJCJBnoiHnWjy7N5C4lqJIQ8UXkiir9+dMrty6I2WZeSNePsMRSCM0d6QIFBE0dNxH2kx1aL0xItACPFZqOCB3LH8VrSOGHNwXuKLNT+geL6p3TObQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:23.092218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8f7dc7b4-3df9-466f-873f-281ae3ab0f80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Getting quotas for project 3bf371ee661342e193e6d9d4aacda40d. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:36:23.106667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8f7dc7b4-3df9-466f-873f-281ae3ab0f80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Getting quotas for user 6a10008a2a4e41c5be09552821db8fad and project 3bf371ee661342e193e6d9d4aacda40d. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:36:23.148732 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f7dc7b4-3df9-466f-873f-281ae3ab0f80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099337 Oct 16 01:36:23.149756 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2989/5844] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:36:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:36:23.531721 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-106094604", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "69a9632f-aeb6-4d71-a553-c07c689c9f7d"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:23.680170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] validate_networks() for [('69a9632f-aeb6-4d71-a553-c07c689c9f7d', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:36:24.801170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:36:24.801725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:36:24.802147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:36:24.802473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:36:24.802888 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:36:24.817211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:24.817716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:24.818161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:24.834555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:24.835211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:24.836080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:24.894873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Getting quotas for project 18778c9e91d14fed9e49afc254aa81fd. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:36:24.900669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Getting quotas for user 4bdb352285134f4b93ab4879db31c8c1 and project 18778c9e91d14fed9e49afc254aa81fd. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:36:24.964358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:36:24.976360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:36:25.113753 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8460b87e-9f5c-417a-b07c-a9bda29dce0a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.587275 Oct 16 01:36:25.118753 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2856/5845] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:36:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:36:25.132843 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-deca9e08-77f0-482d-b501-7131e05d1845 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:25.134507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-deca9e08-77f0-482d-b501-7131e05d1845 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:25.367346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-deca9e08-77f0-482d-b501-7131e05d1845 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:25.392933 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-deca9e08-77f0-482d-b501-7131e05d1845 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1218 microversion: 2.1 time: 0.264292 Oct 16 01:36:25.398776 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2990/5846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:25 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:26.175986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-912867783", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b2d38f5-a0ff-48ac-8d65-321cf81e635b"}], "security_groups": [{"name": "tempest-securitygroup--793759939"}], "key_name": "tempest-keypair-2059157219", "user_data": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:26.427818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cebbc7d0-7f5b-458e-ab1c-738f043bdba3 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:26.428469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cebbc7d0-7f5b-458e-ab1c-738f043bdba3 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:26.855807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cebbc7d0-7f5b-458e-ab1c-738f043bdba3 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:26.871697 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cebbc7d0-7f5b-458e-ab1c-738f043bdba3 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1218 microversion: 2.1 time: 0.446949 Oct 16 01:36:26.879301 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2991/5847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:26 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1218 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:36:26.939743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] validate_networks() for [('4b2d38f5-a0ff-48ac-8d65-321cf81e635b', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:36:27.899392 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-51746a08-c2bf-45c0-b5bd-934f39b78310 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:27.900252 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-51746a08-c2bf-45c0-b5bd-934f39b78310 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:27.931962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:36:27.932538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:36:27.933112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:36:27.933996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:36:27.934566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:36:27.959782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:27.960285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:27.960730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:27.961468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:27.961935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:27.962374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:28.001277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Getting quotas for project 3bf371ee661342e193e6d9d4aacda40d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:36:28.008831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Getting quotas for user 6a10008a2a4e41c5be09552821db8fad and project 3bf371ee661342e193e6d9d4aacda40d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:36:28.024803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:36:28.028373 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:36:28.117677 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59c73a92-4764-413b-bc9b-9b396639dd5d tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.947535 Oct 16 01:36:28.118666 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2857/5848] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:36:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:36:28.130027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-51746a08-c2bf-45c0-b5bd-934f39b78310 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:28.134304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e762b1bf-b4f7-4124-b49d-f7cebd91c27c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:28.136630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e762b1bf-b4f7-4124-b49d-f7cebd91c27c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:28.138995 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-51746a08-c2bf-45c0-b5bd-934f39b78310 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1218 microversion: 2.1 time: 0.245647 Oct 16 01:36:28.144955 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2992/5849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:27 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:28.293597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e762b1bf-b4f7-4124-b49d-f7cebd91c27c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:28.357021 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e762b1bf-b4f7-4124-b49d-f7cebd91c27c tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1237 microversion: 2.1 time: 0.230203 Oct 16 01:36:28.357693 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2858/5850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:28 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1237 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:36:29.168277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:29.186020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:29.203370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:29.203878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:29.204318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:29.214869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:29.215683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:29.216288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:29.379764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:29.389301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:29.390599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:29.409834 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8214cc5a-d92d-4a32-bc79-f328bbcc2b45 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1278 microversion: 2.1 time: 0.247941 Oct 16 01:36:29.410847 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2993/5851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:29 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:29.427482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:29.428036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:29.428527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:29.440185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:29.440185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:29.440185 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:29.544416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:29.557159 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d70f7e67-8a3e-45b1-91f6-24b384990265 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1289 microversion: 2.1 time: 0.173990 Oct 16 01:36:29.558179 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2859/5852] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:29 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1289 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:30.437248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:30.438058 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:30.451784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:30.458061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:30.459023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:30.460314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:30.460997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:30.461584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:30.587670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:30.588963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:30.596327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:30.613488 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b172feaa-90bf-4c99-92df-160fc3a7df97 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1276 microversion: 2.1 time: 0.182752 Oct 16 01:36:30.617737 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2994/5853] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:30 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:30.622546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:30.627545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:30.628006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:30.628753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:30.629216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:30.638771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:30.828474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:30.837241 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51528bb8-c243-4024-ac48-2f7ecface671 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1295 microversion: 2.1 time: 0.253353 Oct 16 01:36:30.841458 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2860/5854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:30 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1295 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:36:31.644002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:31.645181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:31.652611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:31.653291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:31.654366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:31.655322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:31.655944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:31.656525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:31.869475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:31.870099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:31.881631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:31.882134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:31.882580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:31.883343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:31.888291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:31.889653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:32.010805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:32.025944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:32.037405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-330fd716-0481-4156-bc2e-b8dffbbeccb7 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1295 microversion: 2.1 time: 0.175621 Oct 16 01:36:32.038725 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2861/5855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:31 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1295 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:36:32.048544 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6a1ba12-1826-46f8-97a8-26657ba871da tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1318 microversion: 2.1 time: 0.406697 Oct 16 01:36:32.050016 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2995/5856] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:31 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:32.850861 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d813dbd9-1d80-4ec5-b70f-ae53228f7ff6 req-5fd7e4e7-45fe-4138-a27a-5ea335c1cf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd480f21-1731-4ed6-82d1-9536c652a42d", "tag": "e92c39e2-9bc3-4eca-a5f3-485f5a5b8399"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:32.868676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d813dbd9-1d80-4ec5-b70f-ae53228f7ff6 req-5fd7e4e7-45fe-4138-a27a-5ea335c1cf11 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:32.869418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d813dbd9-1d80-4ec5-b70f-ae53228f7ff6 req-5fd7e4e7-45fe-4138-a27a-5ea335c1cf11 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:32.870174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d813dbd9-1d80-4ec5-b70f-ae53228f7ff6 req-5fd7e4e7-45fe-4138-a27a-5ea335c1cf11 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:32.956397 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d813dbd9-1d80-4ec5-b70f-ae53228f7ff6 req-5fd7e4e7-45fe-4138-a27a-5ea335c1cf11 service nova] Creating event network-changed:e92c39e2-9bc3-4eca-a5f3-485f5a5b8399 for instance bd480f21-1731-4ed6-82d1-9536c652a42d on n-h1-master-1 Oct 16 01:36:32.980994 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d813dbd9-1d80-4ec5-b70f-ae53228f7ff6 req-5fd7e4e7-45fe-4138-a27a-5ea335c1cf11 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133556 Oct 16 01:36:32.990867 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2862/5857] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:36:33.064685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:33.065319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:33.075911 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:33.077936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:33.093645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:33.094183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:33.094638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:33.099889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:33.100283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:33.100732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:33.103746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:33.104404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:33.104862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:33.105875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:33.111195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:33.114643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:33.653388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:33.665477 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8db05d76-be1f-47ee-a9dc-a65e1ce4f114 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1318 microversion: 2.1 time: 0.595133 Oct 16 01:36:33.672308 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2863/5858] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:33 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:33.687667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:33.704424 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7f9d976a-a564-4c20-b45c-8f7916a38003 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1362 microversion: 2.1 time: 0.644053 Oct 16 01:36:33.725027 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2996/5859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:33 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1362 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:34.695559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:34.696210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:34.713608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:34.716062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:34.716739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:34.719385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:34.723861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:34.725576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:34.732250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:34.733469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:34.754320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:34.755835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:34.757030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:34.757837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:34.768298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:34.768942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:35.076981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:35.136001 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ce5e7ef-f88e-4ea8-92a4-809443a688b6 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1318 microversion: 2.1 time: 0.442742 Oct 16 01:36:35.160221 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2864/5860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:34 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:35.172873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ee96b379-3885-4ce5-a82e-4d3540669006 req-c1af1a7e-272e-4054-9eef-02347f95a660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20873f31-0c67-4339-8c9f-010401f9193b", "tag": "dbb192c7-6422-4d20-a0d3-16e1019cdba0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:35.190757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee96b379-3885-4ce5-a82e-4d3540669006 req-c1af1a7e-272e-4054-9eef-02347f95a660 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:35.191454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee96b379-3885-4ce5-a82e-4d3540669006 req-c1af1a7e-272e-4054-9eef-02347f95a660 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:35.192246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ee96b379-3885-4ce5-a82e-4d3540669006 req-c1af1a7e-272e-4054-9eef-02347f95a660 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:35.193252 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:35.202573 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-35b8acba-3617-464b-bae2-99bba7bcfc46 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1362 microversion: 2.1 time: 0.473826 Oct 16 01:36:35.212022 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2997/5861] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:34 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:35.212378 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ee96b379-3885-4ce5-a82e-4d3540669006 req-c1af1a7e-272e-4054-9eef-02347f95a660 service nova] Creating event network-changed:dbb192c7-6422-4d20-a0d3-16e1019cdba0 for instance 20873f31-0c67-4339-8c9f-010401f9193b on n-h1-master-1 Oct 16 01:36:35.219030 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ee96b379-3885-4ce5-a82e-4d3540669006 req-c1af1a7e-272e-4054-9eef-02347f95a660 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057049 Oct 16 01:36:35.220871 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2865/5862] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:36:36.162656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:36.163326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:36.170203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:36.185576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:36.186308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:36.187559 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:36.187665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:36.188323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:36.258313 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:36.259106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:36.270895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:36.271437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:36.271930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:36.272793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:36.273606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:36.274187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:36.564237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:36.583671 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b862f1dc-b9f7-47d9-beb8-db57120e7050 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1362 microversion: 2.1 time: 0.347124 Oct 16 01:36:36.585200 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2866/5863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:36 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:36.598723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:36.606791 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67683783-0e65-486f-ae4c-5d56c35dfd1c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1318 microversion: 2.1 time: 0.447923 Oct 16 01:36:36.608599 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2998/5864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:36 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:37.613957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:37.614663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:37.630392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:37.631965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:37.633489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:37.635911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:37.636424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:37.636547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:37.637973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:37.638577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:37.653478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:37.653954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:37.654404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:37.655181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:37.655649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:37.656077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:37.985805 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:38.137975 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=10 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:38.229860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:38.263488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:38.267956 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0c882a2e-b9e9-4846-b699-fc9fe4a46ba8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1318 microversion: 2.1 time: 0.633533 Oct 16 01:36:38.278435 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 2999/5865] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:37 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:38.280661 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-173f9e35-3444-4c2d-b68f-0256a6581851 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1362 microversion: 2.1 time: 0.671018 Oct 16 01:36:38.298861 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2867/5866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:37 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1362 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:39.310297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:39.317410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:39.322021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:39.322648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:39.332773 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=14 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:39.344195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:39.344689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:39.345213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:39.346027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:39.346678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:39.347624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:39.357496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:39.358090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:39.358548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:39.362596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:39.363118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:39.363562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:39.621179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:39.627578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:39.649686 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a88b75d4-13fe-4d57-868c-b3e7574bf3ee tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1318 microversion: 2.1 time: 0.359565 Oct 16 01:36:39.652866 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6bf5652-781c-408c-8a67-1b76371896af tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1362 microversion: 2.1 time: 0.334912 Oct 16 01:36:39.653818 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3000/5867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:39 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:39.683819 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2868/5868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:39 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:40.473906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1f8b8d26-3921-492e-a956-1d27f16d9829 req-bb6da40d-668f-4b6d-b0e0-8726581e8b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd480f21-1731-4ed6-82d1-9536c652a42d", "name": "network-vif-plugged", "status": "completed", "tag": "e92c39e2-9bc3-4eca-a5f3-485f5a5b8399"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:40.511218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1f8b8d26-3921-492e-a956-1d27f16d9829 req-bb6da40d-668f-4b6d-b0e0-8726581e8b81 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:40.511218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1f8b8d26-3921-492e-a956-1d27f16d9829 req-bb6da40d-668f-4b6d-b0e0-8726581e8b81 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:40.511218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1f8b8d26-3921-492e-a956-1d27f16d9829 req-bb6da40d-668f-4b6d-b0e0-8726581e8b81 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:40.531620 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1f8b8d26-3921-492e-a956-1d27f16d9829 req-bb6da40d-668f-4b6d-b0e0-8726581e8b81 service nova] Creating event network-vif-plugged:e92c39e2-9bc3-4eca-a5f3-485f5a5b8399 for instance bd480f21-1731-4ed6-82d1-9536c652a42d on n-h1-master-1 Oct 16 01:36:40.544647 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1f8b8d26-3921-492e-a956-1d27f16d9829 req-bb6da40d-668f-4b6d-b0e0-8726581e8b81 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.344549 Oct 16 01:36:40.546308 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3001/5869] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:36:40.677818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:40.678431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:40.678590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:40.679333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:40.688939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:40.693373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:40.694125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:40.696371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:40.697110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:40.697582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:40.698014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:40.699663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:40.700119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:40.700865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:40.701347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:40.701821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:41.020428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:41.030947 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b55d201-cb41-42f5-bad9-71a0770dc637 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1362 microversion: 2.1 time: 0.355552 Oct 16 01:36:41.035282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3002/5870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:40 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:41.054952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:41.072327 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9cc5fbb3-cc58-44f0-b20f-0422122fb98c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1318 microversion: 2.1 time: 0.402550 Oct 16 01:36:41.072940 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2869/5871] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:40 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:36:42.057653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:42.058274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:42.066589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:42.067390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:42.068027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:42.069461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:42.070071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:42.070842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:42.097630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:42.098591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:42.118579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:42.119114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:42.119741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:42.120642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:42.121355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:42.123464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:42.375780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:42.379531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:42.389076 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-383fc86e-2b8e-41ea-89de-3d17215b2910 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1362 microversion: 2.1 time: 0.336916 Oct 16 01:36:42.389840 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bcbbdac7-f6ae-4438-bfa4-59a8e6963630 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1507 microversion: 2.1 time: 0.297390 Oct 16 01:36:42.390835 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2870/5872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:42 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:42.396146 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3003/5873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:42 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:42.586719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f948d709-5d4e-4518-8453-82b91c54acd7 req-c67a0275-2006-4e0f-b6ec-83fbb748b87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20873f31-0c67-4339-8c9f-010401f9193b", "name": "network-vif-plugged", "status": "completed", "tag": "dbb192c7-6422-4d20-a0d3-16e1019cdba0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:42.602885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f948d709-5d4e-4518-8453-82b91c54acd7 req-c67a0275-2006-4e0f-b6ec-83fbb748b87f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:42.603336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f948d709-5d4e-4518-8453-82b91c54acd7 req-c67a0275-2006-4e0f-b6ec-83fbb748b87f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:42.603772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f948d709-5d4e-4518-8453-82b91c54acd7 req-c67a0275-2006-4e0f-b6ec-83fbb748b87f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:42.616424 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f948d709-5d4e-4518-8453-82b91c54acd7 req-c67a0275-2006-4e0f-b6ec-83fbb748b87f service nova] Creating event network-vif-plugged:dbb192c7-6422-4d20-a0d3-16e1019cdba0 for instance 20873f31-0c67-4339-8c9f-010401f9193b on n-h1-master-1 Oct 16 01:36:42.621564 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f948d709-5d4e-4518-8453-82b91c54acd7 req-c67a0275-2006-4e0f-b6ec-83fbb748b87f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040072 Oct 16 01:36:42.622643 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2871/5874] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:36:43.427711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:43.428331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:43.435794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:43.436606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:43.437574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:43.438494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:43.439442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:43.440203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:43.729799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:43.767623 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-602fd99c-31bc-49a4-a911-7bc4a6085f72 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1362 microversion: 2.1 time: 0.337053 Oct 16 01:36:43.768509 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3004/5875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:43 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:44.810054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:44.813239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:44.861601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:44.862114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:44.862560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:44.863385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:44.863848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:44.864288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:44.935814 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:45.208326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:36:45.232417 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b7d304f-cfec-41c2-9db3-9ba8783fade0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1548 microversion: 2.1 time: 0.442197 Oct 16 01:36:45.238143 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2872/5876] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:36:44 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1548 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:36:45.258645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:45.260236 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:45.272384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:45.273208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:45.274956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:45.276615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:45.277289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:45.278346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:45.393505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-052e58b2-da01-4db7-872a-2bb712afffa0 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140224 Oct 16 01:36:45.394491 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3005/5877] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:36:45 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:36:47.757492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f725f1e9-4200-4b04-b3fe-b85cc4ae3aff req-c5190cf4-1f77-437c-931e-9af94e5100e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20873f31-0c67-4339-8c9f-010401f9193b", "tag": "dbb192c7-6422-4d20-a0d3-16e1019cdba0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:36:47.774576 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:47.794005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f725f1e9-4200-4b04-b3fe-b85cc4ae3aff req-c5190cf4-1f77-437c-931e-9af94e5100e8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:47.796971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f725f1e9-4200-4b04-b3fe-b85cc4ae3aff req-c5190cf4-1f77-437c-931e-9af94e5100e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:47.797366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f725f1e9-4200-4b04-b3fe-b85cc4ae3aff req-c5190cf4-1f77-437c-931e-9af94e5100e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:47.830553 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f725f1e9-4200-4b04-b3fe-b85cc4ae3aff req-c5190cf4-1f77-437c-931e-9af94e5100e8 service nova] Creating event network-changed:dbb192c7-6422-4d20-a0d3-16e1019cdba0 for instance 20873f31-0c67-4339-8c9f-010401f9193b on n-h1-master-1 Oct 16 01:36:47.841725 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f725f1e9-4200-4b04-b3fe-b85cc4ae3aff req-c5190cf4-1f77-437c-931e-9af94e5100e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.445416 Oct 16 01:36:47.850608 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2873/5878] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:36:58.387439 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:58.390101 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:36:58.394885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:36:58.395599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:36:58.402978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:58.403658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:58.404276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:58.405744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:36:58.406420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:36:58.407105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:36:58.537970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lazy-loading 'services' on Instance uuid 4323f84e-b517-4f2a-a0c8-ff58f852626d {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:36:58.629903 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b120bda8-86f4-40d8-9e2e-93f3c43d81be tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d/os-volume_attachments/f4881bda-acb5-4a7a-9d76-3cf2fa163221" status: 202 len: 0 microversion: 2.1 time: 0.243724 Oct 16 01:36:58.630500 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3006/5879] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:36:58 2022] DELETE /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d/os-volume_attachments/f4881bda-acb5-4a7a-9d76-3cf2fa163221 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:37:08.635755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:08.636344 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:08.639632 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:08.643676 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:08.657055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:08.657555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:08.670329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:08.671883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:08.672376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:08.672809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:08.720916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:37:08.891542 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-426be467-2d42-45de-8eb4-78ca5bf8393e tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 204 len: 0 microversion: 2.1 time: 0.259028 Oct 16 01:37:08.893043 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2874/5880] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:37:08 2022] DELETE /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:37:08.902288 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:08.904189 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:08.910649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:08.911663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:08.926401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:08.927454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:08.928111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:08.929935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:08.930665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:08.931878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:09.182123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:37:09.191434 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-04d36c28-dac7-453b-9883-cb5b0af30cdc tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1469 microversion: 2.1 time: 0.293979 Oct 16 01:37:09.192341 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3007/5881] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:08 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1469 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:37:10.222630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:10.223476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:10.237379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:10.237881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:10.238591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:10.241480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:10.241991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:10.242436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:10.713278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:37:10.723821 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd367415-6725-4f38-8cf0-9d6efc4f8ff0 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1469 microversion: 2.1 time: 0.506868 Oct 16 01:37:10.725105 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2875/5882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:10 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1469 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:11.749905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:11.750682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:11.758355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:11.758994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:11.759668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:11.761497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:11.762184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:11.762821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:11.798318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-30fd4c0a-ba84-4568-9876-7d4f96015aab req-a1e675e6-cfb8-440a-b45e-392e71955897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4323f84e-b517-4f2a-a0c8-ff58f852626d", "name": "network-vif-deleted", "tag": "38c43063-c9ad-4ea9-83ef-a27abed8ca49"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:11.818380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-30fd4c0a-ba84-4568-9876-7d4f96015aab req-a1e675e6-cfb8-440a-b45e-392e71955897 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:11.819020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-30fd4c0a-ba84-4568-9876-7d4f96015aab req-a1e675e6-cfb8-440a-b45e-392e71955897 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:11.820287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-30fd4c0a-ba84-4568-9876-7d4f96015aab req-a1e675e6-cfb8-440a-b45e-392e71955897 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:11.862199 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-30fd4c0a-ba84-4568-9876-7d4f96015aab req-a1e675e6-cfb8-440a-b45e-392e71955897 service nova] Creating event network-vif-deleted:38c43063-c9ad-4ea9-83ef-a27abed8ca49 for instance 4323f84e-b517-4f2a-a0c8-ff58f852626d on n-h2-master-1 Oct 16 01:37:11.884343 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-30fd4c0a-ba84-4568-9876-7d4f96015aab req-a1e675e6-cfb8-440a-b45e-392e71955897 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093967 Oct 16 01:37:11.885591 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2876/5883] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:11.910079 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aefc3d45e24a2a90c1e4eac92b2697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59856008e5d1474a916e494267001984', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:37:11.923779 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-618d238b-cd1c-4fcf-8bd5-aed572067ace tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 200 len: 1427 microversion: 2.1 time: 0.179588 Oct 16 01:37:11.925545 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3008/5884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:11 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 1427 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:12.997883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:13.021432 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] [instance: 4323f84e-b517-4f2a-a0c8-ff58f852626d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:13.056375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:13.061875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:13.064457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:13.079175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:13.079955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:13.080569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:13.115198 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] HTTP exception thrown: Instance 4323f84e-b517-4f2a-a0c8-ff58f852626d could not be found. Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Request method failure captured: Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d HTTP/1.1 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS1-6g9plKG6tZG5LH6OEEVZKQqJnuIrDT7hJNahc7dMFF4ehq_nneTVu0uHofsxYX4KGNM7MyxfhGPXMmj2GvSDAjhI7GEJ5BfgjaCNQYtL59RbdHAKaH8pDGOwxu72z2jWMMT3x7a1gkY3ncjA4nO-Nrf8Xxyj1EwwFrvPhJzHEAF4 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 59856008e5d1474a916e494267001984 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-VolumesBackupsTest-274669439 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59856008e5d1474a916e494267001984", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59856008e5d1474a916e494267001984"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59856008e5d1474a916e494267001984"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59856008e5d1474a916e494267001984"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-VolumesBackupsTest-274669439 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 59856008e5d1474a916e494267001984 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-VolumesBackupsTest-274669439 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-VolumesBackupsTest-274669439-project Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 94aefc3d45e24a2a90c1e4eac92b2697 Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-VolumesBackupsTest-274669439-project Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 4323f84e-b517-4f2a-a0c8-ff58f852626d could not be found. Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4323f84e-b517-4f2a-a0c8-ff58f852626d'} Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4323f84e-b517-4f2a-a0c8-ff58f852626d could not be found. Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4323f84e-b517-4f2a-a0c8-ff58f852626d could not be found. Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:37:13.118417 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:37:13.122762 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:37:13.122762 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:37:13.122762 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:37:13.122762 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:37:13.122762 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:37:13.122762 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4323f84e-b517-4f2a-a0c8-ff58f852626d could not be found. Oct 16 01:37:13.122762 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:37:13.124458 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] Returning 404 to user: Instance 4323f84e-b517-4f2a-a0c8-ff58f852626d could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:37:13.125684 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3c002a6-6c84-4db8-9df3-6ce49b88bd24 tempest-VolumesBackupsTest-274669439 tempest-VolumesBackupsTest-274669439-project] 10.222.0.39 "GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d" status: 404 len: 111 microversion: 2.1 time: 0.165038 Oct 16 01:37:13.126314 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2877/5885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:12 2022] GET /compute/v2.1/servers/4323f84e-b517-4f2a-a0c8-ff58f852626d => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:37:16.811652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1b31359-89dc-4a29-a9eb-1fd64dd5fac5", "device": "/dev/sdb"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:16.816144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:16.824564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:16.825312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:16.825999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:16.827283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:16.828365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:16.830729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:17.364799 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68904c61-9d9c-4228-8625-62af129a1b85 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "POST /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567567 Oct 16 01:37:17.372654 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3009/5886] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:37:16 2022] POST /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:20.110994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:20.110994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:20.123970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:20.124802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:20.125078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:20.125798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:20.126260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:20.146559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:20.244779 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d6430175-22a4-45f7-aae3-2768e6110596 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/ips" status: 200 len: 146 microversion: 2.1 time: 0.141069 Oct 16 01:37:20.249239 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2878/5887] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Oct 16 01:37:20 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/ips => generated 146 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:37:24.539694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "528d18da-1c02-40b7-9ed9-97c809ca8bf9"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:24.542686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:24.557930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:24.560715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:24.562545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:24.564450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:24.565443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:24.571366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:26.914186 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4c45ba3-e552-4479-965c-58b85d104676 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.377802 Oct 16 01:37:26.923274 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3010/5888] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:37:24 2022] POST /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments => generated 194 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:29.121205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e35158d-f945-47e2-a0a8-5734afb01a1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:29.122869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e35158d-f945-47e2-a0a8-5734afb01a1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:29.124158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e35158d-f945-47e2-a0a8-5734afb01a1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:29.125111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e35158d-f945-47e2-a0a8-5734afb01a1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:29.125856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e35158d-f945-47e2-a0a8-5734afb01a1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:29.126315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e35158d-f945-47e2-a0a8-5734afb01a1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:29.126740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e35158d-f945-47e2-a0a8-5734afb01a1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:29.213633 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e35158d-f945-47e2-a0a8-5734afb01a1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.269314 Oct 16 01:37:29.214554 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2879/5889] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Oct 16 01:37:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:29.334006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-109127287", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "ec46c21c-4b0d-4dc6-97f5-1c318cb291ba"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:29.481701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] validate_networks() for [('ec46c21c-4b0d-4dc6-97f5-1c318cb291ba', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:37:30.884549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:37:30.885071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:37:30.886028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:37:30.886519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:37:30.887094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:37:30.912050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:30.912637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:30.913152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:30.913966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:30.914499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:30.915060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:31.422308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Getting quotas for project 2f9ad54a91194b49823b9b4a704cb546. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:37:31.433761 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Getting quotas for user 1bced1656a3344968447b4152d7bec15 and project 2f9ad54a91194b49823b9b4a704cb546. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:37:31.448795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:37:31.452184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:37:31.533027 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-435ecfb8-e58c-4346-9316-686e473dd306 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.198307 Oct 16 01:37:31.533902 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3011/5890] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:37:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:37:31.545128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-318fe1bc-cfa0-4fda-b5db-1f23ab92ebbf tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:31.546330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-318fe1bc-cfa0-4fda-b5db-1f23ab92ebbf tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:31.877425 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-318fe1bc-cfa0-4fda-b5db-1f23ab92ebbf tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1328 microversion: 2.1 time: 0.336405 Oct 16 01:37:31.881180 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2880/5891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:31 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1328 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:32.908020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c5a0bef0-10e9-4f0f-9109-14b3affa62a9 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:32.908606 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c5a0bef0-10e9-4f0f-9109-14b3affa62a9 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:33.040688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c5a0bef0-10e9-4f0f-9109-14b3affa62a9 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1328 microversion: 2.1 time: 0.139249 Oct 16 01:37:33.047418 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3012/5892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:32 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1328 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:34.074083 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:34.079156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:34.096878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:34.097596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:34.099424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:34.100550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:34.102966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:34.103598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:34.233672 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e5769f97-4f8d-4a51-af44-cbff83eb4f9f tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1415 microversion: 2.1 time: 0.165496 Oct 16 01:37:34.238582 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2881/5893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:34 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1415 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:37:35.260408 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:35.265977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:35.293897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:35.297116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:35.301008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:35.302212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:35.307340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:35.308271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:35.673675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d050b161-ba5f-4728-aa8e-0dadadad5973 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1421 microversion: 2.1 time: 0.414301 Oct 16 01:37:35.688163 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3013/5894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:35 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1421 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:36.702327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:36.702977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:36.715942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:36.716433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:36.717484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:36.725260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:36.725791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:36.726240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:37.188016 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-029e3e04-b51a-4329-ac12-b4d9d8798ce0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1463 microversion: 2.1 time: 0.491379 Oct 16 01:37:37.206521 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2882/5895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:36 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1463 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:38.229733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:38.231524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:38.254538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:38.256323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:38.257547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:38.258691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:38.265958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:38.267336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:38.514846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-61d8ef70-0980-4226-b41b-6adf43d3ebcf req-162ab818-f8b1-4025-bafc-fe79dc290da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ac0808-f5c1-434c-b78c-cffe906d77eb", "tag": "c9fd0a2e-4566-48de-bf58-d9a9993fd231"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:38.538447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-61d8ef70-0980-4226-b41b-6adf43d3ebcf req-162ab818-f8b1-4025-bafc-fe79dc290da8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:38.539212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-61d8ef70-0980-4226-b41b-6adf43d3ebcf req-162ab818-f8b1-4025-bafc-fe79dc290da8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:38.539775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-61d8ef70-0980-4226-b41b-6adf43d3ebcf req-162ab818-f8b1-4025-bafc-fe79dc290da8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:38.562774 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-61d8ef70-0980-4226-b41b-6adf43d3ebcf req-162ab818-f8b1-4025-bafc-fe79dc290da8 service nova] Creating event network-changed:c9fd0a2e-4566-48de-bf58-d9a9993fd231 for instance 66ac0808-f5c1-434c-b78c-cffe906d77eb on n-h2-master-1 Oct 16 01:37:38.586736 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-61d8ef70-0980-4226-b41b-6adf43d3ebcf req-162ab818-f8b1-4025-bafc-fe79dc290da8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076307 Oct 16 01:37:38.588063 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2883/5896] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:38.615349 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bfe36a1f-f441-4a99-91af-d679068de536 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1463 microversion: 2.1 time: 0.389678 Oct 16 01:37:38.641222 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3014/5897] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:38 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1463 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:39.653613 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:39.660887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:39.663210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:39.665334 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:39.673654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:39.674613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:39.675114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:39.675814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:39.676428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:39.677004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:39.713757 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:39.990664 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6745c175-ef70-49f1-a88e-5a7dcfb6f79d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1463 microversion: 2.1 time: 0.336673 Oct 16 01:37:39.991873 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2884/5898] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:39 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1463 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:41.013500 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:41.015847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:41.018902 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:41.024392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:41.028168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:41.030355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:41.032942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:41.035117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:41.036542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:41.044564 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:41.299399 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e218e1f-1884-4410-9ab4-b8c4f1b08330 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1463 microversion: 2.1 time: 0.289437 Oct 16 01:37:41.302130 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3015/5899] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:41 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1463 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:42.355132 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:42.356322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:42.360298 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:42.378628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:42.384860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:42.390536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:42.392269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:42.394480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:42.395843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:42.687759 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-283ceb9b-5baf-4e44-8d67-160ee575587d tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1463 microversion: 2.1 time: 0.363173 Oct 16 01:37:42.688790 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2885/5900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:42 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1463 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:43.711473 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:43.712089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:43.714067 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:43.716266 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:43.724364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:43.727973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:43.737310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:43.738344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:43.739019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:43.739609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:43.954896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-23d32d5e-1e6f-4349-a085-396a3a9e70d8 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1463 microversion: 2.1 time: 0.247029 Oct 16 01:37:43.956960 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3016/5901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:43 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1463 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:44.397619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d27bedd5-7490-4440-a44d-82f459d78524 req-5f282a05-b489-4025-950c-16b6247e7289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ac0808-f5c1-434c-b78c-cffe906d77eb", "name": "network-vif-plugged", "status": "completed", "tag": "c9fd0a2e-4566-48de-bf58-d9a9993fd231"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:44.430518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d27bedd5-7490-4440-a44d-82f459d78524 req-5f282a05-b489-4025-950c-16b6247e7289 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:44.431335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d27bedd5-7490-4440-a44d-82f459d78524 req-5f282a05-b489-4025-950c-16b6247e7289 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:44.432014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d27bedd5-7490-4440-a44d-82f459d78524 req-5f282a05-b489-4025-950c-16b6247e7289 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:44.470803 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d27bedd5-7490-4440-a44d-82f459d78524 req-5f282a05-b489-4025-950c-16b6247e7289 service nova] Creating event network-vif-plugged:c9fd0a2e-4566-48de-bf58-d9a9993fd231 for instance 66ac0808-f5c1-434c-b78c-cffe906d77eb on n-h2-master-1 Oct 16 01:37:44.477205 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d27bedd5-7490-4440-a44d-82f459d78524 req-5f282a05-b489-4025-950c-16b6247e7289 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096987 Oct 16 01:37:44.478314 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2886/5902] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:44.979268 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:44.981134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:45.004979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:45.006069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:45.008552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:45.010143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:45.011965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:45.014768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:45.202661 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-76d8b1d7-f238-48d8-a373-cc560e01419a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1463 microversion: 2.1 time: 0.227280 Oct 16 01:37:45.203831 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3017/5903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:44 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1463 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:45.752510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:45.755447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:45.764802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:45.765935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:45.766955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:45.767770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:45.769335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:45.769994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:45.827151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b0de707e-1b96-4935-847e-5cf175e469d6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082215 Oct 16 01:37:45.855339 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2887/5904] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:37:45 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:45.867878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:45.868678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:45.884565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:45.885527 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:45.886208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:45.895531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:45.897051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:45.898511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:45.986295 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4b03b1f7-f184-447a-8970-90d044441399 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/528d18da-1c02-40b7-9ed9-97c809ca8bf9" status: 200 len: 194 microversion: 2.1 time: 0.122639 Oct 16 01:37:45.994106 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3018/5905] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Oct 16 01:37:45 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/528d18da-1c02-40b7-9ed9-97c809ca8bf9 => generated 194 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:46.229215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:46.229842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:46.242234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:46.242653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:46.243123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:46.243846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:46.250280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:46.250810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:46.551993 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30ed6d04-9d95-416b-92ff-cffb4aac6c69 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1648 microversion: 2.1 time: 0.327257 Oct 16 01:37:46.577938 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2888/5906] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:46 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1648 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:46.586407 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:46.587245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:46.600785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:46.603090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:46.605647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:46.606711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:46.608242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:46.611231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:46.913822 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-72d239aa-bee7-4eab-b22b-d18f1a9a2c57 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1648 microversion: 2.1 time: 0.336268 Oct 16 01:37:46.914281 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3019/5907] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:46 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1648 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:37:46.938258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:46.938876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:46.946587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:46.947637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:46.948116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:46.948823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:46.949280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:46.949893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:47.194878 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d225b088-846d-45b6-a743-1d008ca563c7 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1648 microversion: 2.1 time: 0.261019 Oct 16 01:37:47.197931 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2889/5908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:46 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1648 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:47.433778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1752958420", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "ec46c21c-4b0d-4dc6-97f5-1c318cb291ba"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:47.515431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] validate_networks() for [('ec46c21c-4b0d-4dc6-97f5-1c318cb291ba', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:37:48.380409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:37:48.380950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:37:48.381648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:37:48.382162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:37:48.382685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:37:48.406906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:48.407617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:48.408162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:48.408999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:48.409637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:48.410206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:48.449849 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Getting quotas for project 2f9ad54a91194b49823b9b4a704cb546. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:37:48.460890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Getting quotas for user 1bced1656a3344968447b4152d7bec15 and project 2f9ad54a91194b49823b9b4a704cb546. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:37:48.489366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:37:48.491820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:37:48.553274 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4f3e05d5-d92f-4103-87f2-a5631ba686d2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122738 Oct 16 01:37:48.562564 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3020/5909] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:37:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:37:48.566816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37846047-d989-4673-8285-b484e0640d1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:48.567472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37846047-d989-4673-8285-b484e0640d1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:48.671973 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37846047-d989-4673-8285-b484e0640d1a tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1329 microversion: 2.1 time: 0.108733 Oct 16 01:37:48.674958 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2890/5910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:48 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:49.130039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39741527-4ebb-4747-940e-6b20a1c18ebe"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:49.132514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:49.208969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:49.215660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:49.216384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:49.218108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:49.219176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:49.219802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:49.685111 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-421a567d-204b-4727-b76a-8809ebf9c29a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "POST /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.556739 Oct 16 01:37:49.696747 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3021/5911] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:37:49 2022] POST /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:37:49.699876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:49.704280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:49.722220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:49.723109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:49.723736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:49.728596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:49.729453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:49.730087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:49.907232 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-349b6857-dd23-45b5-abac-76ed605aed66 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1338 microversion: 2.1 time: 0.210533 Oct 16 01:37:49.907856 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2891/5912] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:49 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1338 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:37:50.931844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:50.933111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:50.947639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:50.948740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:50.951380 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:50.952427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:50.954146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:50.955383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:51.139523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e628f8a8-0d4e-4cf0-a431-4237e18ffc02 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1422 microversion: 2.1 time: 0.213118 Oct 16 01:37:51.151166 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3022/5913] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:50 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1422 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:52.162941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:52.163557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:52.176843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:52.177758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:52.177758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:52.179356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:52.179898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:52.180351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:52.640439 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b5767c8-3831-4d54-ad4c-2559cca1982c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1464 microversion: 2.1 time: 0.475194 Oct 16 01:37:52.641680 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2892/5914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:52 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1464 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:53.667402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:53.669198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:53.692367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:53.696093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:53.697278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:53.704140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:53.704818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:53.705583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:53.885776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5dc04383-ad68-41f6-9719-b6d64731113c req-fc4d56bd-950a-476b-9894-0f3009e23333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d0f60c-8cb5-4952-b94f-71d198354873", "tag": "7520820a-19ea-4040-bb36-78bd1bcbed17"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:37:53.911834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5dc04383-ad68-41f6-9719-b6d64731113c req-fc4d56bd-950a-476b-9894-0f3009e23333 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:53.912322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5dc04383-ad68-41f6-9719-b6d64731113c req-fc4d56bd-950a-476b-9894-0f3009e23333 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:53.912772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5dc04383-ad68-41f6-9719-b6d64731113c req-fc4d56bd-950a-476b-9894-0f3009e23333 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:53.949403 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5dc04383-ad68-41f6-9719-b6d64731113c req-fc4d56bd-950a-476b-9894-0f3009e23333 service nova] Creating event network-changed:7520820a-19ea-4040-bb36-78bd1bcbed17 for instance 05d0f60c-8cb5-4952-b94f-71d198354873 on n-h1-master-1 Oct 16 01:37:53.954763 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5dc04383-ad68-41f6-9719-b6d64731113c req-fc4d56bd-950a-476b-9894-0f3009e23333 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072692 Oct 16 01:37:53.956103 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2893/5915] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:37:54.063939 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-95704717-fe82-4df5-9f0d-cc7707a2f182 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1464 microversion: 2.1 time: 0.402252 Oct 16 01:37:54.064930 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3023/5916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:53 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1464 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:55.105992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:55.109368 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:55.118558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:55.119304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:55.120057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:55.120978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:55.121795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:55.122418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:55.292071 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ecbe76a7-e492-416f-9d0e-00154ad0df1b tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1464 microversion: 2.1 time: 0.206449 Oct 16 01:37:55.293026 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2894/5917] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:55 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1464 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:56.318891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:56.319705 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:56.338680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:56.339990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:56.340549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:56.341449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:56.342994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:56.342994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:56.583678 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-acbfea3f-1cd9-4636-a278-43b80f20a302 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1464 microversion: 2.1 time: 0.268446 Oct 16 01:37:56.585825 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3024/5918] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:56 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1464 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:57.330767 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:57.331872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:57.339833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:57.341277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:57.342057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:57.343807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:57.344517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:57.345133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:57.437697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lazy-loading 'services' on Instance uuid bd480f21-1731-4ed6-82d1-9536c652a42d {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:37:57.536665 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-069910c4-d397-4914-9eaa-42b8cec10290 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d/os-volume_attachments/a1b31359-89dc-4a29-a9eb-1fd64dd5fac5" status: 202 len: 0 microversion: 2.1 time: 0.210519 Oct 16 01:37:57.552920 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2895/5919] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:37:57 2022] DELETE /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d/os-volume_attachments/a1b31359-89dc-4a29-a9eb-1fd64dd5fac5 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:37:57.610437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:57.612220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:57.622192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:57.624082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:57.624850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:57.626046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:57.628646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:57.629302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:57.793356 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f23d6a0-840c-4fe2-81b7-411c760808e4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1464 microversion: 2.1 time: 0.188480 Oct 16 01:37:57.794211 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3025/5920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:57 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:37:58.824832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:37:58.825799 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:37:58.834965 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:37:58.838053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:58.838623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:58.839301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:58.840086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:37:58.840629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:37:58.841124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:37:59.009597 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-788db801-809c-4467-ab29-a6cbea6f0694 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1464 microversion: 2.1 time: 0.192086 Oct 16 01:37:59.010212 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2896/5921] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:37:58 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1464 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:00.033279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:00.034777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:00.037979 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:00.038885 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:00.044822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:00.046486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:00.047241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:00.047991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:00.048463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:00.048902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:00.186980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9712fab1-4597-4e29-9696-ee307bdbf944 req-f5fbcab1-5453-41f6-b281-7d7f4b73ba67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d0f60c-8cb5-4952-b94f-71d198354873", "name": "network-vif-plugged", "status": "completed", "tag": "7520820a-19ea-4040-bb36-78bd1bcbed17"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:00.193265 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e24a8576-8b69-4ea3-9700-3fa5e7dfbd34 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1464 microversion: 2.1 time: 0.164248 Oct 16 01:38:00.193861 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3026/5922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:00 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:00.199780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9712fab1-4597-4e29-9696-ee307bdbf944 req-f5fbcab1-5453-41f6-b281-7d7f4b73ba67 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:00.200593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9712fab1-4597-4e29-9696-ee307bdbf944 req-f5fbcab1-5453-41f6-b281-7d7f4b73ba67 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:00.201406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9712fab1-4597-4e29-9696-ee307bdbf944 req-f5fbcab1-5453-41f6-b281-7d7f4b73ba67 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:00.215016 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9712fab1-4597-4e29-9696-ee307bdbf944 req-f5fbcab1-5453-41f6-b281-7d7f4b73ba67 service nova] Creating event network-vif-plugged:7520820a-19ea-4040-bb36-78bd1bcbed17 for instance 05d0f60c-8cb5-4952-b94f-71d198354873 on n-h1-master-1 Oct 16 01:38:00.221119 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9712fab1-4597-4e29-9696-ee307bdbf944 req-f5fbcab1-5453-41f6-b281-7d7f4b73ba67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038707 Oct 16 01:38:00.222287 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2897/5923] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:01.216184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:01.216940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:01.223838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:01.224321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:01.224753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:01.225444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:01.225905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:01.226330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:01.354161 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3fad40d2-427d-4d7c-92b3-11c4cc933cb2 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1464 microversion: 2.1 time: 0.141643 Oct 16 01:38:01.354670 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3027/5924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:01 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:02.378704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:02.379423 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:02.385643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:02.386126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:02.386560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:02.387297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:02.387754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:02.388175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:02.525748 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b907608-bc92-41da-999c-721a7abdde16 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1650 microversion: 2.1 time: 0.152157 Oct 16 01:38:02.526582 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2898/5925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:02 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1650 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:02.549238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:02.549961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:02.556374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:02.556956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:02.557475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:02.558254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:02.558799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:02.559353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:02.693833 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-912eaf00-bf4a-468a-a237-b8304f25e2cc tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1650 microversion: 2.1 time: 0.149477 Oct 16 01:38:02.694607 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3028/5926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:02 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1650 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:02.716218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:02.717635 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:02.723763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:02.724319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:02.724823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:02.725589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:02.726115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:02.726609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:02.858236 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-001f276b-fcfb-44d1-87b8-09e1684196a1 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1650 microversion: 2.1 time: 0.145606 Oct 16 01:38:02.858820 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2899/5927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:02 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1650 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:02.880660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:02.881248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:02.887802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:02.889085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:02.889543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:02.890258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:02.890745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:02.891301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:02.917019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:38:02.962388 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:03.011965 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5cd50c15-46a1-4c82-bf0b-7c464d1181b4 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 204 len: 0 microversion: 2.1 time: 0.134610 Oct 16 01:38:03.012571 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3029/5928] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:38:02 2022] DELETE /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:38:03.021956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:03.022573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:03.028579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:03.029089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:03.030131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:03.030834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:03.031322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:03.031745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:03.161760 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cbb8dd6e-00f6-4c5c-b1d1-c5641cea603e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1656 microversion: 2.1 time: 0.143687 Oct 16 01:38:03.162346 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2900/5929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:03 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1656 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:38:04.186327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:04.187246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:04.193978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:04.194503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:04.195011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:04.196044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:04.196568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:04.197069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:04.339206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:04.339964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:04.349040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:04.349573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:04.349997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:04.351064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:04.351785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:04.352354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:04.378077 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-104be0a5-e940-4296-8aaf-4d2c9797d0e0 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1656 microversion: 2.1 time: 0.196354 Oct 16 01:38:04.379251 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3030/5930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:04 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1656 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:04.392362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:38:04.464401 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:04.506960 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c8e713ca-1378-46c8-a3f7-6102bd1ebfa0 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 204 len: 0 microversion: 2.1 time: 0.172730 Oct 16 01:38:04.511506 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2901/5931] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:38:04 2022] DELETE /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:38:04.517637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:04.518424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:04.525619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:04.526487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:04.527230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:04.528153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:04.528824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:04.530515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:04.711714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:04.721323 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9945ccd1-8673-4be6-aa4d-f6dd2a423d76 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1513 microversion: 2.1 time: 0.208652 Oct 16 01:38:04.730940 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3031/5932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:04 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:05.019341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c20266b3-7ca8-4682-a45b-b28591c70841 req-30b07270-577b-4e71-a73d-62fdae4cfedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d0f60c-8cb5-4952-b94f-71d198354873", "name": "network-vif-deleted", "tag": "7520820a-19ea-4040-bb36-78bd1bcbed17"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:05.043973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c20266b3-7ca8-4682-a45b-b28591c70841 req-30b07270-577b-4e71-a73d-62fdae4cfedf service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:05.045829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c20266b3-7ca8-4682-a45b-b28591c70841 req-30b07270-577b-4e71-a73d-62fdae4cfedf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:05.047328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c20266b3-7ca8-4682-a45b-b28591c70841 req-30b07270-577b-4e71-a73d-62fdae4cfedf service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:05.063524 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c20266b3-7ca8-4682-a45b-b28591c70841 req-30b07270-577b-4e71-a73d-62fdae4cfedf service nova] Creating event network-vif-deleted:7520820a-19ea-4040-bb36-78bd1bcbed17 for instance 05d0f60c-8cb5-4952-b94f-71d198354873 on n-h1-master-1 Oct 16 01:38:05.079912 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c20266b3-7ca8-4682-a45b-b28591c70841 req-30b07270-577b-4e71-a73d-62fdae4cfedf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065053 Oct 16 01:38:05.080912 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2902/5933] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:05.401595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:05.402293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:05.410996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:05.411745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:05.412383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:05.413479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:05.414188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:05.414814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:05.492075 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-797cc278-a272-4020-a82d-7e9794ab1ac6 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1614 microversion: 2.1 time: 0.094168 Oct 16 01:38:05.494639 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3032/5934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:05 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:05.747280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:05.748140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:05.762439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:05.762973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:05.767153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:05.768106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:05.770737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:05.772206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:05.951913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:05.960733 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3cdf49ed-d2fb-4b1e-8298-e06afd8b4645 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1513 microversion: 2.1 time: 0.218424 Oct 16 01:38:05.974836 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2903/5935] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:05 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:06.517119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:06.517741 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:06.527008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:06.527569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:06.528237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:06.529243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:06.529911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:06.530537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:06.595573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:06.596316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:06.597275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:06.597898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lazy-loading 'fault' on Instance uuid 05d0f60c-8cb5-4952-b94f-71d198354873 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:38:06.658961 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-03e7da1d-273a-440f-9c4e-b4c95cd74f46 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 200 len: 1454 microversion: 2.1 time: 0.145230 Oct 16 01:38:06.661159 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3033/5936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:06 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:06.984190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:06.985391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:07.001638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.002389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.002979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:07.003813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.004499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.005729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:07.083230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:07.097681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-275f493d-e323-4f52-b823-3918156dfd83 req-676b081d-03c6-46b3-870f-c512aa0c104f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd480f21-1731-4ed6-82d1-9536c652a42d", "name": "network-vif-deleted", "tag": "e92c39e2-9bc3-4eca-a5f3-485f5a5b8399"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:07.112132 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e8339251-c3b8-478d-89c8-92347679971c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 200 len: 1471 microversion: 2.1 time: 0.130923 Oct 16 01:38:07.114713 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2904/5937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:06 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 1471 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:07.119707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-275f493d-e323-4f52-b823-3918156dfd83 req-676b081d-03c6-46b3-870f-c512aa0c104f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.121320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-275f493d-e323-4f52-b823-3918156dfd83 req-676b081d-03c6-46b3-870f-c512aa0c104f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.122203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-275f493d-e323-4f52-b823-3918156dfd83 req-676b081d-03c6-46b3-870f-c512aa0c104f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:07.139800 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-275f493d-e323-4f52-b823-3918156dfd83 req-676b081d-03c6-46b3-870f-c512aa0c104f service nova] Creating event network-vif-deleted:e92c39e2-9bc3-4eca-a5f3-485f5a5b8399 for instance bd480f21-1731-4ed6-82d1-9536c652a42d on n-h1-master-1 Oct 16 01:38:07.145944 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-275f493d-e323-4f52-b823-3918156dfd83 req-676b081d-03c6-46b3-870f-c512aa0c104f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051595 Oct 16 01:38:07.146769 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3034/5938] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:38:07.682165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:07.682932 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 05d0f60c-8cb5-4952-b94f-71d198354873] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:07.694742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.695881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.697180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:07.698150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.699314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.699973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:07.718590 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] HTTP exception thrown: Instance 05d0f60c-8cb5-4952-b94f-71d198354873 could not be found. Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Request method failure captured: Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 HTTP/1.1 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2BYMorL5wkak4NZtF77gda8e5X8FYypy6Pc8n90hbSjocsiiZsnQRka5MLaNIjFbGD11qg619DpCEnMBbsQyRZIs-Mq8YutXlV-V_dqhShPcAMF-sVYPUwXk-s_u03ZrxmobGkv63Wsi4_3qLE2p3Smo28hbWonsenC9qAHHUr2OLY Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 2f9ad54a91194b49823b9b4a704cb546 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestServerMultinode-1319260105 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2f9ad54a91194b49823b9b4a704cb546", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2f9ad54a91194b49823b9b4a704cb546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f9ad54a91194b49823b9b4a704cb546"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f9ad54a91194b49823b9b4a704cb546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestServerMultinode-1319260105 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 2f9ad54a91194b49823b9b4a704cb546 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestServerMultinode-1319260105 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestServerMultinode-1319260105-project-admin Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1bced1656a3344968447b4152d7bec15 Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestServerMultinode-1319260105-project-admin Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 05d0f60c-8cb5-4952-b94f-71d198354873 could not be found. Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '05d0f60c-8cb5-4952-b94f-71d198354873'} Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d0f60c-8cb5-4952-b94f-71d198354873 could not be found. Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d0f60c-8cb5-4952-b94f-71d198354873 could not be found. Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:38:07.722461 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:07.726287 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:07.726287 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:38:07.726287 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:38:07.726287 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:38:07.726287 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:38:07.726287 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d0f60c-8cb5-4952-b94f-71d198354873 could not be found. Oct 16 01:38:07.726287 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:07.728640 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Returning 404 to user: Instance 05d0f60c-8cb5-4952-b94f-71d198354873 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:38:07.730063 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53c0202b-c617-43b9-88bc-c23cee847f8e tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873" status: 404 len: 111 microversion: 2.1 time: 0.052283 Oct 16 01:38:07.730859 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2905/5939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:07 2022] GET /compute/v2.1/servers/05d0f60c-8cb5-4952-b94f-71d198354873 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:38:07.741397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:07.741990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:07.754694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.755767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.756434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:07.757748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.759079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.759876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:07.800745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:38:07.933640 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d836827-5727-4028-a4fd-a58f213d592c tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 204 len: 0 microversion: 2.1 time: 0.196249 Oct 16 01:38:07.934509 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3035/5940] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:38:07 2022] DELETE /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:38:07.944994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:07.945972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:07.960659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.961779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.962291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:07.963752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:07.964466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:07.965401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:08.144671 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cc358ba1-2eb1-4942-8956-f9302e2ed933 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1654 microversion: 2.1 time: 0.205336 Oct 16 01:38:08.146435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:08.147112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: bd480f21-1731-4ed6-82d1-9536c652a42d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:08.155656 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2906/5941] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:07 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1654 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:08.157715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:08.160175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:08.161424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:08.162352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:08.163265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:08.164096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:08.199426 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] HTTP exception thrown: Instance bd480f21-1731-4ed6-82d1-9536c652a42d could not be found. Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Request method failure captured: Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d HTTP/1.1 Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1-4Rlv7sLEQUHmGnYwNq9RiG5Iv_swuEZ-H9Hl8yfKYMUsdPcuIGJ-mlHotofW017hD-Y9dIqVRYUJZX0brpqKTWCB2YPHDbahVUYsVGw6LcaAqZx1E_6W3kF148yMtE7nwLO2vd8CSAqEPUreCBSXg5O9BByYkzEYoug2to2w_RpQ Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 18778c9e91d14fed9e49afc254aa81fd Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesSnapshotTestJSON-305034216 Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_18778c9e91d14fed9e49afc254aa81fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/18778c9e91d14fed9e49afc254aa81fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/18778c9e91d14fed9e49afc254aa81fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/18778c9e91d14fed9e49afc254aa81fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesSnapshotTestJSON-305034216 Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 18778c9e91d14fed9e49afc254aa81fd Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-305034216 Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesSnapshotTestJSON-305034216-project Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 4bdb352285134f4b93ab4879db31c8c1 Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesSnapshotTestJSON-305034216-project Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: exception: Instance bd480f21-1731-4ed6-82d1-9536c652a42d could not be found. Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'bd480f21-1731-4ed6-82d1-9536c652a42d'} Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd480f21-1731-4ed6-82d1-9536c652a42d could not be found. Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd480f21-1731-4ed6-82d1-9536c652a42d could not be found. Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:38:08.202086 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:08.206846 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:08.206846 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:38:08.206846 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:38:08.206846 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:38:08.206846 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:38:08.206846 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd480f21-1731-4ed6-82d1-9536c652a42d could not be found. Oct 16 01:38:08.206846 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:08.212789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Returning 404 to user: Instance bd480f21-1731-4ed6-82d1-9536c652a42d could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:38:08.213710 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8aff46b5-198a-4462-b56f-5f201bafb0af tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d" status: 404 len: 111 microversion: 2.1 time: 0.072078 Oct 16 01:38:08.214500 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3036/5942] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:08 2022] GET /compute/v2.1/servers/bd480f21-1731-4ed6-82d1-9536c652a42d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:38:09.177376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:09.178004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:09.190750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:09.191280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:09.191710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:09.196384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:09.197506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:09.197963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:09.460175 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ae69236-9d20-405f-ad51-afbd79c7e238 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1654 microversion: 2.1 time: 0.287914 Oct 16 01:38:09.460770 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2907/5943] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:09 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1654 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:10.485804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:10.486535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:10.500885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:10.501611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:10.504577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:10.505503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:10.507516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:10.509182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:10.558112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-39cb4199-82f4-4f8a-9b47-58d026fd421a req-9d4bcb39-7796-4fc0-8cca-efc8048b7eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ac0808-f5c1-434c-b78c-cffe906d77eb", "name": "network-vif-deleted", "tag": "c9fd0a2e-4566-48de-bf58-d9a9993fd231"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:10.575963 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:10.585806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-39cb4199-82f4-4f8a-9b47-58d026fd421a req-9d4bcb39-7796-4fc0-8cca-efc8048b7eae service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:10.586538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-39cb4199-82f4-4f8a-9b47-58d026fd421a req-9d4bcb39-7796-4fc0-8cca-efc8048b7eae service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:10.587276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-39cb4199-82f4-4f8a-9b47-58d026fd421a req-9d4bcb39-7796-4fc0-8cca-efc8048b7eae service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:10.615746 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-39cb4199-82f4-4f8a-9b47-58d026fd421a req-9d4bcb39-7796-4fc0-8cca-efc8048b7eae service nova] Creating event network-vif-deleted:c9fd0a2e-4566-48de-bf58-d9a9993fd231 for instance 66ac0808-f5c1-434c-b78c-cffe906d77eb on n-h2-master-1 Oct 16 01:38:10.647188 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-39cb4199-82f4-4f8a-9b47-58d026fd421a req-9d4bcb39-7796-4fc0-8cca-efc8048b7eae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094166 Oct 16 01:38:10.647353 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2908/5944] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:38:10.698617 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa71dd63-645e-493d-94b5-a6e6d31213ce tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 200 len: 1612 microversion: 2.1 time: 0.217098 Oct 16 01:38:10.699798 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3037/5945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:10 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 1612 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:11.725505 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:11.726222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] [instance: 66ac0808-f5c1-434c-b78c-cffe906d77eb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:11.737895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:11.738406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:11.738852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:11.742150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:11.743601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:11.746012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:11.800869 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] HTTP exception thrown: Instance 66ac0808-f5c1-434c-b78c-cffe906d77eb could not be found. Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Request method failure captured: Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb HTTP/1.1 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2BYMorL5wkak4NZtF77gda8e5X8FYypy6Pc8n90hbSjocsiiZsnQRka5MLaNIjFbGD11qg619DpCEnMBbsQyRZIs-Mq8YutXlV-V_dqhShPcAMF-sVYPUwXk-s_u03ZrxmobGkv63Wsi4_3qLE2p3Smo28hbWonsenC9qAHHUr2OLY Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 2f9ad54a91194b49823b9b4a704cb546 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestServerMultinode-1319260105 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2f9ad54a91194b49823b9b4a704cb546", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2f9ad54a91194b49823b9b4a704cb546"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f9ad54a91194b49823b9b4a704cb546"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f9ad54a91194b49823b9b4a704cb546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestServerMultinode-1319260105 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 2f9ad54a91194b49823b9b4a704cb546 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestServerMultinode-1319260105 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestServerMultinode-1319260105-project-admin Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1bced1656a3344968447b4152d7bec15 Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestServerMultinode-1319260105-project-admin Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 66ac0808-f5c1-434c-b78c-cffe906d77eb could not be found. Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '66ac0808-f5c1-434c-b78c-cffe906d77eb'} Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66ac0808-f5c1-434c-b78c-cffe906d77eb could not be found. Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66ac0808-f5c1-434c-b78c-cffe906d77eb could not be found. Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:38:11.805930 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:11.814329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:11.814329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:38:11.814329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:38:11.814329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:38:11.814329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:38:11.814329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ac0808-f5c1-434c-b78c-cffe906d77eb could not be found. Oct 16 01:38:11.814329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:38:11.814329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] Returning 404 to user: Instance 66ac0808-f5c1-434c-b78c-cffe906d77eb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:38:11.816018 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a2fcd86d-1af8-4007-a1c0-4756a056cb18 tempest-TestServerMultinode-1319260105 tempest-TestServerMultinode-1319260105-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb" status: 404 len: 111 microversion: 2.1 time: 0.094368 Oct 16 01:38:11.817064 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2909/5946] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:11 2022] GET /compute/v2.1/servers/66ac0808-f5c1-434c-b78c-cffe906d77eb => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:38:18.962554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:18.966345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:18.975700 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:18.977328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:18.977870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:18.978303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:18.979050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:18.979521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:18.980096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:19.032986 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cda66d9d-6181-4121-800e-7592a763730a tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.075738 Oct 16 01:38:19.033902 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3038/5947] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:38:18 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:19.171820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:19.172445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:19.187672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:19.191467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:19.191920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:19.192651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:19.193116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:19.193551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:19.267945 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-387a195f-2396-4f14-980c-61cd9704a375 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/528d18da-1c02-40b7-9ed9-97c809ca8bf9" status: 200 len: 194 microversion: 2.1 time: 0.100743 Oct 16 01:38:19.268954 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2910/5948] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Oct 16 01:38:19 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/528d18da-1c02-40b7-9ed9-97c809ca8bf9 => generated 194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:19.282510 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:19.284028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:19.292549 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:19.293251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:19.294173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:19.295718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:19.296844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:19.297750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:19.431505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lazy-loading 'services' on Instance uuid 20873f31-0c67-4339-8c9f-010401f9193b {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:38:19.446564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1711930846", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "69a9632f-aeb6-4d71-a553-c07c689c9f7d"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:19.546467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] validate_networks() for [('69a9632f-aeb6-4d71-a553-c07c689c9f7d', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:38:19.588254 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d34c329e-fc84-4ef3-8107-d9ba0c13570f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/528d18da-1c02-40b7-9ed9-97c809ca8bf9" status: 202 len: 0 microversion: 2.1 time: 0.312384 Oct 16 01:38:19.590377 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3039/5949] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:38:19 2022] DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/528d18da-1c02-40b7-9ed9-97c809ca8bf9 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:38:20.392984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:38:20.394947 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:38:20.395456 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:38:20.395878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:38:20.396315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:38:20.414351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:20.416941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:20.417801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:20.419774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:20.421520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:20.424361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:20.503765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Getting quotas for project 18778c9e91d14fed9e49afc254aa81fd. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:38:20.520477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Getting quotas for user 4bdb352285134f4b93ab4879db31c8c1 and project 18778c9e91d14fed9e49afc254aa81fd. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:38:20.550904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:38:20.555645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:38:20.656480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f60b7c2-0942-4d50-ba38-a76c3a8f3679 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215182 Oct 16 01:38:20.660199 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2911/5950] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:38:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:38:20.672757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f2dec18-7292-4893-ab6d-01af34e6f2b9 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:20.673597 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f2dec18-7292-4893-ab6d-01af34e6f2b9 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:20.930609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f2dec18-7292-4893-ab6d-01af34e6f2b9 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:20.940810 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f2dec18-7292-4893-ab6d-01af34e6f2b9 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1219 microversion: 2.1 time: 0.273154 Oct 16 01:38:20.943978 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3040/5951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:20 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1219 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:21.971098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:21.972349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:21.987855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:21.988696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:21.993634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:21.995842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:21.997654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:21.999069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:22.204907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:22.215514 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9893d8e1-8ebf-45b4-b4a2-01b3728d1d56 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1215 microversion: 2.1 time: 0.249675 Oct 16 01:38:22.227409 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2912/5952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:21 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:23.241675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:23.243127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:23.265144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:23.267151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:23.271517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:23.275187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:23.275998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:23.276632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:23.437573 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:23.446156 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-93624ad0-3dd8-4ae4-8a65-183b82be6d7f tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1277 microversion: 2.1 time: 0.208071 Oct 16 01:38:23.460085 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3041/5953] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:23 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:24.486305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:24.487105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:24.509290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:24.515230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:24.515819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:24.518533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:24.521369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:24.522196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:24.859637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:24.873432 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4443b306-5793-49af-ae9e-25e4a80a2c24 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1319 microversion: 2.1 time: 0.391177 Oct 16 01:38:24.876423 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2913/5954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:24 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:25.793552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-bc1572da-af63-400a-8503-5df5b03e299f req-a00debe7-dc92-4005-87da-0dab9e2068ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf443be-e5ee-43fc-92cd-11bf48e43725", "tag": "e3989875-3e57-40c8-b567-ff4b9d67c163"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:25.818535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bc1572da-af63-400a-8503-5df5b03e299f req-a00debe7-dc92-4005-87da-0dab9e2068ad service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:25.819522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bc1572da-af63-400a-8503-5df5b03e299f req-a00debe7-dc92-4005-87da-0dab9e2068ad service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:25.820735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-bc1572da-af63-400a-8503-5df5b03e299f req-a00debe7-dc92-4005-87da-0dab9e2068ad service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:25.851655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-bc1572da-af63-400a-8503-5df5b03e299f req-a00debe7-dc92-4005-87da-0dab9e2068ad service nova] Creating event network-changed:e3989875-3e57-40c8-b567-ff4b9d67c163 for instance baf443be-e5ee-43fc-92cd-11bf48e43725 on n-h2-master-1 Oct 16 01:38:25.859404 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-bc1572da-af63-400a-8503-5df5b03e299f req-a00debe7-dc92-4005-87da-0dab9e2068ad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069865 Oct 16 01:38:25.869520 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3042/5955] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:25.900499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:25.901271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:25.911783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:25.917902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:25.918471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:25.919368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:25.920000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:25.931611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:26.186617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:26.195360 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2f658a2-f752-4107-8f20-91d047155634 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1319 microversion: 2.1 time: 0.299332 Oct 16 01:38:26.203604 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2914/5956] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:25 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:27.226833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:27.227855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:27.238780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:27.239313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:27.239902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:27.240453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:27.240909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:27.241334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:27.489582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:27.500863 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a603f316-987a-41d3-9605-a8e8b45ff636 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1319 microversion: 2.1 time: 0.278944 Oct 16 01:38:27.505034 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3043/5957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:27 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:28.527793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:28.528726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:28.564074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:28.569045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:28.571429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:28.575974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:28.576799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:28.580816 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:28.707036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:28.708238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:28.724751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:28.727725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:28.728372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:28.729679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:28.734226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:28.736480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:28.832953 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fe666ad3-0c4b-4fba-a8ea-9f3a18e30d92 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/39741527-4ebb-4747-940e-6b20a1c18ebe" status: 200 len: 194 microversion: 2.1 time: 0.133144 Oct 16 01:38:28.844064 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3044/5958] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Oct 16 01:38:28 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/39741527-4ebb-4747-940e-6b20a1c18ebe => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:28.871242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:28.873745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:28.891378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:28.892263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:28.892948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:28.893937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:28.894657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:28.895359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:29.085386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lazy-loading 'services' on Instance uuid 20873f31-0c67-4339-8c9f-010401f9193b {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:38:29.229032 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:29.261450 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7dda8743-8755-4330-813a-4101ff763826 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/39741527-4ebb-4747-940e-6b20a1c18ebe" status: 202 len: 0 microversion: 2.1 time: 0.415044 Oct 16 01:38:29.269369 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3045/5959] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:38:28 2022] DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments/39741527-4ebb-4747-940e-6b20a1c18ebe => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:38:29.440018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:29.448623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2467f985-0039-4c3b-a1c0-54115d306146 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1319 microversion: 2.1 time: 0.925642 Oct 16 01:38:29.449798 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2915/5960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:28 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1319 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:30.482050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:30.484158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:30.505944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:30.509663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:30.511646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:30.512571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:30.516581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:30.517349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:30.651944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9871d2ad-6c62-45e8-9d89-ea555fbff541 req-6bc4cfbe-5a96-4bf9-9828-e4f18f7d1294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf443be-e5ee-43fc-92cd-11bf48e43725", "name": "network-vif-plugged", "status": "completed", "tag": "e3989875-3e57-40c8-b567-ff4b9d67c163"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:30.674199 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:30.674908 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:30.679366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9871d2ad-6c62-45e8-9d89-ea555fbff541 req-6bc4cfbe-5a96-4bf9-9828-e4f18f7d1294 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:30.681316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9871d2ad-6c62-45e8-9d89-ea555fbff541 req-6bc4cfbe-5a96-4bf9-9828-e4f18f7d1294 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:30.681768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9871d2ad-6c62-45e8-9d89-ea555fbff541 req-6bc4cfbe-5a96-4bf9-9828-e4f18f7d1294 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:30.712058 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9871d2ad-6c62-45e8-9d89-ea555fbff541 req-6bc4cfbe-5a96-4bf9-9828-e4f18f7d1294 service nova] Creating event network-vif-plugged:e3989875-3e57-40c8-b567-ff4b9d67c163 for instance baf443be-e5ee-43fc-92cd-11bf48e43725 on n-h2-master-1 Oct 16 01:38:30.722496 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9871d2ad-6c62-45e8-9d89-ea555fbff541 req-6bc4cfbe-5a96-4bf9-9828-e4f18f7d1294 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074064 Oct 16 01:38:30.724777 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2916/5961] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:30.870790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:30.882622 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f2861bbc-3e97-427b-8864-216903de2437 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1319 microversion: 2.1 time: 0.410465 Oct 16 01:38:30.884458 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3046/5962] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:30 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:31.912862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:31.915191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:31.936481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:31.938689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:31.940449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:31.943294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:31.944016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:31.945737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:32.297586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:32.306849 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76591e0a-c82f-4618-8403-9b82fbe42ea1 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1319 microversion: 2.1 time: 0.404285 Oct 16 01:38:32.311456 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2917/5963] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:31 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:33.337374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:33.337931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:33.350017 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:33.355371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:33.358197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:33.362485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:33.363611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:33.364378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:33.365009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:33.660328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:33.670644 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f069c196-6e68-410c-ace9-29c4fb5c9b6c tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1508 microversion: 2.1 time: 0.337868 Oct 16 01:38:33.679010 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3047/5964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:33 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:33.704702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "918646b2-a127-44fd-af35-f746330de130", "device": "/dev/sdb"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:33.711892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:33.728976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:33.733568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:33.734334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:33.735278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:33.735911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:33.736974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:34.343197 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3fd00a2c-5a3b-4d96-881a-e8042312ab15 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "POST /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641936 Oct 16 01:38:34.351593 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2918/5965] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:38:33 2022] POST /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:39.031902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:39.034469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:39.052600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:39.053798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:39.054317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:39.055063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:39.056530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:39.056975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:39.148379 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5011ab54-44f8-4af8-bc10-9bb7a5ac030f tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121265 Oct 16 01:38:39.155082 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3048/5966] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:38:39 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:38:39.433331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:39.435910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:39.452790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:39.453293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:39.453741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:39.454460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:39.454966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:39.455468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:39.469298 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:39.536285 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-99c42e90-5573-408a-9f9c-58f676893728 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108587 Oct 16 01:38:39.537208 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2919/5967] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 01:38:39 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 01:38:39.849939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:39.851056 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:39.864834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:39.865339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:39.865914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:39.866734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:39.867237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:39.867671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:39.930606 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:38:40.134895 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a432991-e6d3-436e-9b8e-63ffc275eb82 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 204 len: 0 microversion: 2.1 time: 0.289003 Oct 16 01:38:40.135858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3049/5968] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:38:39 2022] DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:38:40.144387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:40.145020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:40.161972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:40.161972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:40.162274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:40.163044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:40.163513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:40.164072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:40.480239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:40.502661 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-881e9e72-7e67-41cf-bbc9-71d6e16d17ab tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1673 microversion: 2.1 time: 0.361965 Oct 16 01:38:40.505507 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2920/5969] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:40 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1673 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:41.532669 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:41.533739 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:41.565244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:41.569905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:41.570478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:41.574442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:41.579595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:41.580335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:42.054744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:42.069305 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-61eb05db-b5f7-4e8d-89bf-cf96130305d4 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1673 microversion: 2.1 time: 0.541083 Oct 16 01:38:42.070349 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3050/5970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:41 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1673 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:43.102754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:43.104127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:43.108083 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:43.145627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:43.146336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:43.147482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:43.153010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:43.153504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:43.162830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:43.989923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:44.003366 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b9af28e-e079-40f7-89b7-b43b8248ace6 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1673 microversion: 2.1 time: 0.905675 Oct 16 01:38:44.006492 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2921/5971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:43 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1673 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:44.746655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-85389ad3-5d13-42e0-976f-ae05698030b8 req-fa63475c-bad8-42a8-a455-3ee6ecb57bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20873f31-0c67-4339-8c9f-010401f9193b", "name": "network-vif-deleted", "tag": "dbb192c7-6422-4d20-a0d3-16e1019cdba0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:44.803404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-85389ad3-5d13-42e0-976f-ae05698030b8 req-fa63475c-bad8-42a8-a455-3ee6ecb57bd4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:44.805149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-85389ad3-5d13-42e0-976f-ae05698030b8 req-fa63475c-bad8-42a8-a455-3ee6ecb57bd4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:44.806004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-85389ad3-5d13-42e0-976f-ae05698030b8 req-fa63475c-bad8-42a8-a455-3ee6ecb57bd4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:44.847886 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-85389ad3-5d13-42e0-976f-ae05698030b8 req-fa63475c-bad8-42a8-a455-3ee6ecb57bd4 service nova] Creating event network-vif-deleted:dbb192c7-6422-4d20-a0d3-16e1019cdba0 for instance 20873f31-0c67-4339-8c9f-010401f9193b on n-h1-master-1 Oct 16 01:38:44.860449 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-85389ad3-5d13-42e0-976f-ae05698030b8 req-fa63475c-bad8-42a8-a455-3ee6ecb57bd4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117468 Oct 16 01:38:44.861557 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3051/5972] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:38:45.031498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:45.033707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:45.051599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:45.053121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:45.055224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:45.058849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:45.059651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:45.061852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:45.171802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:45.172582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:45.173861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:45.174559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lazy-loading 'fault' on Instance uuid 20873f31-0c67-4339-8c9f-010401f9193b {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:38:45.396409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a10008a2a4e41c5be09552821db8fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf371ee661342e193e6d9d4aacda40d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:38:45.411216 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-91cc5c68-8b77-4f2d-9f4d-03fa925e5dca tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 200 len: 1327 microversion: 2.1 time: 0.385508 Oct 16 01:38:45.413224 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2922/5973] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:45 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 1327 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:38:46.448334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:46.449697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:38:46.459179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:46.459951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:46.460556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:46.461448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:38:46.462611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:38:46.463490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:38:46.542292 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] HTTP exception thrown: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Request method failure captured: Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b HTTP/1.1 Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS19A3zchT3-eXPzRtOyyjkDBfAP0Qbv9FzPLP1e30O6vNz6UdmPsN5boQwUfjwMOpYGzucQ9JL5eIWd3tI2lz5sm_pSZ2GILZis6z0yWNWZY4bxyHlMrWlA623Aqd2clBLY1cMEUfm9z4uXjeMd6OtxTt5BmaGe3POFjrx3ipmBCNTs Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3bf371ee661342e193e6d9d4aacda40d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 6a10008a2a4e41c5be09552821db8fad Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '20873f31-0c67-4339-8c9f-010401f9193b'} Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:38:46.549181 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:46.554116 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:38:46.554116 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:38:46.554116 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:38:46.554116 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:38:46.554116 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:38:46.554116 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:38:46.554116 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:38:46.556712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Returning 404 to user: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:38:46.559464 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-25880c32-0460-410d-9085-f30125c51a80 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 404 len: 111 microversion: 2.1 time: 0.120065 Oct 16 01:38:46.567137 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3052/5974] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:38:46 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:38:46.573930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-20e791a3-1a31-450f-a704-37936dd9918b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '.version_select at 0x7fd64e7c00d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:38:46.630978 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-20e791a3-1a31-450f-a704-37936dd9918b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059157219" status: 202 len: 0 microversion: 2.1 time: 0.062377 Oct 16 01:38:46.632220 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2923/5975] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:38:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059157219 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:38:59.399220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-767987572", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "02efe511-a193-415d-9b54-1cf9cbe5f018", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61eb30c5-accf-4cf9-b162-43c4bdd26615"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:38:59.492681 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:38:59.492681 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 01:38:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 16 01:38:59.493365 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:59.494097 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=42,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:38:59.608812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] validate_networks() for [('61eb30c5-accf-4cf9-b162-43c4bdd26615', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:39:00.711628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:39:00.712702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:39:00.713352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:39:00.713939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:39:00.714509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:39:00.755326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:00.756047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:00.756680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:00.757583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:00.767711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:00.768175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:00.829937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:39:00.843241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:39:01.113049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:39:01.115139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02efe511-a193-415d-9b54-1cf9cbe5f018',volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:39:01.532622 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42f83d00-d198-4d7e-bc00-bec89674653c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.134896 Oct 16 01:39:01.535579 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3053/5976] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:38:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:39:01.543043 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=25 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:01.544531 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:01.549328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e148cbc-c241-408a-b363-cb27a69e86e3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:01.555742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e148cbc-c241-408a-b363-cb27a69e86e3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:01.725072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7e148cbc-c241-408a-b363-cb27a69e86e3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:01.732594 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e148cbc-c241-408a-b363-cb27a69e86e3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1056 microversion: 2.1 time: 0.191542 Oct 16 01:39:01.735631 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2924/5977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:01 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1056 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:02.758634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:02.759709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:02.770051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:02.770558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:02.775028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:02.778896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:02.780308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:02.782166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:02.950988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:02.959866 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d1ece5a7-c2ef-4bd0-ac24-274f02c30b8f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1098 microversion: 2.1 time: 0.206034 Oct 16 01:39:02.960445 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3054/5978] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:02 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1098 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:04.015768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:04.016456 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:04.073057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:04.097109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:04.105037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:04.118746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:04.128065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:04.131998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:04.260511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:04.263619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:04.277632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:04.277632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:04.298983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:04.300238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:04.303634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:04.305310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:04.376842 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] HTTP exception thrown: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.377220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Request method failure captured: Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b HTTP/1.1 Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS19A3zchT3-eXPzRtOyyjkDBfAP0Qbv9FzPLP1e30O6vNz6UdmPsN5boQwUfjwMOpYGzucQ9JL5eIWd3tI2lz5sm_pSZ2GILZis6z0yWNWZY4bxyHlMrWlA623Aqd2clBLY1cMEUfm9z4uXjeMd6OtxTt5BmaGe3POFjrx3ipmBCNTs Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3bf371ee661342e193e6d9d4aacda40d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 6a10008a2a4e41c5be09552821db8fad Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '20873f31-0c67-4339-8c9f-010401f9193b'} Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:39:04.382893 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.390209 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.392351 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d2b65d61-ae91-4a59-b0e6-9f29b9039dff tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1172 microversion: 2.1 time: 0.400547 Oct 16 01:39:04.395514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Returning 404 to user: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:39:04.398792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e5679e3-a591-4db1-85e7-daaff780932b tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 404 len: 111 microversion: 2.1 time: 0.141379 Oct 16 01:39:04.405770 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2925/5979] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:03 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1172 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:04.420066 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3055/5980] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:39:04 2022] DELETE /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:39:04.423879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:04.424740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 20873f31-0c67-4339-8c9f-010401f9193b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:04.443125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:04.444008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:04.444625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:04.445523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:04.446152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:04.447043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:04.476647 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] HTTP exception thrown: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Request method failure captured: Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b HTTP/1.1 Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS19A3zchT3-eXPzRtOyyjkDBfAP0Qbv9FzPLP1e30O6vNz6UdmPsN5boQwUfjwMOpYGzucQ9JL5eIWd3tI2lz5sm_pSZ2GILZis6z0yWNWZY4bxyHlMrWlA623Aqd2clBLY1cMEUfm9z4uXjeMd6OtxTt5BmaGe3POFjrx3ipmBCNTs Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3bf371ee661342e193e6d9d4aacda40d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 6a10008a2a4e41c5be09552821db8fad Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '20873f31-0c67-4339-8c9f-010401f9193b'} Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:04.482753 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.486945 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:04.486945 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:04.486945 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:04.486945 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:39:04.486945 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:39:04.486945 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. Oct 16 01:39:04.486945 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:39:04.489625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Returning 404 to user: Instance 20873f31-0c67-4339-8c9f-010401f9193b could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:39:04.490710 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-87beaa73-6953-4521-b001-6621061225d9 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b" status: 404 len: 111 microversion: 2.1 time: 0.083580 Oct 16 01:39:04.492978 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2926/5981] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:04 2022] GET /compute/v2.1/servers/20873f31-0c67-4339-8c9f-010401f9193b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:39:05.413748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:05.414361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:05.452807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:05.456312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:05.457243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:05.458631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:05.461950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:05.463630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:06.003959 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:06.037334 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ffffe03-c7e8-40b9-9065-cdbec70c4803 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.623422 Oct 16 01:39:06.043100 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3056/5982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:05 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:07.081323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:07.085876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:07.119305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:07.122433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:07.128805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:07.131443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:07.132980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:07.135011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:07.607642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:07.639617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab213d03-3e5b-4e18-a608-3e37a0a6d609 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.569399 Oct 16 01:39:07.641563 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2927/5983] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:07 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:07.764160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-35b2a196-7feb-42e7-b10b-6776d92a010c req-0fb6de41-f34e-4298-8880-a08aa9380ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282cf27c-79ad-4576-a3e2-9f7f99e4ac09", "tag": "4908ba2a-93ea-423d-97e2-1764d211e715"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:07.825196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-35b2a196-7feb-42e7-b10b-6776d92a010c req-0fb6de41-f34e-4298-8880-a08aa9380ecc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:07.828840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-35b2a196-7feb-42e7-b10b-6776d92a010c req-0fb6de41-f34e-4298-8880-a08aa9380ecc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:07.830531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-35b2a196-7feb-42e7-b10b-6776d92a010c req-0fb6de41-f34e-4298-8880-a08aa9380ecc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:07.875115 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-35b2a196-7feb-42e7-b10b-6776d92a010c req-0fb6de41-f34e-4298-8880-a08aa9380ecc service nova] Creating event network-changed:4908ba2a-93ea-423d-97e2-1764d211e715 for instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 on n-h1-master-1 Oct 16 01:39:07.896439 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-35b2a196-7feb-42e7-b10b-6776d92a010c req-0fb6de41-f34e-4298-8880-a08aa9380ecc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148200 Oct 16 01:39:07.898098 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3057/5984] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:39:08.672630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:08.673809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:08.688877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:08.689742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:08.690344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:08.696696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:08.697683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:08.698281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:09.307801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:09.352062 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6527724d-5aa0-4c06-8b56-b4717c1686ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.684048 Oct 16 01:39:09.353994 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2928/5985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:08 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:10.402952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:10.411811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:10.438887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:10.439958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:10.449005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:10.450378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:10.455405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:10.456722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:10.786146 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:10.886615 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:10.921155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:10.930040 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5877d6db-ce5f-4501-af81-a0e240dc5a93 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.540922 Oct 16 01:39:10.931443 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3058/5986] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:10 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:11.955040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:11.957065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:11.970376 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:11.992943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:11.995757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:11.996337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:11.997392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:12.002390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:12.003705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:12.157054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:12.158096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:12.168095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:12.171612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:12.172232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:12.173120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:12.175474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:12.176098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:12.230600 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] HTTP exception thrown: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Request method failure captured: Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c HTTP/1.1 Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS19A3zchT3-eXPzRtOyyjkDBfAP0Qbv9FzPLP1e30O6vNz6UdmPsN5boQwUfjwMOpYGzucQ9JL5eIWd3tI2lz5sm_pSZ2GILZis6z0yWNWZY4bxyHlMrWlA623Aqd2clBLY1cMEUfm9z4uXjeMd6OtxTt5BmaGe3POFjrx3ipmBCNTs Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3bf371ee661342e193e6d9d4aacda40d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 6a10008a2a4e41c5be09552821db8fad Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '44c0fbbc-ac3c-4217-8b5b-1555b683137c'} Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:39:12.234182 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.237889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.242298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Returning 404 to user: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:39:12.253857 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6d9fee91-fa6d-47bf-bbae-aaf379e699d2 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 404 len: 111 microversion: 2.1 time: 0.101397 Oct 16 01:39:12.257955 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3059/5987] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:39:12 2022] DELETE /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:39:12.263830 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:12.264800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] [instance: 44c0fbbc-ac3c-4217-8b5b-1555b683137c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:12.276973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:12.277791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:12.279270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:12.280310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:12.284362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:12.285127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:12.319501 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] HTTP exception thrown: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Request method failure captured: Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c HTTP/1.1 Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS19A3zchT3-eXPzRtOyyjkDBfAP0Qbv9FzPLP1e30O6vNz6UdmPsN5boQwUfjwMOpYGzucQ9JL5eIWd3tI2lz5sm_pSZ2GILZis6z0yWNWZY4bxyHlMrWlA623Aqd2clBLY1cMEUfm9z4uXjeMd6OtxTt5BmaGe3POFjrx3ipmBCNTs Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3bf371ee661342e193e6d9d4aacda40d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf371ee661342e193e6d9d4aacda40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3bf371ee661342e193e6d9d4aacda40d Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2082392731 Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 6a10008a2a4e41c5be09552821db8fad Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-AttachVolumeTestJSON-2082392731-project Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '44c0fbbc-ac3c-4217-8b5b-1555b683137c'} Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:12.321457 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.326079 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:12.326079 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:12.326079 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:12.326079 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:39:12.326079 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:39:12.326079 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. Oct 16 01:39:12.326079 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:12.329787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] Returning 404 to user: Instance 44c0fbbc-ac3c-4217-8b5b-1555b683137c could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:39:12.330891 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e3eff57d-ef1f-4797-9da3-42342dbd8010 tempest-AttachVolumeTestJSON-2082392731 tempest-AttachVolumeTestJSON-2082392731-project] 10.222.0.39 "GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c" status: 404 len: 111 microversion: 2.1 time: 0.071451 Oct 16 01:39:12.335347 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3060/5988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:12 2022] GET /compute/v2.1/servers/44c0fbbc-ac3c-4217-8b5b-1555b683137c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:39:12.682211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:12.692482 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b8d392c-b4eb-4b09-a137-236775ac807b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.742748 Oct 16 01:39:12.715589 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2929/5989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:11 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:13.722253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:13.723483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:13.738859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:13.741789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:13.743190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:13.752681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:13.753975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:13.756452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:14.042576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:14.051884 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13e2b3ed-adb6-4234-90ca-7ac067fec885 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.333312 Oct 16 01:39:14.052509 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3061/5990] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:13 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:15.079137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:15.079881 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:15.097792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:15.098838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:15.100899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:15.102769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:15.105122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:15.105832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:15.367705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:15.382783 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c3bb5830-7d50-4c56-80a0-c3f80f6e1ea8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.307263 Oct 16 01:39:15.397966 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2930/5991] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:15 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:16.406581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:16.407372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:16.428489 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:16.429058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:16.429513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:16.430258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:16.430732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:16.431198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:16.855295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:16.864086 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca54c7ac-2a6c-47f0-ab8c-7fbe80771632 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.462174 Oct 16 01:39:16.883200 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3062/5992] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:16 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:17.890215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:17.891610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:17.905298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:17.908674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:17.909708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:17.910681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:17.914773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:17.915581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:18.128149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:18.140850 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56bf123f-76c3-49e8-a1c0-617207614283 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1214 microversion: 2.1 time: 0.254862 Oct 16 01:39:18.144737 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2931/5993] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:17 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1214 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:19.069505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:19.070059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:19.081761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:19.083362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:19.085235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:19.086605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:19.089592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:19.092174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:19.110998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-337043706", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:19.201789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] validate_networks() for None {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:39:19.320879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lazy-loading 'services' on Instance uuid baf443be-e5ee-43fc-92cd-11bf48e43725 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:39:19.474991 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97880492-c9b0-4f1a-a22b-4efa8df47ad8 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "DELETE /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725/os-volume_attachments/918646b2-a127-44fd-af35-f746330de130" status: 202 len: 0 microversion: 2.1 time: 0.410035 Oct 16 01:39:19.478886 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3063/5994] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 01:39:19 2022] DELETE /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725/os-volume_attachments/918646b2-a127-44fd-af35-f746330de130 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:39:19.507658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:19.508749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:19.520882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:19.521785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:19.522844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:19.523782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:19.524555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:19.525155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:19.793814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:39:19.794823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:39:19.795651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:39:19.796244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:39:19.796861 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:39:19.818606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:19.820249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:19.823120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:19.824116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:19.824838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:19.827422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:19.875120 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Getting quotas for project 3006edea3cd547909615ce3275b58597. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:39:19.890591 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Getting quotas for user 22bcdb6c0e89492ba77baf34456dca3c and project 3006edea3cd547909615ce3275b58597. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:39:19.907950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:39:19.910617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:39:19.969448 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e8c0c0d2-8812-4f36-ba3e-fea2a2373a0d tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872200 Oct 16 01:39:19.975157 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2932/5995] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:39:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:39:19.986530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-65f5f435-8fca-47d7-ac03-f615738685c4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:19.993630 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-65f5f435-8fca-47d7-ac03-f615738685c4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:20.261351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-65f5f435-8fca-47d7-ac03-f615738685c4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:20.270543 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-65f5f435-8fca-47d7-ac03-f615738685c4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1214 microversion: 2.1 time: 0.290807 Oct 16 01:39:20.271778 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2933/5996] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:19 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1214 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:20.320007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:20.328307 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3420afaf-81e6-4171-a80f-f8411cc81cbf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1202 microversion: 2.1 time: 0.847302 Oct 16 01:39:20.329004 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3064/5997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:19 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1202 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:21.298695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:21.299340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:21.316921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:21.319100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:21.320243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:21.321151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:21.322560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:21.323048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:21.355869 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:21.357755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:21.369858 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:21.370396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:21.370875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:21.371679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:21.372191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:21.372789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:21.476740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:21.499879 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f6fedba4-392b-4e47-a665-f746f89723dc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1266 microversion: 2.1 time: 0.207005 Oct 16 01:39:21.516875 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2934/5998] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:21 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:21.683090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:21.711750 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5dc128e4-2445-4a3e-905d-aa063fef4f74 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1202 microversion: 2.1 time: 0.360885 Oct 16 01:39:21.715269 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3065/5999] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:21 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1202 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:22.528643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:22.529405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:22.549341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:22.550235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:22.553820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:22.554748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:22.555651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:22.556430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:22.690194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:22.705910 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b03d500b-893c-4479-bbc4-d853e2b978ec tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1272 microversion: 2.1 time: 0.182667 Oct 16 01:39:22.718950 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2935/6000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:22 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:22.736211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:22.737181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:22.744505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:22.745148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:22.745687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:22.746492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:22.753438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:22.754064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:23.075522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:23.085574 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-17478f94-ac65-4099-ae0b-39df4ef6a09f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1202 microversion: 2.1 time: 0.353449 Oct 16 01:39:23.096824 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3066/6001] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:22 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1202 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:23.736430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:23.737051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:23.747967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:23.748478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:23.752823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:23.753804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:23.754464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:23.755109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:24.125794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:24.127234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:24.136639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:24.158685 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9cc8ceef-fb4c-4056-b97a-88f4ee8ef252 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1314 microversion: 2.1 time: 0.428701 Oct 16 01:39:24.160679 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2936/6002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:23 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:24.161095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:24.161835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:24.162484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:24.163464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:24.165293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:24.165971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:24.412810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:24.421166 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2290741d-91d4-46d6-a4d5-43c1560a6e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1202 microversion: 2.1 time: 0.300359 Oct 16 01:39:24.438119 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3067/6003] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:24 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1202 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:24.654804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dc1547df-60b1-4857-bac6-3eb14fe484a2 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd64e155670>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:24.712825 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dc1547df-60b1-4857-bac6-3eb14fe484a2 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7e70dfa3-7513-4f7f-811c-35a64ed1904d" status: 200 len: 350 microversion: 2.1 time: 0.061862 Oct 16 01:39:24.713597 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2937/6004] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:39:24 2022] GET /compute/v2.1/os-volumes/7e70dfa3-7513-4f7f-811c-35a64ed1904d => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:25.103565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ee0e43e9-d856-444d-8c87-82db9cb2b1a0 req-04fd5696-73df-492d-86fe-6a948952e76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e6fe69-5685-410f-8183-b1d9ada9678a", "tag": "3525b9d2-758a-45d6-9043-1314b070cf5b"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:25.140953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee0e43e9-d856-444d-8c87-82db9cb2b1a0 req-04fd5696-73df-492d-86fe-6a948952e76d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:25.146217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee0e43e9-d856-444d-8c87-82db9cb2b1a0 req-04fd5696-73df-492d-86fe-6a948952e76d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:25.146889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee0e43e9-d856-444d-8c87-82db9cb2b1a0 req-04fd5696-73df-492d-86fe-6a948952e76d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:25.206438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:25.207930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:25.223283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:25.226416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:25.228493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:25.230129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:25.233591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:25.234301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:25.243721 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ee0e43e9-d856-444d-8c87-82db9cb2b1a0 req-04fd5696-73df-492d-86fe-6a948952e76d service nova] Creating event network-changed:3525b9d2-758a-45d6-9043-1314b070cf5b for instance e0e6fe69-5685-410f-8183-b1d9ada9678a on n-h2-master-1 Oct 16 01:39:25.270846 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ee0e43e9-d856-444d-8c87-82db9cb2b1a0 req-04fd5696-73df-492d-86fe-6a948952e76d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172128 Oct 16 01:39:25.283967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3068/6005] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:25.445860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:25.446587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:25.461393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:25.462112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:25.462724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:25.463623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:25.464236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:25.464822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:25.549856 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:25.560957 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be641457-da9a-4efa-9999-6787e327d6fe tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1314 microversion: 2.1 time: 0.379897 Oct 16 01:39:25.572937 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2938/6006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:25 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:25.864118 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:25.872272 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7299bae3-03b2-45bd-8320-b3fbb9845324 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1202 microversion: 2.1 time: 0.431076 Oct 16 01:39:25.873787 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3069/6007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:25 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:39:26.604617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:26.605906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:26.620941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:26.622804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:26.625028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:26.626002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:26.627465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:26.629883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:26.900680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:26.901443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:26.915278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:26.930800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:26.934498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:26.935891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:26.938372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:26.941947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:26.968736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:26.989970 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bf9c5d87-222e-4ada-ad0d-3c2d7d9ebbac tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1314 microversion: 2.1 time: 0.389165 Oct 16 01:39:26.990630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2939/6008] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:26 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:27.180370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:27.190050 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fd478087-a358-440d-b6bd-f94140120594 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1202 microversion: 2.1 time: 0.293643 Oct 16 01:39:27.212239 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3070/6009] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:26 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1202 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:39:27.559082 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11284838-0b32-4dd4-9348-98bd7ca13239 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd64e4d8b80>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:27.644924 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11284838-0b32-4dd4-9348-98bd7ca13239 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/733df9f0-a9f0-49cb-a043-351a36b94117" status: 200 len: 350 microversion: 2.1 time: 0.089939 Oct 16 01:39:27.645674 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2940/6010] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:39:27 2022] GET /compute/v2.1/os-volumes/733df9f0-a9f0-49cb-a043-351a36b94117 => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:28.000310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:28.001076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:28.022626 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:28.024057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:28.032103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.033119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.033780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:28.033914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.034592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.035343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.036017 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:28.036274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.036735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.037184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:28.040562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.041015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:28.099575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:39:28.165970 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:28.224461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:28.249765 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ee355619-b3b8-4fcd-9633-1e6d7c9706fc tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1314 microversion: 2.1 time: 0.230997 Oct 16 01:39:28.251267 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2941/6011] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:28 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:28.257224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:28.258098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:28.265944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.266867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.267731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:28.268684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.269511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.270184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:28.291238 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f6429f2b-a9fb-427b-87f6-27c84209aedb tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "DELETE /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 204 len: 0 microversion: 2.1 time: 0.293994 Oct 16 01:39:28.291928 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3071/6012] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:39:27 2022] DELETE /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:39:28.304071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:28.306848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:28.325652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.333451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.333905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:28.334649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.340176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.341991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:28.556517 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:28.573151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-21b4063d-c4a2-4b52-adcd-33bff546d7ea tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1202 microversion: 2.1 time: 0.320319 Oct 16 01:39:28.578439 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2942/6013] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:28 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1202 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:28.752409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:28.761005 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e43a25f3-8be0-44b7-9ab9-14d264453488 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1514 microversion: 2.1 time: 0.463666 Oct 16 01:39:28.766804 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3072/6014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:28 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1514 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:28.951893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a569e2a0-29c8-4ec3-b633-01048f6fdaf5 req-9fc23b59-ba41-4681-8a87-fe162c41bd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282cf27c-79ad-4576-a3e2-9f7f99e4ac09", "name": "network-vif-plugged", "status": "completed", "tag": "4908ba2a-93ea-423d-97e2-1764d211e715"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:28.984004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a569e2a0-29c8-4ec3-b633-01048f6fdaf5 req-9fc23b59-ba41-4681-8a87-fe162c41bd72 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:28.984622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a569e2a0-29c8-4ec3-b633-01048f6fdaf5 req-9fc23b59-ba41-4681-8a87-fe162c41bd72 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:28.985186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a569e2a0-29c8-4ec3-b633-01048f6fdaf5 req-9fc23b59-ba41-4681-8a87-fe162c41bd72 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:29.021898 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a569e2a0-29c8-4ec3-b633-01048f6fdaf5 req-9fc23b59-ba41-4681-8a87-fe162c41bd72 service nova] Creating event network-vif-plugged:4908ba2a-93ea-423d-97e2-1764d211e715 for instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 on n-h1-master-1 Oct 16 01:39:29.035343 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a569e2a0-29c8-4ec3-b633-01048f6fdaf5 req-9fc23b59-ba41-4681-8a87-fe162c41bd72 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085746 Oct 16 01:39:29.037392 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2943/6015] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:29.274328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:29.275193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:29.287836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:29.299719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:29.303584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:29.305986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:29.306807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:29.307314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:29.527549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:29.561731 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b41167e-50ce-478f-af6f-4de21d80ece4 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1314 microversion: 2.1 time: 0.291026 Oct 16 01:39:29.579745 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3073/6016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:29 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:29.621569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:29.622986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:29.640163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:29.640879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:29.641417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:29.642244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:29.642883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:29.643488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:29.792458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:29.800337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:29.808678 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:29.813933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:29.814536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:29.815022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:29.815735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:29.816264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:29.816719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:29.833144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:29.845387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cc4747d0-2db7-4dc0-aa4b-3d2b14c95f30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1202 microversion: 2.1 time: 0.244828 Oct 16 01:39:29.846069 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2944/6017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:29 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1202 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:39:29.982029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:29.990550 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e3a4ce15-c1a1-4df9-8c61-43c6d4c7f6f7 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1514 microversion: 2.1 time: 0.202079 Oct 16 01:39:29.991947 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3074/6018] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:29 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:39:30.362724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b9ac5c71-f0ac-40e2-b32d-41a5904ac3f5 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd64e4e6280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:30.374419 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:30.376699 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:30.464077 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b9ac5c71-f0ac-40e2-b32d-41a5904ac3f5 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/71c02d77-2d47-4e72-a2f9-f3755f31178e" status: 200 len: 351 microversion: 2.1 time: 0.105403 Oct 16 01:39:30.464869 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2945/6019] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Oct 16 01:39:30 2022] GET /compute/v2.1/os-volumes/71c02d77-2d47-4e72-a2f9-f3755f31178e => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:30.482419 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0494651-b61b-4d56-a658-0e7afa1209fd tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd6527a19d0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:30.585615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:30.586399 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:30.607254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:30.608102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:30.612205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:30.613674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:30.614200 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:30.614957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:30.659983 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0494651-b61b-4d56-a658-0e7afa1209fd tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.181735 Oct 16 01:39:30.672743 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3075/6020] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Oct 16 01:39:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:30.677744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dfac0eb3-750f-4763-8054-79c2496070ae tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd6526c6e50>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:30.819178 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dfac0eb3-750f-4763-8054-79c2496070ae tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.143247 Oct 16 01:39:30.827098 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3076/6021] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Oct 16 01:39:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:30.855221 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-46cc73c2-3bec-411a-9532-863be508e3bd tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd64ddec430>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:30.890871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:30.899391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8fcd5ffc-4419-4ed5-ad8d-c63ec825af8e tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1314 microversion: 2.1 time: 0.317587 Oct 16 01:39:30.924300 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2946/6022] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:30 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:30.929581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:30.930480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:30.954759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:30.955323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:30.958205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:30.959372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:30.959999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:30.960441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.011301 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:31.112020 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-46cc73c2-3bec-411a-9532-863be508e3bd tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.272950 Oct 16 01:39:31.112856 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3077/6023] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Oct 16 01:39:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:31.127480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-daa42a47-e26d-4fd2-ab6b-d05418b28d66 req-ae6ee1ac-2593-49d3-8cd4-39af027433b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf443be-e5ee-43fc-92cd-11bf48e43725", "name": "network-vif-deleted", "tag": "e3989875-3e57-40c8-b567-ff4b9d67c163"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:31.179883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-daa42a47-e26d-4fd2-ab6b-d05418b28d66 req-ae6ee1ac-2593-49d3-8cd4-39af027433b6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.189446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-daa42a47-e26d-4fd2-ab6b-d05418b28d66 req-ae6ee1ac-2593-49d3-8cd4-39af027433b6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.190232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-daa42a47-e26d-4fd2-ab6b-d05418b28d66 req-ae6ee1ac-2593-49d3-8cd4-39af027433b6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.244065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:31.252319 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-daa42a47-e26d-4fd2-ab6b-d05418b28d66 req-ae6ee1ac-2593-49d3-8cd4-39af027433b6 service nova] Creating event network-vif-deleted:e3989875-3e57-40c8-b567-ff4b9d67c163 for instance baf443be-e5ee-43fc-92cd-11bf48e43725 on n-h2-master-1 Oct 16 01:39:31.257044 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1f87c72c-b341-43af-a65d-7059ca755e87 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1388 microversion: 2.1 time: 0.331276 Oct 16 01:39:31.264519 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-daa42a47-e26d-4fd2-ab6b-d05418b28d66 req-ae6ee1ac-2593-49d3-8cd4-39af027433b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150303 Oct 16 01:39:31.273565 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3078/6024] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:31.274908 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2947/6025] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:30 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1388 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:31.279981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6c2fd5c4-780a-4d6f-85db-e8a62214078c req-7dd659c3-c804-4551-aed5-4663d7d2fad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e6fe69-5685-410f-8183-b1d9ada9678a", "name": "network-vif-plugged", "status": "completed", "tag": "3525b9d2-758a-45d6-9043-1314b070cf5b"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:31.286309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:31.290234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6c2fd5c4-780a-4d6f-85db-e8a62214078c req-7dd659c3-c804-4551-aed5-4663d7d2fad7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.290887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6c2fd5c4-780a-4d6f-85db-e8a62214078c req-7dd659c3-c804-4551-aed5-4663d7d2fad7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.291552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6c2fd5c4-780a-4d6f-85db-e8a62214078c req-7dd659c3-c804-4551-aed5-4663d7d2fad7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.291968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:31.305837 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6c2fd5c4-780a-4d6f-85db-e8a62214078c req-7dd659c3-c804-4551-aed5-4663d7d2fad7 service nova] Creating event network-vif-plugged:3525b9d2-758a-45d6-9043-1314b070cf5b for instance e0e6fe69-5685-410f-8183-b1d9ada9678a on n-h2-master-1 Oct 16 01:39:31.311306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.312015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.312557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.312904 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6c2fd5c4-780a-4d6f-85db-e8a62214078c req-7dd659c3-c804-4551-aed5-4663d7d2fad7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036234 Oct 16 01:39:31.314014 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2948/6026] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:31.320169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cf84e2bd-5c1d-4f52-a603-7f105c80b42f tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd64ebe9ee0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:31.320585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.325151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.329532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.402493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.403810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.404494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.405394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lazy-loading 'fault' on Instance uuid baf443be-e5ee-43fc-92cd-11bf48e43725 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:39:31.534425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:31.548983 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-95dcbb49-43ff-488d-baad-9a228bec6190 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1309 microversion: 2.1 time: 0.269675 Oct 16 01:39:31.563987 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3079/6027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:31 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:31.577170 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:31.580758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:31.597095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.597816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.598621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.599536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.600168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.600845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.683110 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cf84e2bd-5c1d-4f52-a603-7f105c80b42f tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.367695 Oct 16 01:39:31.683682 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2949/6028] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Oct 16 01:39:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:31.699953 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aea3fc9e-958f-4c4a-b070-acde932bb6d0 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd64e1a69d0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:31.837049 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aea3fc9e-958f-4c4a-b070-acde932bb6d0 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.141248 Oct 16 01:39:31.849130 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2950/6029] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Oct 16 01:39:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:31.854439 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-290d6027-eb8a-4995-8c13-2f88e63be22a tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd64d075af0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:31.855377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:31.865442 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6bf726f9-95e3-4854-bdd9-151dee8954d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1388 microversion: 2.1 time: 0.300128 Oct 16 01:39:31.877708 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3080/6030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:31 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1388 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:31.894487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:31.895377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:31.902571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.904007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.904654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:31.905580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:31.906239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:31.906825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.014486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-290d6027-eb8a-4995-8c13-2f88e63be22a tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164060 Oct 16 01:39:32.025483 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2951/6031] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:39:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:32.030896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:32.031667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:32.033776 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:32.054029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.054590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.060209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.061159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.061631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.066436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.101506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:32.110952 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f671947c-7fdc-4e5b-91f5-c7a1dcb76c30 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1388 microversion: 2.1 time: 0.220849 Oct 16 01:39:32.123497 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3081/6032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:31 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1388 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:32.133823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55c24a2b-dbf2-4517-ab37-68a552e0b138 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd6526c3ee0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:32.235461 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-55c24a2b-dbf2-4517-ab37-68a552e0b138 tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.110175 Oct 16 01:39:32.244680 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3082/6033] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Oct 16 01:39:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:32.244680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:32.244680 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:32.252511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.253315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.253761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.254608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.255389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.255636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.291413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:39:32.355934 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:32.366452 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c97cce77-af5a-4695-83e5-57519c1a41ee tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1314 microversion: 2.1 time: 0.339786 Oct 16 01:39:32.367599 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2952/6034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:32 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:32.384220 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-664ab1fa-7447-4326-9bea-beb29d2903ea tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] Calling method '.version_select at 0x7fd64efa5280>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:32.453870 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3ba5b59a-3aac-452a-8461-2a53dd7da4bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 204 len: 0 microversion: 2.1 time: 0.214732 Oct 16 01:39:32.454481 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3083/6035] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:39:32 2022] DELETE /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:39:32.472014 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:32.472722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:32.478894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.480003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.480003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.480801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.481957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.482492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.689772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:32.698049 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3fa7bc79-2753-4e97-ae8e-42fe74330de0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1394 microversion: 2.1 time: 0.238981 Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3084/6036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:32 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1394 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.714253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.746769 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-664ab1fa-7447-4326-9bea-beb29d2903ea tempest-VolumesTestJSON-395506958 tempest-VolumesTestJSON-395506958-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.377901 Oct 16 01:39:32.747514 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2953/6037] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Oct 16 01:39:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:32.760686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:32.761456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:32.762035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:32.763305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lazy-loading 'fault' on Instance uuid baf443be-e5ee-43fc-92cd-11bf48e43725 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:39:32.837544 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bdb352285134f4b93ab4879db31c8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18778c9e91d14fed9e49afc254aa81fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:32.847938 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-710bc5d5-fb13-42ed-9e4a-2eccb677ba94 tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 200 len: 1309 microversion: 2.1 time: 0.147862 Oct 16 01:39:32.849527 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3085/6038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:32 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:33.396702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:33.397800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:33.421501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:33.422004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:33.422444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:33.423178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:33.423648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:33.424073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:33.730644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:33.732792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:33.744115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:33.744615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:33.745057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:33.745767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:33.746227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:33.754343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:33.760181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:33.775793 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c99ee3a0-c1a5-41d1-946a-5a9a8cdcac64 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1463 microversion: 2.1 time: 0.384476 Oct 16 01:39:33.776745 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2954/6039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:33 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1463 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:39:33.841683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:33.842580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:33.866452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:33.867002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:33.867623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:33.868514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:33.869166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:33.869760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:33.920082 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:39:33.979853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:33.988655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad72622c-64ad-4bef-9604-a087991cd429 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1394 microversion: 2.1 time: 0.265805 Oct 16 01:39:33.990746 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3086/6040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:33 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1394 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:33.996510 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:33.998119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] [instance: baf443be-e5ee-43fc-92cd-11bf48e43725] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:34.004681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:34.005363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:34.005959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:34.007010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:34.007642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:34.008258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:34.024162 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] HTTP exception thrown: Instance baf443be-e5ee-43fc-92cd-11bf48e43725 could not be found. Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Request method failure captured: Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 HTTP/1.1 Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS1-4Rlv7sLEQUHmGnYwNq9RiG5Iv_swuEZ-H9Hl8yfKYMUsdPcuIGJ-mlHotofW017hD-Y9dIqVRYUJZX0brpqKTWCB2YPHDbahVUYsVGw6LcaAqZx1E_6W3kF148yMtE7nwLO2vd8CSAqEPUreCBSXg5O9BByYkzEYoug2to2w_RpQ Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 18778c9e91d14fed9e49afc254aa81fd Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesSnapshotTestJSON-305034216 Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_18778c9e91d14fed9e49afc254aa81fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/18778c9e91d14fed9e49afc254aa81fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/18778c9e91d14fed9e49afc254aa81fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/18778c9e91d14fed9e49afc254aa81fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesSnapshotTestJSON-305034216 Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 18778c9e91d14fed9e49afc254aa81fd Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-305034216 Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesSnapshotTestJSON-305034216-project Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 4bdb352285134f4b93ab4879db31c8c1 Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesSnapshotTestJSON-305034216-project Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: exception: Instance baf443be-e5ee-43fc-92cd-11bf48e43725 could not be found. Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'baf443be-e5ee-43fc-92cd-11bf48e43725'} Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf443be-e5ee-43fc-92cd-11bf48e43725 could not be found. Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf443be-e5ee-43fc-92cd-11bf48e43725 could not be found. Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:34.026415 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:34.031719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:34.031719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:34.031719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:34.031719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:39:34.031719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:39:34.031719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf443be-e5ee-43fc-92cd-11bf48e43725 could not be found. Oct 16 01:39:34.031719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:34.034663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] Returning 404 to user: Instance baf443be-e5ee-43fc-92cd-11bf48e43725 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:39:34.036140 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d8b70381-af6e-45f8-bad8-d8715ed2203a tempest-VolumesSnapshotTestJSON-305034216 tempest-VolumesSnapshotTestJSON-305034216-project] 10.222.0.39 "GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725" status: 404 len: 111 microversion: 2.1 time: 0.044191 Oct 16 01:39:34.040317 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3087/6041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:33 2022] GET /compute/v2.1/servers/baf443be-e5ee-43fc-92cd-11bf48e43725 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:39:34.212965 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-230e871d-1574-4df9-89a7-d2f6c654a3ef tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 204 len: 0 microversion: 2.1 time: 0.375787 Oct 16 01:39:34.215583 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2955/6042] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:39:33 2022] DELETE /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:39:34.224117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:34.224984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:34.236160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:34.236939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:34.238114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:34.241305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:34.241933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:34.242621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:34.684986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:34.699075 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-332b73c5-af6a-4597-a575-a0f35e962ea8 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1469 microversion: 2.1 time: 0.479319 Oct 16 01:39:34.703462 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3088/6043] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:34 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:39:35.026189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:35.027516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:35.050894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:35.050894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:35.050894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:35.050894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:35.050894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:35.060539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:35.176723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f6d1cb83-d5c4-43b7-9b37-e55138db870b req-d757378b-78e7-42f9-b3f6-945d01f7c1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282cf27c-79ad-4576-a3e2-9f7f99e4ac09", "name": "network-vif-deleted", "tag": "4908ba2a-93ea-423d-97e2-1764d211e715"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:35.242153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f6d1cb83-d5c4-43b7-9b37-e55138db870b req-d757378b-78e7-42f9-b3f6-945d01f7c1d5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:35.242738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f6d1cb83-d5c4-43b7-9b37-e55138db870b req-d757378b-78e7-42f9-b3f6-945d01f7c1d5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:35.243428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f6d1cb83-d5c4-43b7-9b37-e55138db870b req-d757378b-78e7-42f9-b3f6-945d01f7c1d5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:35.260269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:35.282802 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1e7d245-9599-4345-be22-ccde99027745 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1352 microversion: 2.1 time: 0.265636 Oct 16 01:39:35.292953 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f6d1cb83-d5c4-43b7-9b37-e55138db870b req-d757378b-78e7-42f9-b3f6-945d01f7c1d5 service nova] Creating event network-vif-deleted:4908ba2a-93ea-423d-97e2-1764d211e715 for instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 on n-h1-master-1 Oct 16 01:39:35.310957 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2956/6044] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:35 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1352 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:35.315906 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f6d1cb83-d5c4-43b7-9b37-e55138db870b req-d757378b-78e7-42f9-b3f6-945d01f7c1d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146676 Oct 16 01:39:35.327294 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3089/6045] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:35.730899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:35.732365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:35.746658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:35.749771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:35.752119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:35.753018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:35.753634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:35.758466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:36.006937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:36.018265 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3e58adef-7f01-4d0d-a936-c40cb4bbd2ea tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1469 microversion: 2.1 time: 0.291833 Oct 16 01:39:36.036517 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2957/6046] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:35 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:36.318611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:36.323362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:36.358080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:36.358574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:36.359212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:36.360121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:36.360739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:36.361323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:36.567808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:36.606493 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9bb7c37e-a3a6-4cca-8383-5b6eeb76c893 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1187 microversion: 2.1 time: 0.292037 Oct 16 01:39:36.608277 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3090/6047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:36 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1187 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:37.044778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:37.045926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:37.084762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:37.085170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:37.085608 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:37.100314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:37.100823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:37.104892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:37.236311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:37.236812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:37.237255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:37.237715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lazy-loading 'fault' on Instance uuid e0e6fe69-5685-410f-8183-b1d9ada9678a {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:39:37.334480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-7b3e363c-f090-4cd8-a557-11474ed8eb40 req-eadcf842-53bd-4cd7-ac45-b8f400a9022a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e6fe69-5685-410f-8183-b1d9ada9678a", "name": "network-vif-deleted", "tag": "3525b9d2-758a-45d6-9043-1314b070cf5b"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:37.362051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7b3e363c-f090-4cd8-a557-11474ed8eb40 req-eadcf842-53bd-4cd7-ac45-b8f400a9022a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:37.365331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bcdb6c0e89492ba77baf34456dca3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3006edea3cd547909615ce3275b58597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:37.367210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7b3e363c-f090-4cd8-a557-11474ed8eb40 req-eadcf842-53bd-4cd7-ac45-b8f400a9022a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:37.370110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7b3e363c-f090-4cd8-a557-11474ed8eb40 req-eadcf842-53bd-4cd7-ac45-b8f400a9022a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:37.380948 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-caefb430-bfe5-4ae6-ab03-360043ff472c tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 200 len: 1304 microversion: 2.1 time: 0.340742 Oct 16 01:39:37.401511 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2958/6048] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:37 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 1304 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:37.415318 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-7b3e363c-f090-4cd8-a557-11474ed8eb40 req-eadcf842-53bd-4cd7-ac45-b8f400a9022a service nova] Creating event network-vif-deleted:3525b9d2-758a-45d6-9043-1314b070cf5b for instance e0e6fe69-5685-410f-8183-b1d9ada9678a on n-h2-master-1 Oct 16 01:39:37.429384 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-7b3e363c-f090-4cd8-a557-11474ed8eb40 req-eadcf842-53bd-4cd7-ac45-b8f400a9022a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099720 Oct 16 01:39:37.434325 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3091/6049] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:39:37.633147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:37.634798 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:37.646429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:37.647358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:37.651869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:37.652834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:37.654061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:37.654730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:37.833124 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:37.855340 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1452818a-a70f-475f-ac7f-f023e16e7589 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1187 microversion: 2.1 time: 0.227985 Oct 16 01:39:37.867493 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2959/6050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:37 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1187 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:38.410608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:38.411333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] [instance: e0e6fe69-5685-410f-8183-b1d9ada9678a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:38.422206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:38.431514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:38.432156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:38.433049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:38.433677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:38.434271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:38.453939 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:38.507966 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] HTTP exception thrown: Instance e0e6fe69-5685-410f-8183-b1d9ada9678a could not be found. Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Request method failure captured: Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a HTTP/1.1 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2DCkY0ADpvOxiqeqe4jZa0YzaQmyakqmox6KFAvpjVO0oFt-QO3Cr9V_XF0VgPi-bIEif-VW_8ZbfgzMzQdHlb2S8AXisPMlSgJKIHBOBSBYFBmhh-VgFjOvN7Pa2UmOO6E5nBJ5HmJjZsks6-54f-KBmE7Emi6fI0Cf61e-6c6FJM Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 3006edea3cd547909615ce3275b58597 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-VolumesNegativeTest-1593684177 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3006edea3cd547909615ce3275b58597", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3006edea3cd547909615ce3275b58597"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3006edea3cd547909615ce3275b58597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3006edea3cd547909615ce3275b58597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-VolumesNegativeTest-1593684177 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 3006edea3cd547909615ce3275b58597 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-VolumesNegativeTest-1593684177 Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-VolumesNegativeTest-1593684177-project Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 22bcdb6c0e89492ba77baf34456dca3c Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-VolumesNegativeTest-1593684177-project Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e0e6fe69-5685-410f-8183-b1d9ada9678a could not be found. Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e0e6fe69-5685-410f-8183-b1d9ada9678a'} Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e6fe69-5685-410f-8183-b1d9ada9678a could not be found. Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e6fe69-5685-410f-8183-b1d9ada9678a could not be found. Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:38.509911 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:38.514501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:38.514501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:38.514501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:38.514501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:39:38.514501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:39:38.514501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e6fe69-5685-410f-8183-b1d9ada9678a could not be found. Oct 16 01:39:38.514501 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:38.527881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] Returning 404 to user: Instance e0e6fe69-5685-410f-8183-b1d9ada9678a could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:39:38.530266 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e4b2c22-5093-43b1-abdd-607b0db09612 tempest-VolumesNegativeTest-1593684177 tempest-VolumesNegativeTest-1593684177-project] 10.222.0.39 "GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a" status: 404 len: 111 microversion: 2.1 time: 0.124516 Oct 16 01:39:38.539731 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3092/6051] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:38 2022] GET /compute/v2.1/servers/e0e6fe69-5685-410f-8183-b1d9ada9678a => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:39:38.879818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:38.880440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:38.897852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:38.898356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:38.898807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:38.899559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:38.900297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:38.900438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:39.051314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:39.063881 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b4863b5c-15a3-4e69-b057-357ecbf32692 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1187 microversion: 2.1 time: 0.187772 Oct 16 01:39:39.073751 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2960/6052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:38 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1187 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:40.096960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:40.101461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:40.123896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:40.127338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:40.128556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:40.129469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:40.130104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:40.130702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:40.291479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:40.300739 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5bf6cd4e-52ed-4c95-9fc9-d0da5e06cacd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1187 microversion: 2.1 time: 0.212237 Oct 16 01:39:40.301333 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3093/6053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:40 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1187 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:41.326544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:41.331138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:41.362447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:41.365904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:41.368382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:41.369481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:41.372899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:41.372899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:41.658583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:41.666629 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2f5b0883-917c-47c7-a4a6-e1e50d3f316e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1187 microversion: 2.1 time: 0.346142 Oct 16 01:39:41.670535 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2961/6054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:41 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1187 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:42.704562 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:42.706484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:42.731128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:42.732323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:42.732832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:42.733690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:42.738072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:42.738637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:42.896969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:42.909640 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e4177948-3480-4a21-b67f-6335bfbde524 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1187 microversion: 2.1 time: 0.218390 Oct 16 01:39:42.916730 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3094/6055] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:42 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1187 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:43.951447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:43.953042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:43.969057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:43.969582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:43.970031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:43.970772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:43.971271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:43.971705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:44.169306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:44.178815 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e3899a10-d2ea-487b-b952-4117c0329903 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 200 len: 1187 microversion: 2.1 time: 0.236799 Oct 16 01:39:44.183262 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2962/6056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:43 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 1187 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:39:45.203783 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:45.204472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 282cf27c-79ad-4576-a3e2-9f7f99e4ac09] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:45.225388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:45.228201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:45.228673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:45.234544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:45.235088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:45.239917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:45.297229 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 could not be found. Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 HTTP/1.1 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 could not be found. Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '282cf27c-79ad-4576-a3e2-9f7f99e4ac09'} Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 could not be found. Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 could not be found. Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:39:45.299087 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 could not be found. Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 282cf27c-79ad-4576-a3e2-9f7f99e4ac09 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de2fc7cb-842a-4bbd-bc2a-c07e2ec1c4cb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09" status: 404 len: 111 microversion: 2.1 time: 0.102810 Oct 16 01:39:45.316206 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3095/6057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:45 2022] GET /compute/v2.1/servers/282cf27c-79ad-4576-a3e2-9f7f99e4ac09 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:39:56.361843 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:56.379713 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:56.981197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84788796-b0c6-486a-a29d-8cb741ebd9fe tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'create', calling method: .version_select at 0x7fd64e473af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2045296368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+H6g3e/UpceQUmHLYmUqlaiRQwzM5+/u0vvNu67SD/VLHH3YGXmMwedeZvVLdprD5YU9Of7VpZF0VVs6/IzHp/0tNce/rzIPFXM3Hqs99XYzqY55ukoDGUr0pcs7zAsQ=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:57.043937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-84788796-b0c6-486a-a29d-8cb741ebd9fe tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for project 855792b0264144dd941200c8468ac26d. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:39:57.060607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-84788796-b0c6-486a-a29d-8cb741ebd9fe tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for user 83bbcff8a1f64cfa936f13f3cb3955b6 and project 855792b0264144dd941200c8468ac26d. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:39:57.115976 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-84788796-b0c6-486a-a29d-8cb741ebd9fe tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.759835 Oct 16 01:39:57.117129 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2963/6058] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:39:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:39:57.949365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-792000641", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "822251ff-1f3f-4ef7-9d99-fb3275a19361", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61eb30c5-accf-4cf9-b162-43c4bdd26615"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:39:57.982131 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:57.982997 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=14 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:39:58.066772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] validate_networks() for [('61eb30c5-accf-4cf9-b162-43c4bdd26615', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:39:58.898224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:39:58.898651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:39:58.899901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:39:58.900484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:39:58.900915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:39:58.923492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:58.923994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:58.924466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:58.925225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:39:58.925758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:39:58.926257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:39:58.979942 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:39:58.986627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:39:59.120147 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:39:59.122955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='822251ff-1f3f-4ef7-9d99-fb3275a19361',volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:39:59.446428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d9dac548-990c-4204-b257-498eb4b689a6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501582 Oct 16 01:39:59.447124 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3096/6059] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:39:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:39:59.459797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-091d008b-bcac-4a80-b011-9b5acee743c1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:39:59.461051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-091d008b-bcac-4a80-b011-9b5acee743c1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:39:59.594808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-091d008b-bcac-4a80-b011-9b5acee743c1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:39:59.608404 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-091d008b-bcac-4a80-b011-9b5acee743c1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1056 microversion: 2.1 time: 0.152688 Oct 16 01:39:59.612434 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2964/6060] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:39:59 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1056 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:00.634940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:00.635583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:00.642252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:00.642750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:00.643228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:00.643948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:00.644412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:00.644855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:00.791675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:00.802464 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5d529aed-3d2d-4633-a390-646b3da14ae7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1098 microversion: 2.1 time: 0.172438 Oct 16 01:40:00.810196 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3097/6061] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:00 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1098 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:01.842655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:01.847541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:01.869614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:01.873145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:01.874028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:01.877918 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:01.878423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:01.878893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:02.045966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:02.055694 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aae58555-7f51-4d47-ab34-a11ec5bc82d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1172 microversion: 2.1 time: 0.226271 Oct 16 01:40:02.057760 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2965/6062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:01 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1172 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:03.080899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:03.081620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:03.092584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:03.095116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:03.095725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:03.097322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:03.099970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:03.100765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:03.271864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:03.285343 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0c564d09-2944-411f-90f4-fe4ffcc02e9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1172 microversion: 2.1 time: 0.208258 Oct 16 01:40:03.286476 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3098/6063] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:03 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1172 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:04.310863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:04.311576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:04.320315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:04.321204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:04.322615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:04.323982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:04.324609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:04.332077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:04.611890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:04.627811 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ee61c580-2308-4de8-b79e-7103e344d191 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.322154 Oct 16 01:40:04.630689 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2966/6064] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:04 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:05.652900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:05.654606 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:05.676329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:05.677058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:05.677879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:05.678876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:05.679608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:05.680259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:05.957486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:05.967884 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-72923253-00ac-4171-bb0f-1057dd83c910 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.319875 Oct 16 01:40:05.968655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3099/6065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:05 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:06.396367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a1a7d248-42e1-4ea2-9f5d-ebaad71f26ea req-e28c625a-0d1c-46ae-8ddb-572e9884a00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d63210e-d710-44d3-85df-bb99f3787836", "tag": "a91d4dcb-6015-43ed-a1aa-eef876b141c8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:06.422313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a1a7d248-42e1-4ea2-9f5d-ebaad71f26ea req-e28c625a-0d1c-46ae-8ddb-572e9884a00f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:06.422812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a1a7d248-42e1-4ea2-9f5d-ebaad71f26ea req-e28c625a-0d1c-46ae-8ddb-572e9884a00f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:06.425421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a1a7d248-42e1-4ea2-9f5d-ebaad71f26ea req-e28c625a-0d1c-46ae-8ddb-572e9884a00f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:06.480282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a1a7d248-42e1-4ea2-9f5d-ebaad71f26ea req-e28c625a-0d1c-46ae-8ddb-572e9884a00f service nova] Creating event network-changed:a91d4dcb-6015-43ed-a1aa-eef876b141c8 for instance 3d63210e-d710-44d3-85df-bb99f3787836 on n-h1-master-1 Oct 16 01:40:06.499460 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a1a7d248-42e1-4ea2-9f5d-ebaad71f26ea req-e28c625a-0d1c-46ae-8ddb-572e9884a00f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106549 Oct 16 01:40:06.503682 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2967/6066] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:40:06.998511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:06.998511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:07.004927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:07.005420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:07.005852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:07.007196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:07.007659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:07.008086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:07.465687 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:07.473963 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7c1afb3f-db51-446a-8166-1655ae5402aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.487961 Oct 16 01:40:07.476781 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3100/6067] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:06 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:08.505306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:08.506347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:08.531267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:08.532339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:08.533748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:08.536540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:08.539896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:08.548452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:09.112016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:09.121437 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dec4216b-2d54-4615-9f3a-7c746fe6936b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.620789 Oct 16 01:40:09.140033 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2968/6068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:08 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:10.148385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:10.148997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:10.153209 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:10.155372 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:10.172261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:10.172782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:10.173226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:10.174744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:10.175396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:10.175777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:10.728339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:10.740881 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b15106af-fbf0-4c49-80d7-fd63b8a88fb0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.597129 Oct 16 01:40:10.744651 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3101/6069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:10 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:11.776100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:11.776817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:11.788801 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:11.795579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:11.796352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:11.804438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:11.805468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:11.806103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:11.806715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:12.397900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:12.412673 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e759952-71de-4589-96a8-959649881c55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.640402 Oct 16 01:40:12.435711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2969/6070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:11 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:13.446861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:13.448379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:13.467004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:13.467448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:13.467893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:13.468617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:13.469087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:13.469520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:13.901338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:13.915736 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad80f1a4-a47e-4a6b-9964-6e702879d13b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.471475 Oct 16 01:40:13.933121 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3102/6071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:13 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:14.958055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:14.960043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:14.979692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:14.983170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:14.984339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:14.986786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:14.987664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:14.988570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:15.410554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:15.431359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab31ccca-8c00-4920-b50b-6d93d02aa0f9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.490272 Oct 16 01:40:15.442524 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2970/6072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:14 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:15.641435 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1101990545", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "263164de-1433-4777-bb7a-08a469dd0bbd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2045296368", "security_groups": [{"name": "tempest-secgroup-smoke-1367298233"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:16.002769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] validate_networks() for [('263164de-1433-4777-bb7a-08a469dd0bbd', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:40:16.471926 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:16.473253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:16.483897 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:16.496704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:16.499787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:16.502160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:16.503305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:16.512205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:17.241773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:40:17.242874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:40:17.243656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:40:17.244300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:40:17.244958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:40:17.255554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:17.271826 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-669f1077-65c1-42e0-b058-570313e4e8aa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1214 microversion: 2.1 time: 0.803790 Oct 16 01:40:17.290714 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2971/6073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:16 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1214 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:17.291102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:17.291102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:17.291102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:17.291102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:17.291102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:17.291102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:17.370661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for project 855792b0264144dd941200c8468ac26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:40:17.411297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for user 83bbcff8a1f64cfa936f13f3cb3955b6 and project 855792b0264144dd941200c8468ac26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:40:17.461655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:40:17.472041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:40:17.682294 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-777114a8-0179-4671-a71b-617b3dbee65b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.043155 Oct 16 01:40:17.686210 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3103/6074] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:40:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:40:17.697923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ebd5c78f-cb7e-43f4-9303-05581829d423 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:17.698789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ebd5c78f-cb7e-43f4-9303-05581829d423 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:17.917775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ebd5c78f-cb7e-43f4-9303-05581829d423 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:17.925671 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ebd5c78f-cb7e-43f4-9303-05581829d423 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1267 microversion: 2.1 time: 0.231588 Oct 16 01:40:17.926262 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2972/6075] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:17 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:18.302757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:18.304624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:18.333361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:18.334162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:18.338412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:18.341517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:18.345089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:18.345828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:18.807245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:18.840683 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68c8b7e0-6701-4931-a533-8090f1b57251 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.533213 Oct 16 01:40:18.842406 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3104/6076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:18 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:18.956835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-86093d15-5750-43d1-8808-02d2dab7353b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:18.959755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-86093d15-5750-43d1-8808-02d2dab7353b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:19.154713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-86093d15-5750-43d1-8808-02d2dab7353b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:19.182485 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-86093d15-5750-43d1-8808-02d2dab7353b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1267 microversion: 2.1 time: 0.231549 Oct 16 01:40:19.201614 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2973/6077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:18 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:19.881326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:19.881955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:19.909697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:19.915603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:19.916109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:19.916856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:19.919542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:19.920197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:20.212339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:20.214883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:20.257906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:20.267177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:20.271562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:20.279871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:20.284855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:20.287089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:20.670105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:20.691359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5469020d-aa17-4b25-b1fc-853270442278 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1327 microversion: 2.1 time: 0.485561 Oct 16 01:40:20.719651 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2974/6078] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:20 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1327 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:20.910420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:20.947255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6bc4a55-9ced-455e-9ad9-6e398ed6a80f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 1.070901 Oct 16 01:40:20.953887 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3105/6079] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:19 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:21.729540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:21.730229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:21.743320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:21.743841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:21.744284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:21.754286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:21.754856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:21.755347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:21.980861 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:21.982211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:21.999092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:22.010509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:22.011212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:22.012045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:22.013133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:22.013573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:22.032343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:22.054345 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3545bceb-a135-4468-99e8-73a779914102 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1325 microversion: 2.1 time: 0.323591 Oct 16 01:40:22.056778 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2975/6080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:21 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:22.958497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:22.971761 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-574b27b5-9c2d-4dea-a0a3-88f6120bd26b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.995246 Oct 16 01:40:22.972757 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3106/6081] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:21 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:23.087391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:23.088890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:23.110598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:23.111417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:23.112667 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:23.113737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:23.114444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:23.115184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:23.956202 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:24.018434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:24.020370 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:24.026782 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fc78ec48-4041-4948-8d0b-e36676f01c03 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1393 microversion: 2.1 time: 0.944769 Oct 16 01:40:24.048484 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2976/6082] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:23 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1393 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:24.064171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:24.072276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:24.090871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:24.092584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:24.094831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:24.108490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:24.871801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-61e57834-8322-4797-a19d-36e374d5633a req-08002571-6862-465e-bc09-8d4019dac333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8a9a0e-ab70-4603-b447-5666e7fbb4f9", "tag": "ca5cd282-c912-44e7-842e-46d9a50f6520"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:24.917967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-61e57834-8322-4797-a19d-36e374d5633a req-08002571-6862-465e-bc09-8d4019dac333 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:24.925002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-61e57834-8322-4797-a19d-36e374d5633a req-08002571-6862-465e-bc09-8d4019dac333 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:24.925872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-61e57834-8322-4797-a19d-36e374d5633a req-08002571-6862-465e-bc09-8d4019dac333 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:24.952646 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-61e57834-8322-4797-a19d-36e374d5633a req-08002571-6862-465e-bc09-8d4019dac333 service nova] Creating event network-changed:ca5cd282-c912-44e7-842e-46d9a50f6520 for instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 on n-h2-master-1 Oct 16 01:40:24.973827 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-61e57834-8322-4797-a19d-36e374d5633a req-08002571-6862-465e-bc09-8d4019dac333 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107966 Oct 16 01:40:24.976878 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2977/6083] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:40:25.067243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:25.068243 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:25.084493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:25.097077 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d5168d7c-a12f-4ab0-a55d-db2f4dfdec55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 1.096682 Oct 16 01:40:25.110042 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3107/6084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:23 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:25.128068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:25.129896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:25.132616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:25.133631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:25.135622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:25.136313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:26.134757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:26.135411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:26.154373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:26.155309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:26.156007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:26.156911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:26.157547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:26.158156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:26.738411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:26.741381 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=63 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:26.757836 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e16fe948-b741-4689-9b0a-8e5cf1c32bf1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1393 microversion: 2.1 time: 1.695599 Oct 16 01:40:26.774133 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2978/6085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:25 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1393 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:26.999383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:27.009901 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-39e6c4e1-d6bf-45de-8529-4c7c2fcdedd8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.878739 Oct 16 01:40:27.023845 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3108/6086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:26 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:27.785148 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:27.786434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:27.797289 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:27.820085 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:27.822747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:27.823756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:27.827688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:27.828972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:27.829683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:28.035581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:28.037111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:28.052810 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:28.059883 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:28.060716 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:28.062293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:28.062685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:28.067633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:28.068500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:28.069345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:28.069481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:28.160703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:28.168689 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=71 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:28.172844 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-968f4aa5-4485-4138-9e14-6f31f007d539 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1393 microversion: 2.1 time: 0.388020 Oct 16 01:40:28.183298 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2979/6087] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:27 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1393 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:28.435296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:28.449658 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ac3c866-fa91-49d2-80d7-9d2547a523f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.414270 Oct 16 01:40:28.464301 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3109/6088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:28 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:29.202123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:29.202671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:29.205426 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:29.220105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:29.220602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:29.221273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:29.224343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:29.225040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:29.227519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:29.477747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:29.478671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:29.500307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:29.503477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:29.504423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:29.506359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:29.509551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:29.513082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:30.108444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:30.117060 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6422e772-b881-4836-868e-5011d8d05c82 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.643620 Oct 16 01:40:30.117664 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3110/6089] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:29 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:30.126448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:30.138969 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6cf6ddd4-2cbf-4947-abde-d8fa5af46c61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1393 microversion: 2.1 time: 0.941546 Oct 16 01:40:30.143803 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2980/6090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:29 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1393 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:31.145743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:31.155327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:31.167778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:31.170268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:31.170907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:31.171745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:31.172399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:31.175524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:31.176249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:31.176861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:31.197977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:31.198753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:31.199243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:31.200050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:31.209910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:31.210434 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:31.797915 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:31.813124 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8feb19db-9cf8-4498-b64e-88ccd489527d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1393 microversion: 2.1 time: 0.643425 Oct 16 01:40:31.819340 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2981/6091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:31 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1393 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:31.897161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:31.908947 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c06c1f85-e606-4a8c-8947-1b92672031d4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.767097 Oct 16 01:40:31.913284 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3111/6092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:31 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:32.353213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ff8f1dbd-6915-4c4a-a4e6-b62bff8923f9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Action: 'create', calling method: .version_select at 0x7fd64d6edc10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1929315166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO+sxeeKM1LxUJrAlBLvWmedkjYf2E1aX+DJTD80r7laf35FHgtaTi9QuHND7XOr4OwbYlUFDesjDkm/HLK9jB0AAldGmEG3HXkf9bXQFcnAF6RMK/oY9xNvMSej7TAvA=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:32.382805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ff8f1dbd-6915-4c4a-a4e6-b62bff8923f9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Getting quotas for project ec6724e74aa140e7826844a05b404a27. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:40:32.392872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ff8f1dbd-6915-4c4a-a4e6-b62bff8923f9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Getting quotas for user 7f58f86160d54e0380ff27912f42417d and project ec6724e74aa140e7826844a05b404a27. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:40:32.425204 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ff8f1dbd-6915-4c4a-a4e6-b62bff8923f9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.490953 Oct 16 01:40:32.431920 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2982/6093] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:40:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:40:32.865101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:32.868076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:32.940903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:32.942724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:32.946120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:32.947597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:32.950285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:32.967277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:32.969053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:32.970264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:32.978679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:32.979199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:32.979639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:32.980348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:32.980925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:32.982072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:33.486674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:33.492756 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-626f42a3-f52a-4c82-bfe3-e3e0872827ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.559585 Oct 16 01:40:33.503699 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2983/6094] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:32 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:33.636073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:33.648969 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1ffd989-a46b-4a71-b0e7-965dc7d5a59c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1393 microversion: 2.1 time: 0.805125 Oct 16 01:40:33.650635 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3112/6095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:32 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1393 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:34.519115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:34.520496 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:34.540774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:34.543855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:34.545073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:34.547398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:34.548402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:34.549233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:34.670651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5aadc301-20fc-406b-901c-cb29afd3095c req-8f64d9da-427b-4202-b902-d941bd574345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8a9a0e-ab70-4603-b447-5666e7fbb4f9", "name": "network-vif-plugged", "status": "completed", "tag": "ca5cd282-c912-44e7-842e-46d9a50f6520"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:34.686099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5aadc301-20fc-406b-901c-cb29afd3095c req-8f64d9da-427b-4202-b902-d941bd574345 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:34.686862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5aadc301-20fc-406b-901c-cb29afd3095c req-8f64d9da-427b-4202-b902-d941bd574345 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:34.687491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5aadc301-20fc-406b-901c-cb29afd3095c req-8f64d9da-427b-4202-b902-d941bd574345 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:34.703767 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5aadc301-20fc-406b-901c-cb29afd3095c req-8f64d9da-427b-4202-b902-d941bd574345 service nova] Creating event network-vif-plugged:ca5cd282-c912-44e7-842e-46d9a50f6520 for instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 on n-h2-master-1 Oct 16 01:40:34.713193 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5aadc301-20fc-406b-901c-cb29afd3095c req-8f64d9da-427b-4202-b902-d941bd574345 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048894 Oct 16 01:40:34.716655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3113/6096] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:40:34.732628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:34.733890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:34.748705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:34.750297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:34.750946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:34.752264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:34.753348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:34.753947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:35.147025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:35.162421 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5c3097c6-65c1-4fbb-9efa-15e40e6d84c9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.648983 Oct 16 01:40:35.165278 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2984/6097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:34 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:35.293064 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:35.306395 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cca1b574-436c-4a17-914a-ee3843ffa099 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1393 microversion: 2.1 time: 0.587995 Oct 16 01:40:35.311032 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3114/6098] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:34 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1393 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:35.802631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-809581565", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1929315166", "security_groups": [{"name": "tempest-secgroup-smoke-2100956792"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "7bb73dd7-2ac4-4960-ac3b-c2e02614d69c"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:35.990695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] validate_networks() for [('7bb73dd7-2ac4-4960-ac3b-c2e02614d69c', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:40:36.190851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:36.191503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:36.206464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:36.211053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:36.211877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:36.212817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:36.213461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:36.214078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:36.694745 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:36.725715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Getting quotas for project ec6724e74aa140e7826844a05b404a27. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:40:36.726078 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e53248a5-3310-45a4-877c-a0157f9c88f5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.532246 Oct 16 01:40:36.746226 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3115/6099] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:36 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:36.756765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:36.757381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:36.759161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Getting quotas for user 7f58f86160d54e0380ff27912f42417d and project ec6724e74aa140e7826844a05b404a27. Resources: dict_keys(['metadata_items']) {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:40:36.773807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:36.776797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:36.778201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:36.779653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:36.782295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:36.783651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:36.794516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:40:36.795135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:40:36.802020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:40:36.802911 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:40:36.803964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:40:36.820600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:36.821104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:36.821542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:36.822280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:36.822738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:36.823220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:36.877723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Getting quotas for project ec6724e74aa140e7826844a05b404a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:40:36.884443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Getting quotas for user 7f58f86160d54e0380ff27912f42417d and project ec6724e74aa140e7826844a05b404a27. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:40:36.901709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:40:36.908717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:40:37.003820 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2456eec4-8c4a-443b-a97f-548f451dfe7b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.205577 Oct 16 01:40:37.004487 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2985/6100] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:40:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:40:37.019193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f253a8ae-ea48-4a6c-b132-83784cf0ca48 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:37.026544 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f253a8ae-ea48-4a6c-b132-83784cf0ca48 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:37.186786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f253a8ae-ea48-4a6c-b132-83784cf0ca48 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:37.206727 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f253a8ae-ea48-4a6c-b132-83784cf0ca48 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1302 microversion: 2.1 time: 0.194849 Oct 16 01:40:37.207358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2986/6101] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:37 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1302 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:37.236434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-44cf6cff-f88e-4f9d-aa8e-5abafe5822d6 req-7a742ccd-e3df-47d5-ae1e-4d8c9a531d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d63210e-d710-44d3-85df-bb99f3787836", "name": "network-vif-plugged", "status": "completed", "tag": "a91d4dcb-6015-43ed-a1aa-eef876b141c8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:37.294287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-44cf6cff-f88e-4f9d-aa8e-5abafe5822d6 req-7a742ccd-e3df-47d5-ae1e-4d8c9a531d40 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:37.294287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-44cf6cff-f88e-4f9d-aa8e-5abafe5822d6 req-7a742ccd-e3df-47d5-ae1e-4d8c9a531d40 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:37.294287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-44cf6cff-f88e-4f9d-aa8e-5abafe5822d6 req-7a742ccd-e3df-47d5-ae1e-4d8c9a531d40 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:37.319226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:37.332200 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91dd7b00-707d-4930-ae14-fc2532fa90dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1393 microversion: 2.1 time: 0.583295 Oct 16 01:40:37.333747 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3116/6102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:36 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1393 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:37.365255 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-44cf6cff-f88e-4f9d-aa8e-5abafe5822d6 req-7a742ccd-e3df-47d5-ae1e-4d8c9a531d40 service nova] Creating event network-vif-plugged:a91d4dcb-6015-43ed-a1aa-eef876b141c8 for instance 3d63210e-d710-44d3-85df-bb99f3787836 on n-h1-master-1 Oct 16 01:40:37.386897 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-44cf6cff-f88e-4f9d-aa8e-5abafe5822d6 req-7a742ccd-e3df-47d5-ae1e-4d8c9a531d40 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172429 Oct 16 01:40:37.389082 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2987/6103] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:40:37.755914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:37.757871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:37.786526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:37.788684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:37.790305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:37.792338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:37.796642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:37.799201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:38.233086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:38.237706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:38.272168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:38.273297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:38.273754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:38.278234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:38.278740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:38.285858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:38.298953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:38.302037 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0a2f1f30-0ecc-4b0c-ac16-b1b9721a5837 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.555882 Oct 16 01:40:38.309390 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3117/6104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:37 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:38.355625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:38.356429 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:38.368300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:38.368969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:38.369507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:38.370341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:38.373701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:38.374421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:38.460077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:38.480311 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c34d429f-44a0-4e56-9c97-45a512b94fb1 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1306 microversion: 2.1 time: 0.250595 Oct 16 01:40:38.483330 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2988/6105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:38 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:38.809484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:38.820228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0cbcc6bf-2325-48bf-9ede-e6df519eb086 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1566 microversion: 2.1 time: 0.468688 Oct 16 01:40:38.820828 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3118/6106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:38 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1566 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:38.853715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:38.855351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:38.882577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:38.885077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:38.885751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:38.888949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:38.889730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:38.893445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:39.226266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:39.241165 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f52b58d4-ca95-4ba3-87a1-93bece98fbee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1566 microversion: 2.1 time: 0.395882 Oct 16 01:40:39.258667 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2989/6107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:38 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1566 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:39.336377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:39.336964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:39.346502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:39.347340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:39.347880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:39.348815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:39.349536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:39.350022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:39.508384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:39.509275 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:39.518604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:39.519376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:39.525627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:39.526570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:39.528888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:39.529519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:39.696088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:39.716317 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4926fe8-2733-4ebb-9304-77ee5b270cdd tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1354 microversion: 2.1 time: 0.209418 Oct 16 01:40:39.718181 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2990/6108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:39 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:40.113515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:40.127307 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0fc0d707-8a1d-4178-93b7-39ac0772158f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1202 microversion: 2.1 time: 0.794969 Oct 16 01:40:40.139278 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3119/6109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:39 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1202 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:40.741329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:40.742644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:40.775814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:40.776670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:40.779739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:40.782354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:40.783590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:40.785174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:40.912121 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:40.923705 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-15501dae-4269-4b43-8047-8312e5d556fa tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1360 microversion: 2.1 time: 0.186526 Oct 16 01:40:40.925598 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2991/6110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:40 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1360 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:41.153976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:41.154597 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:41.172574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:41.173089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:41.173521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:41.180870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:41.181550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:41.182157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:41.505231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:41.517242 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58ea5fc2-22d4-4b29-8664-471db0680d79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1388 microversion: 2.1 time: 0.365260 Oct 16 01:40:41.531554 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3120/6111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:41 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1388 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:41.566169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:41.567746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:41.588181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:41.588975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:41.594890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:41.596093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:41.596751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:41.597339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:41.933197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:41.952062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:41.952778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:41.967702 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dbbd6bba-6366-49d8-bde9-ad3a081933af tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1388 microversion: 2.1 time: 0.426212 Oct 16 01:40:41.995161 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2992/6112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:41 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1388 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:41.998041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:42.006464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:42.007042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:42.014406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:42.014944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:42.020359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:42.022523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:42.027827 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:42.070549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:42.071087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:42.071530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:42.072253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:42.072708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:42.073132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:42.980062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:42.997249 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2fa033e-47a1-4c88-987c-d537c7aa4b3a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1388 microversion: 2.1 time: 0.996317 Oct 16 01:40:42.998234 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2993/6113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:41 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1388 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:43.032444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:43.034208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:43.045712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:43.046707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:43.047968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:43.049119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:43.049845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:43.050455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:43.107291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:40:43.119482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:43.142107 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b24ae844-33e4-4768-85c3-b7186fb39ee2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 1.195645 Oct 16 01:40:43.145082 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3121/6114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:41 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:43.370802 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c01aeeea-2cd2-45d7-893a-45573d7ec7f7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 204 len: 0 microversion: 2.1 time: 0.348365 Oct 16 01:40:43.375634 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2994/6115] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:40:43 2022] DELETE /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:40:43.386528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:43.391314 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:43.400471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:43.401502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:43.402147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:43.403905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:43.404987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:43.405666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:43.900760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:43.914422 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a5929967-72c3-46a5-bc0d-34ed6d9ca535 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1394 microversion: 2.1 time: 0.534375 Oct 16 01:40:43.915567 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3122/6116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:43 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1394 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:44.174342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:44.175199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:44.216454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:44.221394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:44.223158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:44.227296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:44.227768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:44.228203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:44.563603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:44.572873 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f16716f2-9f88-4212-8f3c-a3c512ddd31a tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 0.406027 Oct 16 01:40:44.577304 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2995/6117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:44 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:44.938605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:44.939361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:44.971866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:44.972646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:44.977165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:44.977680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:44.978152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:44.978896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:44.986879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:44.987438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:44.990177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:44.991180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:44.991645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:44.992558 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:44.996928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:44.997469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:46.144925 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:46.153689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:46.159114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4dd3c167-245e-4c64-83ad-fa2e840cb80b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1394 microversion: 2.1 time: 1.225132 Oct 16 01:40:46.170034 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a6bc1c79-f2c5-4766-a34f-23706994dbbb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1566 microversion: 2.1 time: 1.202287 Oct 16 01:40:46.179823 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3123/6118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:44 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1394 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:46.193746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2c2f5e5a-1627-477c-9bfe-1c8167a34349 req-7d5dc40f-bdf3-43a8-a7c8-82761384b059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8a9a0e-ab70-4603-b447-5666e7fbb4f9", "tag": "ca5cd282-c912-44e7-842e-46d9a50f6520"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:46.196703 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2996/6119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:44 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1566 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:46.209913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:46.220930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:46.245024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2c2f5e5a-1627-477c-9bfe-1c8167a34349 req-7d5dc40f-bdf3-43a8-a7c8-82761384b059 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:46.245464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2c2f5e5a-1627-477c-9bfe-1c8167a34349 req-7d5dc40f-bdf3-43a8-a7c8-82761384b059 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:46.245919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2c2f5e5a-1627-477c-9bfe-1c8167a34349 req-7d5dc40f-bdf3-43a8-a7c8-82761384b059 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:46.250432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:46.253309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:46.254391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:46.266823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:46.273309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:46.273934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:46.293779 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2c2f5e5a-1627-477c-9bfe-1c8167a34349 req-7d5dc40f-bdf3-43a8-a7c8-82761384b059 service nova] Creating event network-changed:ca5cd282-c912-44e7-842e-46d9a50f6520 for instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 on n-h2-master-1 Oct 16 01:40:46.304895 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:46.311177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2c2f5e5a-1627-477c-9bfe-1c8167a34349 req-7d5dc40f-bdf3-43a8-a7c8-82761384b059 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128288 Oct 16 01:40:46.311799 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3124/6120] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:40:46.654353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:46.667999 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-71bb1fcc-0ab8-4511-b2e1-c5ec19e7fc89 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 0.467736 Oct 16 01:40:46.687935 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2997/6121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:46 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:47.188698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:47.189468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:47.208807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:47.209506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:47.210215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:47.211153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:47.211959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:47.212556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:47.495918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:47.521088 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6908958c-af93-4caa-86fa-13208c4da114 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1352 microversion: 2.1 time: 0.338068 Oct 16 01:40:47.536272 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3125/6122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:47 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1352 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:47.702483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:47.703175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:47.711444 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:47.712228 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=16 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:47.719550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:47.720072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:47.720504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:47.721225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:47.738977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:47.739707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:48.095869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:48.104791 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5aeadeb6-7e15-4048-aba1-6e233a9ada94 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 0.406954 Oct 16 01:40:48.105819 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2998/6123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:47 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:48.453174 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3bb300e8-6945-47d8-814e-647a4474f1c0 req-bdb54c46-8a61-4677-ab47-5a842b74cfbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d1fbc4-9d61-43cd-bae6-47522cbfbc03", "tag": "260b02af-28ba-40a1-a575-070f9c4872f9"}, {"server_uuid": "3d63210e-d710-44d3-85df-bb99f3787836", "name": "network-vif-deleted", "tag": "a91d4dcb-6015-43ed-a1aa-eef876b141c8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:48.470711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3bb300e8-6945-47d8-814e-647a4474f1c0 req-bdb54c46-8a61-4677-ab47-5a842b74cfbd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:48.471531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3bb300e8-6945-47d8-814e-647a4474f1c0 req-bdb54c46-8a61-4677-ab47-5a842b74cfbd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:48.472262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3bb300e8-6945-47d8-814e-647a4474f1c0 req-bdb54c46-8a61-4677-ab47-5a842b74cfbd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:48.489278 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3bb300e8-6945-47d8-814e-647a4474f1c0 req-bdb54c46-8a61-4677-ab47-5a842b74cfbd service nova] Creating event network-changed:260b02af-28ba-40a1-a575-070f9c4872f9 for instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 on n-h1-master-1 Oct 16 01:40:48.489877 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3bb300e8-6945-47d8-814e-647a4474f1c0 req-bdb54c46-8a61-4677-ab47-5a842b74cfbd service nova] Creating event network-vif-deleted:a91d4dcb-6015-43ed-a1aa-eef876b141c8 for instance 3d63210e-d710-44d3-85df-bb99f3787836 on n-h1-master-1 Oct 16 01:40:48.497942 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3bb300e8-6945-47d8-814e-647a4474f1c0 req-bdb54c46-8a61-4677-ab47-5a842b74cfbd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049623 Oct 16 01:40:48.499230 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3126/6124] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:40:48.546419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:48.547193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:48.555452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:48.564837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:48.564951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:48.565773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:48.566260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:48.566703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:48.683407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:48.694355 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5b6b75b-105c-4715-9823-6980f75d48f8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1187 microversion: 2.1 time: 0.152477 Oct 16 01:40:48.697485 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 2999/6125] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:48 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1187 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:49.131050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:49.131983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:49.160434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:49.164326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:49.167072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:49.168602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:49.170033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:49.170648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:49.359855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:49.362123 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:40:49.377752 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3c9a45b8-4b88-4ad3-af4b-5881c1252b39 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 0.248809 Oct 16 01:40:49.395164 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3127/6126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:49 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:49.726084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:49.726770 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:49.734279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:49.735219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:49.735968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:49.753649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:49.755619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:49.756406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:49.909134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:49.919165 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fed8baa-842b-4ff2-9821-b2425c1486d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1187 microversion: 2.1 time: 0.197134 Oct 16 01:40:49.920466 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3000/6127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:49 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1187 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:50.401867 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:50.402610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:50.410165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:50.410872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:50.411507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:50.412655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:50.413281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:50.414177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:50.637297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:50.649611 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e7bd1233-48e6-4135-98c3-7406e63a340f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 0.249767 Oct 16 01:40:50.683099 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3128/6128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:50 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:50.951208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:50.953664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:50.963616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:50.964215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:50.964705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:50.966636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:50.967132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:50.967561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:51.100853 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:51.113454 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1a94eb43-d346-4fdf-999f-d4ec5adb6e03 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1187 microversion: 2.1 time: 0.174485 Oct 16 01:40:51.114696 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3001/6129] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:50 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1187 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:51.680073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:51.682130 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:51.694703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:51.698484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:51.700125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:51.712066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:51.712818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:51.713455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:52.095728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:52.105197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc42191a-e420-4871-971b-24d04264c0e7 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 0.429104 Oct 16 01:40:52.108875 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3129/6130] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:51 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:52.144920 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:52.146505 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:52.156223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:52.156719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:52.157162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:52.158032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:52.159297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:52.159748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:52.297866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:52.308019 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e67dbec3-9d10-4d76-acca-6d17a6643162 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1187 microversion: 2.1 time: 0.174347 Oct 16 01:40:52.315036 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3002/6131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:52 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1187 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:53.131896 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:53.132523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:53.142416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:53.142416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:53.142620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:53.143312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:53.143784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:53.144217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:53.343879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:53.345092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:53.356753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:53.368860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:53.372000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:53.372981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:53.374113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:53.375010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:53.375697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:53.376906 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a74dc82-5866-4727-9244-524dfbb1df46 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 0.248837 Oct 16 01:40:53.377815 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3130/6132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:53 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:53.474154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:53.483484 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c64e512-e461-4f6e-8228-6ae43764fe55 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1187 microversion: 2.1 time: 0.143792 Oct 16 01:40:53.491547 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3003/6133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:53 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1187 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:53.716643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2c9abbd7-1442-4bcd-91f1-b0ae5db29025 req-90c67999-6ded-49ca-8a99-177af989cd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d1fbc4-9d61-43cd-bae6-47522cbfbc03", "name": "network-vif-plugged", "status": "completed", "tag": "260b02af-28ba-40a1-a575-070f9c4872f9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:40:53.733729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2c9abbd7-1442-4bcd-91f1-b0ae5db29025 req-90c67999-6ded-49ca-8a99-177af989cd2f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:53.734258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2c9abbd7-1442-4bcd-91f1-b0ae5db29025 req-90c67999-6ded-49ca-8a99-177af989cd2f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:53.734694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2c9abbd7-1442-4bcd-91f1-b0ae5db29025 req-90c67999-6ded-49ca-8a99-177af989cd2f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:53.769652 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2c9abbd7-1442-4bcd-91f1-b0ae5db29025 req-90c67999-6ded-49ca-8a99-177af989cd2f service nova] Creating event network-vif-plugged:260b02af-28ba-40a1-a575-070f9c4872f9 for instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 on n-h1-master-1 Oct 16 01:40:53.777279 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2c9abbd7-1442-4bcd-91f1-b0ae5db29025 req-90c67999-6ded-49ca-8a99-177af989cd2f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065730 Oct 16 01:40:53.779187 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3131/6134] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:40:54.408269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:54.409250 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:54.420611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:54.421957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:54.422705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:54.424878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:54.425445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:54.426423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:54.510532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:54.511911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:54.527102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:54.528023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:54.528695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:54.529598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:54.530225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:54.530810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:54.621232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:54.636852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fa9e8e02-07ff-467f-a249-20f48bf5adbe tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1428 microversion: 2.1 time: 0.237402 Oct 16 01:40:54.641294 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3004/6135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:54 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1428 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:54.699931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:54.708485 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7f298510-54f6-4754-a4f4-75f069256834 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 200 len: 1187 microversion: 2.1 time: 0.204048 Oct 16 01:40:54.709734 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3132/6136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:54 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 1187 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:55.666466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:55.667606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:55.678629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:55.679211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:55.679652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:55.684176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:55.684861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:55.685490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:55.734095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:55.734769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 3d63210e-d710-44d3-85df-bb99f3787836] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:55.745075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:55.745573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:55.746658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:55.747426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:55.755275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:55.757868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:55.784765 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 3d63210e-d710-44d3-85df-bb99f3787836 could not be found. Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 HTTP/1.1 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 3d63210e-d710-44d3-85df-bb99f3787836 could not be found. Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '3d63210e-d710-44d3-85df-bb99f3787836'} Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d63210e-d710-44d3-85df-bb99f3787836 could not be found. Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d63210e-d710-44d3-85df-bb99f3787836 could not be found. Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:40:55.786441 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:40:55.791673 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:40:55.791673 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:40:55.791673 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:40:55.791673 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:40:55.791673 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:40:55.791673 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d63210e-d710-44d3-85df-bb99f3787836 could not be found. Oct 16 01:40:55.791673 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:40:55.793659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 3d63210e-d710-44d3-85df-bb99f3787836 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:40:55.795390 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fef628dd-ccf7-4fa6-8b10-fbc766ad8b80 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836" status: 404 len: 111 microversion: 2.1 time: 0.066237 Oct 16 01:40:55.796446 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3133/6137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:55 2022] GET /compute/v2.1/servers/3d63210e-d710-44d3-85df-bb99f3787836 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:40:55.952027 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:55.964421 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ea64f650-1160-4202-ab49-897c742ed541 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1608 microversion: 2.1 time: 0.302207 Oct 16 01:40:55.991307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:55.992179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:55.994668 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3005/6138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:55 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1608 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:40:56.005738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:56.014758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:56.015471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:56.016418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:56.016888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:56.017484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:56.191034 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:56.201895 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e6e19c1-9ec0-42ac-95ed-e639e36149f5 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1608 microversion: 2.1 time: 0.214381 Oct 16 01:40:56.216697 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3134/6139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:55 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1608 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:40:56.232794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:40:56.233804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:40:56.251380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:56.253323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:56.254187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:56.255233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:40:56.255957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:40:56.256768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:40:56.436876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:40:56.448455 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-395a65a4-4e47-4e2a-857a-5bfd5fd9b59b tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1608 microversion: 2.1 time: 0.219294 Oct 16 01:40:56.450453 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3006/6140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:40:56 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1608 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:00.014780 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1f6756b8-854f-4d1a-a70d-704ab2b312b3 req-c5905e3a-051a-45a2-947c-8c891161eb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d1fbc4-9d61-43cd-bae6-47522cbfbc03", "tag": "260b02af-28ba-40a1-a575-070f9c4872f9"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:00.025283 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=52 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:00.034847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1f6756b8-854f-4d1a-a70d-704ab2b312b3 req-c5905e3a-051a-45a2-947c-8c891161eb2a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:00.040220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1f6756b8-854f-4d1a-a70d-704ab2b312b3 req-c5905e3a-051a-45a2-947c-8c891161eb2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:00.040965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1f6756b8-854f-4d1a-a70d-704ab2b312b3 req-c5905e3a-051a-45a2-947c-8c891161eb2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:00.057198 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1f6756b8-854f-4d1a-a70d-704ab2b312b3 req-c5905e3a-051a-45a2-947c-8c891161eb2a service nova] Creating event network-changed:260b02af-28ba-40a1-a575-070f9c4872f9 for instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 on n-h1-master-1 Oct 16 01:41:00.065416 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1f6756b8-854f-4d1a-a70d-704ab2b312b3 req-c5905e3a-051a-45a2-947c-8c891161eb2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061604 Oct 16 01:41:00.066348 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3135/6141] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:41:03.871872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:03.876457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:03.888083 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:03.896674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:03.897391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:03.898112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:03.899125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:03.899819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:03.900495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:04.017452 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d1cae61-1428-46d9-8931-c64e8d88bafd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action" status: 200 len: 24570 microversion: 2.1 time: 0.151432 Oct 16 01:41:04.019973 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3007/6142] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:41:03 2022] POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action => generated 24570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:41:15.053147 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=37 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:15.054298 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:15.061445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:15.062296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:15.071074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:15.071577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:15.072017 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:15.072948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:15.073356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:15.073791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:15.406885 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-74d7900c-b9ab-4a60-a751-b0804ce3a0a2 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1836 microversion: 2.1 time: 0.358190 Oct 16 01:41:15.411467 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3136/6143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:15 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1836 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:15.439203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:15.440541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:15.451472 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=63 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:15.454939 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:15.460734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:15.461488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:15.462814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:15.464427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:15.467052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:15.468307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:15.640234 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:15.649170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-372744fa-4051-4978-859d-4e3ba8c9b8cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1685 microversion: 2.1 time: 0.216024 Oct 16 01:41:15.650234 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3008/6144] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:15 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1685 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:15.789144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:15.796951 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:15.813097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:15.813706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:15.815388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:15.817331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:15.818729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:15.820183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:15.956715 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ce2b9fc-6553-4cd0-93ea-3d440d4e5f29 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action" status: 200 len: 32642 microversion: 2.1 time: 0.173918 Oct 16 01:41:15.961901 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3137/6145] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:41:15 2022] POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action => generated 32642 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:41:16.098730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:16.099372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:16.112187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:16.114352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:16.114966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:16.119311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:16.119961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:16.122136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:16.186446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '358a87063f3f42db9eaf4c91eeed863a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006d55fa66e4e34883f683f439fed71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:16.187169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] flavor_id is None. Assuming migration. {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 16 01:41:16.187618 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:41:16.513963 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16dbf223-6b29-4350-9673-601b9d188831 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action" status: 202 len: 0 microversion: 2.1 time: 0.421469 Oct 16 01:41:16.517667 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3009/6146] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:41:16 2022] POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:41:16.523618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:16.524378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:16.534213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:16.535014 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:16.535828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:16.536744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:16.537210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:16.537636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:16.713401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:16.723867 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5b78e395-66e8-4bff-8e59-067737bbc695 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1694 microversion: 2.1 time: 0.204764 Oct 16 01:41:16.725141 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3138/6147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:16 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:17.760741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:17.762446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:17.803374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:17.804020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:17.804531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:17.805329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:17.805865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:17.806383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:18.033372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:18.052966 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1048d9a-16f5-4b23-8d2f-b48ea337650c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1694 microversion: 2.1 time: 0.306020 Oct 16 01:41:18.056037 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3010/6148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:17 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1694 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:19.078269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:19.080047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:19.102565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:19.104086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:19.104674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:19.106700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:19.107779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:19.109242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:19.417638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:19.431835 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f718755-8ea6-4091-86bc-c088b6553a04 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1694 microversion: 2.1 time: 0.357956 Oct 16 01:41:19.449859 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3139/6149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:19 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1694 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:20.462485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:20.463200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:20.492513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:20.492937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:20.493397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:20.494177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:20.494961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:20.495709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:21.219307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:21.227348 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e5f370b5-4d65-44e0-b28c-6d0cde584ee4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.769137 Oct 16 01:41:21.240005 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3011/6150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:20 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:22.256303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:22.256954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:22.264328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:22.265054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:22.265764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:22.266649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:22.267301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:22.267916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:22.540910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:22.562944 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-781ae4fb-6bc6-46ec-9910-b0eb5c749c87 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.310400 Oct 16 01:41:22.565888 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3140/6151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:22 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:23.592781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:23.594269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:23.603270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:23.604015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:23.604621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:23.605543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:23.606315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:23.607255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:23.834548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:23.846051 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a96b68b9-d4fc-45e2-8f60-9bb0be6ccc4e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.259886 Oct 16 01:41:23.846668 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3012/6152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:23 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:24.875580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:24.876980 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:24.884180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:24.884964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:24.885686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:24.886604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:24.887308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:24.892079 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:25.081228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:25.095329 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b2651db-fdf2-4eda-a7b7-3c493ad815c2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.228796 Oct 16 01:41:25.098261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3141/6153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:24 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:26.124837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:26.126221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:26.142066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:26.145232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:26.147781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:26.149725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:26.150368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:26.151805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:26.530339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:26.541865 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0c0010c5-1ddc-416b-8101-3a634da2b66c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.423292 Oct 16 01:41:26.559167 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3013/6154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:26 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:27.568662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:27.569382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:27.607571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:27.609445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:27.609925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:27.612862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:27.614351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:27.615622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:27.860187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:27.875872 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-78942045-ab4c-4464-bf01-403cceb8727f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.311632 Oct 16 01:41:27.878953 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3142/6155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:27 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:28.910613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:28.910613 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:28.931381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:28.932172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:28.933618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:28.935732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:28.936520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:28.937161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:29.237625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:29.253852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-15e3fe72-5120-4d8e-856e-75cac1e52c49 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.356389 Oct 16 01:41:29.257216 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3014/6156] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:28 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:30.279134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:30.279738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:30.307268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:30.315695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:30.316173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:30.317159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:30.327887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:30.328383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:30.604967 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:30.615661 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5662240e-b50e-47e9-80ff-cb95ee23de3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.341880 Oct 16 01:41:30.621609 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3143/6157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:30 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:31.645688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:31.646309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:31.658317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:31.665983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:31.669725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:31.670507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:31.671027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:31.671476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:31.720985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:31.722282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:31.736742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:31.737673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:31.738321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:31.739546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:31.740236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:31.741017 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:31.787457 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e2387466-23dd-46d2-a87c-1c256057a1ff tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.071546 Oct 16 01:41:31.788886 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3144/6158] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Oct 16 01:41:31 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03/os-server-password => generated 116 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:41:31.974570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:31.988015 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-998c746e-422c-4544-96aa-a77e286cb76a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.346088 Oct 16 01:41:31.989910 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3015/6159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:31 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:32.443651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1773483766", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3b24b96a-6d82-4535-bb7a-a16554897485", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "61eb30c5-accf-4cf9-b162-43c4bdd26615"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:32.562797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] validate_networks() for [('61eb30c5-accf-4cf9-b162-43c4bdd26615', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:41:33.017660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:33.018288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:33.034112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:33.034597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:33.035076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:33.035802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:33.036268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:33.036700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:33.057472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:41:33.060427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:41:33.062241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:41:33.063779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:41:33.065886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:41:33.092202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:33.096256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:33.096812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:33.099177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:33.099676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:33.100115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:33.123457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:41:33.140186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:41:33.162639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:41:33.165002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3b24b96a-6d82-4535-bb7a-a16554897485',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:41:33.260343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:33.266477 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a718567e-4142-4327-9d90-12383b8dc3ac tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827443 Oct 16 01:41:33.267790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3145/6160] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:41:33.278699 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c691b6f-ba6b-417b-922a-98043f30c2cd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.263897 Oct 16 01:41:33.279126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8cfe1552-1433-4b1f-a228-05a1eb05369c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:33.279947 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8cfe1552-1433-4b1f-a228-05a1eb05369c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:33.280217 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3016/6161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:33 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:33.390266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8cfe1552-1433-4b1f-a228-05a1eb05369c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:33.399572 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8cfe1552-1433-4b1f-a228-05a1eb05369c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1057 microversion: 2.1 time: 0.124770 Oct 16 01:41:33.415474 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3146/6162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:33 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1057 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:34.304307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:34.305670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:34.314082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:34.314741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:34.315638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:34.316890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:34.317584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:34.318297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:34.424272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:34.425015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:34.432849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:34.433778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:34.435538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:34.436299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:34.436799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:34.437226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:34.535397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:34.546196 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f4e18b9-decd-41a8-b8e6-5b110ae74823 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1109 microversion: 2.1 time: 0.125704 Oct 16 01:41:34.551465 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3147/6163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:34 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1109 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:34.551937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:34.579261 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a1f81a01-79bd-4d8e-8a8e-dec10acf2884 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.277172 Oct 16 01:41:34.579970 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3017/6164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:34 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:35.569255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:35.570442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:35.592209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:35.593590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:35.599055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:35.600149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:35.600846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:35.601498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:35.609470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:35.611211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:35.622753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:35.623587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:35.624617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:35.626345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:35.627078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:35.627727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:36.198421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:36.212297 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f747648e-348a-43db-9602-f834cf053b78 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.646038 Oct 16 01:41:36.213957 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3148/6165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:35 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:36.229194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:36.238431 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1996a02-d546-42c8-bca1-2f1eb64dd7d3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.638239 Oct 16 01:41:36.257928 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3018/6166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:35 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:37.247336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:37.250432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:37.271393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:37.271923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:37.272530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:37.273249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:37.273721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:37.274152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:37.283629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:37.284900 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:37.337391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:37.342998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:37.343455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:37.344193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:37.346321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:37.346758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:37.885890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:37.904618 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-863929c1-47a3-46cc-bb0e-b72a6a08c6db tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1699 microversion: 2.1 time: 0.623255 Oct 16 01:41:37.907436 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3019/6167] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:37 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1699 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:37.937803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:37.970489 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1caecece-7c19-4133-af72-2a72b2c718b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.734156 Oct 16 01:41:37.978126 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3149/6168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:37 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:38.931498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:38.932761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:38.943245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:38.943919 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:38.944535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:38.948225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:38.951686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:38.952161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:38.994335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:38.997584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:39.008862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:39.012748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:39.021919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:39.023195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:39.023835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:39.024447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:39.268707 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:39.282829 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a567a1ca-fef6-40a6-8760-70f8f922d7a0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1698 microversion: 2.1 time: 0.354303 Oct 16 01:41:39.284442 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3020/6169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:38 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1698 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:39.309769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:39.318576 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-36eaa098-c9ce-4963-bb55-84ad08009b54 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.329101 Oct 16 01:41:39.320540 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3150/6170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:38 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:39.757051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-53f4757c-fd80-418a-ad5b-064544478fbd req-2410193c-8afe-4b21-85c1-9729c3cb009c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8a9a0e-ab70-4603-b447-5666e7fbb4f9", "name": "network-vif-unplugged", "status": "completed", "tag": "ca5cd282-c912-44e7-842e-46d9a50f6520"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:39.785517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-53f4757c-fd80-418a-ad5b-064544478fbd req-2410193c-8afe-4b21-85c1-9729c3cb009c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:39.786009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-53f4757c-fd80-418a-ad5b-064544478fbd req-2410193c-8afe-4b21-85c1-9729c3cb009c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:39.786568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-53f4757c-fd80-418a-ad5b-064544478fbd req-2410193c-8afe-4b21-85c1-9729c3cb009c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:39.812044 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-53f4757c-fd80-418a-ad5b-064544478fbd req-2410193c-8afe-4b21-85c1-9729c3cb009c service nova] Creating event network-vif-unplugged:ca5cd282-c912-44e7-842e-46d9a50f6520 for instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 on n-h1-master-1 Oct 16 01:41:39.823990 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-53f4757c-fd80-418a-ad5b-064544478fbd req-2410193c-8afe-4b21-85c1-9729c3cb009c service nova] Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:41:39.847283 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-53f4757c-fd80-418a-ad5b-064544478fbd req-2410193c-8afe-4b21-85c1-9729c3cb009c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102551 Oct 16 01:41:39.849014 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3021/6171] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:41:40.314776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:40.316061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:40.329179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:40.330117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:40.330670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:40.331798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:40.333029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:40.333703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:40.346201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:40.346905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:40.354399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:40.356197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:40.356839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:40.357744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:40.358379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:40.359008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:40.710274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:40.731732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:40.741150 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e0a0450-08c2-4de7-94e2-7e7253c38ba3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.400026 Oct 16 01:41:40.741930 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3022/6172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:40 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:40.750793 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f9cf717-6a1e-441e-be00-65e6d246ea95 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1698 microversion: 2.1 time: 0.429638 Oct 16 01:41:40.759964 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3151/6173] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:40 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1698 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:41.803389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:41.809885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:41.811421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:41.814488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:41.833876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:41.838006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:41.841779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:41.842516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:41.846508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:41.848344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:41.848576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:41.849708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:41.852588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:41.856817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:41.858258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:41.859189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:41.883774 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:42.622037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:42.631210 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd532d94-8d92-4478-a08f-9caa2dd802e4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1698 microversion: 2.1 time: 0.862707 Oct 16 01:41:42.639549 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3152/6174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:41 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1698 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:42.645825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f1eadd36-33ba-448a-8e6f-50a7a575060a req-d21092b8-7930-464b-92c9-6c169748d23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb2d86e-fdd5-4811-bd28-3c481f8cf74b", "tag": "8092f570-d1fc-4ef2-8ea9-4863dd0e3acb"}, {"name": "network-changed", "server_uuid": "0c8a9a0e-ab70-4603-b447-5666e7fbb4f9", "tag": "ca5cd282-c912-44e7-842e-46d9a50f6520"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:42.671277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f1eadd36-33ba-448a-8e6f-50a7a575060a req-d21092b8-7930-464b-92c9-6c169748d23d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:42.671984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f1eadd36-33ba-448a-8e6f-50a7a575060a req-d21092b8-7930-464b-92c9-6c169748d23d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:42.672575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f1eadd36-33ba-448a-8e6f-50a7a575060a req-d21092b8-7930-464b-92c9-6c169748d23d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:42.701822 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f1eadd36-33ba-448a-8e6f-50a7a575060a req-d21092b8-7930-464b-92c9-6c169748d23d service nova] Creating event network-changed:8092f570-d1fc-4ef2-8ea9-4863dd0e3acb for instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b on n-h2-master-1 Oct 16 01:41:42.702834 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f1eadd36-33ba-448a-8e6f-50a7a575060a req-d21092b8-7930-464b-92c9-6c169748d23d service nova] Creating event network-changed:ca5cd282-c912-44e7-842e-46d9a50f6520 for instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 on n-h1-master-1 Oct 16 01:41:42.709045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-f1eadd36-33ba-448a-8e6f-50a7a575060a req-d21092b8-7930-464b-92c9-6c169748d23d service nova] Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:41:42.728451 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f1eadd36-33ba-448a-8e6f-50a7a575060a req-d21092b8-7930-464b-92c9-6c169748d23d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086376 Oct 16 01:41:42.729959 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3153/6175] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:41:42.893345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:42.905901 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9bd459a7-2813-4c57-ba9d-8e7fd3949919 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 1.142654 Oct 16 01:41:42.907097 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3023/6176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:41 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:43.671088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:43.672495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:43.680538 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:43.682638 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:43.702426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:43.703953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:43.705999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:43.707744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:43.708312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:43.708856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:43.953890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:43.954592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:43.970103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:43.975402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:43.976054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:43.976976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:43.979666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:43.980313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:43.990385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:44.002726 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbc08057-6be7-4951-a60a-d7a8e1f48315 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1696 microversion: 2.1 time: 0.336957 Oct 16 01:41:44.006558 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3154/6177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:43 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1696 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:44.466620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:44.478842 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9faebe89-dd90-4abc-9909-784ad6a03682 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.536552 Oct 16 01:41:44.485552 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3024/6178] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:43 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:45.049688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:45.051065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:45.069198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:45.070836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:45.077545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:45.078985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:45.083964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:45.084755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:45.155310 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=99 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:45.465312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:45.475539 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-35053e02-356c-4307-a4dd-4093cdce96c7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1693 microversion: 2.1 time: 0.430886 Oct 16 01:41:45.480844 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3155/6179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:45 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1693 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:45.512081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:45.512671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:45.517740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:45.518362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:45.520299 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:45.523970 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=37 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:41:45.532034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:45.541188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:45.542304 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:45.544993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:45.548944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:45.549374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:45.553468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:45.554269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:45.554755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:45.555222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:45.556067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:45.556769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:45.687799 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b4ea66f-73d5-4e92-9cf0-484cee17ee27 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action" status: 204 len: 0 microversion: 2.1 time: 0.186906 Oct 16 01:41:45.688701 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3025/6180] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:41:45 2022] POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:41:45.725814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:45.727854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:45.764532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:45.765394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:45.765825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:45.766532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:45.767019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:45.767445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:46.145214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:46.163683 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ceb47be1-63bc-4bc0-b4c6-de557f97fe17 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.653664 Oct 16 01:41:46.165473 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3156/6181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:45 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:46.325963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:46.337725 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bec499b1-4001-48c7-a4f1-2be9ec55805e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1693 microversion: 2.1 time: 0.643740 Oct 16 01:41:46.339353 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3026/6182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:45 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1693 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:47.190878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:47.192148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:47.202834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:47.203792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:47.204436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:47.205696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:47.206317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:47.206813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:47.366928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:47.367696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:47.387099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:47.387623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:47.388068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:47.388792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:47.389248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:47.389675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:47.598167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:47.611482 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1fa4402-36f7-43f9-8eef-903bf1efa0fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.425325 Oct 16 01:41:47.612579 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3157/6183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:47 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:47.864174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:47.886908 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7a74947-b5b1-451d-8955-3599bb41f49d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1693 microversion: 2.1 time: 0.523407 Oct 16 01:41:47.890441 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3027/6184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:47 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1693 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:41:48.347045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-7a214d5f-b5db-4645-9ef7-45807d6ffbc5 req-9019b320-959d-45a2-9817-f418d74d3e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8a9a0e-ab70-4603-b447-5666e7fbb4f9", "name": "network-vif-plugged", "status": "completed", "tag": "ca5cd282-c912-44e7-842e-46d9a50f6520"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:41:48.358704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7a214d5f-b5db-4645-9ef7-45807d6ffbc5 req-9019b320-959d-45a2-9817-f418d74d3e42 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:48.359572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7a214d5f-b5db-4645-9ef7-45807d6ffbc5 req-9019b320-959d-45a2-9817-f418d74d3e42 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:48.360213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-7a214d5f-b5db-4645-9ef7-45807d6ffbc5 req-9019b320-959d-45a2-9817-f418d74d3e42 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:48.375498 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-7a214d5f-b5db-4645-9ef7-45807d6ffbc5 req-9019b320-959d-45a2-9817-f418d74d3e42 service nova] Creating event network-vif-plugged:ca5cd282-c912-44e7-842e-46d9a50f6520 for instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 on n-h1-master-1 Oct 16 01:41:48.381811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-7a214d5f-b5db-4645-9ef7-45807d6ffbc5 req-9019b320-959d-45a2-9817-f418d74d3e42 service nova] Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:41:48.397831 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-7a214d5f-b5db-4645-9ef7-45807d6ffbc5 req-9019b320-959d-45a2-9817-f418d74d3e42 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156332 Oct 16 01:41:48.398632 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3158/6185] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:41:48.653558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:48.654328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:48.661574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:48.662069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:48.662508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:48.663279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:48.663935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:48.664540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:48.902589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:48.913174 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e0052b5-e47c-4a48-b346-d32485fd1452 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.264011 Oct 16 01:41:48.930039 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3028/6186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:48 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:48.932617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:48.934421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:48.953245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:48.953747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:48.954183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:48.954893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:48.955373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:48.955796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:49.239790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:49.265754 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-25597de1-753c-4482-851f-7ed95d4a082b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1693 microversion: 2.1 time: 0.350396 Oct 16 01:41:49.267399 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3159/6187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:48 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1693 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:49.942311 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:49.942866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:49.953031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:49.953820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:49.954457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:49.955576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:49.956429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:49.957128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:50.179917 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:50.191075 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-78248393-880b-4710-bfad-76607afe33f4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.254066 Oct 16 01:41:50.195071 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3029/6188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:49 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:50.292802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:50.294996 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:50.307978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:50.310315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:50.310953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:50.311876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:50.312522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:50.313128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:50.591146 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:50.599764 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-97404ed0-7063-4215-96c6-af30b6d07a18 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1685 microversion: 2.1 time: 0.311301 Oct 16 01:41:50.600357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3160/6189] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:50 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1685 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:51.214111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:51.215783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:51.233702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:51.234208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:51.235440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:51.236793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:51.237652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:51.238530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:51.471345 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:51.481425 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bbe9f0ad-b252-4c96-aeb6-c221b5caf9d1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.271028 Oct 16 01:41:51.483577 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3030/6190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:51 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:52.504468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:52.505684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:52.512996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:52.513849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:52.514474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:52.515382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:52.516012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:52.516611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:52.783424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:52.800247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5134a8bb-5ebf-47e4-abf3-fd85816eac1b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.299399 Oct 16 01:41:52.815938 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3161/6191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:52 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:53.822367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:53.823098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:53.839205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:53.840025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:53.840853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:53.841791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:53.842355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:53.843406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:54.098429 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:54.111202 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e75bedd0-934d-41cb-9d7f-d9d0b3e41507 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.292593 Oct 16 01:41:54.126847 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3031/6192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:53 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:55.135864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:55.137868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:55.145378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:55.146192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:55.146808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:55.148102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:55.148704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:55.149383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:55.385325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:55.405558 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-60a6b5ef-5362-41d2-a6fb-bf26fd395b6e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1169 microversion: 2.1 time: 0.275302 Oct 16 01:41:55.420044 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3162/6193] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:55 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1169 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:56.431564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:56.432395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:56.441238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:56.441873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:56.442409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:56.443294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:56.443852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:56.444760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:56.708709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:56.717514 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cf116700-7bd6-45e2-94df-fa4faf607666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.290000 Oct 16 01:41:56.718380 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3032/6194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:56 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:57.742270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:57.742893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:57.757414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:57.758183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:57.758793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:57.759768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:57.764654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:57.765498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:57.987430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:58.001659 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6270ba07-3fb6-41b3-b1fd-7fb9df0f5585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.263623 Oct 16 01:41:58.015522 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3163/6195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:57 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:41:59.047072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:41:59.047701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:41:59.054375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:59.055159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:59.055757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:59.056620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:41:59.057235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:41:59.057820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:41:59.217902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:41:59.228386 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2ab4ed9a-c0d1-43b3-9d07-cdd65122d409 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.193294 Oct 16 01:41:59.229727 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3033/6196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:41:59 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:00.253853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:00.254449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:00.263813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:00.264622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:00.265155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:00.266112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:00.267010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:00.267777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:00.482215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:00.490761 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c1f6d1cb-3bff-4220-84bb-3201444aefd4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.241501 Oct 16 01:42:00.491637 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3164/6197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:00 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:01.518781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:01.519489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:01.531654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:01.532559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:01.533178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:01.534056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:01.534891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:01.535499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:01.782666 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:01.791172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b5196121-923a-48d4-8c96-47ef1a8a7082 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.277325 Oct 16 01:42:01.792255 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3034/6198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:01 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:42:02.815863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:02.817098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:02.824522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:02.825538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:02.825998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:02.826713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:02.827372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:02.827976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:02.974313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:02.984765 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1a97780b-3b10-4929-83e5-23339649a21a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.173065 Oct 16 01:42:02.987038 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3165/6199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:02 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:04.007821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:04.009114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:04.017347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:04.018033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:04.018601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:04.019494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:04.020329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:04.020997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:04.181899 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:04.194338 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f277d82d-d6ed-4008-b11a-64e06d9c8531 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.190305 Oct 16 01:42:04.199580 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3035/6200] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:04 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:05.221662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:05.222432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:05.230828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:05.231077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:05.231740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:05.232615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:05.233078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:05.233506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:05.431703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:05.440439 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fbc7309c-20e8-485d-9ef3-1b22f79aced3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.224856 Oct 16 01:42:05.441668 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3166/6201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:05 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:06.050337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-dbaf9be9-c673-4dad-81d0-7bfe8b0c7cc9 req-9451e1a6-5884-4af2-aa51-80cb2a01bcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb2d86e-fdd5-4811-bd28-3c481f8cf74b", "name": "network-vif-plugged", "status": "completed", "tag": "8092f570-d1fc-4ef2-8ea9-4863dd0e3acb"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:06.067544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dbaf9be9-c673-4dad-81d0-7bfe8b0c7cc9 req-9451e1a6-5884-4af2-aa51-80cb2a01bcda service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:06.068738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dbaf9be9-c673-4dad-81d0-7bfe8b0c7cc9 req-9451e1a6-5884-4af2-aa51-80cb2a01bcda service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:06.069207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-dbaf9be9-c673-4dad-81d0-7bfe8b0c7cc9 req-9451e1a6-5884-4af2-aa51-80cb2a01bcda service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:06.094419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-dbaf9be9-c673-4dad-81d0-7bfe8b0c7cc9 req-9451e1a6-5884-4af2-aa51-80cb2a01bcda service nova] Creating event network-vif-plugged:8092f570-d1fc-4ef2-8ea9-4863dd0e3acb for instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b on n-h2-master-1 Oct 16 01:42:06.103517 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-dbaf9be9-c673-4dad-81d0-7bfe8b0c7cc9 req-9451e1a6-5884-4af2-aa51-80cb2a01bcda service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057926 Oct 16 01:42:06.104503 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3036/6202] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:42:06.464934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:06.466103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:06.474314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:06.474803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:06.475276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:06.475969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:06.476592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:06.477178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:06.623458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:06.633772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ead404d-d84a-4eec-a212-49e429aad645 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1203 microversion: 2.1 time: 0.172851 Oct 16 01:42:06.634489 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3167/6203] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:06 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:07.661047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:07.662410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:07.669120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:07.669961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:07.670978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:07.671929 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:07.672630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:07.673187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:07.890147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:07.901064 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8f587806-50f8-4751-86f6-03c9d1af7628 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1390 microversion: 2.1 time: 0.246069 Oct 16 01:42:07.901768 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3037/6204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:07 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:07.927334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:07.928030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:07.937824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:07.939032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:07.939672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:07.940764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:07.941754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:07.942182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.146884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:08.155588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52645c4d-09b8-4300-8cf2-ed44a1d542d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1390 microversion: 2.1 time: 0.233701 Oct 16 01:42:08.156215 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3168/6205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:07 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1390 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:08.180264 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:08.180878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:08.192367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:08.192878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:08.193302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.194002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:08.194449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:08.196731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.332831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:08.342102 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bd354686-c1e6-4ec2-b22a-2458ee175dd2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1390 microversion: 2.1 time: 0.165600 Oct 16 01:42:08.342699 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3038/6206] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:08 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:08.426910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:08.427769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:08.435259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:08.436099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:08.436760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.437636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:08.438086 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:08.438521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.466905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:42:08.569538 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b340055b-09fd-44e1-b849-6dd89d04d6d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 204 len: 0 microversion: 2.1 time: 0.146407 Oct 16 01:42:08.570240 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3169/6207] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:42:08 2022] DELETE /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:42:08.579582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:08.580284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:08.586267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:08.586751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:08.587252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.588154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:08.588620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:08.589050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.604844 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:08.730909 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:08.740575 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9e725f8d-ffcf-4a62-b532-da7190a08009 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1396 microversion: 2.1 time: 0.165420 Oct 16 01:42:08.741479 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3039/6208] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:08 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:42:08.803341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:08.805503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:08.815386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:08.815890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:08.816517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.817423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:08.818061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:08.818497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:08.836801 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:08.899355 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7b85e772-afd3-42eb-8ae9-006967ea6570 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action" status: 200 len: 24578 microversion: 2.1 time: 0.100350 Oct 16 01:42:08.900171 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3170/6209] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:42:08 2022] POST /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9/action => generated 24578 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:42:09.780763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:09.783887 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:09.796609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:09.797107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:09.797545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:09.800483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:09.801125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:09.802301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:10.351628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:10.361184 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-beeb5967-dc73-4f6d-9ca7-4f5672082651 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1396 microversion: 2.1 time: 0.597302 Oct 16 01:42:10.363520 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3040/6210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:09 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1396 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:11.144386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6eaa26ed-f37c-4906-b3a8-ef58077e1de8 req-521e2b67-70e9-467a-b599-ad4395d94541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb2d86e-fdd5-4811-bd28-3c481f8cf74b", "name": "network-vif-deleted", "tag": "8092f570-d1fc-4ef2-8ea9-4863dd0e3acb"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:11.163013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6eaa26ed-f37c-4906-b3a8-ef58077e1de8 req-521e2b67-70e9-467a-b599-ad4395d94541 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:11.164047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6eaa26ed-f37c-4906-b3a8-ef58077e1de8 req-521e2b67-70e9-467a-b599-ad4395d94541 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:11.164966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6eaa26ed-f37c-4906-b3a8-ef58077e1de8 req-521e2b67-70e9-467a-b599-ad4395d94541 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:11.178198 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6eaa26ed-f37c-4906-b3a8-ef58077e1de8 req-521e2b67-70e9-467a-b599-ad4395d94541 service nova] Creating event network-vif-deleted:8092f570-d1fc-4ef2-8ea9-4863dd0e3acb for instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b on n-h2-master-1 Oct 16 01:42:11.183630 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6eaa26ed-f37c-4906-b3a8-ef58077e1de8 req-521e2b67-70e9-467a-b599-ad4395d94541 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238694 Oct 16 01:42:11.184516 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3171/6211] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:42:11.384391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:11.385005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:11.395246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:11.399313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:11.399870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:11.400682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:11.401274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:11.402245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:11.476063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:11.484878 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d086d498-5cf8-48ee-8873-68f4c6c39bc9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1188 microversion: 2.1 time: 0.105012 Oct 16 01:42:11.485953 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3041/6212] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:11 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:12.510930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:12.511786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:12.518311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:12.519107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:12.519756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:12.520471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:12.521078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:12.521516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:12.593604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:12.601992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a1b2bb5-d8d7-44fe-8c0f-181580eeccc7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1188 microversion: 2.1 time: 0.096227 Oct 16 01:42:12.602586 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3172/6213] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:12 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:42:13.625061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:13.626364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:13.633293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:13.634382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:13.635282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:13.637057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:13.637689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:13.638474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:13.709143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:13.722156 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11856a6e-3aac-4c15-9697-5fc0358c1533 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1188 microversion: 2.1 time: 0.101433 Oct 16 01:42:13.723166 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3042/6214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:13 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:42:14.745622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:14.746937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:14.754315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:14.754811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:14.755270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:14.755989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:14.756429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:14.756852 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:14.829474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:14.837825 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd42854e-cecf-4026-9098-2f1f376236fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1188 microversion: 2.1 time: 0.098099 Oct 16 01:42:14.838576 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3173/6215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:14 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:15.377342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:15.378594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:15.390037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:15.391095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:15.391494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:15.392402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:15.393614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:15.394175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:15.589555 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e9a7a77e-2a45-4f54-ad72-fd075f5c74c5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1836 microversion: 2.1 time: 0.219317 Oct 16 01:42:15.594960 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3043/6216] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:15 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1836 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:15.861770 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:15.862381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:15.867857 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:15.873997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:15.874753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:15.875306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:15.876830 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:15.877507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:15.878131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:15.928676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:15.929461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:15.930066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:15.930826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lazy-loading 'fault' on Instance uuid 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:42:15.988111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:15.999291 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6494ab91-c2a5-40c7-9393-58cdbca3c71f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 200 len: 1193 microversion: 2.1 time: 0.140696 Oct 16 01:42:15.999859 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3174/6217] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:15 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 1193 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:16.911026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:16.912335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4f571a1c-5ed2-428c-a6e7-6c2a3a96a45c req-f35df3d6-5a0b-4ab9-b3ca-2cd8bc79f201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8a9a0e-ab70-4603-b447-5666e7fbb4f9", "tag": "ca5cd282-c912-44e7-842e-46d9a50f6520"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:16.912832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:16.919839 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=38 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:16.923410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:16.925120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:16.926493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4f571a1c-5ed2-428c-a6e7-6c2a3a96a45c req-f35df3d6-5a0b-4ab9-b3ca-2cd8bc79f201 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:16.927431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4f571a1c-5ed2-428c-a6e7-6c2a3a96a45c req-f35df3d6-5a0b-4ab9-b3ca-2cd8bc79f201 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:16.927727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:16.928366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4f571a1c-5ed2-428c-a6e7-6c2a3a96a45c req-f35df3d6-5a0b-4ab9-b3ca-2cd8bc79f201 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:16.928495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:16.928961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:16.929387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:16.943755 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4f571a1c-5ed2-428c-a6e7-6c2a3a96a45c req-f35df3d6-5a0b-4ab9-b3ca-2cd8bc79f201 service nova] Creating event network-changed:ca5cd282-c912-44e7-842e-46d9a50f6520 for instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 on n-h1-master-1 Oct 16 01:42:16.952164 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4f571a1c-5ed2-428c-a6e7-6c2a3a96a45c req-f35df3d6-5a0b-4ab9-b3ca-2cd8bc79f201 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043449 Oct 16 01:42:16.953518 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3175/6218] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:42:16.981896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:42:17.024919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:17.026142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:17.040384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:17.047008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:17.047768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:17.049052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:17.049806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:17.050514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:17.068236 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b HTTP/1.1 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '4eb2d86e-fdd5-4811-bd28-3c481f8cf74b'} Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:42:17.070694 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:17.077141 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:17.077141 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:42:17.077141 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:42:17.077141 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:42:17.077141 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:42:17.077141 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:17.077141 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:17.079696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:42:17.081420 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3438f1f0-e17c-437c-b90b-2cefccbba319 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 404 len: 111 microversion: 2.1 time: 0.062055 Oct 16 01:42:17.083348 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3176/6219] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:17 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:42:17.128531 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-937447dc-b8d9-4d01-a416-434a71ff9a12 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 204 len: 0 microversion: 2.1 time: 0.222098 Oct 16 01:42:17.130480 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3044/6220] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:42:16 2022] DELETE /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:42:17.140108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:17.141122 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:17.148613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:17.149194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:17.149771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:17.150642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:17.151203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:17.152291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:17.343884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:17.353755 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b2c9dade-8ff5-402e-8075-ea4d0620bd3a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1691 microversion: 2.1 time: 0.217334 Oct 16 01:42:17.359662 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3177/6221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:17 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1691 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:18.380511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:18.381587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:18.393634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:18.394472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:18.395023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:18.395875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:18.396873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:18.396873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:18.557659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:18.576133 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d114578-cc7e-40c3-8d5d-efe4f2383646 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1691 microversion: 2.1 time: 0.199840 Oct 16 01:42:18.577090 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3045/6222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:18 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:19.373128 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6c3dfdec-44f5-4b4d-ad3c-87e1f45c38c5 req-27164137-a259-4b3b-9fcc-572b20f80d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8a9a0e-ab70-4603-b447-5666e7fbb4f9", "name": "network-vif-deleted", "tag": "ca5cd282-c912-44e7-842e-46d9a50f6520"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:19.384136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c3dfdec-44f5-4b4d-ad3c-87e1f45c38c5 req-27164137-a259-4b3b-9fcc-572b20f80d45 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:19.384504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c3dfdec-44f5-4b4d-ad3c-87e1f45c38c5 req-27164137-a259-4b3b-9fcc-572b20f80d45 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:19.384944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c3dfdec-44f5-4b4d-ad3c-87e1f45c38c5 req-27164137-a259-4b3b-9fcc-572b20f80d45 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:19.426509 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6c3dfdec-44f5-4b4d-ad3c-87e1f45c38c5 req-27164137-a259-4b3b-9fcc-572b20f80d45 service nova] Creating event network-vif-deleted:ca5cd282-c912-44e7-842e-46d9a50f6520 for instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 on n-h1-master-1 Oct 16 01:42:19.435973 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6c3dfdec-44f5-4b4d-ad3c-87e1f45c38c5 req-27164137-a259-4b3b-9fcc-572b20f80d45 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069299 Oct 16 01:42:19.439761 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3178/6223] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:42:19.603166 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:19.603938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:19.615347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:19.616819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:19.617269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:19.617995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:19.618459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:19.618895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:19.688225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:19.688903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:19.689716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:19.690299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lazy-loading 'fault' on Instance uuid 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:42:19.747440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:19.762004 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-97bac5d3-cc9a-4617-a464-b13d5cf1ad20 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 200 len: 1357 microversion: 2.1 time: 0.162248 Oct 16 01:42:19.763387 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3046/6224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:19 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:20.794301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:20.795759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:20.798282 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:42:20.798656 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 01:42:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 (ip 10.222.0.39) !!! Oct 16 01:42:20.813202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:20.813880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:20.814657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:20.815668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:20.816356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:20.817010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:20.836325 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] HTTP exception thrown: Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 could not be found. Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Request method failure captured: Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 HTTP/1.1 Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2DqN-UT2falK72w98Rw1ecfssH-Glws7VEsKQiphDY1d9smk-R1JvXKD0Dqf8PxLYTV6aXG--fD5W0nuCIGhiXXhaSUnqm_oKesChDekdLqyYd1pPTaNQL6VFOZHf4uXw0-kS8HODdK0elzb0ty6zGgXYWz06m-gK8IoUVR5r7Q9Eg Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 855792b0264144dd941200c8468ac26d Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_855792b0264144dd941200c8468ac26d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/855792b0264144dd941200c8468ac26d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/855792b0264144dd941200c8468ac26d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/855792b0264144dd941200c8468ac26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 855792b0264144dd941200c8468ac26d Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestNetworkAdvancedServerOps-1761159727-project Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 83bbcff8a1f64cfa936f13f3cb3955b6 Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1761159727-project Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 could not be found. Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '0c8a9a0e-ab70-4603-b447-5666e7fbb4f9'} Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 could not be found. Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 could not be found. Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:20.838504 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:42:20.843559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:20.843559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:20.843559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:42:20.843559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:42:20.843559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:42:20.843559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:42:20.843559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 could not be found. Oct 16 01:42:20.843559 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:20.845545 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Returning 404 to user: Instance 0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:42:20.847027 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5c5a05d-748e-4ed6-8b9e-38f34d71d1c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9" status: 404 len: 111 microversion: 2.1 time: 0.057793 Oct 16 01:42:20.848321 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3179/6225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:20 2022] GET /compute/v2.1/servers/0c8a9a0e-ab70-4603-b447-5666e7fbb4f9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:42:21.504184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:21.505287 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:21.512971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:21.513889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:21.514375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:21.515291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:21.515914 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:21.516518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:21.531071 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b HTTP/1.1 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4eb2d86e-fdd5-4811-bd28-3c481f8cf74b'} Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:42:21.533016 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.537935 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.539459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:42:21.540483 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e85af0c4-a976-4d1e-b987-fa0eff985795 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 404 len: 111 microversion: 2.1 time: 0.040348 Oct 16 01:42:21.541595 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3047/6226] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:42:21 2022] DELETE /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:42:21.550291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:21.551293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:21.568682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:21.569184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:21.569628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:21.570342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:21.570807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:21.571264 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:21.587269 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b HTTP/1.1 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '4eb2d86e-fdd5-4811-bd28-3c481f8cf74b'} Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:42:21.588762 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 4eb2d86e-fdd5-4811-bd28-3c481f8cf74b could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2603f2d6-9946-4ed5-a2fb-4fce43174362 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b" status: 404 len: 111 microversion: 2.1 time: 0.044495 Oct 16 01:42:21.593755 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3180/6227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:21 2022] GET /compute/v2.1/servers/4eb2d86e-fdd5-4811-bd28-3c481f8cf74b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:42:26.624622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9360da04-6372-4532-abcf-4b84f41dac2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '.version_select at 0x7fd64d3aac10>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:26.692010 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9360da04-6372-4532-abcf-4b84f41dac2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045296368" status: 202 len: 0 microversion: 2.1 time: 0.072026 Oct 16 01:42:26.692957 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3048/6228] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Oct 16 01:42:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045296368 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:42:26.731290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-edb36846-a6a2-4801-abab-fd8eaf1b5360 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'create', calling method: .version_select at 0x7fd64e3873a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-111878889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk1jWhd7P1HyzAa5HFVsYclj0lW3crJQxQwllvD+Q8/D3MVNMPkknFceMIb6rK7X2AbwQ/tIQ7EhKrqz6E9KlnvnQmML+qimBSdPEsXuwvbSMeTJL1bXrxRtoVAF5d1+A=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:26.753682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-edb36846-a6a2-4801-abab-fd8eaf1b5360 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for project 855792b0264144dd941200c8468ac26d. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:42:26.760412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-edb36846-a6a2-4801-abab-fd8eaf1b5360 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for user 83bbcff8a1f64cfa936f13f3cb3955b6 and project 855792b0264144dd941200c8468ac26d. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:42:26.794668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-edb36846-a6a2-4801-abab-fd8eaf1b5360 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.068052 Oct 16 01:42:26.796670 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3181/6229] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:42:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:42:36.674610 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:36.679071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1665223751", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "b9959ab1-49c2-4592-a7c5-d25a15e89fde"}], "key_name": "tempest-TestNetworkAdvancedServerOps-111878889", "security_groups": [{"name": "tempest-secgroup-smoke-137009285"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:36.698429 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:36.978074 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] validate_networks() for [('b9959ab1-49c2-4592-a7c5-d25a15e89fde', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:42:38.136832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:42:38.137548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:42:38.137909 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:42:38.138326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:42:38.138742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:42:38.168623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:38.170598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:38.171258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:38.175195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:38.177789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:38.179980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:38.227251 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for project 855792b0264144dd941200c8468ac26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:42:38.245639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for user 83bbcff8a1f64cfa936f13f3cb3955b6 and project 855792b0264144dd941200c8468ac26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:42:38.294907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:42:38.300633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:42:38.416914 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b06eb0d-9d48-4c75-bb93-aa968d93e033 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.742026 Oct 16 01:42:38.418844 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3049/6230] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:42:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:42:38.427964 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=39 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:38.428913 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:38.429670 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:38.435768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a397aa77-33e6-4197-9955-97b93b00e34a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:38.436588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a397aa77-33e6-4197-9955-97b93b00e34a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:38.612070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a397aa77-33e6-4197-9955-97b93b00e34a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:38.620300 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a397aa77-33e6-4197-9955-97b93b00e34a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1266 microversion: 2.1 time: 0.193992 Oct 16 01:42:38.620901 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3182/6231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:38 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:39.645648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:39.646560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:39.685205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:39.685704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:39.686156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:39.686881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:39.687377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:39.687813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:39.801239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:39.817764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ebde4e15-cdbf-4e43-9332-12444c3a0c83 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1270 microversion: 2.1 time: 0.175734 Oct 16 01:42:39.821292 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3050/6232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:39 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:40.843685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:40.844311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:40.877371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:40.887181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:40.895767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:40.896810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:40.897477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:40.898119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:41.024555 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:41.034537 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-042171df-fb99-4e04-8125-5c326c9998d8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1326 microversion: 2.1 time: 0.195399 Oct 16 01:42:41.043322 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3183/6233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:40 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1326 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:42.059585 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:42.062751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:42.086232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:42.087007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:42.093763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:42.094400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:42.094885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:42.096456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:42.399363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:42.415777 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23fb14b0-571f-4b1f-8430-d2dbca3e7981 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1391 microversion: 2.1 time: 0.361830 Oct 16 01:42:42.416398 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3051/6234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:42 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1391 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:43.442835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:43.443742 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:43.453627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:43.454544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:43.455507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:43.457011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:43.457980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:43.458515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:43.467226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-cbc3ce0f-26e0-4777-889d-c0b2f83befee req-2b6d4418-6b85-4071-a59a-e3231e7605b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:43.490403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cbc3ce0f-26e0-4777-889d-c0b2f83befee req-2b6d4418-6b85-4071-a59a-e3231e7605b6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:43.491219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cbc3ce0f-26e0-4777-889d-c0b2f83befee req-2b6d4418-6b85-4071-a59a-e3231e7605b6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:43.491808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cbc3ce0f-26e0-4777-889d-c0b2f83befee req-2b6d4418-6b85-4071-a59a-e3231e7605b6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:43.505477 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-cbc3ce0f-26e0-4777-889d-c0b2f83befee req-2b6d4418-6b85-4071-a59a-e3231e7605b6 service nova] Creating event network-changed:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:42:43.525094 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-cbc3ce0f-26e0-4777-889d-c0b2f83befee req-2b6d4418-6b85-4071-a59a-e3231e7605b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066517 Oct 16 01:42:43.526805 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3052/6235] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:42:43.644910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:43.655719 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d20eaf89-681c-4ac1-b6b6-f772f8c45098 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1391 microversion: 2.1 time: 0.217933 Oct 16 01:42:43.657024 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3184/6236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:43 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1391 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:44.680777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:44.681515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:44.702049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:44.702794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:44.707046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:44.707970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:44.708603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:44.709216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:44.920578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:44.932547 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd4c94b7-d70f-477d-8f1b-8571da9e2006 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1391 microversion: 2.1 time: 0.255814 Oct 16 01:42:44.933075 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3053/6237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:44 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:45.956914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:45.958494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:45.970498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:45.974699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:45.975488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:45.976746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:45.977469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:45.978450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:46.182245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:46.192320 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-20702df5-7d45-4075-8a0c-a7c632424e67 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1391 microversion: 2.1 time: 0.239155 Oct 16 01:42:46.194473 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3185/6238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:45 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:47.216878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:47.217725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:47.224689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:47.225165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:47.225599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:47.226286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:47.226735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:47.227187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:47.378614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:47.388148 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53d3c766-cc0b-4afc-8357-9ca40a78a3cf tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1391 microversion: 2.1 time: 0.175976 Oct 16 01:42:47.389107 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3054/6239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:47 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:48.136948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9839061a-4d7d-41f7-82cd-53d531cb9de4 req-d8863d69-7e72-419b-92b3-30d737a143f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "name": "network-vif-plugged", "status": "completed", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:48.157332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9839061a-4d7d-41f7-82cd-53d531cb9de4 req-d8863d69-7e72-419b-92b3-30d737a143f9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:48.158095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9839061a-4d7d-41f7-82cd-53d531cb9de4 req-d8863d69-7e72-419b-92b3-30d737a143f9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:48.159044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9839061a-4d7d-41f7-82cd-53d531cb9de4 req-d8863d69-7e72-419b-92b3-30d737a143f9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:48.171984 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9839061a-4d7d-41f7-82cd-53d531cb9de4 req-d8863d69-7e72-419b-92b3-30d737a143f9 service nova] Creating event network-vif-plugged:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:42:48.178163 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9839061a-4d7d-41f7-82cd-53d531cb9de4 req-d8863d69-7e72-419b-92b3-30d737a143f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046587 Oct 16 01:42:48.179520 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3186/6240] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:42:48.411867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:48.412525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:48.414462 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:48.415972 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:48.432419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:48.434069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:48.434220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:48.434861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:48.435335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:48.435766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:48.719563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:48.731711 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-63bc30dd-cdfa-4ceb-b874-5c67923e166a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1391 microversion: 2.1 time: 0.321106 Oct 16 01:42:48.732380 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3055/6241] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:48 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:49.757396 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:49.759609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:49.767429 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:42:49.772289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:49.773386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:49.774126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:49.775666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:49.776571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:49.777625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:49.981633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:50.003530 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b4ad626-520a-4bb0-a1e3-9c9e41acecb1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1562 microversion: 2.1 time: 0.250714 Oct 16 01:42:50.017023 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3187/6242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:49 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1562 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:50.031107 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:50.032321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:50.039677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:50.040393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:50.041622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:50.043495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:50.044168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:50.044787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:50.235038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:50.252732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6bda66a-28a3-4e39-8f8c-1bcd377863b0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1562 microversion: 2.1 time: 0.227102 Oct 16 01:42:50.253332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3056/6243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:50 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:42:53.282722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:53.283393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:53.296259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:53.300078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:53.300700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:53.303656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:53.304305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:53.308925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:53.640195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e5a8e46d-ec6b-4208-81d2-de2c34b969ee req-8745529c-5dfc-4c91-910d-0f6cb2e856a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:53.674159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e5a8e46d-ec6b-4208-81d2-de2c34b969ee req-8745529c-5dfc-4c91-910d-0f6cb2e856a8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:53.682192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e5a8e46d-ec6b-4208-81d2-de2c34b969ee req-8745529c-5dfc-4c91-910d-0f6cb2e856a8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:53.685232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:53.689087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e5a8e46d-ec6b-4208-81d2-de2c34b969ee req-8745529c-5dfc-4c91-910d-0f6cb2e856a8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:53.697023 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e10e3067-55e2-44c0-9a97-a253653f8f86 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1562 microversion: 2.1 time: 0.418100 Oct 16 01:42:53.704781 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3188/6244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:53 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1562 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:53.739569 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e5a8e46d-ec6b-4208-81d2-de2c34b969ee req-8745529c-5dfc-4c91-910d-0f6cb2e856a8 service nova] Creating event network-changed:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:42:53.755576 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e5a8e46d-ec6b-4208-81d2-de2c34b969ee req-8745529c-5dfc-4c91-910d-0f6cb2e856a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.461952 Oct 16 01:42:53.764300 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3057/6245] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:42:57.373119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1796034104", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "93e8512f-9140-4a32-a8d1-ccd2403e8480", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "61eb30c5-accf-4cf9-b162-43c4bdd26615"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:42:57.452178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] validate_networks() for [('61eb30c5-accf-4cf9-b162-43c4bdd26615', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:42:57.863186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:42:57.863609 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:42:57.864086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:42:57.864496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:42:57.864909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:42:57.879991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:57.880517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:57.881156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:57.882129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:57.882790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:57.883544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:57.907541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:42:57.914238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:42:57.992307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:42:57.994862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93e8512f-9140-4a32-a8d1-ccd2403e8480',volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:42:58.163909 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7588f24-8a87-4769-833d-101d2366394a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795202 Oct 16 01:42:58.164839 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3189/6246] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:42:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:42:58.178512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c4202ec-6507-4e2c-b9f5-eab49f8ff666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:58.179249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c4202ec-6507-4e2c-b9f5-eab49f8ff666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:58.272664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9c4202ec-6507-4e2c-b9f5-eab49f8ff666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:58.288434 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c4202ec-6507-4e2c-b9f5-eab49f8ff666 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1071 microversion: 2.1 time: 0.115142 Oct 16 01:42:58.289340 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3058/6247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:58 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1071 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:42:59.312913 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:42:59.314964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:42:59.319965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:59.320452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:59.321144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:59.322028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:42:59.322658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:42:59.323379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:42:59.402969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:42:59.424900 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e37517c4-fc6e-44c5-bb0a-7a93de07f06b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1169 microversion: 2.1 time: 0.116778 Oct 16 01:42:59.435056 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3190/6248] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:42:59 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1169 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:00.452305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:00.453027 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:00.470101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:00.470737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:00.471466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:00.472432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:00.473116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:00.480896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:00.723361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:00.733360 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8bbff0be-ac21-4731-8616-ac99cc4c6733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1229 microversion: 2.1 time: 0.286127 Oct 16 01:43:00.734241 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3059/6249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:00 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1229 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:01.263769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3829faf4-3cbd-4e61-956d-f562da29820c req-1707e9b4-92b4-49d4-8891-03a33e3a3cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34dfff77-0342-43be-89ea-0d4bc7850ebc", "tag": "8c8c2445-0b70-4d87-bc3e-06d858301484"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:01.277271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3829faf4-3cbd-4e61-956d-f562da29820c req-1707e9b4-92b4-49d4-8891-03a33e3a3cc1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:01.277754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3829faf4-3cbd-4e61-956d-f562da29820c req-1707e9b4-92b4-49d4-8891-03a33e3a3cc1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:01.278201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3829faf4-3cbd-4e61-956d-f562da29820c req-1707e9b4-92b4-49d4-8891-03a33e3a3cc1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:01.303197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3829faf4-3cbd-4e61-956d-f562da29820c req-1707e9b4-92b4-49d4-8891-03a33e3a3cc1 service nova] Creating event network-changed:8c8c2445-0b70-4d87-bc3e-06d858301484 for instance 34dfff77-0342-43be-89ea-0d4bc7850ebc on n-h1-master-1 Oct 16 01:43:01.315479 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3829faf4-3cbd-4e61-956d-f562da29820c req-1707e9b4-92b4-49d4-8891-03a33e3a3cc1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055508 Oct 16 01:43:01.316472 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3191/6250] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:43:01.765316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:01.767221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:01.782089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:01.790627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:01.791566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:01.795586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:01.800113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:01.800766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:02.043883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:02.059208 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-72a2664c-c2cb-49e6-9c5d-de6f56d3abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1229 microversion: 2.1 time: 0.303875 Oct 16 01:43:02.060425 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3060/6251] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:01 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1229 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:03.087211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:03.087918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:03.095990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:03.096584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:03.097098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:03.098007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:03.098473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:03.098901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:03.245971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:03.254630 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7a3fef03-c266-4de8-a10e-552f5b4ff8e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1229 microversion: 2.1 time: 0.171819 Oct 16 01:43:03.255310 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3192/6252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:03 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1229 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:04.278477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:04.279183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:04.286698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:04.287491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:04.288100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:04.289011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:04.289637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:04.290235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:04.517174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:04.525632 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-44b7a3b9-a2df-40d9-aa3a-584ac5462678 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1229 microversion: 2.1 time: 0.251635 Oct 16 01:43:04.527943 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3061/6253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:04 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1229 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:05.555091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:05.556277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:05.569599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:05.571653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:05.572107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:05.572899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:05.574118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:05.574591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:05.832971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:05.861209 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e91d70ce-af4f-4dbf-9146-1018c93091d3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1229 microversion: 2.1 time: 0.314778 Oct 16 01:43:05.870816 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3193/6254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:05 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1229 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:06.913919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:06.914743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:06.918238 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:06.925160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:06.925908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:06.926602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:06.927345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:06.927814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:06.928242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:06.931517 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=61 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:07.078369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:07.087270 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-92ead50f-5ebc-415c-b5e3-7af01f8d2013 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.177145 Oct 16 01:43:07.087869 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3062/6255] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:06 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:08.111573 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:08.112292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:08.115102 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:08.115765 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:08.131720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:08.132553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:08.132994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:08.133732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:08.134189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:08.137955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:08.299469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:08.309110 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf04e27a-9002-40b3-bb9e-2501dc2edb65 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.201728 Oct 16 01:43:08.309977 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3194/6256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:08 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:09.338321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:09.339209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:09.347704 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:09.350016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:09.350615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:09.351416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:09.353060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:09.353615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:09.354775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:09.513286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:09.521484 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a3ad731-3ebd-4741-983a-d9c4268ac66f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.187902 Oct 16 01:43:09.522148 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3063/6257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:09 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:10.545388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:10.546011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:10.553061 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:10.555088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:10.555955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:10.556574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:10.557305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:10.557971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:10.558576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:10.562967 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=61 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:10.699321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:10.708691 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1bd3c5e3-afb6-4a9a-957d-ad9ffc8c795d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.168005 Oct 16 01:43:10.709532 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3195/6258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:10 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:11.732978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:11.733615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:11.739714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:11.740201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:11.740623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:11.741322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:11.741784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:11.742208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:11.892074 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:11.903482 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ebf226f-9ff5-44d2-9776-08484fd7a4e4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.175399 Oct 16 01:43:11.904008 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3064/6259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:11 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:12.927057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:12.927677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:12.934618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:12.935734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:12.936241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:12.936946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:12.937412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:12.937838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:13.083004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:13.092166 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a653c97f-bb1f-4a21-93fc-62b3636e67a9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.169649 Oct 16 01:43:13.092764 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3196/6260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:12 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:14.115010 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:14.115639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:14.123027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:14.123514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:14.123943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:14.124788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:14.125245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:14.125666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:14.285453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:14.294586 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6097962d-169d-46c8-b87f-3688c3ff2cb3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.183589 Oct 16 01:43:14.295758 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3065/6261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:14 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:15.317655 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:15.318309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:15.326072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:15.326562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:15.327848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:15.328558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:15.329019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:15.329444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:15.469623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:15.477759 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bda629f1-8b3c-4088-a253-23e7c719485d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.163929 Oct 16 01:43:15.478640 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3197/6262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:15 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:16.268444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:16.271662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:16.279680 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:16.280178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:16.280619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:16.281613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:16.282079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:16.282688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:16.335886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d4a6f1d1-d3bd-4c27-afcf-763b7e741519 req-9c82bd8a-4a63-470c-86e6-e7964847b756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dfff77-0342-43be-89ea-0d4bc7850ebc", "name": "network-vif-plugged", "status": "completed", "tag": "8c8c2445-0b70-4d87-bc3e-06d858301484"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:16.348782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d4a6f1d1-d3bd-4c27-afcf-763b7e741519 req-9c82bd8a-4a63-470c-86e6-e7964847b756 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:16.349539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d4a6f1d1-d3bd-4c27-afcf-763b7e741519 req-9c82bd8a-4a63-470c-86e6-e7964847b756 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:16.350502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d4a6f1d1-d3bd-4c27-afcf-763b7e741519 req-9c82bd8a-4a63-470c-86e6-e7964847b756 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:16.357342 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-134cf071-62c9-47a8-ae5c-731da7fe6fb9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action" status: 200 len: 24574 microversion: 2.1 time: 0.093175 Oct 16 01:43:16.359077 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3066/6263] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:43:16 2022] POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action => generated 24574 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:43:16.366321 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d4a6f1d1-d3bd-4c27-afcf-763b7e741519 req-9c82bd8a-4a63-470c-86e6-e7964847b756 service nova] Creating event network-vif-plugged:8c8c2445-0b70-4d87-bc3e-06d858301484 for instance 34dfff77-0342-43be-89ea-0d4bc7850ebc on n-h1-master-1 Oct 16 01:43:16.372321 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d4a6f1d1-d3bd-4c27-afcf-763b7e741519 req-9c82bd8a-4a63-470c-86e6-e7964847b756 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040913 Oct 16 01:43:16.373297 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3198/6264] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:43:16.503060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:16.503831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:16.513082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:16.513586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:16.514492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:16.514753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:16.515243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:16.515663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:16.663619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:16.673387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ac0bef98-70c2-4a51-b604-4322251607d9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1217 microversion: 2.1 time: 0.174984 Oct 16 01:43:16.673984 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3067/6265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:16 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:17.700323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:17.703220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:17.709987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:17.710480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:17.710945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:17.711643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:17.712111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:17.712538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:17.877378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:17.887101 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b447606b-2b6c-4eff-b0d2-aac1c10f668f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1403 microversion: 2.1 time: 0.193186 Oct 16 01:43:17.888268 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3199/6266] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:17 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1403 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:17.910712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:17.911371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:17.920401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:17.921122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:17.921611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:17.922456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:17.923115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:17.925464 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:18.061862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:18.072578 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8cbcdba9-0c0c-4d4a-837c-c3628e651ed7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1403 microversion: 2.1 time: 0.166134 Oct 16 01:43:18.074094 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3068/6267] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:17 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:18.096292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-68829641"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:18.098731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:18.105099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:18.105811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:18.106314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:18.107134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:18.107667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:18.108164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:18.205235 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Attempting to quiesce instance before volume snapshot. Oct 16 01:43:18.282746 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 16 01:43:18.360012 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Creating snapshot from volume 93e8512f-9140-4a32-a8d1-ccd2403e8480. {{(pid=120545) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 16 01:43:24.109546 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-faaaea5d-13a1-47c6-b9b5-4294a5e3bafa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc/action" status: 202 len: 0 microversion: 2.1 time: 6.015136 Oct 16 01:43:24.109546 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3200/6268] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:43:18 2022] POST /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc/action => generated 0 bytes in 6018 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 01:43:24.426431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1248642377", "imageRef": "be63576b-e6b3-4571-bbeb-2c3bde50aa91", "flavorRef": "452", "networks": [{"uuid": "61eb30c5-accf-4cf9-b162-43c4bdd26615"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:24.487619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] validate_networks() for [('61eb30c5-accf-4cf9-b162-43c4bdd26615', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:43:24.940709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:43:24.941465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:43:24.942130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:43:24.942710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:43:24.943338 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:43:24.955098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:24.956111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:24.956738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:24.957666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:24.958305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:24.958942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:24.979376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:43:24.985410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:43:24.999683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:43:25.002779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f4b13621-92c4-4eef-b808-48065aac7189',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:43:25.092690 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-051a626e-7476-4012-910d-c376fa661733 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669870 Oct 16 01:43:25.094149 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3069/6269] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:43:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:43:25.105647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8043bfd3-bfee-4b8b-bdc4-29d9fbb35b27 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:25.106618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8043bfd3-bfee-4b8b-bdc4-29d9fbb35b27 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:25.178205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8043bfd3-bfee-4b8b-bdc4-29d9fbb35b27 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:25.186427 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8043bfd3-bfee-4b8b-bdc4-29d9fbb35b27 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1230 microversion: 2.1 time: 0.085294 Oct 16 01:43:25.206057 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3201/6270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:25 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:26.212761 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:26.213409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:26.221380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:26.221886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:26.222325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:26.223077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:26.223563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:26.223980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:26.297255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:26.313199 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1470a3c-dab3-4f72-bf81-f83c5b694b9b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1282 microversion: 2.1 time: 0.098372 Oct 16 01:43:26.315023 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3070/6271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:26 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:27.061447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:27.062241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:27.072759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:27.076624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:27.079946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:27.081076 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:27.083846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:27.084726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:27.337609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:27.338557 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:27.349811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:27.352123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:27.352710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:27.353853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:27.355835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:27.356577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:27.404992 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-172d1cdb-3648-42c4-9dfd-a78643cae5c6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1832 microversion: 2.1 time: 0.348714 Oct 16 01:43:27.409323 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3202/6272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:27 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1832 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:27.438712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:27.439653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:27.454814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:27.459188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:27.459508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:27.460839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:27.461484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:27.462118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:27.521087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:27.530884 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c7d2b24f-7de7-40a7-8365-5e5b741bd653 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1300 microversion: 2.1 time: 0.197017 Oct 16 01:43:27.534355 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3071/6273] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:27 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:27.716891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:27.726024 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bfd07702-b46f-4a2b-8cf3-c0cda477844a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1681 microversion: 2.1 time: 0.293568 Oct 16 01:43:27.726624 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3203/6274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:27 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1681 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:27.851405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:27.855860 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:27.872365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:27.872365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:27.872647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:27.873889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:27.874649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:27.875334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:27.954336 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-05adaa51-00cd-470b-bbd7-637ef1ccc9b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action" status: 200 len: 32649 microversion: 2.1 time: 0.108448 Oct 16 01:43:27.961672 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3072/6275] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:43:27 2022] POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action => generated 32649 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:43:28.136484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:28.137109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:28.152093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:28.152884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:28.155510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:28.158614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:28.159348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:28.159840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:28.251158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '358a87063f3f42db9eaf4c91eeed863a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0006d55fa66e4e34883f683f439fed71', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:28.252191 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] flavor_id is None. Assuming migration. {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 16 01:43:28.252859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:43:28.567002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:28.567445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:28.578887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:28.583553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:28.584286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:28.587986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:28.593965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:28.596598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:28.784229 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e957b74-d16e-40a4-b680-8c86509bb778 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action" status: 202 len: 0 microversion: 2.1 time: 0.651423 Oct 16 01:43:28.785241 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3204/6276] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:43:28 2022] POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:43:28.799968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:28.803965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:28.820373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:28.820953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:28.824135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:28.825099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:28.825780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:28.826255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:29.069584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:29.085117 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58190e55-081f-4de2-8637-e6cad714d752 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.527548 Oct 16 01:43:29.087215 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3073/6277] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:28 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:29.131807 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-bf0279ed-b203-4c58-94dd-0a7b08242492 req-02dda66c-2703-474a-b692-f83fe0909f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5e0db6-310b-4c56-ae0e-aceb15567bce", "tag": "fdbb0716-3bbd-4fcd-8961-583dc9b5d740"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:29.159466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bf0279ed-b203-4c58-94dd-0a7b08242492 req-02dda66c-2703-474a-b692-f83fe0909f1a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:29.161541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bf0279ed-b203-4c58-94dd-0a7b08242492 req-02dda66c-2703-474a-b692-f83fe0909f1a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:29.162587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bf0279ed-b203-4c58-94dd-0a7b08242492 req-02dda66c-2703-474a-b692-f83fe0909f1a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:29.191240 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-bf0279ed-b203-4c58-94dd-0a7b08242492 req-02dda66c-2703-474a-b692-f83fe0909f1a service nova] Creating event network-changed:fdbb0716-3bbd-4fcd-8961-583dc9b5d740 for instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce on n-h2-master-1 Oct 16 01:43:29.209265 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-bf0279ed-b203-4c58-94dd-0a7b08242492 req-02dda66c-2703-474a-b692-f83fe0909f1a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077853 Oct 16 01:43:29.211581 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3074/6278] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:43:29.322758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:29.343693 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-31387442-3d77-412c-94f2-5e84f5db092b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1690 microversion: 2.1 time: 0.552760 Oct 16 01:43:29.346492 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3205/6279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:28 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1690 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:30.122393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:30.124419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:30.156855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:30.158253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:30.159694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:30.161036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:30.162096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:30.163057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:30.382420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:30.384180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:30.405975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:30.408339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:30.410649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:30.414459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:30.417075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:30.421492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:30.545346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:30.554138 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1442de2e-246b-475f-8f1d-024964e3744e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.439283 Oct 16 01:43:30.554808 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3075/6280] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:30 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:30.779412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:30.801400 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1161a64c-5724-4c28-b0d3-faec470b2135 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1690 microversion: 2.1 time: 0.431582 Oct 16 01:43:30.803162 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3206/6281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:30 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1690 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:31.580066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:31.580686 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:31.594731 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:31.595613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:31.598936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:31.600007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:31.600740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:31.601242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:31.818997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:31.835792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0debc868-8646-4756-a0af-278c1a20072b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.258081 Oct 16 01:43:31.837750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3076/6282] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:31 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:31.841219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:31.843294 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:31.856907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:31.857933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:31.859226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:31.861695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:31.862855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:31.863965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:32.215306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:32.231051 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69f7058c-8133-406d-a622-bebb49fd18bc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1690 microversion: 2.1 time: 0.397561 Oct 16 01:43:32.231982 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3207/6283] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:31 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1690 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:32.862745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:32.864054 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:32.872416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:32.873199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:32.873812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:32.874829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:32.875499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:32.876101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:33.062163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:33.073816 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-abd8b066-c352-457e-b0c3-41125eda7e7f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.215127 Oct 16 01:43:33.074890 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3077/6284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:32 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:33.264572 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:33.267452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:33.290320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:33.290961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:33.294077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:33.294815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:33.295349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:33.295801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:33.570822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:33.581610 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0046539-7e38-4aa7-b347-cc27f5cc26b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.327260 Oct 16 01:43:33.582477 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3208/6285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:33 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:34.106590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:34.108466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:34.121821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:34.122368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:34.122855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:34.124086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:34.125039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:34.125938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:34.338522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:34.361647 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a0845624-efa1-42a1-9de6-e357200e9f28 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.262458 Oct 16 01:43:34.362609 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3078/6286] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:34 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:34.611273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:34.612139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:34.618869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:34.620170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:34.620811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:34.621725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:34.622371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:34.623026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:34.643973 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:34.840240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:34.856463 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f9f1b7c-c9a9-4381-9ec3-a940c425f8c8 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.248914 Oct 16 01:43:34.871967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3209/6287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:34 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:35.398007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:35.399367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:35.401840 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:35.402882 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:35.411741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:35.412555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:35.413439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:35.416103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:35.416103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:35.416103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:35.573843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:35.587258 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce441683-2859-4fb5-81b2-03cbff892078 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.193700 Oct 16 01:43:35.587948 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3079/6288] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:35 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:35.902645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:35.903777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:35.909941 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:35.914127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:35.914997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:35.915488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:35.916342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:35.917659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:35.918730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:36.095886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:36.104748 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-268828d8-cd57-4b3c-8366-746c29b7dc7d tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.210749 Oct 16 01:43:36.106404 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3210/6289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:35 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:36.642740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:36.645005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:36.664733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:36.665802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:36.670559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:36.675407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:36.676580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:36.683358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:36.926263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:36.929650 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:36.944988 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-91178a21-b632-47bc-a284-357554813210 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.331850 Oct 16 01:43:36.967387 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3080/6290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:36 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:37.146406 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:37.155922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:37.173615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:37.174284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:37.175110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:37.176073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:37.176754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:37.177436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:37.422261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:37.431657 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1d554b6-9b67-4834-8695-6cfd10931841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.297082 Oct 16 01:43:37.435431 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3211/6291] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:37 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:37.982283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:37.982824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:37.986615 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:37.990777 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:37.991533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:37.992154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:37.993029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:37.993655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:37.994237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:38.220006 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:38.232452 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab826d3d-302f-4a60-920d-f93966128d94 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.253506 Oct 16 01:43:38.233841 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3081/6292] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:37 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:38.472617 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:38.473299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:38.488007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:38.488794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:38.489236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:38.496015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:38.496918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:38.497607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:38.707449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:38.720164 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-84b9a7f3-61c0-4ecd-80d1-b0319cbd56e6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.254342 Oct 16 01:43:38.721637 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3212/6293] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:38 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:39.257375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:39.260125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:39.274020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:39.275133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:39.277715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:39.278749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:39.279595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:39.284261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:39.473376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:39.483681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c4b0b793-66b2-47e1-a8d0-106b20828ef1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.230193 Oct 16 01:43:39.484613 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3082/6294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:39 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:39.747288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:39.748461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:39.757193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:39.757850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:39.758474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:39.759420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:39.760055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:39.760744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:40.030844 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:40.042646 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e4dc030-8126-409b-92b3-2cc5604a0c63 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.298872 Oct 16 01:43:40.043605 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3213/6295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:39 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:40.508073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:40.509361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:40.517019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:40.517904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:40.518623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:40.519648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:40.520379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:40.521018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:40.706835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:40.718376 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cfd50e6b-9249-4b50-bde0-7b547f9ce1f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.214388 Oct 16 01:43:40.719148 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3083/6296] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:40 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:41.070242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:41.070874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:41.078524 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=42 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:41.084530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:41.085403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:41.086900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:41.089155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:41.089919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:41.090554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:41.312271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:41.324892 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bb09c7c6-78cf-4bfd-af16-1ca9a3ad3b82 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.259973 Oct 16 01:43:41.325678 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3214/6297] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:41 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:41.748805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:41.749332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:41.760008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:41.760607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:41.761148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:41.762059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:41.763429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:41.764044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:41.950062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:41.960361 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f0db98a0-97b0-48a8-ad75-e92d360eb5a2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.217002 Oct 16 01:43:41.961750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3084/6298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:41 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:42.355528 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:42.357041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:42.367287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:42.368443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:42.369939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:42.371297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:42.372089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:42.373435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:42.571214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:42.584054 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0dca7580-e55f-43db-b96b-7d0cd1dcb059 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.235574 Oct 16 01:43:42.585400 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3215/6299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:42 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:42.989814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:42.992192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:43.011388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:43.013224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:43.014851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:43.018195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:43.019467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:43.020116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:43.226050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:43.235721 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fdc7acfb-3e9d-4393-af12-394cb961f1d8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.253907 Oct 16 01:43:43.236326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3085/6300] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:42 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:43.611348 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:43.612298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:43.623217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:43.623990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:43.624569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:43.625648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:43.626654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:43.627250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:43.889141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:43.920017 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bbeda1fd-fddb-4eed-8e4e-42cca6e8b597 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.305047 Oct 16 01:43:43.920017 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3216/6301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:43 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:44.260523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:44.261164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:44.268238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:44.268984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:44.269456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:44.270116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:44.270574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:44.272133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:44.437303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:44.450148 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81300fdb-75b7-4432-a9b1-cf1abed1d4d0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.192784 Oct 16 01:43:44.452369 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3086/6302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:44 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:44.937792 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:44.939747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:44.947297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:44.948621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:44.949310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:44.950296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:44.951030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:44.951706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:45.104235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:45.115344 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf63a60b-9731-4ec0-a841-d25ccf539ea3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.180678 Oct 16 01:43:45.117375 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3217/6303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:44 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:45.473741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:45.474258 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:45.482313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:45.482809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:45.483274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:45.487849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:45.488630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:45.489338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:45.670078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:45.677997 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-004577b5-e846-4db4-aa3e-70be7a55946f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1342 microversion: 2.1 time: 0.208206 Oct 16 01:43:45.691113 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3087/6304] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:45 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:46.142366 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:46.143344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:46.151557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:46.152093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:46.152590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:46.153606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:46.154084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:46.154715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:46.302816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:46.311766 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5bab2695-0de7-4749-bc1d-a9ad8400d72b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.173603 Oct 16 01:43:46.312355 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3218/6305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:46 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:46.705752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:46.707864 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:46.719148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:46.720102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:46.720756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:46.721691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:46.722435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:46.723093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:46.995739 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:47.007349 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-059e144b-39fa-4788-9880-b1ace581c061 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.306978 Oct 16 01:43:47.008833 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3088/6306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:46 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:47.338208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:47.340088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:47.349003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:47.349791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:47.351158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:47.352501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:47.352988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:47.353876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:47.530661 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:47.540659 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-11f09ada-4fba-4296-a702-54649efef386 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.207722 Oct 16 01:43:47.542136 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3219/6307] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:47 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:48.034765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:48.035782 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:48.044422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:48.044949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:48.045543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:48.046422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:48.046998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:48.047746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:48.213072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:48.225954 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ca74a47-b706-4d80-9fc3-4f6b7dff59e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.195679 Oct 16 01:43:48.227172 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3089/6308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:48 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:48.571051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:48.572508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:48.580850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:48.581659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:48.582465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:48.583507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:48.584152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:48.584788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:48.762797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:48.772074 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-46c85570-4dc7-4978-99da-ca540566d18e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.207175 Oct 16 01:43:48.772703 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3220/6309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:48 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:49.252859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:49.253460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:49.270320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:49.270813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:49.271373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:49.272226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:49.272928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:49.273357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:49.501111 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:49.511944 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39843cb4-312e-4ef7-9c56-183b67f66ccd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.264616 Oct 16 01:43:49.522964 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3090/6310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:49 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:49.797552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:49.798214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:49.805553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:49.806055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:49.806942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:49.807785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:49.808257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:49.808854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:49.985649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:49.996423 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b48326ee-b043-4af9-9063-18a34d53b1b5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1695 microversion: 2.1 time: 0.202496 Oct 16 01:43:50.011375 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3221/6311] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:49 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1695 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:50.542184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:50.543580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:50.554163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:50.555153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:50.557378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:50.558403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:50.559095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:50.559853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:50.679650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5dc63c88-2a3e-4604-8aba-89faa3b4d501 req-8b79ec4a-edd3-4992-a1eb-7c328419fea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "name": "network-vif-unplugged", "status": "completed", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:50.693110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5dc63c88-2a3e-4604-8aba-89faa3b4d501 req-8b79ec4a-edd3-4992-a1eb-7c328419fea9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:50.709490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5dc63c88-2a3e-4604-8aba-89faa3b4d501 req-8b79ec4a-edd3-4992-a1eb-7c328419fea9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:50.710071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5dc63c88-2a3e-4604-8aba-89faa3b4d501 req-8b79ec4a-edd3-4992-a1eb-7c328419fea9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:50.772385 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5dc63c88-2a3e-4604-8aba-89faa3b4d501 req-8b79ec4a-edd3-4992-a1eb-7c328419fea9 service nova] Creating event network-vif-unplugged:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h1-master-1 Oct 16 01:43:50.779152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:50.789447 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df809774-2b7b-4fea-82e1-f35791c6d7bf tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.255230 Oct 16 01:43:50.790723 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3091/6312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:50 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:50.800240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-5dc63c88-2a3e-4604-8aba-89faa3b4d501 req-8b79ec4a-edd3-4992-a1eb-7c328419fea9 service nova] Instance ac9e3faa-e7ac-473e-b106-917816db042b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:43:50.828149 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5dc63c88-2a3e-4604-8aba-89faa3b4d501 req-8b79ec4a-edd3-4992-a1eb-7c328419fea9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151449 Oct 16 01:43:50.829615 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3222/6313] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:43:51.024127 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:51.025779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:51.036827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:51.037917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:51.038895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:51.042164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:51.043545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:51.044350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:51.313129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:51.322298 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-07b44e67-84a4-4abc-bad9-3bb5caf0f3f2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1694 microversion: 2.1 time: 0.302965 Oct 16 01:43:51.324247 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3092/6314] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:51 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1694 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:51.815227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:51.816619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:51.828073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:51.830030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:51.830670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:51.831960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:51.832658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:51.833261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:52.027392 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:52.036215 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ba272c62-e403-464a-ad91-afbc7b480602 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.226217 Oct 16 01:43:52.039597 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3223/6315] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:51 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:52.350903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:52.352425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:52.365516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:52.366231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:52.366860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:52.367988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:52.369263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:52.370141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:52.551425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:52.565785 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3c7730f3-7483-4761-bc4a-749b23bd9342 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1692 microversion: 2.1 time: 0.219498 Oct 16 01:43:52.567879 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3093/6316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:52 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1692 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:52.852983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-924dff2d-3fed-4a5f-a4eb-e280562710fc req-c64b4d89-5037-416c-a894-c5b75c54bca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:52.871717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-924dff2d-3fed-4a5f-a4eb-e280562710fc req-c64b4d89-5037-416c-a894-c5b75c54bca7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:52.872219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-924dff2d-3fed-4a5f-a4eb-e280562710fc req-c64b4d89-5037-416c-a894-c5b75c54bca7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:52.872657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-924dff2d-3fed-4a5f-a4eb-e280562710fc req-c64b4d89-5037-416c-a894-c5b75c54bca7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:52.889140 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-924dff2d-3fed-4a5f-a4eb-e280562710fc req-c64b4d89-5037-416c-a894-c5b75c54bca7 service nova] Creating event network-changed:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h1-master-1 Oct 16 01:43:52.895292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-924dff2d-3fed-4a5f-a4eb-e280562710fc req-c64b4d89-5037-416c-a894-c5b75c54bca7 service nova] Instance ac9e3faa-e7ac-473e-b106-917816db042b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:43:52.910094 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-924dff2d-3fed-4a5f-a4eb-e280562710fc req-c64b4d89-5037-416c-a894-c5b75c54bca7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060747 Oct 16 01:43:52.911456 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3224/6317] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:43:53.061745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:53.063505 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:53.070126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:53.070623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:53.071097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:53.072330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:53.072798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:53.073230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:53.304485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:53.314436 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51b6b7a7-bf38-403d-bfe7-f0bce6d6acdc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.256388 Oct 16 01:43:53.326951 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3094/6318] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:53 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:53.592725 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:53.593854 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:53.601287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:53.602276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:53.603796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:53.604964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:53.605696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:53.606562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:53.861227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:53.908782 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0e3c0182-70f3-4720-961f-c7a574e03f56 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1692 microversion: 2.1 time: 0.320743 Oct 16 01:43:53.915063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3225/6319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:53 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1692 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:54.342171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:54.342859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:54.352930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:54.353852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:54.354814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:54.355954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:54.356599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:54.357220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:54.518614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:54.542065 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5895d734-7539-4f51-ac3b-f3f4a22a95d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.204585 Oct 16 01:43:54.542673 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3095/6320] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:54 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:54.951665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:54.952223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:54.959302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:54.959805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:54.960260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:54.960963 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:54.961431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:54.961865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:55.106825 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:55.111071 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:55.116763 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-215a0da3-b2a6-4599-ae5b-433726cb0f7f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1689 microversion: 2.1 time: 0.170298 Oct 16 01:43:55.117362 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3226/6321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:54 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:55.140677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:55.141027 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:55.147269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:55.147980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:55.148416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:55.149208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:55.149577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:55.150349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:55.223426 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:43:55.278308 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53a3b6f1-a870-448e-932e-7948d55506d4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action" status: 202 len: 0 microversion: 2.1 time: 0.141663 Oct 16 01:43:55.282230 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3096/6322] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:43:55 2022] POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:43:55.292627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:55.293568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:55.303593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:55.304211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:55.304803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:55.305600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:55.306372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:55.307467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:55.452296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:55.460571 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5611209-dbc2-43b8-a8a2-58e008f077da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1688 microversion: 2.1 time: 0.176739 Oct 16 01:43:55.461311 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3227/6323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:55 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:55.847722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:55.848537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:55.855406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:55.855982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:55.856490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:55.857266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:55.857790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:55.858283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:56.012273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:56.020168 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-90cf1c9f-f24b-48f1-9f7d-81c1647468ec tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.457898 Oct 16 01:43:56.020746 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3097/6324] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:55 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:56.490067 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:56.491263 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:56.503193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:56.504035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:56.505100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:56.506316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:56.507144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:56.507882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:56.580663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f8827466-d4e4-49c8-9e11-f59abedf8ed3 req-ecd0093a-e62d-437c-9902-01d49b1ede14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5e0db6-310b-4c56-ae0e-aceb15567bce", "name": "network-vif-plugged", "status": "completed", "tag": "fdbb0716-3bbd-4fcd-8961-583dc9b5d740"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:56.595517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f8827466-d4e4-49c8-9e11-f59abedf8ed3 req-ecd0093a-e62d-437c-9902-01d49b1ede14 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:56.598194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f8827466-d4e4-49c8-9e11-f59abedf8ed3 req-ecd0093a-e62d-437c-9902-01d49b1ede14 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:56.599155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f8827466-d4e4-49c8-9e11-f59abedf8ed3 req-ecd0093a-e62d-437c-9902-01d49b1ede14 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:56.617224 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f8827466-d4e4-49c8-9e11-f59abedf8ed3 req-ecd0093a-e62d-437c-9902-01d49b1ede14 service nova] Creating event network-vif-plugged:fdbb0716-3bbd-4fcd-8961-583dc9b5d740 for instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce on n-h2-master-1 Oct 16 01:43:56.623716 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f8827466-d4e4-49c8-9e11-f59abedf8ed3 req-ecd0093a-e62d-437c-9902-01d49b1ede14 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052097 Oct 16 01:43:56.624476 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3098/6325] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:43:56.675802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:56.689130 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d3675014-1200-4e9b-8141-b87a7733c642 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1688 microversion: 2.1 time: 0.206483 Oct 16 01:43:56.699070 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3228/6326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:56 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:43:57.044841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:57.045570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:57.051810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:57.052290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:57.052723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:57.053406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:57.053859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:57.054281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:57.187405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:57.195265 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4cba2506-14d9-4578-a57f-cd1b5dd9923b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1376 microversion: 2.1 time: 0.155129 Oct 16 01:43:57.195855 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3099/6327] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:57 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:57.718467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:57.719353 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:57.726952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:57.727150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:57.728021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:57.728824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:57.729381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:57.729983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:57.882244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:57.898218 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-14c732c9-db01-498d-bef3-7c9fd919456e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1688 microversion: 2.1 time: 0.183769 Oct 16 01:43:57.898791 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3229/6328] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:57 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:58.219048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:58.220433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:58.227290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.227835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.228436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.228968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.229431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.229894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.381318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:58.389404 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-671a99c2-c0aa-456b-b617-de43a8915ac7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1563 microversion: 2.1 time: 0.174326 Oct 16 01:43:58.390539 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3100/6329] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:58 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:58.412063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:58.412718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:58.420338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.420834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.421318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.421999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.422491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.422959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.574274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:58.582643 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-311948b8-848d-48d1-b724-89126275b115 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1563 microversion: 2.1 time: 0.174404 Oct 16 01:43:58.583761 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3230/6330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:58 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:58.648168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6d5a7402-fba4-4e08-948b-44f2fd200bb7 req-f614f8fd-7d78-4bf3-ba8e-5cc44c14d5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "name": "network-vif-plugged", "status": "completed", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:58.665943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6d5a7402-fba4-4e08-948b-44f2fd200bb7 req-f614f8fd-7d78-4bf3-ba8e-5cc44c14d5fd service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.667212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6d5a7402-fba4-4e08-948b-44f2fd200bb7 req-f614f8fd-7d78-4bf3-ba8e-5cc44c14d5fd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.667875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6d5a7402-fba4-4e08-948b-44f2fd200bb7 req-f614f8fd-7d78-4bf3-ba8e-5cc44c14d5fd service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.673045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:58.673246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:58.679522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.680236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.683658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.684958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.685666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.686332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.688479 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6d5a7402-fba4-4e08-948b-44f2fd200bb7 req-f614f8fd-7d78-4bf3-ba8e-5cc44c14d5fd service nova] Creating event network-vif-plugged:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:43:58.697998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-6d5a7402-fba4-4e08-948b-44f2fd200bb7 req-f614f8fd-7d78-4bf3-ba8e-5cc44c14d5fd service nova] Instance ac9e3faa-e7ac-473e-b106-917816db042b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:43:58.712231 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6d5a7402-fba4-4e08-948b-44f2fd200bb7 req-f614f8fd-7d78-4bf3-ba8e-5cc44c14d5fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067467 Oct 16 01:43:58.713446 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3101/6331] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:43:58.744713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:43:58.834634 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0207c089-e969-4d58-9bc8-69386c90597a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 204 len: 0 microversion: 2.1 time: 0.166106 Oct 16 01:43:58.836099 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3231/6332] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:43:58 2022] DELETE /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:43:58.845237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:58.845972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:58.852938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.853431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.853877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.854587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.855081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.855590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.937388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:43:58.938190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:43:58.947632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.948637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.949309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:58.950238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:58.950896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:58.951913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:59.054301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:59.067145 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab8976c4-8bdf-477e-a3f1-6e10f7ece4d5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1569 microversion: 2.1 time: 0.226457 Oct 16 01:43:59.086730 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3102/6333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:58 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:43:59.095141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2a17946e-3d0a-4aa0-b00a-19fb6a5906ca req-7de7242d-92e9-41b1-b3c0-1f3436f7ce71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "name": "network-vif-unplugged", "status": "completed", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:43:59.107821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a17946e-3d0a-4aa0-b00a-19fb6a5906ca req-7de7242d-92e9-41b1-b3c0-1f3436f7ce71 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:43:59.108613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a17946e-3d0a-4aa0-b00a-19fb6a5906ca req-7de7242d-92e9-41b1-b3c0-1f3436f7ce71 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:43:59.109259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2a17946e-3d0a-4aa0-b00a-19fb6a5906ca req-7de7242d-92e9-41b1-b3c0-1f3436f7ce71 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:43:59.127241 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2a17946e-3d0a-4aa0-b00a-19fb6a5906ca req-7de7242d-92e9-41b1-b3c0-1f3436f7ce71 service nova] Creating event network-vif-unplugged:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:43:59.134379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-2a17946e-3d0a-4aa0-b00a-19fb6a5906ca req-7de7242d-92e9-41b1-b3c0-1f3436f7ce71 service nova] Instance ac9e3faa-e7ac-473e-b106-917816db042b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:43:59.148050 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2a17946e-3d0a-4aa0-b00a-19fb6a5906ca req-7de7242d-92e9-41b1-b3c0-1f3436f7ce71 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057943 Oct 16 01:43:59.148672 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3103/6334] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:43:59.151887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:43:59.160662 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0710d443-00ce-4738-a038-e36066845ce7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1688 microversion: 2.1 time: 0.230945 Oct 16 01:43:59.161555 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3232/6335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:43:58 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1688 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:00.093789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:00.094488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:00.102106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:00.102978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:00.103654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:00.104482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:00.105057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:00.105582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:00.187494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:00.188734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:00.197731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:00.198515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:00.199191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:00.200102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:00.200955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:00.201656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:00.312830 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:00.324821 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd7cac18-b20d-40bf-aa1c-8d9781c2fd79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1569 microversion: 2.1 time: 0.235768 Oct 16 01:44:00.328750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3104/6336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:00 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:00.417132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:00.426084 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-db205bb3-7253-4fe4-ada0-60a449406b09 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1688 microversion: 2.1 time: 0.243867 Oct 16 01:44:00.426727 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3233/6337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:00 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1688 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:01.191723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a02fa877-fc9b-4bc1-8bdb-34b143a0dc26 req-7fb97805-f229-4e88-9d0d-dcd91e6bc4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:01.206499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a02fa877-fc9b-4bc1-8bdb-34b143a0dc26 req-7fb97805-f229-4e88-9d0d-dcd91e6bc4bc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:01.207239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a02fa877-fc9b-4bc1-8bdb-34b143a0dc26 req-7fb97805-f229-4e88-9d0d-dcd91e6bc4bc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:01.207910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a02fa877-fc9b-4bc1-8bdb-34b143a0dc26 req-7fb97805-f229-4e88-9d0d-dcd91e6bc4bc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:01.224287 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a02fa877-fc9b-4bc1-8bdb-34b143a0dc26 req-7fb97805-f229-4e88-9d0d-dcd91e6bc4bc service nova] Creating event network-changed:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:44:01.233155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-a02fa877-fc9b-4bc1-8bdb-34b143a0dc26 req-7fb97805-f229-4e88-9d0d-dcd91e6bc4bc service nova] Instance ac9e3faa-e7ac-473e-b106-917816db042b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:44:01.247391 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a02fa877-fc9b-4bc1-8bdb-34b143a0dc26 req-7fb97805-f229-4e88-9d0d-dcd91e6bc4bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060475 Oct 16 01:44:01.248039 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3105/6338] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:44:01.354571 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:01.356121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:01.365939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:01.366539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:01.367175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:01.368606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:01.369263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:01.369879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:01.454099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:01.455240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:01.466007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:01.469108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:01.469570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:01.470300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:01.470756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:01.471210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:01.731515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:01.740828 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-15f51bd1-46c2-4b7b-828b-5fdc07522efb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1569 microversion: 2.1 time: 0.394874 Oct 16 01:44:01.746177 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3234/6339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:01 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1569 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:01.825048 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ee223668-b839-4dd7-9f7e-7abc3da3aa34 req-729fb89e-82d7-46a5-811f-dc316acd2bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5e0db6-310b-4c56-ae0e-aceb15567bce", "name": "network-vif-deleted", "tag": "fdbb0716-3bbd-4fcd-8961-583dc9b5d740"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:01.849662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee223668-b839-4dd7-9f7e-7abc3da3aa34 req-729fb89e-82d7-46a5-811f-dc316acd2bfb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:01.850177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee223668-b839-4dd7-9f7e-7abc3da3aa34 req-729fb89e-82d7-46a5-811f-dc316acd2bfb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:01.852642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ee223668-b839-4dd7-9f7e-7abc3da3aa34 req-729fb89e-82d7-46a5-811f-dc316acd2bfb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:01.876624 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ee223668-b839-4dd7-9f7e-7abc3da3aa34 req-729fb89e-82d7-46a5-811f-dc316acd2bfb service nova] Creating event network-vif-deleted:fdbb0716-3bbd-4fcd-8961-583dc9b5d740 for instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce on n-h2-master-1 Oct 16 01:44:01.877548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:01.882327 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ee223668-b839-4dd7-9f7e-7abc3da3aa34 req-729fb89e-82d7-46a5-811f-dc316acd2bfb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062656 Oct 16 01:44:01.887559 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fa56db3a-a226-4e85-a670-cc7b6bdb73da tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1688 microversion: 2.1 time: 0.439234 Oct 16 01:44:01.890973 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3106/6340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:01 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1688 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:01.891189 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3235/6341] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:02.772354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:02.773695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:02.781776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:02.782662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:02.783145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:02.783962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:02.784412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:02.784899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:02.915766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:02.921305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:02.930172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:02.939319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7b8fdadd-6886-41fd-a48b-46d72c637511 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1361 microversion: 2.1 time: 0.171211 Oct 16 01:44:02.944827 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3107/6342] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:02 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:02.954351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:02.955229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:02.955889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:02.957090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:02.957991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:02.959485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:03.387565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:03.401906 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-43c8ca77-9321-464a-9cba-8d5950634a3e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1688 microversion: 2.1 time: 0.492181 Oct 16 01:44:03.404414 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3236/6343] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:02 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1688 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:03.972499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:03.974066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:03.983423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:03.983921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:03.984362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:03.985369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:03.985866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:03.986268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:04.078248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:04.089866 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-121b54c1-4caf-47a9-87b2-10d089881437 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1361 microversion: 2.1 time: 0.122070 Oct 16 01:44:04.090838 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3108/6344] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:03 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1361 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:04.428931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:04.430886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:04.438354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:04.439165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:04.439812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:04.440726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:04.441378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:04.441993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:04.558315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1308941a-4b98-4586-bc19-0064e62a6c87 req-a54eaa54-31fc-4dec-ba5e-43484a2f9960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "name": "network-vif-plugged", "status": "completed", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:04.580405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1308941a-4b98-4586-bc19-0064e62a6c87 req-a54eaa54-31fc-4dec-ba5e-43484a2f9960 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:04.581721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1308941a-4b98-4586-bc19-0064e62a6c87 req-a54eaa54-31fc-4dec-ba5e-43484a2f9960 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:04.582335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1308941a-4b98-4586-bc19-0064e62a6c87 req-a54eaa54-31fc-4dec-ba5e-43484a2f9960 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:04.607655 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1308941a-4b98-4586-bc19-0064e62a6c87 req-a54eaa54-31fc-4dec-ba5e-43484a2f9960 service nova] Creating event network-vif-plugged:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:44:04.617124 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1308941a-4b98-4586-bc19-0064e62a6c87 req-a54eaa54-31fc-4dec-ba5e-43484a2f9960 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063284 Oct 16 01:44:04.618968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3109/6345] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:04.646084 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:04.655013 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a989ea31-f913-4e86-ac98-32e9c3076dc5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1681 microversion: 2.1 time: 0.230905 Oct 16 01:44:04.655624 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3237/6346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:04 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:05.118665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:05.119545 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:05.125822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:05.126304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:05.126733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:05.127448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:05.127901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:05.128324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:05.197061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:05.205288 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c067089-d0ae-44e7-be43-0572272b3859 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1361 microversion: 2.1 time: 0.092394 Oct 16 01:44:05.211970 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3110/6347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:05 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1361 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:06.230622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:06.231575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:06.239462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:06.240123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:06.240673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:06.241610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:06.242209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:06.243422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:06.316628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:06.326464 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-62b60ad6-8913-48fd-b1e8-ea908c7f0270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1361 microversion: 2.1 time: 0.101209 Oct 16 01:44:06.327254 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3238/6348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:06 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1361 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:07.356126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:07.356722 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:07.364664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:07.365191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:07.365910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:07.366874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:07.368119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:07.368893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:07.440719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:07.449685 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-78ad0a99-c56a-4fa7-a9d3-c19854a7848e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 200 len: 1361 microversion: 2.1 time: 0.098386 Oct 16 01:44:07.457627 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3111/6349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:07 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 1361 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:08.474431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:08.475214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:08.483211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:08.484099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:08.484789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:08.485711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:08.486383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:08.487495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:08.507131 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce HTTP/1.1 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '9c5e0db6-310b-4c56-ae0e-aceb15567bce'} Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:08.510029 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f45cb97-89fe-4434-949c-8b60f13d04f3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 404 len: 111 microversion: 2.1 time: 0.041078 Oct 16 01:44:08.516028 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3239/6350] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:08 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:44:12.837394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:12.837994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:12.840367 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=66 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:12.846007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:12.846577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:12.847135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:12.847836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:12.848297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:12.848749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:12.874623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:44:12.927260 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:12.956841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-744385e1-c811-4867-aea0-178b050813e7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 204 len: 0 microversion: 2.1 time: 0.123427 Oct 16 01:44:12.957670 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3112/6351] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:44:12 2022] DELETE /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:44:12.968459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:12.969937 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:12.974016 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:12.980048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:12.980659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:12.981267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:12.982048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:12.982603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:12.983147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:13.123841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:13.133878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f400eaa-7a2e-43b0-8171-c52ca195d85e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1409 microversion: 2.1 time: 0.170556 Oct 16 01:44:13.135925 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3240/6352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:12 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:14.158283 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:14.159031 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:14.166851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:14.167435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:14.167878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:14.168585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:14.169050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:14.169669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:14.305768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:14.313723 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-164cfc78-d677-4004-a7b5-9b78bf6b5042 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1409 microversion: 2.1 time: 0.159772 Oct 16 01:44:14.314319 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3113/6353] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:14 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:15.077878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-fe6a1c99-86f4-4522-b3b6-3cb1dd2d0b17 req-a47a855e-2b85-4d22-bb3a-da748c96c7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dfff77-0342-43be-89ea-0d4bc7850ebc", "name": "network-vif-deleted", "tag": "8c8c2445-0b70-4d87-bc3e-06d858301484"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:15.093020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fe6a1c99-86f4-4522-b3b6-3cb1dd2d0b17 req-a47a855e-2b85-4d22-bb3a-da748c96c7c1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:15.093457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fe6a1c99-86f4-4522-b3b6-3cb1dd2d0b17 req-a47a855e-2b85-4d22-bb3a-da748c96c7c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:15.093908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fe6a1c99-86f4-4522-b3b6-3cb1dd2d0b17 req-a47a855e-2b85-4d22-bb3a-da748c96c7c1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:15.107540 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-fe6a1c99-86f4-4522-b3b6-3cb1dd2d0b17 req-a47a855e-2b85-4d22-bb3a-da748c96c7c1 service nova] Creating event network-vif-deleted:8c8c2445-0b70-4d87-bc3e-06d858301484 for instance 34dfff77-0342-43be-89ea-0d4bc7850ebc on n-h1-master-1 Oct 16 01:44:15.114395 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-fe6a1c99-86f4-4522-b3b6-3cb1dd2d0b17 req-a47a855e-2b85-4d22-bb3a-da748c96c7c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041261 Oct 16 01:44:15.115024 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3241/6354] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:15.337187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:15.338055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:15.347844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:15.348607 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:15.349128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:15.349963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:15.350540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:15.351581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:15.437416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:15.448086 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6a30c591-e413-497c-a9c5-835afdc687ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1202 microversion: 2.1 time: 0.114722 Oct 16 01:44:15.448931 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3114/6355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:15 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1202 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:16.473805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:16.474879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:16.484015 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:16.484719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:16.485340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:16.486047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:16.486586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:16.487131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:16.564234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:16.573129 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c4eb3ad1-423c-4cb5-b359-11973dc641ab tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1202 microversion: 2.1 time: 0.105346 Oct 16 01:44:16.573708 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3242/6356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:16 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1202 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:17.599260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:17.602240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:17.614496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:17.616430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:17.617917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:17.619354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:17.619848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:17.620525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:17.699642 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:17.718038 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af7ac25c-7091-47dd-b2ad-c184ca43ccf7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1202 microversion: 2.1 time: 0.125157 Oct 16 01:44:17.733956 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3115/6357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:17 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1202 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:18.742057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:18.742755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:18.751628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:18.752306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:18.752856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:18.753908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:18.754478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:18.755190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:18.829828 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:18.834061 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:18.841521 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec1cbbc2-ccdb-4525-a723-6e21c7ae50ce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1202 microversion: 2.1 time: 0.103742 Oct 16 01:44:18.842221 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3243/6358] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:18 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1202 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:19.867158 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:19.868061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:19.876708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:19.877460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:19.878149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:19.879167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:19.879856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:19.880530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:19.919218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:19.920094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:19.920762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:19.921444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lazy-loading 'fault' on Instance uuid 34dfff77-0342-43be-89ea-0d4bc7850ebc {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:44:19.983001 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:19.991281 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8cdd9d8e-7a04-4f97-becb-5e7048f0298b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 200 len: 1207 microversion: 2.1 time: 0.129805 Oct 16 01:44:19.992424 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3116/6359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:19 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 1207 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:21.016427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:21.017169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:21.026413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:21.027044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:21.027581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:21.028455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:21.029013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:21.029456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:21.044946 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc HTTP/1.1 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '34dfff77-0342-43be-89ea-0d4bc7850ebc'} Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:21.046636 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1db31187-0904-44c8-9c72-39b9d0941eb1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 404 len: 111 microversion: 2.1 time: 0.036059 Oct 16 01:44:21.052812 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3244/6360] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:21 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:44:23.206455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:23.207373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:23.216287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.216902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.217630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.218470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.219216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.219886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.235266 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce HTTP/1.1 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '9c5e0db6-310b-4c56-ae0e-aceb15567bce'} Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:44:23.236948 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:44:23.242379 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ccbb1fe5-9a71-46b5-a02d-0b260f4ba4d2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 404 len: 111 microversion: 2.1 time: 0.039124 Oct 16 01:44:23.243988 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3245/6361] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:44:23 2022] DELETE /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:44:23.250275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:23.251075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 9c5e0db6-310b-4c56-ae0e-aceb15567bce] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:23.257978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.258571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.259110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.259893 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.260436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.260939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.276419 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce HTTP/1.1 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '9c5e0db6-310b-4c56-ae0e-aceb15567bce'} Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:23.278023 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.283552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.283552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:23.283552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:23.283552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:44:23.283552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:44:23.283552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. Oct 16 01:44:23.283552 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.283552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 9c5e0db6-310b-4c56-ae0e-aceb15567bce could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:44:23.284301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-257319803", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "c48099fd-5049-4027-aba5-e9705c7c3389"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:23.284786 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6ef25662-e0f7-4af5-bf97-0aa44a5eb28b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce" status: 404 len: 111 microversion: 2.1 time: 0.033680 Oct 16 01:44:23.284786 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3246/6362] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:23 2022] GET /compute/v2.1/servers/9c5e0db6-310b-4c56-ae0e-aceb15567bce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:44:23.344847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] validate_networks() for [('c48099fd-5049-4027-aba5-e9705c7c3389', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:44:23.739351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:44:23.740190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:44:23.740725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:44:23.741732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:44:23.742292 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:44:23.762875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.763402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.763839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.764569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.765030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.765984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.784574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Getting quotas for project 6430b7c382284580beb574867b665e05. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:44:23.789984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Getting quotas for user fe5a503e64d94e7d840cc97d9fa03637 and project 6430b7c382284580beb574867b665e05. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:44:23.802952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:44:23.805418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:44:23.837631 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:23.838277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:23.844351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.844847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.845294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.846031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.846505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.846962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.855593 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d267d4c5-e246-4be5-9576-c12bcc48b7bc tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712650 Oct 16 01:44:23.856252 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3117/6363] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:44:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:44:23.860983 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc HTTP/1.1 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '34dfff77-0342-43be-89ea-0d4bc7850ebc'} Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:44:23.862833 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b0eb541-0e8e-4e1b-af45-51083809fbe7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 404 len: 111 microversion: 2.1 time: 0.031521 Oct 16 01:44:23.869794 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3247/6364] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:44:23 2022] DELETE /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:44:23.872476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52ca4237-d35e-4015-a2b3-3e651b7d322d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:23.873192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-52ca4237-d35e-4015-a2b3-3e651b7d322d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:23.873876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:23.874546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 34dfff77-0342-43be-89ea-0d4bc7850ebc] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:23.880505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.881417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.881417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.882772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:23.883275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:23.883700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:23.903752 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc HTTP/1.1 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '34dfff77-0342-43be-89ea-0d4bc7850ebc'} Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:23.905766 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 34dfff77-0342-43be-89ea-0d4bc7850ebc could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:44:23.911746 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-789c7442-afec-43e2-ba68-ea50e0612760 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc" status: 404 len: 111 microversion: 2.1 time: 0.037191 Oct 16 01:44:23.913257 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3248/6365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:23 2022] GET /compute/v2.1/servers/34dfff77-0342-43be-89ea-0d4bc7850ebc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:44:23.935719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-52ca4237-d35e-4015-a2b3-3e651b7d322d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:23.943190 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-52ca4237-d35e-4015-a2b3-3e651b7d322d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1214 microversion: 2.1 time: 0.079397 Oct 16 01:44:23.943990 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3118/6366] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:23 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:23.990478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a075d67-d732-4565-ac02-be89eae56c45 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: .version_select at 0x7fd64e206b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1266830298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMx0pTxQ31J//7JFs+viQviuoNhR4UG4uYnvoSKBgeI7m+ADB2rdoErb4sRrIl2DqQx1/DUCtZ0iHv20Xk7QIpJoxhpcUzei17Gi3uo2Mo94YWt7/3nSbaDEuY0UKhJeVQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:24.007445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-2a075d67-d732-4565-ac02-be89eae56c45 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:44:24.012779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-2a075d67-d732-4565-ac02-be89eae56c45 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:44:24.036160 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2a075d67-d732-4565-ac02-be89eae56c45 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.049749 Oct 16 01:44:24.036861 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3249/6367] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:44:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:24.968808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:24.970721 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:24.980588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:24.981580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:24.982426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:24.984335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:24.985906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:24.986762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:25.114569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:25.123310 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e514a01-177e-4cf1-a381-08f538c11790 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1274 microversion: 2.1 time: 0.159544 Oct 16 01:44:25.130320 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3119/6368] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:24 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1274 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:26.157069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:26.157756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:26.169009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:26.169535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:26.169996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:26.171060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:26.171541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:26.172183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:26.353915 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:26.362828 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6711851b-f814-4f52-8926-52aa4a1b03f8 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1314 microversion: 2.1 time: 0.210764 Oct 16 01:44:26.363857 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3250/6369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:26 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:26.895244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1b43183d-867b-4a32-909e-eddcbbcb96f7 req-ce900748-69c5-4b96-9e87-5efc271ffb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6ecb4d-3c5b-44fc-922c-81d374e2a029", "tag": "485c8e9e-5e40-4379-a58b-746fd6e72616"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:26.912987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b43183d-867b-4a32-909e-eddcbbcb96f7 req-ce900748-69c5-4b96-9e87-5efc271ffb12 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:26.913834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b43183d-867b-4a32-909e-eddcbbcb96f7 req-ce900748-69c5-4b96-9e87-5efc271ffb12 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:26.914603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b43183d-867b-4a32-909e-eddcbbcb96f7 req-ce900748-69c5-4b96-9e87-5efc271ffb12 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:26.936719 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1b43183d-867b-4a32-909e-eddcbbcb96f7 req-ce900748-69c5-4b96-9e87-5efc271ffb12 service nova] Creating event network-changed:485c8e9e-5e40-4379-a58b-746fd6e72616 for instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 on n-h1-master-1 Oct 16 01:44:26.943636 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1b43183d-867b-4a32-909e-eddcbbcb96f7 req-ce900748-69c5-4b96-9e87-5efc271ffb12 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054253 Oct 16 01:44:26.945602 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3120/6370] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:27.387887 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:27.388518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:27.395609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:27.396138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:27.396593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:27.397524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:27.398005 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:27.398454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:27.539377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:27.548242 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e8036111-a96a-4d0c-9f3f-79f07d16870c tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1314 microversion: 2.1 time: 0.164311 Oct 16 01:44:27.563014 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3251/6371] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:27 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:28.576329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:28.577173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:28.583389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:28.584121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:28.587732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:28.588609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:28.589094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:28.589527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:28.788212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:28.796973 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0a8387e2-01c7-4f2c-b8d9-14a66e01024e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1314 microversion: 2.1 time: 0.227893 Oct 16 01:44:28.797551 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3121/6372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:28 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:29.822636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:29.823246 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:29.830594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:29.831132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:29.831584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:29.832295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:29.832768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:29.833209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:29.971971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:29.980744 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45cd4144-bcd7-4380-bb84-9b3539062a62 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1314 microversion: 2.1 time: 0.163277 Oct 16 01:44:29.981339 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3252/6373] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:29 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:30.883509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:30.886102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:30.893586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:30.894079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:30.894520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:30.895522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:30.896165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:30.897338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:30.980742 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88453283-cdb9-4ef3-a256-704ee9e212dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action" status: 200 len: 63173 microversion: 2.1 time: 0.100930 Oct 16 01:44:30.981331 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3122/6374] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:44:30 2022] POST /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b/action => generated 63173 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:44:31.004465 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:31.005103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:31.012651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:31.013414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:31.014056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:31.015024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:31.015705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:31.016354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:31.154723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:31.163178 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-55925e73-915d-49b9-bdb5-2b7c436c8fed tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1314 microversion: 2.1 time: 0.162032 Oct 16 01:44:31.163758 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3253/6375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:30 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:32.187763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:32.188384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:32.195956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:32.196438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:32.196875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:32.197570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:32.198035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:32.198470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:32.338428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:32.346401 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8218b292-8321-4d85-9a2f-5869c35f3517 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1314 microversion: 2.1 time: 0.162874 Oct 16 01:44:32.347013 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3123/6376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:32 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:32.649083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-8f84a70f-3be3-46bf-bcec-1bf13ac936f4 req-bdfa9de9-39e0-44a7-a165-f9defa095969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6ecb4d-3c5b-44fc-922c-81d374e2a029", "name": "network-vif-plugged", "status": "completed", "tag": "485c8e9e-5e40-4379-a58b-746fd6e72616"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:32.661516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8f84a70f-3be3-46bf-bcec-1bf13ac936f4 req-bdfa9de9-39e0-44a7-a165-f9defa095969 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:32.662313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8f84a70f-3be3-46bf-bcec-1bf13ac936f4 req-bdfa9de9-39e0-44a7-a165-f9defa095969 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:32.663322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-8f84a70f-3be3-46bf-bcec-1bf13ac936f4 req-bdfa9de9-39e0-44a7-a165-f9defa095969 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:32.677316 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-8f84a70f-3be3-46bf-bcec-1bf13ac936f4 req-bdfa9de9-39e0-44a7-a165-f9defa095969 service nova] Creating event network-vif-plugged:485c8e9e-5e40-4379-a58b-746fd6e72616 for instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 on n-h1-master-1 Oct 16 01:44:32.683115 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-8f84a70f-3be3-46bf-bcec-1bf13ac936f4 req-bdfa9de9-39e0-44a7-a165-f9defa095969 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038148 Oct 16 01:44:32.685066 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3254/6377] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:33.375525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:33.376259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:33.387472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:33.388050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:33.388569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:33.389356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:33.389891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:33.390396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:33.529840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:33.538505 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df20e1de-ccaa-4b76-b6ee-f263b92aa49d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1314 microversion: 2.1 time: 0.167189 Oct 16 01:44:33.539312 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3124/6378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:33 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:34.560648 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:34.564888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:34.565598 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:34.572715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:34.573467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:34.574113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:34.575105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:34.575757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:34.576197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:34.715112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:34.724187 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7fcf2813-fc8d-47fc-907c-47c373932db4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1501 microversion: 2.1 time: 0.165471 Oct 16 01:44:34.724840 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3255/6379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:34 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:34.747780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:34.748405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:34.750859 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:34.751801 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:34.758312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:34.758799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:34.759272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:34.760842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:34.760842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:34.760842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:34.905260 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:34.913678 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bf4c8ff-79de-44ca-ac7e-d570bfd9d9d1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1501 microversion: 2.1 time: 0.169793 Oct 16 01:44:34.914265 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3125/6380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:34 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:34.935924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:34.936468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:34.942424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:34.942941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:34.944174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:34.944883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:34.945346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:34.945783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:34.970212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lazy-loading 'flavor' on Instance uuid 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:44:35.049612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dd4597f0-53fa-4a1c-be21-73c7e881461e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "POST /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029/action" status: 202 len: 0 microversion: 2.1 time: 0.117145 Oct 16 01:44:35.050273 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3256/6381] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:44:34 2022] POST /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:44:35.058374 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:35.059019 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:35.067349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:35.067997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:35.069010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:35.071195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:35.071662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:35.073562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:35.215662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:35.223486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-76c6d075-253e-4466-bc3c-8dba7623a11a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1509 microversion: 2.1 time: 0.168950 Oct 16 01:44:35.224070 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3126/6382] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:35 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:36.248284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:36.249002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:36.255281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:36.256321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:36.256822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:36.257547 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:36.258057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:36.258510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:36.390589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:36.399762 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b40a053b-eb4e-4808-a916-217d0126507e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1492 microversion: 2.1 time: 0.156677 Oct 16 01:44:36.400538 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3257/6383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:36 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1492 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:36.423186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:36.423751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:36.431537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:36.432022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:36.432454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:36.433140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:36.433586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:36.434129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:36.502074 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1f60accb-e6f8-4b96-a41e-d1f8b182b852 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "POST /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029/action" status: 202 len: 0 microversion: 2.1 time: 0.082698 Oct 16 01:44:36.505661 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3127/6384] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:44:36 2022] POST /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:44:36.517179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:36.517933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:36.524396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:36.524903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:36.525359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:36.526081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:36.526587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:36.527261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:36.683073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:36.691272 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5fa4871b-c49c-4a79-9ebe-6d0002ba8a2a tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1498 microversion: 2.1 time: 0.177994 Oct 16 01:44:36.691861 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3258/6385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:36 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:37.369749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:37.370438 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:37.376684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:37.377166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:37.377596 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:37.378276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:37.378726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:37.379175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:37.512828 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98c92184-be88-46c7-9bd2-1d813f80a06c tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1832 microversion: 2.1 time: 0.147725 Oct 16 01:44:37.513501 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3128/6386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:37 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1832 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:37.715498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:37.716327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:37.723948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:37.724490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:37.725477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:37.726223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:37.726692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:37.727156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:37.967822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:37.978229 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-276d872d-f28b-45ba-b7ba-e91c95c8b070 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1498 microversion: 2.1 time: 0.266896 Oct 16 01:44:37.978952 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3259/6387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:37 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1498 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:38.832290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:38.833203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:38.833340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-09f1aa74-ca2d-45cf-ba48-67e7be5864ff req-b959eca1-8949-4e24-8d06-a7b4e1d92b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:38.841807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:38.842659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:38.843733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:38.844458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-09f1aa74-ca2d-45cf-ba48-67e7be5864ff req-b959eca1-8949-4e24-8d06-a7b4e1d92b21 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:38.844814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:38.845371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:38.845513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-09f1aa74-ca2d-45cf-ba48-67e7be5864ff req-b959eca1-8949-4e24-8d06-a7b4e1d92b21 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:38.845966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:38.846325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-09f1aa74-ca2d-45cf-ba48-67e7be5864ff req-b959eca1-8949-4e24-8d06-a7b4e1d92b21 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:38.859757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-09f1aa74-ca2d-45cf-ba48-67e7be5864ff req-b959eca1-8949-4e24-8d06-a7b4e1d92b21 service nova] Creating event network-changed:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:44:38.866391 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-09f1aa74-ca2d-45cf-ba48-67e7be5864ff req-b959eca1-8949-4e24-8d06-a7b4e1d92b21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036454 Oct 16 01:44:38.867434 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3260/6388] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:44:38.882566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:44:38.922691 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:38.986214 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df48b126-e36d-42b5-a362-67a021e34fae tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 204 len: 0 microversion: 2.1 time: 0.157674 Oct 16 01:44:38.991226 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3129/6389] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:44:38 2022] DELETE /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:44:39.000241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:39.002178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:39.009955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:39.011020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:39.011675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:39.011943 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:39.012780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:39.013673 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:39.013876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:39.014641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:39.027727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:39.030457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:39.031197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:39.031991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:39.032555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:39.033079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:39.313539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:39.318002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:39.323977 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ded3d30f-0cbe-46e7-9b7b-790622a7e9e0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1687 microversion: 2.1 time: 0.331593 Oct 16 01:44:39.331215 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd26c1fe-2680-4e73-a098-8374f0716c21 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1501 microversion: 2.1 time: 0.330665 Oct 16 01:44:39.332260 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3130/6390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:38 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1501 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:39.340983 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3261/6391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:38 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1687 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:39.360940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:39.361798 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:39.369930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:39.370860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:39.371714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:39.373104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:39.373364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:39.375026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:39.404344 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lazy-loading 'flavor' on Instance uuid 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:44:39.504903 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8bb5b137-6b70-4985-9071-45fb0f545360 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "POST /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029/action" status: 202 len: 0 microversion: 2.1 time: 0.150347 Oct 16 01:44:39.509349 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3131/6392] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:44:39 2022] POST /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:44:39.515760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:39.515760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:39.523595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:39.524467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:39.524958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:39.525708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:39.526395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:39.526937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:39.699302 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:39.709594 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1c450f42-0c33-43f9-801d-ade0f41539d4 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1509 microversion: 2.1 time: 0.198826 Oct 16 01:44:39.710415 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3262/6393] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:39 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:40.356269 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:40.356978 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:40.363380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:40.363869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:40.364309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:40.365572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:40.366031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:40.366458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:40.586207 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:40.594794 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-555b66f5-cccb-4f9b-bafb-086f45dbfdc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1687 microversion: 2.1 time: 0.243564 Oct 16 01:44:40.595479 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3132/6394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:40 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1687 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:40.736149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:40.736775 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:40.744069 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:40.744684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:40.745231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:40.746155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:40.746695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:40.747301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:40.889972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:40.898665 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-13de9719-f98b-4718-ab43-66f23092f59d tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1492 microversion: 2.1 time: 0.166942 Oct 16 01:44:40.914945 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3263/6395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:40 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1492 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:40.923667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:40.924215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:40.930299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:40.930789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:40.931282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:40.931979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:40.932445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:40.932874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:40.999764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a188e878-c5f8-4919-85c9-bf0dc4b47112 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "POST /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029/action" status: 202 len: 0 microversion: 2.1 time: 0.079870 Oct 16 01:44:41.003580 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3133/6396] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:44:40 2022] POST /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:44:41.012059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:41.012801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:41.019747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:41.020394 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:41.020860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:41.022335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:41.022813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:41.023305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:41.043436 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:41.178113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:41.187748 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-090f513f-d20f-452b-8ee0-527e39c6c5ff tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1498 microversion: 2.1 time: 0.179596 Oct 16 01:44:41.188587 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3264/6397] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:41 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1498 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:41.194199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9f8ee9b5-7657-499f-a071-dffa5d08d5ed req-d343ff2e-f9b0-4d2e-ae3e-17d2eef27142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac9e3faa-e7ac-473e-b106-917816db042b", "name": "network-vif-deleted", "tag": "5fe708b3-8194-4b0f-98fc-5dd1d89f2365"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:41.204409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9f8ee9b5-7657-499f-a071-dffa5d08d5ed req-d343ff2e-f9b0-4d2e-ae3e-17d2eef27142 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:41.204898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9f8ee9b5-7657-499f-a071-dffa5d08d5ed req-d343ff2e-f9b0-4d2e-ae3e-17d2eef27142 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:41.205337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9f8ee9b5-7657-499f-a071-dffa5d08d5ed req-d343ff2e-f9b0-4d2e-ae3e-17d2eef27142 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:41.217928 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9f8ee9b5-7657-499f-a071-dffa5d08d5ed req-d343ff2e-f9b0-4d2e-ae3e-17d2eef27142 service nova] Creating event network-vif-deleted:5fe708b3-8194-4b0f-98fc-5dd1d89f2365 for instance ac9e3faa-e7ac-473e-b106-917816db042b on n-h2-master-1 Oct 16 01:44:41.222901 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9f8ee9b5-7657-499f-a071-dffa5d08d5ed req-d343ff2e-f9b0-4d2e-ae3e-17d2eef27142 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 Oct 16 01:44:41.223528 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3134/6398] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:41.622257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:41.623216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:41.630173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:41.631257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:41.631925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:41.632650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:41.633295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:41.634090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:41.671638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:41.672323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:41.672780 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:41.674073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lazy-loading 'fault' on Instance uuid ac9e3faa-e7ac-473e-b106-917816db042b {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:44:41.712174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-286768811", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1266830298", "security_groups": [{"name": "tempest-secgroup-smoke-361426714"}], "block_device_mapping_v2": [{"uuid": "6543be82-dec3-4f79-919f-a11732492ee4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61eb30c5-accf-4cf9-b162-43c4bdd26615"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:41.720275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:41.728839 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-61dedbb4-565f-4629-b4f9-35ef0fee272b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 200 len: 1356 microversion: 2.1 time: 0.110431 Oct 16 01:44:41.729512 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3265/6399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:41 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:41.827799 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] validate_networks() for [('61eb30c5-accf-4cf9-b162-43c4bdd26615', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:44:42.214250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:42.214986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:42.218287 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:44:42.218712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:44:42.219249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:44:42.219660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:44:42.220075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:44:42.223306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:42.224035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:42.225492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:42.226464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:42.227182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:42.227840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:42.230804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:42.231371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:42.232023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:42.233007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:42.233468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:42.233893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:42.252076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:44:42.258230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:44:42.321364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:44:42.323610 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6543be82-dec3-4f79-919f-a11732492ee4',volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:44:42.368251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:42.376603 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c866c15-8288-47fa-a7e2-618fb2f68041 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1498 microversion: 2.1 time: 0.166640 Oct 16 01:44:42.377183 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3266/6400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:42 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:42.468842 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3a3f88ab-2c18-4b1c-886c-f6821243182f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.762162 Oct 16 01:44:42.469411 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3135/6401] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:44:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 01:44:42.480809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0f2248e-d957-40c3-a6a5-0dbc39250506 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:42.481567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f0f2248e-d957-40c3-a6a5-0dbc39250506 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:42.536704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f0f2248e-d957-40c3-a6a5-0dbc39250506 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:42.544164 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0f2248e-d957-40c3-a6a5-0dbc39250506 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1094 microversion: 2.1 time: 0.067333 Oct 16 01:44:42.544737 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3267/6402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:42 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:42.753852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:42.754467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: ac9e3faa-e7ac-473e-b106-917816db042b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:42.762938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:42.763429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:42.763912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:42.764906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:42.765376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:42.765972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:42.780231 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] HTTP exception thrown: Instance ac9e3faa-e7ac-473e-b106-917816db042b could not be found. Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Request method failure captured: Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b HTTP/1.1 Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2DqN-UT2falK72w98Rw1ecfssH-Glws7VEsKQiphDY1d9smk-R1JvXKD0Dqf8PxLYTV6aXG--fD5W0nuCIGhiXXhaSUnqm_oKesChDekdLqyYd1pPTaNQL6VFOZHf4uXw0-kS8HODdK0elzb0ty6zGgXYWz06m-gK8IoUVR5r7Q9Eg Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 855792b0264144dd941200c8468ac26d Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_855792b0264144dd941200c8468ac26d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/855792b0264144dd941200c8468ac26d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/855792b0264144dd941200c8468ac26d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/855792b0264144dd941200c8468ac26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 855792b0264144dd941200c8468ac26d Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestNetworkAdvancedServerOps-1761159727-project Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 83bbcff8a1f64cfa936f13f3cb3955b6 Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1761159727-project Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ac9e3faa-e7ac-473e-b106-917816db042b could not be found. Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ac9e3faa-e7ac-473e-b106-917816db042b'} Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac9e3faa-e7ac-473e-b106-917816db042b could not be found. Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac9e3faa-e7ac-473e-b106-917816db042b could not be found. Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:42.781901 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac9e3faa-e7ac-473e-b106-917816db042b could not be found. Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Returning 404 to user: Instance ac9e3faa-e7ac-473e-b106-917816db042b could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-715f00a2-418e-4776-a302-ce62f4fa7ce5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b" status: 404 len: 111 microversion: 2.1 time: 0.034187 Oct 16 01:44:42.787711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3136/6403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:42 2022] GET /compute/v2.1/servers/ac9e3faa-e7ac-473e-b106-917816db042b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:44:43.401560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:43.402520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:43.408687 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:43.415295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:43.416105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:43.416806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:43.417629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:43.418201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:43.418783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:43.567296 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:43.567970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:43.570167 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:43.576269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:43.576762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:43.577195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:43.577890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:43.578343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:43.578766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:43.649227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:43.656937 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-201976e9-051d-4d9f-966a-4c73f4fea5c6 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1501 microversion: 2.1 time: 0.259314 Oct 16 01:44:43.657516 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3268/6404] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:43 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1501 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:43.671092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:43.678710 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba544957-1a9a-467c-810c-684c8d7a5f79 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1192 microversion: 2.1 time: 0.115608 Oct 16 01:44:43.679491 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3137/6405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:43 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:43.681711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:43.682511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:43.689905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:43.690415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:43.693141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:43.693919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:43.694410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:43.694958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:43.726425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:44:43.822735 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-badd8c35-10a8-4754-b7c7-bcdad299890e tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 204 len: 0 microversion: 2.1 time: 0.145162 Oct 16 01:44:43.825251 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3269/6406] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:44:43 2022] DELETE /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:44:43.832791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:43.834564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:43.842023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:43.842487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:43.842942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:43.843647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:43.844135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:43.844505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:44.171308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:44.192966 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a5d2565-6e81-43cd-a628-4adf562a1449 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1507 microversion: 2.1 time: 0.353135 Oct 16 01:44:44.194635 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3138/6407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:43 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:44.706177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:44.708692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:44.727310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:44.728276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:44.728912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:44.729842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:44.733470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:44.734328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:45.123011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:45.136503 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2cbd06b5-47d0-4700-a56a-6f0891254ca9 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1277 microversion: 2.1 time: 0.433476 Oct 16 01:44:45.154279 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3270/6408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:44 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1277 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:45.218521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:45.219201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:45.230459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:45.243804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:45.245753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:45.247007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:45.247689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:45.248675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:45.759254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:45.779426 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c4cbdc9-b104-45a2-a4cd-d183a65b3639 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1507 microversion: 2.1 time: 0.564943 Oct 16 01:44:45.781076 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3139/6409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:45 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:46.163927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:46.164554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:46.179203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:46.180081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:46.180740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:46.181758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:46.182182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:46.182629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:46.365047 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-808bce67-d311-4af4-ab72-b0930aa65e14 req-858c6171-113d-4e3f-a704-4eeaa21f83eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6c8da3-c129-48f7-a984-07c016af226b", "tag": "af166b71-e370-4e5a-bd48-5e16173b39ba"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:46.387301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-808bce67-d311-4af4-ab72-b0930aa65e14 req-858c6171-113d-4e3f-a704-4eeaa21f83eb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:46.388106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-808bce67-d311-4af4-ab72-b0930aa65e14 req-858c6171-113d-4e3f-a704-4eeaa21f83eb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:46.390049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-808bce67-d311-4af4-ab72-b0930aa65e14 req-858c6171-113d-4e3f-a704-4eeaa21f83eb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:46.416270 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-808bce67-d311-4af4-ab72-b0930aa65e14 req-858c6171-113d-4e3f-a704-4eeaa21f83eb service nova] Creating event network-changed:af166b71-e370-4e5a-bd48-5e16173b39ba for instance 6f6c8da3-c129-48f7-a984-07c016af226b on n-h2-master-1 Oct 16 01:44:46.422059 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-808bce67-d311-4af4-ab72-b0930aa65e14 req-858c6171-113d-4e3f-a704-4eeaa21f83eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061381 Oct 16 01:44:46.425766 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3140/6410] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:46.580628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:46.597738 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-83fc8490-70d1-4f63-8cbf-f75722061d7d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1277 microversion: 2.1 time: 0.437620 Oct 16 01:44:46.616942 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3271/6411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:46 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1277 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:46.807063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:46.808285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:46.817807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:46.818750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:46.819553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:46.820578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:46.822299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:46.824506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:47.160068 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe5a503e64d94e7d840cc97d9fa03637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6430b7c382284580beb574867b665e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:47.185500 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c40478db-1f44-4d98-baec-e0bb0ee648f1 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 200 len: 1465 microversion: 2.1 time: 0.383857 Oct 16 01:44:47.187713 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3141/6412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:46 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 1465 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:47.622824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:47.626795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:47.641996 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:47.642553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:47.643019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:47.643850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:47.644781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:47.645413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:47.854131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:47.863616 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67508da2-ba37-4083-9713-2cb5ef39e91f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1277 microversion: 2.1 time: 0.246253 Oct 16 01:44:47.865215 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3272/6413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:47 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:47.966547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-907ab075-6b57-4865-9439-396b9f9ad7b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '.version_select at 0x7fd64cef68b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:48.008856 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-907ab075-6b57-4865-9439-396b9f9ad7b4 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-111878889" status: 202 len: 0 microversion: 2.1 time: 0.047176 Oct 16 01:44:48.009639 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3142/6414] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Oct 16 01:44:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-111878889 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:44:48.050131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-889ea62b-4281-45af-8251-1dbcdbca4f85 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'create', calling method: .version_select at 0x7fd64df5c820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1860243640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLJ7J+lUDnrrOzkoL93ZC2rdXpcsaSTmllwObk4YreCx5bPZVtiueNJPI3OREjnqTBSEh9BwshMJKwK2OBSC35liHYebQ7NO+TJPEi/uRkWVjndN3obeoBKC1cal7wKbQ=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:48.091015 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-889ea62b-4281-45af-8251-1dbcdbca4f85 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for project 855792b0264144dd941200c8468ac26d. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:44:48.097692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-889ea62b-4281-45af-8251-1dbcdbca4f85 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for user 83bbcff8a1f64cfa936f13f3cb3955b6 and project 855792b0264144dd941200c8468ac26d. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:44:48.125842 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-889ea62b-4281-45af-8251-1dbcdbca4f85 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.080589 Oct 16 01:44:48.126902 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3273/6415] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:44:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:48.213963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:48.214663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] [instance: 1f6ecb4d-3c5b-44fc-922c-81d374e2a029] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:48.224849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:48.225760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:48.226458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:48.228004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:48.228867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:48.229453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:48.249701 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] HTTP exception thrown: Instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 could not be found. Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Request method failure captured: Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 HTTP/1.1 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2H1O2D_5cggKDdb1dISAgHQY5EDcQVUz_T5MqGupEs0jtIxbnzG2c6mk9oM7S90_5RbYKSIhiOQmQD7j9Of0bKaC3S6DP75I2yvo_Jzxd-H7y8s6G7z0-JrBTaCxbLHqub_kHgTXA_VLhJ8sbHEqML-YV6H3ziR4P4PulDwCf43xTQ Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 6430b7c382284580beb574867b665e05 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestServerAdvancedOps-1686517175 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6430b7c382284580beb574867b665e05", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6430b7c382284580beb574867b665e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6430b7c382284580beb574867b665e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6430b7c382284580beb574867b665e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestServerAdvancedOps-1686517175 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 6430b7c382284580beb574867b665e05 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestServerAdvancedOps-1686517175 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestServerAdvancedOps-1686517175-project Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: fe5a503e64d94e7d840cc97d9fa03637 Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestServerAdvancedOps-1686517175-project Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 could not be found. Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '1f6ecb4d-3c5b-44fc-922c-81d374e2a029'} Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 could not be found. Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 could not be found. Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:44:48.251813 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 could not be found. Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] Returning 404 to user: Instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:44:48.257809 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16ffe9ae-d86a-45df-8cc8-26f7a2b2e720 tempest-TestServerAdvancedOps-1686517175 tempest-TestServerAdvancedOps-1686517175-project] 10.222.0.39 "GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029" status: 404 len: 111 microversion: 2.1 time: 0.045717 Oct 16 01:44:48.258660 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3143/6416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:48 2022] GET /compute/v2.1/servers/1f6ecb4d-3c5b-44fc-922c-81d374e2a029 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:44:48.774891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3667fe7b-4bf0-4f98-bd9e-a8d7afcf1f92 req-be4e156a-fd73-4aec-8628-cda94bb3f5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6ecb4d-3c5b-44fc-922c-81d374e2a029", "name": "network-vif-deleted", "tag": "485c8e9e-5e40-4379-a58b-746fd6e72616"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:48.798699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3667fe7b-4bf0-4f98-bd9e-a8d7afcf1f92 req-be4e156a-fd73-4aec-8628-cda94bb3f5ec service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:48.799234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3667fe7b-4bf0-4f98-bd9e-a8d7afcf1f92 req-be4e156a-fd73-4aec-8628-cda94bb3f5ec service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:48.799683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3667fe7b-4bf0-4f98-bd9e-a8d7afcf1f92 req-be4e156a-fd73-4aec-8628-cda94bb3f5ec service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:48.811497 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3667fe7b-4bf0-4f98-bd9e-a8d7afcf1f92 req-be4e156a-fd73-4aec-8628-cda94bb3f5ec service nova] Creating event network-vif-deleted:485c8e9e-5e40-4379-a58b-746fd6e72616 for instance 1f6ecb4d-3c5b-44fc-922c-81d374e2a029 on n-h1-master-1 Oct 16 01:44:48.817138 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3667fe7b-4bf0-4f98-bd9e-a8d7afcf1f92 req-be4e156a-fd73-4aec-8628-cda94bb3f5ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047008 Oct 16 01:44:48.818873 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3274/6417] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:48.888506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:48.889364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:48.897317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:48.897819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:48.898263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:48.899157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:48.899622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:48.900366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:49.106005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:49.122112 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-836ba8f9-3ca4-463b-9c19-79a34db519c5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1277 microversion: 2.1 time: 0.238118 Oct 16 01:44:49.123612 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3144/6418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:48 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:50.147482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:50.148901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:50.156979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:50.157854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:50.158798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:50.160054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:50.160806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:50.162117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:50.384787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:50.393433 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-421b3c8a-1d66-4fa6-8f9c-06008e5cda50 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1277 microversion: 2.1 time: 0.251121 Oct 16 01:44:50.394379 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3275/6419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:50 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:51.418646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:51.420067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:51.431246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:51.432159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:51.432851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:51.433887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:51.434624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:51.435417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:51.617382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:51.628745 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-04425290-8f04-4e76-a043-71ad70ea87a7 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.213371 Oct 16 01:44:51.635657 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3145/6420] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:51 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:52.652874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:52.654375 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:52.665480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:52.666207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:52.666837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:52.667798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:52.668453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:52.669090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:52.873441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:52.882837 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2a68ee1a-75bb-4922-8355-912302aad68f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.233920 Oct 16 01:44:52.883757 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3276/6421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:52 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:53.908615 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:53.909228 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:53.916024 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:53.916732 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:53.919504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:53.920037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:53.920902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:53.921722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:53.922597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:53.923303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:54.139842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:54.149541 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1e8e5aa-7f38-47f9-ab77-6a30b46af0cc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.245881 Oct 16 01:44:54.165247 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3146/6422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:53 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:54.596274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1507085013", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e8cb8e83-1ccd-42e1-bc84-4c83cea353c8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1860243640", "security_groups": [{"name": "tempest-secgroup-smoke-578969164"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:54.731965 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] validate_networks() for [('e8cb8e83-1ccd-42e1-bc84-4c83cea353c8', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:44:55.172020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:55.173435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:55.181531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:55.182417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:55.183166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:55.184146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:55.184900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:55.185805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:55.206014 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:44:55.355208 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:44:55.355923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:44:55.356577 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:44:55.357136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:44:55.357675 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:44:55.368934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:55.369588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:55.370279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:55.371328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:55.371809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:55.372256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:55.385041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:55.391062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for project 855792b0264144dd941200c8468ac26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:44:55.393178 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8bcd7660-086c-4480-b183-dbf97b3454b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.225260 Oct 16 01:44:55.394132 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3147/6423] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:55 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:55.397155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for user 83bbcff8a1f64cfa936f13f3cb3955b6 and project 855792b0264144dd941200c8468ac26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:44:55.416807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:44:55.419448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:44:55.468500 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b371b452-9ade-4ce0-8159-e1b0c52a48aa tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.877353 Oct 16 01:44:55.469173 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3277/6424] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:44:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:44:55.480855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6450e7b2-3c28-411f-93fe-f027cfbdcf44 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:55.481460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6450e7b2-3c28-411f-93fe-f027cfbdcf44 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:55.538671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6450e7b2-3c28-411f-93fe-f027cfbdcf44 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:55.549770 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6450e7b2-3c28-411f-93fe-f027cfbdcf44 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1267 microversion: 2.1 time: 0.072247 Oct 16 01:44:55.551083 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3148/6425] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:55 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:56.418767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:56.419427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:56.425488 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:56.425985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:56.426439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:56.427248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:56.427716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:56.428378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:56.576819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:56.577445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:56.587078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:56.587889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:56.588517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:56.589463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:56.590040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:56.590300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:56.590910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:56.601700 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a474163d-8430-43a0-867a-7dcc09d739da tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.185446 Oct 16 01:44:56.602875 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3278/6426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:56 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:56.674273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:56.685313 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f4fa139a-f48f-4771-a7a7-319deb7e2744 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1327 microversion: 2.1 time: 0.114732 Oct 16 01:44:56.687903 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3149/6427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:56 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:57.626202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:57.626841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:57.634365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:57.634950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:57.635456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:57.636224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:57.636759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:57.637206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:57.798561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:57.808198 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc4469bb-19d9-4adf-9785-fda741383c6b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.186193 Oct 16 01:44:57.823589 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3279/6428] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:57 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:57.875255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:57.875879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:57.882825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:57.883425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:57.883936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:57.884896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:57.885424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:57.886049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:58.040982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:58.048854 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7540560a-5758-433b-b441-4635ecb08488 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1392 microversion: 2.1 time: 0.340314 Oct 16 01:44:58.059161 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3150/6429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:57 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:44:58.199944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-64663386-a379-4a54-b4da-0a3c3e14ccf5 req-11f04363-49d7-40c5-b4e8-0fecf7064658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f0ad4c-1726-45c9-bd3d-b2be53337d2c", "tag": "63aaa020-62b3-4567-998b-1431bd05a7d8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:44:58.213324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64663386-a379-4a54-b4da-0a3c3e14ccf5 req-11f04363-49d7-40c5-b4e8-0fecf7064658 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:58.214327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64663386-a379-4a54-b4da-0a3c3e14ccf5 req-11f04363-49d7-40c5-b4e8-0fecf7064658 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:58.215150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64663386-a379-4a54-b4da-0a3c3e14ccf5 req-11f04363-49d7-40c5-b4e8-0fecf7064658 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:58.227986 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-64663386-a379-4a54-b4da-0a3c3e14ccf5 req-11f04363-49d7-40c5-b4e8-0fecf7064658 service nova] Creating event network-changed:63aaa020-62b3-4567-998b-1431bd05a7d8 for instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c on n-h1-master-1 Oct 16 01:44:58.233557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-64663386-a379-4a54-b4da-0a3c3e14ccf5 req-11f04363-49d7-40c5-b4e8-0fecf7064658 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037963 Oct 16 01:44:58.234571 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3280/6430] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:44:58.832227 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:58.832846 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:58.840028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:58.840524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:58.840967 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:58.841675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:58.842134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:58.842575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:58.982353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:58.991343 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a49aef36-a0e1-4486-b858-4b8f75f3bdce tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.162964 Oct 16 01:44:58.991911 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3151/6431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:58 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:44:59.074625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:44:59.075298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:44:59.081550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:59.082057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:59.082513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:59.083247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:44:59.083728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:44:59.084175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:44:59.221397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:44:59.229815 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-edf930e3-e98c-41a7-9e83-76b3c23cbf61 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1392 microversion: 2.1 time: 0.160617 Oct 16 01:44:59.230394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3281/6432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:44:59 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:00.013673 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:00.014431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:00.021842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:00.022334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:00.022812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:00.023568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:00.024063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:00.024493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:00.164855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:00.172815 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6c2a6d02-d10d-4446-9700-89017f158485 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.163034 Oct 16 01:45:00.173588 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3152/6433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:00 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:00.255049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:00.255757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:00.263024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:00.263558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:00.264029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:00.264766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:00.265272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:00.265730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:00.405480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:00.414039 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b55ab142-91b6-4292-82b7-1ceaa8c1881e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1392 microversion: 2.1 time: 0.164506 Oct 16 01:45:00.414658 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3282/6434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:00 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:00.893834 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-58b307a9-db77-4ff0-9ffb-5abac3cbf6bc req-31e6c152-6658-4dea-a0bf-4069ce637fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6c8da3-c129-48f7-a984-07c016af226b", "name": "network-vif-plugged", "status": "completed", "tag": "af166b71-e370-4e5a-bd48-5e16173b39ba"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:00.905624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-58b307a9-db77-4ff0-9ffb-5abac3cbf6bc req-31e6c152-6658-4dea-a0bf-4069ce637fe3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:00.906372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-58b307a9-db77-4ff0-9ffb-5abac3cbf6bc req-31e6c152-6658-4dea-a0bf-4069ce637fe3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:00.907138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-58b307a9-db77-4ff0-9ffb-5abac3cbf6bc req-31e6c152-6658-4dea-a0bf-4069ce637fe3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:00.920483 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-58b307a9-db77-4ff0-9ffb-5abac3cbf6bc req-31e6c152-6658-4dea-a0bf-4069ce637fe3 service nova] Creating event network-vif-plugged:af166b71-e370-4e5a-bd48-5e16173b39ba for instance 6f6c8da3-c129-48f7-a984-07c016af226b on n-h2-master-1 Oct 16 01:45:00.927154 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-58b307a9-db77-4ff0-9ffb-5abac3cbf6bc req-31e6c152-6658-4dea-a0bf-4069ce637fe3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Oct 16 01:45:00.928006 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3153/6435] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:45:01.197641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:01.198765 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:01.204799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:01.205377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:01.205888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:01.206655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:01.208461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:01.208974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:01.213356 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:01.350111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:01.359157 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-33c4bb15-5f62-4ea9-a0ab-1ce8818e2923 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.165444 Oct 16 01:45:01.359767 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3283/6436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:01 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:01.439523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:01.440301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:01.447457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:01.447972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:01.448664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:01.449438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:01.449901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:01.450354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:01.586067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:01.594033 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a380876e-144b-4ee6-8b04-03afd766c67f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1392 microversion: 2.1 time: 0.160132 Oct 16 01:45:01.594622 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3154/6437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:01 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:02.382008 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:02.382657 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:02.389493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:02.389982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:02.390513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:02.391232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:02.391699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:02.392132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:02.536613 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:02.550829 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69e7fc81-e2ec-4386-8a43-f6ec421c4d23 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1265 microversion: 2.1 time: 0.172984 Oct 16 01:45:02.551683 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3284/6438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:02 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:02.618131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:02.618963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:02.625070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:02.625562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:02.626003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:02.626702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:02.627186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:02.627620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:02.764584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:02.773958 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ad27daaa-6597-475f-a48b-043825e3d969 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1392 microversion: 2.1 time: 0.160682 Oct 16 01:45:02.774783 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3155/6439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:02 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:02.945872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-cf6c7554-665f-4b31-81d2-f8215e594d9b req-916d647d-c401-4a24-a20c-2b36a967e86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0ad4c-1726-45c9-bd3d-b2be53337d2c", "name": "network-vif-plugged", "status": "completed", "tag": "63aaa020-62b3-4567-998b-1431bd05a7d8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:02.955960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cf6c7554-665f-4b31-81d2-f8215e594d9b req-916d647d-c401-4a24-a20c-2b36a967e86a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:02.956454 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cf6c7554-665f-4b31-81d2-f8215e594d9b req-916d647d-c401-4a24-a20c-2b36a967e86a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:02.957712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cf6c7554-665f-4b31-81d2-f8215e594d9b req-916d647d-c401-4a24-a20c-2b36a967e86a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:02.968573 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-cf6c7554-665f-4b31-81d2-f8215e594d9b req-916d647d-c401-4a24-a20c-2b36a967e86a service nova] Creating event network-vif-plugged:63aaa020-62b3-4567-998b-1431bd05a7d8 for instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c on n-h1-master-1 Oct 16 01:45:02.973756 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-cf6c7554-665f-4b31-81d2-f8215e594d9b req-916d647d-c401-4a24-a20c-2b36a967e86a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032227 Oct 16 01:45:02.974357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3285/6440] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:45:03.573541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:03.574149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:03.580251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:03.580711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:03.581426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:03.582199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:03.582834 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:03.583289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:03.713332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:03.721220 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eb274a63-6f90-4a4e-8495-81083a25a967 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1451 microversion: 2.1 time: 0.151787 Oct 16 01:45:03.721797 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3156/6441] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:03 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:03.744998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:03.745706 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:03.751870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:03.752367 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:03.752813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:03.753521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:03.754096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:03.754539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:03.796667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:03.797308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:03.803524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:03.804018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:03.804458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:03.805159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:03.805622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:03.806047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:03.955547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:03.964637 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-54361c8f-8f3c-41cf-8f17-258e2b5f4c76 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1451 microversion: 2.1 time: 0.224618 Oct 16 01:45:03.965311 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3286/6442] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:03 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1451 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:03.981099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:03.989530 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-65a9e957-3370-4dd4-8ef8-ad3c45e69557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1392 microversion: 2.1 time: 0.196661 Oct 16 01:45:03.990117 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3157/6443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:03 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:45:05.013126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:05.013656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:05.021456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:05.021964 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:05.022417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:05.023161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:05.023637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:05.024078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:05.162596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:05.170318 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-15f558e6-d425-4337-a3ca-8a312298dadc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1565 microversion: 2.1 time: 0.161319 Oct 16 01:45:05.170889 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3287/6444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:05 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:05.194682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:05.195324 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:05.202352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:05.202840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:05.203314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:05.204014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:05.204475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:05.204903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:05.352925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:05.360796 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f8d09921-b4d8-4638-b19d-5c9515f19e01 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1565 microversion: 2.1 time: 0.170716 Oct 16 01:45:05.361380 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3158/6445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:05 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:06.064974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-cf8c09f5-9a1a-4d65-b088-5c86051b377b req-dca8f51b-6dfe-4759-96be-ed6cd0bea741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6c8da3-c129-48f7-a984-07c016af226b", "tag": "af166b71-e370-4e5a-bd48-5e16173b39ba"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:06.076993 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:06.077878 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:06.081567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cf8c09f5-9a1a-4d65-b088-5c86051b377b req-dca8f51b-6dfe-4759-96be-ed6cd0bea741 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:06.083464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cf8c09f5-9a1a-4d65-b088-5c86051b377b req-dca8f51b-6dfe-4759-96be-ed6cd0bea741 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:06.084240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cf8c09f5-9a1a-4d65-b088-5c86051b377b req-dca8f51b-6dfe-4759-96be-ed6cd0bea741 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:06.099329 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-cf8c09f5-9a1a-4d65-b088-5c86051b377b req-dca8f51b-6dfe-4759-96be-ed6cd0bea741 service nova] Creating event network-changed:af166b71-e370-4e5a-bd48-5e16173b39ba for instance 6f6c8da3-c129-48f7-a984-07c016af226b on n-h2-master-1 Oct 16 01:45:06.108071 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-cf8c09f5-9a1a-4d65-b088-5c86051b377b req-dca8f51b-6dfe-4759-96be-ed6cd0bea741 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048654 Oct 16 01:45:06.109353 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3288/6446] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:45:07.187708 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:07.196535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:07.196787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f744d8ac-d9a1-4171-8861-6e1add838d74 req-219a27a2-5bfc-440b-a164-797c0d46119a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f0ad4c-1726-45c9-bd3d-b2be53337d2c", "tag": "63aaa020-62b3-4567-998b-1431bd05a7d8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:07.205239 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:07.214225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:07.214717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:07.215179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:07.215885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:07.216338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:07.216811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:07.221242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f744d8ac-d9a1-4171-8861-6e1add838d74 req-219a27a2-5bfc-440b-a164-797c0d46119a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:07.221733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f744d8ac-d9a1-4171-8861-6e1add838d74 req-219a27a2-5bfc-440b-a164-797c0d46119a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:07.222664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f744d8ac-d9a1-4171-8861-6e1add838d74 req-219a27a2-5bfc-440b-a164-797c0d46119a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:07.242318 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f744d8ac-d9a1-4171-8861-6e1add838d74 req-219a27a2-5bfc-440b-a164-797c0d46119a service nova] Creating event network-changed:63aaa020-62b3-4567-998b-1431bd05a7d8 for instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c on n-h1-master-1 Oct 16 01:45:07.252953 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f744d8ac-d9a1-4171-8861-6e1add838d74 req-219a27a2-5bfc-440b-a164-797c0d46119a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062725 Oct 16 01:45:07.254050 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3289/6447] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:45:07.384360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:07.394072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-17339685-7ecd-4906-80e5-dc789587ebac tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1565 microversion: 2.1 time: 0.211204 Oct 16 01:45:07.395270 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3159/6448] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:07 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:28.646508 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:28.647306 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=28 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:28.652006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:28.654248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:28.661623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:28.662118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:28.662558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:28.663299 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:28.663765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:28.664201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:28.737355 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-84fedbef-c54d-4b72-88ff-43775e3c9071 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c/action" status: 200 len: 24568 microversion: 2.1 time: 0.093099 Oct 16 01:45:28.737989 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3290/6449] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:45:28 2022] POST /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c/action => generated 24568 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:45:35.388824 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:35.389582 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=64 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:35.491401 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:35.491903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:35.498018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:35.498503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:35.499019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:35.499715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:35.500814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:35.501303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:35.526533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:45:35.605784 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ea29d1cf-2029-44d4-ad43-a3a598b4156f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "DELETE /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 204 len: 0 microversion: 2.1 time: 0.221684 Oct 16 01:45:35.606544 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3160/6450] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:45:35 2022] DELETE /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:45:35.617192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:35.617895 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:35.625045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:35.625693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:35.626147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:35.626902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:35.627474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:35.627916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:35.767700 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:35.775790 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ae88f1b-f954-429f-bb34-012705d28c7f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1731 microversion: 2.1 time: 0.163489 Oct 16 01:45:35.776440 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3291/6451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:35 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:45:36.800986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:36.801696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:36.808653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:36.809152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:36.809589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:36.810281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:36.810740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:36.811262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:37.003188 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:37.010993 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b6b8ba8-1bd5-48e6-9eb7-c0481ad6f6c9 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1731 microversion: 2.1 time: 0.214295 Oct 16 01:45:37.011589 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3161/6452] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:36 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:38.035996 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:38.036758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:38.047977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:38.049145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:38.049786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:38.050548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:38.051056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:38.051500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:38.117990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f58f86160d54e0380ff27912f42417d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6724e74aa140e7826844a05b404a27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:38.126740 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2b875e12-d56f-41f3-b969-31079c154f5e tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 200 len: 1663 microversion: 2.1 time: 0.095563 Oct 16 01:45:38.134988 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3292/6453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:38 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 1663 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:38.162292 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c92bd4b1-3a6c-4458-a29d-e6d9eddc5efc req-f70d6ee7-8479-479a-a6aa-23179d24c2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d1fbc4-9d61-43cd-bae6-47522cbfbc03", "name": "network-vif-deleted", "tag": "260b02af-28ba-40a1-a575-070f9c4872f9"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:38.173274 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c92bd4b1-3a6c-4458-a29d-e6d9eddc5efc req-f70d6ee7-8479-479a-a6aa-23179d24c2f6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:38.173770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c92bd4b1-3a6c-4458-a29d-e6d9eddc5efc req-f70d6ee7-8479-479a-a6aa-23179d24c2f6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:38.174210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c92bd4b1-3a6c-4458-a29d-e6d9eddc5efc req-f70d6ee7-8479-479a-a6aa-23179d24c2f6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:38.185848 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c92bd4b1-3a6c-4458-a29d-e6d9eddc5efc req-f70d6ee7-8479-479a-a6aa-23179d24c2f6 service nova] Creating event network-vif-deleted:260b02af-28ba-40a1-a575-070f9c4872f9 for instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 on n-h1-master-1 Oct 16 01:45:38.190767 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c92bd4b1-3a6c-4458-a29d-e6d9eddc5efc req-f70d6ee7-8479-479a-a6aa-23179d24c2f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032113 Oct 16 01:45:38.191752 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3162/6454] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:45:39.153153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:39.153943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:39.161958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:39.162323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:39.162777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:39.163576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:39.164001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:39.164440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:39.179848 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] HTTP exception thrown: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Request method failure captured: Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 HTTP/1.1 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2EBO4qqodCpNd92RzCOAd2cDpOoknpbtJ933ZQmi5H8l9D8GVCkpshzWm97Q5qC__OyXDPr53r7AqC-fAj98rbEwexgYWkbNou7bqIx80k1dbW4nQ-V8Rgy7Z_fkkFO44QTcPkWIXhA95OipJt30pPeYfC6n3chdOmkHwUP9GUHAzE Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: ec6724e74aa140e7826844a05b404a27 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec6724e74aa140e7826844a05b404a27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: ec6724e74aa140e7826844a05b404a27 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestServerBasicOps-537955442-project Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7f58f86160d54e0380ff27912f42417d Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestServerBasicOps-537955442-project Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '60d1fbc4-9d61-43cd-bae6-47522cbfbc03'} Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:45:39.181699 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Returning 404 to user: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-245c3e8c-c73e-4648-86ea-663f924bec37 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 404 len: 111 microversion: 2.1 time: 0.033995 Oct 16 01:45:39.188523 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3293/6455] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:39 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:45:39.792224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:39.793165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:39.801497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:39.802195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:39.802698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:39.803592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:39.804260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:39.804738 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:39.909201 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:39.909873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:39.917198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:39.917517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:39.918178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:39.918951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:39.919410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:39.919843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:39.936181 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] HTTP exception thrown: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Request method failure captured: Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 HTTP/1.1 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2EBO4qqodCpNd92RzCOAd2cDpOoknpbtJ933ZQmi5H8l9D8GVCkpshzWm97Q5qC__OyXDPr53r7AqC-fAj98rbEwexgYWkbNou7bqIx80k1dbW4nQ-V8Rgy7Z_fkkFO44QTcPkWIXhA95OipJt30pPeYfC6n3chdOmkHwUP9GUHAzE Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: ec6724e74aa140e7826844a05b404a27 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec6724e74aa140e7826844a05b404a27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: ec6724e74aa140e7826844a05b404a27 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestServerBasicOps-537955442-project Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7f58f86160d54e0380ff27912f42417d Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestServerBasicOps-537955442-project Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '60d1fbc4-9d61-43cd-bae6-47522cbfbc03'} Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:45:39.937884 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Returning 404 to user: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e58ccb9-e79a-4b7b-a540-6aaadf22ebb4 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "DELETE /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 404 len: 111 microversion: 2.1 time: 0.034840 Oct 16 01:45:39.944603 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3294/6456] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:45:39 2022] DELETE /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:45:39.948277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:39.948892 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] [instance: 60d1fbc4-9d61-43cd-bae6-47522cbfbc03] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:39.955616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:39.956190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:39.956638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:39.957344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:39.957843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:39.958244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:39.963970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:39.974541 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] HTTP exception thrown: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.974899 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9843918e-97e0-47ab-863d-e35a2ea50e6a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1683 microversion: 2.1 time: 0.189736 Oct 16 01:45:39.975456 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3163/6457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:39 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Request method failure captured: Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 HTTP/1.1 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2EBO4qqodCpNd92RzCOAd2cDpOoknpbtJ933ZQmi5H8l9D8GVCkpshzWm97Q5qC__OyXDPr53r7AqC-fAj98rbEwexgYWkbNou7bqIx80k1dbW4nQ-V8Rgy7Z_fkkFO44QTcPkWIXhA95OipJt30pPeYfC6n3chdOmkHwUP9GUHAzE Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: ec6724e74aa140e7826844a05b404a27 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec6724e74aa140e7826844a05b404a27", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec6724e74aa140e7826844a05b404a27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: ec6724e74aa140e7826844a05b404a27 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestServerBasicOps-537955442 Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestServerBasicOps-537955442-project Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 7f58f86160d54e0380ff27912f42417d Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestServerBasicOps-537955442-project Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '60d1fbc4-9d61-43cd-bae6-47522cbfbc03'} Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:45:39.976288 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Returning 404 to user: Instance 60d1fbc4-9d61-43cd-bae6-47522cbfbc03 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5e5346a-fe1a-4ef7-bc92-9ee0b7c0a7d2 tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03" status: 404 len: 111 microversion: 2.1 time: 0.033562 Oct 16 01:45:39.983189 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3295/6458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:39 2022] GET /compute/v2.1/servers/60d1fbc4-9d61-43cd-bae6-47522cbfbc03 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:45:40.124998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:40.128107 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:40.134104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:40.134611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:40.135062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:40.135753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:40.136207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:40.136632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:40.206382 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ca439a0d-96f2-4ebf-b875-b751a8ca928a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c/action" status: 200 len: 32636 microversion: 2.1 time: 0.085239 Oct 16 01:45:40.210110 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3164/6459] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:45:40 2022] POST /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c/action => generated 32636 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:45:40.237818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f03e0f1-7a12-46eb-877c-251dfeaddd1f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] Calling method '.version_select at 0x7fd6527f7040>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:40.261189 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f03e0f1-7a12-46eb-877c-251dfeaddd1f tempest-TestServerBasicOps-537955442 tempest-TestServerBasicOps-537955442-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1929315166" status: 202 len: 0 microversion: 2.1 time: 0.027586 Oct 16 01:45:40.261739 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3296/6460] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 01:45:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1929315166 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:45:40.502224 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:40.504036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:40.511340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:40.511824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:40.512371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:40.513075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:40.513580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:40.514141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:40.668711 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7e72aa5d-25e7-4de3-9df8-d13d2254fe50 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1834 microversion: 2.1 time: 0.311972 Oct 16 01:45:40.669596 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3165/6461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:40 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1834 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:45:40.701605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:40.705073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:40.712593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:40.713237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:40.713935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:40.714752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:40.715374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:40.715889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:40.742291 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lazy-loading 'flavor' on Instance uuid 49f0ad4c-1726-45c9-bd3d-b2be53337d2c {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:45:40.757436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Going to try to live migrate instance to another host {{(pid=120545) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 16 01:45:42.298192 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e6e21b1-2056-4db4-9c69-cae5758d05e5 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c/action" status: 202 len: 0 microversion: 2.1 time: 1.600744 Oct 16 01:45:42.299159 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3297/6462] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:45:40 2022] POST /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c/action => generated 0 bytes in 1603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:45:42.310102 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:42.311663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:42.322828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:42.323865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:42.324577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:42.325516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:42.326189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:42.326842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:42.843469 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:42.860451 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-14e521ec-5fed-43db-8568-0691515e6259 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1693 microversion: 2.1 time: 0.555408 Oct 16 01:45:42.874971 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3166/6463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:42 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1693 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:43.888823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:43.890719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:43.899688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:43.900790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:43.901643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:43.902894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:43.903784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:43.904409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:43.914170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-76626551-53a6-44a2-878b-b11671dec350 req-a47e9075-fb22-4051-98f5-ff35c39b5b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0ad4c-1726-45c9-bd3d-b2be53337d2c", "name": "network-vif-unplugged", "status": "completed", "tag": "63aaa020-62b3-4567-998b-1431bd05a7d8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:43.927961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-76626551-53a6-44a2-878b-b11671dec350 req-a47e9075-fb22-4051-98f5-ff35c39b5b2a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:43.928578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-76626551-53a6-44a2-878b-b11671dec350 req-a47e9075-fb22-4051-98f5-ff35c39b5b2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:43.929110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-76626551-53a6-44a2-878b-b11671dec350 req-a47e9075-fb22-4051-98f5-ff35c39b5b2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:43.954033 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-76626551-53a6-44a2-878b-b11671dec350 req-a47e9075-fb22-4051-98f5-ff35c39b5b2a service nova] Creating event network-vif-unplugged:63aaa020-62b3-4567-998b-1431bd05a7d8 for instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c on n-h1-master-1 Oct 16 01:45:43.963721 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-76626551-53a6-44a2-878b-b11671dec350 req-a47e9075-fb22-4051-98f5-ff35c39b5b2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053241 Oct 16 01:45:43.964459 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3167/6464] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:45:44.260018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:44.269610 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bb792496-7a4c-4f2f-b5ea-6789d8afd3b6 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1693 microversion: 2.1 time: 0.384706 Oct 16 01:45:44.270423 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3298/6465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:43 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1693 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:45.294595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:45.295569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:45.302298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:45.302789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:45.303257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:45.303956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:45.304423 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:45.304845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:45.443825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:45.452365 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-18eb86d4-96ff-4e6c-8024-d714b83ee4a1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1693 microversion: 2.1 time: 0.163252 Oct 16 01:45:45.453046 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3168/6466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:45 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:45.982009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-19db24a2-7b78-4d9a-96d1-3fa2143159e1 req-55c78de7-d8ce-4145-84fb-5808e47fcc6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f0ad4c-1726-45c9-bd3d-b2be53337d2c", "tag": "63aaa020-62b3-4567-998b-1431bd05a7d8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:45.995305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-19db24a2-7b78-4d9a-96d1-3fa2143159e1 req-55c78de7-d8ce-4145-84fb-5808e47fcc6d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:45.995802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-19db24a2-7b78-4d9a-96d1-3fa2143159e1 req-55c78de7-d8ce-4145-84fb-5808e47fcc6d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:45.996242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-19db24a2-7b78-4d9a-96d1-3fa2143159e1 req-55c78de7-d8ce-4145-84fb-5808e47fcc6d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:46.007302 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-19db24a2-7b78-4d9a-96d1-3fa2143159e1 req-55c78de7-d8ce-4145-84fb-5808e47fcc6d service nova] Creating event network-changed:63aaa020-62b3-4567-998b-1431bd05a7d8 for instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c on n-h1-master-1 Oct 16 01:45:46.012519 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-19db24a2-7b78-4d9a-96d1-3fa2143159e1 req-55c78de7-d8ce-4145-84fb-5808e47fcc6d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034301 Oct 16 01:45:46.013122 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3299/6467] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:45:46.476037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:46.476879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:46.488463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:46.489195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:46.491737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:46.492550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:46.493087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:46.496822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:46.806935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:46.816469 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ddd39fe5-eabb-4288-95cb-13f87e3268d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1693 microversion: 2.1 time: 0.344234 Oct 16 01:45:46.817333 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3169/6468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:46 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1693 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:47.853693 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:47.854515 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:47.861942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:47.862555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:47.863118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:47.863911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:47.864495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:47.865132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:48.099993 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:48.108080 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-11868683-a36a-4a0d-8148-4ea7221d4aee tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1693 microversion: 2.1 time: 0.265000 Oct 16 01:45:48.110551 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3300/6469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:47 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1693 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:49.132655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:49.133841 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:49.142465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:49.143022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:49.143689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:49.144404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:49.144864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:49.145294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:49.284903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:49.292890 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-31b5b292-e069-43a4-9ece-7f228698777a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1693 microversion: 2.1 time: 0.164110 Oct 16 01:45:49.293458 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3170/6470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:49 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:50.318329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:50.319706 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:50.331951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:50.333353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:50.334528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:50.336298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:50.337502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:50.338342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:50.656904 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:50.665677 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7c98d848-8508-4125-8de7-a7468d812f73 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1693 microversion: 2.1 time: 0.351608 Oct 16 01:45:50.666167 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3301/6471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:50 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1693 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:51.690570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:51.692129 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:51.700550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:51.701204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:51.701915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:51.702723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:51.703872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:51.704406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:51.960764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:51.970123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-94ce2cd3-78a6-48e1-ada6-512e2991607b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1683 microversion: 2.1 time: 0.284223 Oct 16 01:45:51.971103 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3171/6472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:51 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1683 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:51.993334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:51.994270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:52.003009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:52.003604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:52.004142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:52.004934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:52.005656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:52.006210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:52.253013 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-418c2807-780f-4368-80a4-2ee79908f4b6 tempest-TestNetworkAdvancedServerOps-209824587 tempest-TestNetworkAdvancedServerOps-209824587-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1834 microversion: 2.1 time: 0.263256 Oct 16 01:45:52.266736 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3302/6473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:51 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1834 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:52.278603 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:52.279252 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:52.295602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:52.296111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:52.296550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:52.297288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:52.298019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:52.298160 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:52.533506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:52.543710 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-50d1324b-c3fa-424d-b38f-a96e16281f8e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1683 microversion: 2.1 time: 0.269476 Oct 16 01:45:52.560203 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3172/6474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:52 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1683 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:52.700354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:52.704437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:52.714332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:52.715402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:52.723864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:52.727207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:52.729440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:52.730200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:52.854994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6b37f5ee-36d3-4103-9166-85f6a2d88195 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c/action" status: 200 len: 38655 microversion: 2.1 time: 0.158851 Oct 16 01:45:52.855669 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3303/6475] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:45:52 2022] POST /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c/action => generated 38655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:45:54.079513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:54.080189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:54.102836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-074e695f-9a42-40e9-b999-828bd128ea49 req-90718a2e-f344-452c-b1b3-f0a2c251ea79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f0ad4c-1726-45c9-bd3d-b2be53337d2c", "tag": "63aaa020-62b3-4567-998b-1431bd05a7d8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:54.115466 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:54.119291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:54.119863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:54.127145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:54.131257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:54.131806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:54.138319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-074e695f-9a42-40e9-b999-828bd128ea49 req-90718a2e-f344-452c-b1b3-f0a2c251ea79 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:54.145512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-074e695f-9a42-40e9-b999-828bd128ea49 req-90718a2e-f344-452c-b1b3-f0a2c251ea79 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:54.147470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-074e695f-9a42-40e9-b999-828bd128ea49 req-90718a2e-f344-452c-b1b3-f0a2c251ea79 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:54.164231 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-074e695f-9a42-40e9-b999-828bd128ea49 req-90718a2e-f344-452c-b1b3-f0a2c251ea79 service nova] Creating event network-changed:63aaa020-62b3-4567-998b-1431bd05a7d8 for instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c on n-h2-master-1 Oct 16 01:45:54.177502 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-074e695f-9a42-40e9-b999-828bd128ea49 req-90718a2e-f344-452c-b1b3-f0a2c251ea79 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080401 Oct 16 01:45:54.179713 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3304/6476] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:45:54.217574 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:45:54.361363 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58c29f32-5c96-4693-92e9-d76a523bc4cb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "DELETE /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 204 len: 0 microversion: 2.1 time: 0.284478 Oct 16 01:45:54.365397 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3173/6477] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:45:54 2022] DELETE /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:45:54.372905 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:54.373627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:54.382693 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:54.383298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:54.383825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:54.385639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:54.386378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:54.387021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:54.629117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:54.638455 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d60bbac3-ee30-4a7f-869d-7ce3b883d107 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1689 microversion: 2.1 time: 0.271439 Oct 16 01:45:54.642987 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3305/6478] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:54 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1689 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:55.679059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:55.680774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:55.690698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:55.694369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:55.695268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:55.696472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:55.697496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:55.699611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:55.778388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:45:55.783473 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:45:55.788937 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd450126-3301-4eb7-84cc-6f3421af5aea tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 200 len: 1504 microversion: 2.1 time: 0.130194 Oct 16 01:45:55.790073 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3174/6479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:55 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 1504 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:45:56.194142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5388c461-98f0-470d-9e50-929012b5e8ab req-c9b06856-dacb-4bda-9668-f0741f3db09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f0ad4c-1726-45c9-bd3d-b2be53337d2c", "name": "network-vif-deleted", "tag": "63aaa020-62b3-4567-998b-1431bd05a7d8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:45:56.225966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5388c461-98f0-470d-9e50-929012b5e8ab req-c9b06856-dacb-4bda-9668-f0741f3db09d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:56.226818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5388c461-98f0-470d-9e50-929012b5e8ab req-c9b06856-dacb-4bda-9668-f0741f3db09d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:56.227504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5388c461-98f0-470d-9e50-929012b5e8ab req-c9b06856-dacb-4bda-9668-f0741f3db09d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:56.241444 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5388c461-98f0-470d-9e50-929012b5e8ab req-c9b06856-dacb-4bda-9668-f0741f3db09d service nova] Creating event network-vif-deleted:63aaa020-62b3-4567-998b-1431bd05a7d8 for instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c on n-h2-master-1 Oct 16 01:45:56.247505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5388c461-98f0-470d-9e50-929012b5e8ab req-c9b06856-dacb-4bda-9668-f0741f3db09d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056807 Oct 16 01:45:56.247931 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3306/6480] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:45:56.814491 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:45:56.815211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 49f0ad4c-1726-45c9-bd3d-b2be53337d2c] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:45:56.822704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:56.823458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:56.824091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:56.824795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:45:56.825433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:45:56.825860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:45:56.841922 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] HTTP exception thrown: Instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c could not be found. Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Request method failure captured: Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c HTTP/1.1 Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2DqN-UT2falK72w98Rw1ecfssH-Glws7VEsKQiphDY1d9smk-R1JvXKD0Dqf8PxLYTV6aXG--fD5W0nuCIGhiXXhaSUnqm_oKesChDekdLqyYd1pPTaNQL6VFOZHf4uXw0-kS8HODdK0elzb0ty6zGgXYWz06m-gK8IoUVR5r7Q9Eg Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 855792b0264144dd941200c8468ac26d Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_855792b0264144dd941200c8468ac26d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/855792b0264144dd941200c8468ac26d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/855792b0264144dd941200c8468ac26d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/855792b0264144dd941200c8468ac26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 855792b0264144dd941200c8468ac26d Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestNetworkAdvancedServerOps-1761159727-project Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 83bbcff8a1f64cfa936f13f3cb3955b6 Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1761159727-project Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c could not be found. Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '49f0ad4c-1726-45c9-bd3d-b2be53337d2c'} Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c could not be found. Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c could not be found. Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:45:56.844661 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:45:56.850101 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:45:56.850101 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:45:56.850101 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:45:56.850101 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:45:56.850101 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:45:56.850101 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:45:56.850101 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c could not be found. Oct 16 01:45:56.850101 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:45:56.851487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Returning 404 to user: Instance 49f0ad4c-1726-45c9-bd3d-b2be53337d2c could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:45:56.852765 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-72d9ddb1-c1e8-4eb0-96c5-6703ee7fa1d2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c" status: 404 len: 111 microversion: 2.1 time: 0.043272 Oct 16 01:45:56.853523 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3175/6481] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:45:56 2022] GET /compute/v2.1/servers/49f0ad4c-1726-45c9-bd3d-b2be53337d2c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:46:02.331798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-300b0ee1-c950-4666-823e-283e2244cb69 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '.version_select at 0x7fd6527a28b0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:02.366763 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:02.388339 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-300b0ee1-c950-4666-823e-283e2244cb69 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1860243640" status: 202 len: 0 microversion: 2.1 time: 0.065603 Oct 16 01:46:02.388906 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3307/6482] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Oct 16 01:46:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1860243640 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:46:02.428528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19229c8f-2770-422f-b0b9-efcf51c31f11 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'create', calling method: .version_select at 0x7fd64cedfaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-43919134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFH66tF+h4Ya+nShJKSRMtRNrtDEa7/1ZxUBgwcCKW/zaQ1lkSTG1nTw83KXOAgXNILIhOdMK/Yo3yE9pkJi4ctwk7277J9ymKWjqpRbcu6DocVigYNMVKWhbF3El4kD+w=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:46:02.471657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-19229c8f-2770-422f-b0b9-efcf51c31f11 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for project 855792b0264144dd941200c8468ac26d. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:46:02.480601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-19229c8f-2770-422f-b0b9-efcf51c31f11 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for user 83bbcff8a1f64cfa936f13f3cb3955b6 and project 855792b0264144dd941200c8468ac26d. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:46:02.525586 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19229c8f-2770-422f-b0b9-efcf51c31f11 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.100713 Oct 16 01:46:02.526895 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3176/6483] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:46:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:46:09.571987 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:09.576883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-371510471", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "b2a63abb-c86d-4cb3-81de-254eb3e6777b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-43919134", "security_groups": [{"name": "tempest-secgroup-smoke-1210889243"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:46:09.743415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] validate_networks() for [('b2a63abb-c86d-4cb3-81de-254eb3e6777b', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:46:10.213662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:46:10.214352 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:46:10.214940 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:46:10.215382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:46:10.215881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:46:10.232645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:10.233968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:10.235257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:10.236021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:10.236643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:10.237733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:10.293256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for project 855792b0264144dd941200c8468ac26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:46:10.300958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Getting quotas for user 83bbcff8a1f64cfa936f13f3cb3955b6 and project 855792b0264144dd941200c8468ac26d. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:46:10.320644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:46:10.323535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:46:10.388803 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-46210ac4-3984-4ba2-a140-27dc557c2657 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818372 Oct 16 01:46:10.390828 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3308/6484] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:46:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:46:10.401976 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:10.424306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fadba4c2-9360-4a38-aab5-c8abf43e6561 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:10.425032 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fadba4c2-9360-4a38-aab5-c8abf43e6561 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:10.429128 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:10.540806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fadba4c2-9360-4a38-aab5-c8abf43e6561 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:10.566670 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fadba4c2-9360-4a38-aab5-c8abf43e6561 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1264 microversion: 2.1 time: 0.168030 Oct 16 01:46:10.567952 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3177/6485] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:10 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:11.596676 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:11.597325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:11.607167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:11.607722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:11.608428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:11.609168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:11.609649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:11.610096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:11.675082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:11.683205 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-79d0a58f-facf-4ab0-8925-694fddd47c1a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1316 microversion: 2.1 time: 0.091656 Oct 16 01:46:11.699253 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3309/6486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:11 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1316 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:12.709123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:12.709749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:12.728315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:12.728735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:12.729219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:12.732092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:12.733386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:12.733863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:12.948928 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:12.958838 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30b6b63f-e7fc-46c2-b565-9b6d777c788b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1390 microversion: 2.1 time: 0.254450 Oct 16 01:46:12.960074 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3178/6487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:12 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1390 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:13.550536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6546f8f9-c531-4f49-9be0-e97705372c01 req-135367bb-4f04-489c-b64b-6da02e4f434f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6d8e6b-c1dd-4670-9335-672524f8d724", "tag": "7fdd44e5-1c5d-4bad-8062-db62fcf85bff"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:46:13.574154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6546f8f9-c531-4f49-9be0-e97705372c01 req-135367bb-4f04-489c-b64b-6da02e4f434f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:13.575873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6546f8f9-c531-4f49-9be0-e97705372c01 req-135367bb-4f04-489c-b64b-6da02e4f434f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:13.576980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6546f8f9-c531-4f49-9be0-e97705372c01 req-135367bb-4f04-489c-b64b-6da02e4f434f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:13.591197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6546f8f9-c531-4f49-9be0-e97705372c01 req-135367bb-4f04-489c-b64b-6da02e4f434f service nova] Creating event network-changed:7fdd44e5-1c5d-4bad-8062-db62fcf85bff for instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 on n-h1-master-1 Oct 16 01:46:13.597563 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6546f8f9-c531-4f49-9be0-e97705372c01 req-135367bb-4f04-489c-b64b-6da02e4f434f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050917 Oct 16 01:46:13.598465 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3310/6488] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:46:13.983832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:13.984763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:13.992704 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:13.993426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:13.994030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:13.994961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:13.995566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:13.996222 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:14.202805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:14.211172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-08e36a33-86af-44dc-ab9e-086ed4cf9242 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1390 microversion: 2.1 time: 0.231375 Oct 16 01:46:14.211857 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3179/6489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:13 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:15.237759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:15.238472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:15.244826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:15.245329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:15.245961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:15.246689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:15.247196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:15.247642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:15.395647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:15.404847 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-63afbeaf-20ae-47d3-b6a3-2058bfcfaac7 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1390 microversion: 2.1 time: 0.172935 Oct 16 01:46:15.406258 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3311/6490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:15 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:16.428305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:16.428919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:16.436768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:16.437251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:16.437691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:16.438394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:16.438856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:16.439332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:16.581003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:16.589084 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be750ba5-f14a-47d2-a7d5-f2d9cf529130 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1390 microversion: 2.1 time: 0.164638 Oct 16 01:46:16.589712 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3180/6491] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:16 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:17.611736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:17.612386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:17.619579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:17.620083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:17.620557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:17.621289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:17.621758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:17.622195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:17.765425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:17.773320 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a063a05d-54c5-43da-ae88-6a83889e3137 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1390 microversion: 2.1 time: 0.165690 Oct 16 01:46:17.774009 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3312/6492] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:17 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:18.796843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:18.797469 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:18.804375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:18.804855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:18.805286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:18.805974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:18.806429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:18.806850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:19.028818 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-dbf64023-44a4-4168-98f5-081fcee4fe6a req-09a79741-d365-4b5f-bd2d-d80cff914945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6d8e6b-c1dd-4670-9335-672524f8d724", "name": "network-vif-plugged", "status": "completed", "tag": "7fdd44e5-1c5d-4bad-8062-db62fcf85bff"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:46:19.048139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-dbf64023-44a4-4168-98f5-081fcee4fe6a req-09a79741-d365-4b5f-bd2d-d80cff914945 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:19.049060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-dbf64023-44a4-4168-98f5-081fcee4fe6a req-09a79741-d365-4b5f-bd2d-d80cff914945 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:19.049620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-dbf64023-44a4-4168-98f5-081fcee4fe6a req-09a79741-d365-4b5f-bd2d-d80cff914945 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:19.066435 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-dbf64023-44a4-4168-98f5-081fcee4fe6a req-09a79741-d365-4b5f-bd2d-d80cff914945 service nova] Creating event network-vif-plugged:7fdd44e5-1c5d-4bad-8062-db62fcf85bff for instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 on n-h1-master-1 Oct 16 01:46:19.073603 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-dbf64023-44a4-4168-98f5-081fcee4fe6a req-09a79741-d365-4b5f-bd2d-d80cff914945 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048689 Oct 16 01:46:19.075530 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3313/6493] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:46:19.266405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:19.274162 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba23c7d4-221f-4e95-adf3-0e07ba987199 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1390 microversion: 2.1 time: 0.482257 Oct 16 01:46:19.274734 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3181/6494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:18 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1390 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:20.301934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:20.303142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:20.310278 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:20.315725 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:20.321528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:20.322162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:20.324298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:20.326870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:20.327619 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:20.329063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:20.505893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:20.513752 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-51fad5e4-2eb4-454f-a27a-f0cbdec81beb tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1562 microversion: 2.1 time: 0.219031 Oct 16 01:46:20.514893 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3314/6495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:20 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:20.537859 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:20.538472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:20.546359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:20.546852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:20.547337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:20.548046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:20.548515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:20.548945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:20.567869 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:20.684543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:20.692640 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eca3e11e-6474-462a-a49d-9e6f29e2adc9 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1562 microversion: 2.1 time: 0.158611 Oct 16 01:46:20.693214 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3182/6496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:20 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:22.662233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:22.662901 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:22.667547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2acbaf39-3402-4fda-a07c-8f0205cff2f4 req-b162a730-5fb3-4aa9-80f3-98610b04f817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6d8e6b-c1dd-4670-9335-672524f8d724", "tag": "7fdd44e5-1c5d-4bad-8062-db62fcf85bff"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:46:22.672187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:22.672947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:22.673581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:22.674479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:22.675462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:22.676057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:22.678841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2acbaf39-3402-4fda-a07c-8f0205cff2f4 req-b162a730-5fb3-4aa9-80f3-98610b04f817 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:22.679354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2acbaf39-3402-4fda-a07c-8f0205cff2f4 req-b162a730-5fb3-4aa9-80f3-98610b04f817 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:22.679790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2acbaf39-3402-4fda-a07c-8f0205cff2f4 req-b162a730-5fb3-4aa9-80f3-98610b04f817 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:22.694404 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2acbaf39-3402-4fda-a07c-8f0205cff2f4 req-b162a730-5fb3-4aa9-80f3-98610b04f817 service nova] Creating event network-changed:7fdd44e5-1c5d-4bad-8062-db62fcf85bff for instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 on n-h1-master-1 Oct 16 01:46:22.699986 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2acbaf39-3402-4fda-a07c-8f0205cff2f4 req-b162a730-5fb3-4aa9-80f3-98610b04f817 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036241 Oct 16 01:46:22.701178 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3183/6497] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:46:22.864891 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:22.874773 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c653dc9b-5a24-4bb1-8f57-97738e04294e tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1562 microversion: 2.1 time: 0.216808 Oct 16 01:46:22.875412 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3315/6498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:22 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1562 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:44.145761 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=15 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:44.146419 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=32 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:44.151106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:46:44.154580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:44.161463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:44.161943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:44.162378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:44.163091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:44.163587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:44.164009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:44.236170 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0e5cd02f-9bbc-42e0-8fb4-7840d70ff557 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724/action" status: 200 len: 24568 microversion: 2.1 time: 0.092818 Oct 16 01:46:44.237636 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3184/6499] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:46:44 2022] POST /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724/action => generated 24568 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:46:55.325498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:46:55.328405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:55.330706 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:55.331457 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=36 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:55.338322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:55.338939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:55.339495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:55.340815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:55.341287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:55.341722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:55.427473 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:46:55.427910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:46:55.428530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:46:55.428817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:46:55.429252 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:46:55.492232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:55.498675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:55.499203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:55.499888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:55.500491 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:55.500971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:55.501443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:55.528364 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-02a81fdd-dd49-43f3-ad0c-f2eda0f87cc0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724/action" status: 202 len: 1136 microversion: 2.1 time: 0.208255 Oct 16 01:46:55.529019 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3316/6500] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:46:55 2022] POST /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724/action => generated 1136 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 16 01:46:55.549632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:55.550332 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:55.553169 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:55.553979 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:46:55.561547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:55.562041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:55.562519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:55.563252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:55.563710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:55.564530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:55.702515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:55.711572 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51084648-97c8-4ea8-8b58-569b5302b61c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.166064 Oct 16 01:46:55.713131 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3185/6501] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:55 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:56.737293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:56.737821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:56.744774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:56.745335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:56.746257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:56.747363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:56.747886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:56.748326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:56.897259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:56.906348 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cee4279a-b6aa-4caf-846e-95e83244e5a2 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.172961 Oct 16 01:46:56.911033 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3317/6502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:56 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:57.932479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:57.933189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:57.941128 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:57.941626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:57.942068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:57.942788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:57.943279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:57.944129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:58.089670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:58.097507 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8ea4513-722a-490e-87e5-cb2a2827694f tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.169081 Oct 16 01:46:58.098101 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3186/6503] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:57 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:46:59.122603 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:46:59.124087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:46:59.134133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:59.135346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:59.137476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:59.138210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:46:59.138684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:46:59.139152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:46:59.275362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:46:59.283158 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c5c1c197-4110-42dc-af5c-61218fb5d4f3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.165379 Oct 16 01:46:59.283738 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3318/6504] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:46:59 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:00.308063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:00.309210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:00.316167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:00.316656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:00.317090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:00.317809 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:00.318261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:00.318959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:00.458997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:00.467191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7448ee6b-495f-4d1e-8d41-6de38ffde7dd tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.163186 Oct 16 01:47:00.467765 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3187/6505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:00 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:01.490258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:01.490969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:01.497823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:01.498318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:01.498760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:01.499483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:01.499955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:01.500390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:01.634948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:01.643306 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bc241b45-14b4-497f-bb78-86db946b7ed0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.157027 Oct 16 01:47:01.644063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3319/6506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:01 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:02.666430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:02.667885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:02.674798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:02.675355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:02.675830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:02.676534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:02.677000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:02.677436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:02.807749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:02.815833 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-892b2d3d-b6e8-4873-952a-77e9c4ec6269 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.153301 Oct 16 01:47:02.816414 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3188/6507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:02 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:03.680121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:03.681259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:03.690271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:03.690798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:03.691278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:03.691991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:03.692462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:03.692895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:03.718719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:47:03.802940 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8c6e6c0d-9fd9-4bd5-b46b-85613a616829 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 204 len: 0 microversion: 2.1 time: 0.126289 Oct 16 01:47:03.803541 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3320/6508] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:47:03 2022] DELETE /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:47:03.816393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:03.817063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:03.824092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:03.824568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:03.825249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:03.825714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:03.826180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:03.826613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:03.840614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:03.841322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:03.847270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:03.847770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:03.848224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:03.848920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:03.849391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:03.849831 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:04.033475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:04.041527 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-00963b61-4be3-4a20-ab5b-e93ec574f4e2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1576 microversion: 2.1 time: 0.232519 Oct 16 01:47:04.042903 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3189/6509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:03 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:04.056383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:04.065010 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4577734e-3ddc-496e-aef7-b6f50440d2c0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.228802 Oct 16 01:47:04.065816 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3321/6510] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:03 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:47:05.064778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:05.065400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:05.072615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:05.073697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:05.074162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:05.074860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:05.075350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:05.075781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:05.090142 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:05.091955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:05.099427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:05.099925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:05.100557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:05.101421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:05.102190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:05.102772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:05.275721 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:05.285369 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0a6804c0-d1d3-4b09-afa3-460d3366852c tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1576 microversion: 2.1 time: 0.224509 Oct 16 01:47:05.286639 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3190/6511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:05 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:05.289948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:05.299007 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1fdc789e-d9bc-43cf-8148-ad5b9f7fdd5b tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.213620 Oct 16 01:47:05.299714 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3322/6512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:05 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:06.311750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:06.312372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:06.320266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:06.320767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:06.321213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:06.321924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:06.322397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:06.322832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:06.323800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:06.325308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:06.342485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:06.343026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:06.343483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:06.344212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:06.344691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:06.345144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:06.478516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:06.487803 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e347efc0-9249-4a17-a574-67c69c7a8299 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1509 microversion: 2.1 time: 0.180485 Oct 16 01:47:06.488395 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3191/6513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:06 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:06.642771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:06.651246 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ce552516-800a-4a09-baa6-3e14ac1135ff tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.331413 Oct 16 01:47:06.652088 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3323/6514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:06 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:47:06.818176 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-bc1b4892-b452-44a5-951d-9d2f357fb7cd req-5606d493-311e-471f-9b6e-ce62820e4f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6c8da3-c129-48f7-a984-07c016af226b", "name": "network-vif-deleted", "tag": "af166b71-e370-4e5a-bd48-5e16173b39ba"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:06.835806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bc1b4892-b452-44a5-951d-9d2f357fb7cd req-5606d493-311e-471f-9b6e-ce62820e4f50 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:06.836299 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bc1b4892-b452-44a5-951d-9d2f357fb7cd req-5606d493-311e-471f-9b6e-ce62820e4f50 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:06.836740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bc1b4892-b452-44a5-951d-9d2f357fb7cd req-5606d493-311e-471f-9b6e-ce62820e4f50 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:06.849159 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-bc1b4892-b452-44a5-951d-9d2f357fb7cd req-5606d493-311e-471f-9b6e-ce62820e4f50 service nova] Creating event network-vif-deleted:af166b71-e370-4e5a-bd48-5e16173b39ba for instance 6f6c8da3-c129-48f7-a984-07c016af226b on n-h2-master-1 Oct 16 01:47:06.856835 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-bc1b4892-b452-44a5-951d-9d2f357fb7cd req-5606d493-311e-471f-9b6e-ce62820e4f50 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041911 Oct 16 01:47:06.858321 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3192/6515] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:47:07.512345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:07.512977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:07.521158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:07.522696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:07.523406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:07.524896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:07.525472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:07.526808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:07.634894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:07.650016 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-57936149-93b7-4aa7-9fc9-05e47bd4ed40 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1225 microversion: 2.1 time: 0.142090 Oct 16 01:47:07.650969 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3324/6516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:07 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:07.685992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:07.687665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:07.695439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:07.695936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:07.696379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:07.697444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:07.698454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:07.699125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:07.886809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:07.898122 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9bc42040-e634-4c29-9a90-5feff6fea67a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.225083 Oct 16 01:47:07.913393 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3193/6517] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:07 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:08.674318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:08.675662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:08.687058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:08.688011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:08.688781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:08.689869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:08.690775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:08.691620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:08.766746 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:08.776679 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-117e2fcf-73ef-42c9-ae15-4861d3984595 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1225 microversion: 2.1 time: 0.105688 Oct 16 01:47:08.778278 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3325/6518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:08 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:08.925751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:08.926654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:08.933902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:08.934484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:08.935047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:08.935823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:08.936356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:08.936992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:09.089542 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:09.097739 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b22682e1-1686-4b48-9884-8c99abfe64b3 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.175938 Oct 16 01:47:09.098541 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3194/6519] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:08 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:09.800737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:09.801332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:09.808400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:09.808937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:09.809370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:09.810255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:09.810732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:09.811245 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:09.890166 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:09.908687 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d4893757-dea6-48e8-a7b4-4e4ee9ea0d06 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1225 microversion: 2.1 time: 0.111696 Oct 16 01:47:09.909289 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3326/6520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:09 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:47:10.122154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:10.122934 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:10.130244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:10.130737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:10.131207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:10.131917 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:10.132384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:10.132819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:10.288525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:10.297212 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-73b84f67-50bc-4f59-bfbf-98fa5309f3dc tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.179438 Oct 16 01:47:10.297793 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3195/6521] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:10 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:10.938205 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:10.938832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:10.946172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:10.946681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:10.947154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:10.948500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:10.949305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:10.949743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:11.015337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:11.023890 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d7200859-ba79-4376-ace2-afae7b50e270 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 200 len: 1225 microversion: 2.1 time: 0.089507 Oct 16 01:47:11.024584 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3327/6522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:10 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:11.322537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:11.323611 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:11.331140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:11.331835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:11.332353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:11.333121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:11.333882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:11.334320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:11.482879 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:11.490833 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ebac3bb-9b23-4025-b984-3879f4a49f26 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.172499 Oct 16 01:47:11.491428 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3196/6523] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:11 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:12.047088 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:12.047721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:12.054501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:12.055051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:12.055506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:12.056213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:12.056692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:12.057986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:12.073307 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b HTTP/1.1 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6f6c8da3-c129-48f7-a984-07c016af226b'} Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:47:12.075036 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a347ddbc-af59-4089-87ba-0f106ccbea5b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 404 len: 111 microversion: 2.1 time: 0.033772 Oct 16 01:47:12.078838 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3328/6524] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:12 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:47:12.180175 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-475211219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1266830298", "security_groups": [{"name": "tempest-secgroup-smoke-361426714"}], "block_device_mapping_v2": [{"uuid": "6543be82-dec3-4f79-919f-a11732492ee4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61eb30c5-accf-4cf9-b162-43c4bdd26615"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:12.293868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] validate_networks() for [('61eb30c5-accf-4cf9-b162-43c4bdd26615', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:47:12.515585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:12.516454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:12.522664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:12.523273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:12.523800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:12.524582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:12.525135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:12.525651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:12.550326 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:12.752581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:12.761040 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc0a30ce-fb95-413b-b009-fe64fa9cdb2c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1689 microversion: 2.1 time: 0.248816 Oct 16 01:47:12.761621 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3329/6525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:12 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1689 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:47:12.780386 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:47:12.780868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:47:12.781379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:47:12.781794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:47:12.782208 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:47:12.791171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:12.792211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:12.792654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:12.793383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:12.793842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:12.794266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:12.811195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:47:12.816389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:47:12.876419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:47:12.878564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6543be82-dec3-4f79-919f-a11732492ee4',volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:47:13.013840 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-55b79603-3c33-4c48-bd53-b50cc37b46bd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.837564 Oct 16 01:47:13.014842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3197/6526] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:47:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:47:13.025709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e5edf87-d9d3-4971-aa51-9ad7726ab6e3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:13.026491 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3e5edf87-d9d3-4971-aa51-9ad7726ab6e3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:13.095754 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3e5edf87-d9d3-4971-aa51-9ad7726ab6e3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:13.103592 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e5edf87-d9d3-4971-aa51-9ad7726ab6e3 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1094 microversion: 2.1 time: 0.081751 Oct 16 01:47:13.104184 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3330/6527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:13 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:13.786731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:13.787523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:13.794508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:13.795018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:13.795457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:13.796154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:13.796609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:13.797033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:13.933312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:13.941172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f22cfe9e-f305-46d4-9302-611a154583a5 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1695 microversion: 2.1 time: 0.159226 Oct 16 01:47:13.941759 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3198/6528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:13 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:14.126322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:14.126970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:14.134551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:14.135585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:14.136042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:14.136748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:14.137222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:14.137662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:14.199601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:14.207496 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0c2472a5-5197-49e2-ba7d-39ee69a6a481 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1192 microversion: 2.1 time: 0.085078 Oct 16 01:47:14.208076 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3331/6529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:14 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:14.965619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:14.967628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:14.981761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:14.982734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:14.983443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:14.984682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:14.985352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:14.986739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:15.233171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:15.233730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:15.250739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:15.251317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:15.251774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:15.252507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:15.252985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:15.253431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:15.574098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:15.587324 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bc5abce3-73e7-44bd-afa8-3e282f65ec46 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1210 microversion: 2.1 time: 0.357893 Oct 16 01:47:15.589769 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3332/6530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:15 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1210 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:47:15.624440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:15.636313 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4c8d82e-f5c9-4df6-9fa7-5e318181c047 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1695 microversion: 2.1 time: 0.673459 Oct 16 01:47:15.637598 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3199/6531] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:14 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1695 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:16.614554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:16.616089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:16.625617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:16.626606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:16.627230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:16.628100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:16.628704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:16.629285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:16.662165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:16.662785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:16.671620 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:16.672112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:16.672549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:16.673318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:16.673779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:16.674203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:16.974210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:16.985150 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-940ce7ad-9852-44a6-89f4-351fa78fbcfb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1277 microversion: 2.1 time: 0.376005 Oct 16 01:47:16.986405 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3333/6532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:16 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1277 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:16.999911 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:17.012267 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb32d0d0-f555-4033-8cf4-f7c0462e3841 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1680 microversion: 2.1 time: 0.354041 Oct 16 01:47:17.013101 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3200/6533] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:16 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1680 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:17.286757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1811606e-97fc-4aa1-b0a1-93a8328c953f req-1f83f00a-afc6-4987-90db-b833879cc2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5290dd10-8645-4a1f-a126-828b2267dbd3", "tag": "bbd2f57f-1925-4622-aaa8-cb9d25c5f877"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:17.309087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1811606e-97fc-4aa1-b0a1-93a8328c953f req-1f83f00a-afc6-4987-90db-b833879cc2d5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:17.309950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1811606e-97fc-4aa1-b0a1-93a8328c953f req-1f83f00a-afc6-4987-90db-b833879cc2d5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:17.310609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1811606e-97fc-4aa1-b0a1-93a8328c953f req-1f83f00a-afc6-4987-90db-b833879cc2d5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:17.330464 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1811606e-97fc-4aa1-b0a1-93a8328c953f req-1f83f00a-afc6-4987-90db-b833879cc2d5 service nova] Creating event network-changed:bbd2f57f-1925-4622-aaa8-cb9d25c5f877 for instance 5290dd10-8645-4a1f-a126-828b2267dbd3 on n-h2-master-1 Oct 16 01:47:17.338968 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1811606e-97fc-4aa1-b0a1-93a8328c953f req-1f83f00a-afc6-4987-90db-b833879cc2d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057575 Oct 16 01:47:17.340820 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3334/6534] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:47:17.606632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d8a4782a-ffc0-447b-909a-fbc781907451 req-ce58b862-6d54-4407-9a7e-24e7341872c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6d8e6b-c1dd-4670-9335-672524f8d724", "name": "network-vif-plugged", "status": "completed", "tag": "7fdd44e5-1c5d-4bad-8062-db62fcf85bff"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:17.616662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d8a4782a-ffc0-447b-909a-fbc781907451 req-ce58b862-6d54-4407-9a7e-24e7341872c7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:17.617362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d8a4782a-ffc0-447b-909a-fbc781907451 req-ce58b862-6d54-4407-9a7e-24e7341872c7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:17.618005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d8a4782a-ffc0-447b-909a-fbc781907451 req-ce58b862-6d54-4407-9a7e-24e7341872c7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:17.630146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d8a4782a-ffc0-447b-909a-fbc781907451 req-ce58b862-6d54-4407-9a7e-24e7341872c7 service nova] Creating event network-vif-plugged:7fdd44e5-1c5d-4bad-8062-db62fcf85bff for instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 on n-h1-master-1 Oct 16 01:47:17.637044 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d8a4782a-ffc0-447b-909a-fbc781907451 req-ce58b862-6d54-4407-9a7e-24e7341872c7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254193 Oct 16 01:47:17.638259 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3201/6535] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:47:18.013582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:18.014632 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:18.023596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:18.024184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:18.024876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:18.026391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:18.027406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:18.028130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:18.262298 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:18.271921 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6de1ea6e-6c5d-4221-9f3e-8a86cc274c04 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1277 microversion: 2.1 time: 0.267332 Oct 16 01:47:18.272876 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3335/6536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:18 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:47:19.295801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:19.296847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:19.304548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:19.305161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:19.305708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:19.307097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:19.307824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:19.308365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:19.463779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:19.471883 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80e06b31-4785-4f03-a7ce-feb31ea2f1d6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1277 microversion: 2.1 time: 0.180860 Oct 16 01:47:19.472464 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3202/6537] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:19 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:20.496145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:20.496789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:20.503779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:20.504277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:20.504725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:20.505461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:20.505962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:20.506401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:20.647452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:20.656473 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-986439c8-55b5-4e61-a00c-b9b73aa48bcc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.165107 Oct 16 01:47:20.657062 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3336/6538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:20 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:21.680014 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:21.680632 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:21.690561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:21.691091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:21.691543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:21.692315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:21.692757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:21.693452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:21.712576 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=100 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:21.830732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:21.838653 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e4a06bc-3bc3-49df-8898-c2fb19cd2dd0 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.162632 Oct 16 01:47:21.839353 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3203/6539] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:21 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:22.861862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:22.862547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:22.870509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:22.871041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:22.871498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:22.872217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:22.872692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:22.873133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:23.015308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:23.023338 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-365971a9-12ab-480d-a287-3bb71a6c742a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.165453 Oct 16 01:47:23.024321 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3337/6540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:22 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:24.046558 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:24.047201 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:24.049894 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:24.050551 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:24.057298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:24.057797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:24.058245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:24.058974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:24.059447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:24.059884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:24.194567 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:24.204259 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58b36893-b3ec-4fdb-a440-aa97ae8cdd8d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.161259 Oct 16 01:47:24.209920 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3204/6541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:24 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:25.226865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:25.227526 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:25.230798 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:25.237181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:25.237802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:25.238131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:25.238834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:25.239336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:25.239777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:25.414133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:25.427161 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9500836a-acac-4d33-8d51-35076dbe6b0f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.204015 Oct 16 01:47:25.427982 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3338/6542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:25 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:47:26.451718 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:26.452430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:26.455265 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:26.460944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:26.461504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:26.462022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:26.462808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:26.463444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:26.463935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:26.604736 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:26.612672 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1a27ce26-73dc-40b5-a752-544f4ec588ee tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.164861 Oct 16 01:47:26.613256 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3205/6543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:26 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:27.635868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:27.636492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:27.639541 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:27.644905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:27.645400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:27.645842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:27.646541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:27.647045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:27.647481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:27.782458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:27.790241 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f9a3224f-532b-479f-a085-9ec3678aa5de tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.158762 Oct 16 01:47:27.790893 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3339/6544] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:27 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:28.813138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:28.813759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:28.821451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:28.822578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:28.823149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:28.823873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:28.824338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:28.824769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:28.966434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:28.974402 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-154776eb-ecc0-4031-9038-a950552700df tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.165201 Oct 16 01:47:28.975110 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3206/6545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:28 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:29.997964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:29.999340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:30.006387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:30.007011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:30.007462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:30.008169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:30.008634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:30.009386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:30.152299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:30.160258 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8029fe9a-9372-49d3-855a-7c8a522f3772 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.166885 Oct 16 01:47:30.160857 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3340/6546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:29 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:31.184452 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:31.185192 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:31.192520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:31.193501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:31.193953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:31.194736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:31.195318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:31.195778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:31.345804 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3fc5cb05-0554-4b72-9f89-d99428384942 req-d9d52b2d-670f-4265-97fe-f762d03bcc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5290dd10-8645-4a1f-a126-828b2267dbd3", "name": "network-vif-plugged", "status": "completed", "tag": "bbd2f57f-1925-4622-aaa8-cb9d25c5f877"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:31.354571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:31.360201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3fc5cb05-0554-4b72-9f89-d99428384942 req-d9d52b2d-670f-4265-97fe-f762d03bcc98 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:31.361410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3fc5cb05-0554-4b72-9f89-d99428384942 req-d9d52b2d-670f-4265-97fe-f762d03bcc98 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:31.362282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3fc5cb05-0554-4b72-9f89-d99428384942 req-d9d52b2d-670f-4265-97fe-f762d03bcc98 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:31.362515 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0d6ec0f0-00dc-42f7-89ea-4d3ed193a3c8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.182720 Oct 16 01:47:31.363139 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3207/6547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:31 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:31.374965 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3fc5cb05-0554-4b72-9f89-d99428384942 req-d9d52b2d-670f-4265-97fe-f762d03bcc98 service nova] Creating event network-vif-plugged:bbd2f57f-1925-4622-aaa8-cb9d25c5f877 for instance 5290dd10-8645-4a1f-a126-828b2267dbd3 on n-h2-master-1 Oct 16 01:47:31.380348 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3fc5cb05-0554-4b72-9f89-d99428384942 req-d9d52b2d-670f-4265-97fe-f762d03bcc98 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038992 Oct 16 01:47:31.380962 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3341/6548] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:47:32.386044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:32.386564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:32.393606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:32.394095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:32.394537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:32.395282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:32.395746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:32.396176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:32.534218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:32.543187 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8a2c4e3-d212-4cab-97ad-df7f77b953c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1265 microversion: 2.1 time: 0.161195 Oct 16 01:47:32.543892 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3208/6549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:32 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:33.567321 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:33.568320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:33.575955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:33.576464 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:33.576913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:33.577634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:33.578104 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:33.578541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:33.720217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:33.728689 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d465d1b2-4e7c-425e-b4c5-b7fa0189104f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1451 microversion: 2.1 time: 0.166593 Oct 16 01:47:33.729261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3342/6550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:33 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:33.750862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:33.751505 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:33.758322 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:33.758814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:33.759545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:33.760341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:33.760807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:33.761244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:33.895346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:33.903332 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-997dfe5f-6c55-4336-bdf9-7f01bad0cc4f tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1451 microversion: 2.1 time: 0.156283 Oct 16 01:47:33.903914 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3209/6551] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:33 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:36.058138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-04e15370-9160-444c-9ff0-c54ef2398803 req-cc7ed007-d3d3-45e5-9696-a143c445c715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5290dd10-8645-4a1f-a126-828b2267dbd3", "tag": "bbd2f57f-1925-4622-aaa8-cb9d25c5f877"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:36.068849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-04e15370-9160-444c-9ff0-c54ef2398803 req-cc7ed007-d3d3-45e5-9696-a143c445c715 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:36.069351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-04e15370-9160-444c-9ff0-c54ef2398803 req-cc7ed007-d3d3-45e5-9696-a143c445c715 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:36.069795 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-04e15370-9160-444c-9ff0-c54ef2398803 req-cc7ed007-d3d3-45e5-9696-a143c445c715 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:36.082348 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-04e15370-9160-444c-9ff0-c54ef2398803 req-cc7ed007-d3d3-45e5-9696-a143c445c715 service nova] Creating event network-changed:bbd2f57f-1925-4622-aaa8-cb9d25c5f877 for instance 5290dd10-8645-4a1f-a126-828b2267dbd3 on n-h2-master-1 Oct 16 01:47:36.088205 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-04e15370-9160-444c-9ff0-c54ef2398803 req-cc7ed007-d3d3-45e5-9696-a143c445c715 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034101 Oct 16 01:47:36.088805 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3343/6552] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:47:41.230979 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:41.233448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:41.240354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:41.241121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:41.241720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:41.242437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:41.243562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:41.244006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:41.316456 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4a4103aa-71a6-41f4-8f0a-f8db88e5ad4a tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "POST /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724/action" status: 200 len: 24570 microversion: 2.1 time: 0.089867 Oct 16 01:47:41.323949 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3210/6553] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:47:41 2022] POST /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724/action => generated 24570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 01:47:48.647728 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=9 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:48.648706 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=68 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:48.653510 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-51ad6e26-c073-4fe8-b7f7-9af95d4f7c7e req-b75e3b1e-85ef-4b4c-9296-d50df77af612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c6d8e6b-c1dd-4670-9335-672524f8d724", "tag": "7fdd44e5-1c5d-4bad-8062-db62fcf85bff"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:48.663152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:48.664044 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:48.665238 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51ad6e26-c073-4fe8-b7f7-9af95d4f7c7e req-b75e3b1e-85ef-4b4c-9296-d50df77af612 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:48.665932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51ad6e26-c073-4fe8-b7f7-9af95d4f7c7e req-b75e3b1e-85ef-4b4c-9296-d50df77af612 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:48.666556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-51ad6e26-c073-4fe8-b7f7-9af95d4f7c7e req-b75e3b1e-85ef-4b4c-9296-d50df77af612 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:48.672825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:48.673350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:48.673812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:48.674542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:48.675323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:48.675842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:48.680709 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-51ad6e26-c073-4fe8-b7f7-9af95d4f7c7e req-b75e3b1e-85ef-4b4c-9296-d50df77af612 service nova] Creating event network-changed:7fdd44e5-1c5d-4bad-8062-db62fcf85bff for instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 on n-h1-master-1 Oct 16 01:47:48.686574 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-51ad6e26-c073-4fe8-b7f7-9af95d4f7c7e req-b75e3b1e-85ef-4b4c-9296-d50df77af612 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038018 Oct 16 01:47:48.687602 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3211/6554] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:47:48.723403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:47:48.843183 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f6bd2b3-878a-4317-bbd1-94142075f1e1 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 204 len: 0 microversion: 2.1 time: 0.197104 Oct 16 01:47:48.846997 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3344/6555] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:47:48 2022] DELETE /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:47:48.853674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:48.854547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:48.866032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:48.868835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:48.869408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:48.891616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:48.892265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:48.892963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:49.070100 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:49.079412 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-33e22205-a0f4-4d08-885b-44cc0e136cde tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1686 microversion: 2.1 time: 0.230367 Oct 16 01:47:49.080383 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3212/6556] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:48 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1686 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:50.107786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:50.108530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:50.115325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:50.115833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:50.116289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:50.117001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:50.117987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:50.118442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:50.284063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:50.293230 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2612ec6c-d3e6-43fc-a1d1-1092805980de tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1686 microversion: 2.1 time: 0.189804 Oct 16 01:47:50.293814 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3345/6557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:50 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:51.253076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e2b9ada7-eb83-4cc7-85c4-85f38e5ae6fe req-fbb5392a-6601-4408-8edf-36009a593244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c6d8e6b-c1dd-4670-9335-672524f8d724", "name": "network-vif-deleted", "tag": "7fdd44e5-1c5d-4bad-8062-db62fcf85bff"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:51.269118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e2b9ada7-eb83-4cc7-85c4-85f38e5ae6fe req-fbb5392a-6601-4408-8edf-36009a593244 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:51.269625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e2b9ada7-eb83-4cc7-85c4-85f38e5ae6fe req-fbb5392a-6601-4408-8edf-36009a593244 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:51.270352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e2b9ada7-eb83-4cc7-85c4-85f38e5ae6fe req-fbb5392a-6601-4408-8edf-36009a593244 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:51.283612 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e2b9ada7-eb83-4cc7-85c4-85f38e5ae6fe req-fbb5392a-6601-4408-8edf-36009a593244 service nova] Creating event network-vif-deleted:7fdd44e5-1c5d-4bad-8062-db62fcf85bff for instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 on n-h1-master-1 Oct 16 01:47:51.289723 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e2b9ada7-eb83-4cc7-85c4-85f38e5ae6fe req-fbb5392a-6601-4408-8edf-36009a593244 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135188 Oct 16 01:47:51.291207 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3213/6558] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:47:51.317667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:51.319329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:51.328745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:51.329252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:51.329943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:51.330760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:51.331542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:51.344041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:51.382095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:51.382599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:51.383150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:51.383616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lazy-loading 'fault' on Instance uuid 3c6d8e6b-c1dd-4670-9335-672524f8d724 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:47:51.431628 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83bbcff8a1f64cfa936f13f3cb3955b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855792b0264144dd941200c8468ac26d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:47:51.440150 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-30811675-84f6-418f-9c00-8b09e8a19ec0 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 200 len: 1354 microversion: 2.1 time: 0.126859 Oct 16 01:47:51.441086 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3346/6559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:51 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 1354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:47:52.468677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:52.469273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] [instance: 3c6d8e6b-c1dd-4670-9335-672524f8d724] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:47:52.475573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:52.476065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:52.477045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:52.478030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:52.478500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:52.479018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:52.481688 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=53 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:52.493829 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] HTTP exception thrown: Instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 could not be found. Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Request method failure captured: Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 HTTP/1.1 Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2DqN-UT2falK72w98Rw1ecfssH-Glws7VEsKQiphDY1d9smk-R1JvXKD0Dqf8PxLYTV6aXG--fD5W0nuCIGhiXXhaSUnqm_oKesChDekdLqyYd1pPTaNQL6VFOZHf4uXw0-kS8HODdK0elzb0ty6zGgXYWz06m-gK8IoUVR5r7Q9Eg Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 855792b0264144dd941200c8468ac26d Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_855792b0264144dd941200c8468ac26d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/855792b0264144dd941200c8468ac26d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/855792b0264144dd941200c8468ac26d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/855792b0264144dd941200c8468ac26d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 855792b0264144dd941200c8468ac26d Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1761159727 Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestNetworkAdvancedServerOps-1761159727-project Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 83bbcff8a1f64cfa936f13f3cb3955b6 Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1761159727-project Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 could not be found. Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '3c6d8e6b-c1dd-4670-9335-672524f8d724'} Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 could not be found. Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 could not be found. Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:47:52.495520 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 could not be found. Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Returning 404 to user: Instance 3c6d8e6b-c1dd-4670-9335-672524f8d724 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bd57b45e-3137-4572-aec5-d7160888a909 tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724" status: 404 len: 111 microversion: 2.1 time: 0.033499 Oct 16 01:47:52.502852 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3214/6560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:52 2022] GET /compute/v2.1/servers/3c6d8e6b-c1dd-4670-9335-672524f8d724 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:47:56.494212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-19331311-4067-4f4e-be2b-a611e333b65c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] Calling method '.version_select at 0x7fd64e0edaf0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:56.520210 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-19331311-4067-4f4e-be2b-a611e333b65c tempest-TestNetworkAdvancedServerOps-1761159727 tempest-TestNetworkAdvancedServerOps-1761159727-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-43919134" status: 202 len: 0 microversion: 2.1 time: 0.031596 Oct 16 01:47:56.525596 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3347/6561] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Oct 16 01:47:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-43919134 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:47:57.904075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c34dded8-9765-4101-a38a-aee020f04aff tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Action: 'create', calling method: .version_select at 0x7fd64e1bcaf0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1733310917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSLrcbpZ3eZGpDLYKTGlaoIBMJ8peK4dLGyQIz5CR+4VfqQbGAMLOf/rjwBxh7OmtD70djeFtH6v5SdLIddRJlFszUqWbGT4uj1ouCFGWmYt7AAiLH8U7e4b0QPl8EudA=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:57.911535 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=20 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:47:57.929061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-c34dded8-9765-4101-a38a-aee020f04aff tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Getting quotas for project a3922018cb024e88a3bb28fb5fc66e66. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:47:57.936833 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-c34dded8-9765-4101-a38a-aee020f04aff tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Getting quotas for user 3e325cdaac8b40b4ae75bf325163a943 and project a3922018cb024e88a3bb28fb5fc66e66. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:47:57.967847 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c34dded8-9765-4101-a38a-aee020f04aff tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.068454 Oct 16 01:47:57.968532 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3215/6562] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:47:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:47:59.213997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1554572555", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9ad333a8-622f-4338-8c3e-ffd17a27b200", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1733310917", "security_groups": [{"name": "tempest-secgroup-smoke-1973195440"}], "networks": [{"uuid": "b9b1ba39-f71b-414f-8d5e-94a6e0042f2d"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:47:59.376962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] validate_networks() for [('b9b1ba39-f71b-414f-8d5e-94a6e0042f2d', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:47:59.751771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:47:59.752207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:47:59.752751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:47:59.753172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:47:59.753679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:47:59.763004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:59.763504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:59.763950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:59.764684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:47:59.765156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:47:59.765652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:47:59.785259 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Getting quotas for project a3922018cb024e88a3bb28fb5fc66e66. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:47:59.791247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Getting quotas for user 3e325cdaac8b40b4ae75bf325163a943 and project a3922018cb024e88a3bb28fb5fc66e66. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:47:59.851961 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:47:59.854452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ad333a8-622f-4338-8c3e-ffd17a27b200',volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:47:59.985641 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ee12988c-aeab-482e-a402-93dc3c46aba1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.777194 Oct 16 01:47:59.986347 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3348/6563] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:47:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:47:59.998929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-22a40340-fd17-4db4-8063-d64155bd5f02 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:47:59.999608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-22a40340-fd17-4db4-8063-d64155bd5f02 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:00.061724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-22a40340-fd17-4db4-8063-d64155bd5f02 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:00.068870 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-22a40340-fd17-4db4-8063-d64155bd5f02 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1099 microversion: 2.1 time: 0.074873 Oct 16 01:48:00.069648 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3216/6564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:47:59 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1099 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:01.093313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:01.093922 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:01.100226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:01.100733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:01.101387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:01.102219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:01.102697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:01.103166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:01.169062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:01.177443 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-77b9c027-e210-497f-9685-1b286899d554 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1197 microversion: 2.1 time: 0.088834 Oct 16 01:48:01.178048 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3349/6565] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:01 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:02.201832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:02.202456 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:02.213442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:02.214668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:02.215430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:02.217615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:02.218546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:02.219990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:02.381996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:02.392017 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98e4007b-2351-4dad-b72c-8e43095c6738 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1283 microversion: 2.1 time: 0.193938 Oct 16 01:48:02.392936 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3217/6566] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:02 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1283 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:02.976265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3992c73e-116f-4b36-b04c-5bb274a69116 req-e0ab869b-5137-4747-bacd-380272a334da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4555bf70-c2fc-41af-a419-1d73394c45b5", "tag": "82eead50-79e9-431b-94d5-9dfd26d3d943"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:48:02.988072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3992c73e-116f-4b36-b04c-5bb274a69116 req-e0ab869b-5137-4747-bacd-380272a334da service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:02.988753 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3992c73e-116f-4b36-b04c-5bb274a69116 req-e0ab869b-5137-4747-bacd-380272a334da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:02.989283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3992c73e-116f-4b36-b04c-5bb274a69116 req-e0ab869b-5137-4747-bacd-380272a334da service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:03.003855 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3992c73e-116f-4b36-b04c-5bb274a69116 req-e0ab869b-5137-4747-bacd-380272a334da service nova] Creating event network-changed:82eead50-79e9-431b-94d5-9dfd26d3d943 for instance 4555bf70-c2fc-41af-a419-1d73394c45b5 on n-h1-master-1 Oct 16 01:48:03.011612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3992c73e-116f-4b36-b04c-5bb274a69116 req-e0ab869b-5137-4747-bacd-380272a334da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040027 Oct 16 01:48:03.012893 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3350/6567] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:48:03.419360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:03.420042 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:03.428066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:03.428554 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:03.429183 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:03.429884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:03.430513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:03.430960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:03.582105 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:03.592210 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-36cd8db3-82ea-4f7f-8727-07996f14f27c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1283 microversion: 2.1 time: 0.177125 Oct 16 01:48:03.602979 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3218/6568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:03 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1283 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:04.617512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:04.618398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:04.624794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:04.625372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:04.625888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:04.626670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:04.627294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:04.627801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:04.759089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:04.767095 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-38b3bf82-18f8-48ac-9361-f7614610f62b tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1283 microversion: 2.1 time: 0.155644 Oct 16 01:48:04.767682 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3351/6569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:04 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:05.793711 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:05.794356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:05.801289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:05.801785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:05.802227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:05.802998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:05.803431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:05.803892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:05.939553 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:05.948083 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a921d02d-a7c7-425b-95d4-043b4ee18723 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1283 microversion: 2.1 time: 0.158309 Oct 16 01:48:05.948685 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3219/6570] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:05 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1283 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:06.971519 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:06.972181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:06.982616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:06.983147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:06.983596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:06.984301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:06.984765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:06.985199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:07.128772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:07.137154 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9f425578-8100-4fb2-b843-0f18c0786bf2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.169638 Oct 16 01:48:07.137733 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3352/6571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:06 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:08.161211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:08.161822 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:08.168958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:08.169450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:08.169894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:08.170594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:08.171070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:08.171616 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:08.313565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:08.322174 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ceec0fa1-9da4-4638-8239-91165835a7a1 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.165492 Oct 16 01:48:08.322782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3220/6572] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:08 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:09.345600 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:09.346215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:09.354165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:09.354657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:09.355134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:09.355839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:09.356303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:09.356735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:09.489269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:09.497020 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0dd464ee-9409-4c0f-a2f4-c8364dba6705 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.155295 Oct 16 01:48:09.497603 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3353/6573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:09 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:10.518091 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:10.522178 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:10.522794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:10.529099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:10.529590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:10.530030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:10.530729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:10.531220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:10.531652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:10.663962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:10.672442 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-775e6822-19f2-47b8-a7c2-4e11f603c030 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.156033 Oct 16 01:48:10.673034 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3221/6574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:10 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:11.695102 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:11.695722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:11.697764 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:11.698428 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:11.705026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:11.705518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:11.705961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:11.706656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:11.707150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:11.707587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:11.843310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:11.850940 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0417f02a-81cf-4857-866c-3f34ba1a3865 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.159939 Oct 16 01:48:11.851519 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3354/6575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:11 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:12.874775 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:12.875371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:12.882016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:12.882507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:12.882961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:12.883658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:12.884117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:12.884544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:13.019637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:13.028389 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-faf96236-895d-4784-879b-4c2e2fe68fbb tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.157679 Oct 16 01:48:13.028963 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3222/6576] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:12 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:14.052226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:14.052890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:14.060129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:14.060631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:14.061078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:14.061797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:14.062270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:14.062712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:14.195507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:14.203223 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ef70e99f-1168-4224-88b0-fbabf40b9013 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.154982 Oct 16 01:48:14.204056 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3355/6577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:14 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:15.226002 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:15.226617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:15.234487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:15.234997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:15.235433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:15.236121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:15.236576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:15.237004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:15.373108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:15.380742 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fdd99649-67c6-4384-9668-6caa5d04210d tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.158598 Oct 16 01:48:15.381317 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3223/6578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:15 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:15.650152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5354b957-9d98-4b89-a089-03619e71d2f9 req-194c8376-a0ab-4e88-82b3-7d664e55b35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4555bf70-c2fc-41af-a419-1d73394c45b5", "name": "network-vif-plugged", "status": "completed", "tag": "82eead50-79e9-431b-94d5-9dfd26d3d943"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:48:15.663631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5354b957-9d98-4b89-a089-03619e71d2f9 req-194c8376-a0ab-4e88-82b3-7d664e55b35d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:15.664121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5354b957-9d98-4b89-a089-03619e71d2f9 req-194c8376-a0ab-4e88-82b3-7d664e55b35d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:15.664563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5354b957-9d98-4b89-a089-03619e71d2f9 req-194c8376-a0ab-4e88-82b3-7d664e55b35d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:15.676336 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5354b957-9d98-4b89-a089-03619e71d2f9 req-194c8376-a0ab-4e88-82b3-7d664e55b35d service nova] Creating event network-vif-plugged:82eead50-79e9-431b-94d5-9dfd26d3d943 for instance 4555bf70-c2fc-41af-a419-1d73394c45b5 on n-h1-master-1 Oct 16 01:48:15.681330 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5354b957-9d98-4b89-a089-03619e71d2f9 req-194c8376-a0ab-4e88-82b3-7d664e55b35d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034973 Oct 16 01:48:15.682373 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3356/6579] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:48:16.403594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:16.404245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:16.411058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:16.411541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:16.411984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:16.412676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:16.413134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:16.413563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:16.544314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:16.552276 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce9309ec-efef-4322-9c65-3b7c912fcf54 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1271 microversion: 2.1 time: 0.152577 Oct 16 01:48:16.552858 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3224/6580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:16 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:17.578111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:17.578820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:17.584966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:17.585461 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:17.585910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:17.586603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:17.587106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:17.587545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:17.724803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:17.733147 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e849fd2e-135a-4d6b-98fa-697a1b085835 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1460 microversion: 2.1 time: 0.160704 Oct 16 01:48:17.733725 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3357/6581] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:17 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1460 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:17.755981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:17.756665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:17.764647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:17.765288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:17.765778 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:17.766538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:17.767037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:17.767506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:17.906845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:17.915340 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f4249e93-1da7-41f2-81b2-070e27013b70 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1460 microversion: 2.1 time: 0.163715 Oct 16 01:48:17.916101 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3225/6582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:17 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1460 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:20.326759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-942d739d-c6bf-4e76-8872-95a76fa1982c req-a59bca9f-3a34-416f-9bf6-cff042d059cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4555bf70-c2fc-41af-a419-1d73394c45b5", "tag": "82eead50-79e9-431b-94d5-9dfd26d3d943"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:48:20.332450 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:20.339727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-942d739d-c6bf-4e76-8872-95a76fa1982c req-a59bca9f-3a34-416f-9bf6-cff042d059cc service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:20.340366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-942d739d-c6bf-4e76-8872-95a76fa1982c req-a59bca9f-3a34-416f-9bf6-cff042d059cc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:20.341061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-942d739d-c6bf-4e76-8872-95a76fa1982c req-a59bca9f-3a34-416f-9bf6-cff042d059cc service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:20.345912 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:20.374054 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-942d739d-c6bf-4e76-8872-95a76fa1982c req-a59bca9f-3a34-416f-9bf6-cff042d059cc service nova] Creating event network-changed:82eead50-79e9-431b-94d5-9dfd26d3d943 for instance 4555bf70-c2fc-41af-a419-1d73394c45b5 on n-h1-master-1 Oct 16 01:48:20.380741 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-942d739d-c6bf-4e76-8872-95a76fa1982c req-a59bca9f-3a34-416f-9bf6-cff042d059cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200229 Oct 16 01:48:20.381981 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3358/6583] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:48:21.862235 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-357e777b-c93f-4a26-9ac0-5076b17003ba req-a01a38df-1ae9-4e8f-95c5-feec2ee13022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4555bf70-c2fc-41af-a419-1d73394c45b5", "tag": "82eead50-79e9-431b-94d5-9dfd26d3d943"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:48:21.879582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-357e777b-c93f-4a26-9ac0-5076b17003ba req-a01a38df-1ae9-4e8f-95c5-feec2ee13022 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:21.880145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-357e777b-c93f-4a26-9ac0-5076b17003ba req-a01a38df-1ae9-4e8f-95c5-feec2ee13022 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:21.880647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-357e777b-c93f-4a26-9ac0-5076b17003ba req-a01a38df-1ae9-4e8f-95c5-feec2ee13022 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:21.892705 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-357e777b-c93f-4a26-9ac0-5076b17003ba req-a01a38df-1ae9-4e8f-95c5-feec2ee13022 service nova] Creating event network-changed:82eead50-79e9-431b-94d5-9dfd26d3d943 for instance 4555bf70-c2fc-41af-a419-1d73394c45b5 on n-h1-master-1 Oct 16 01:48:21.897985 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-357e777b-c93f-4a26-9ac0-5076b17003ba req-a01a38df-1ae9-4e8f-95c5-feec2ee13022 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039476 Oct 16 01:48:21.898808 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3226/6584] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:48:23.915488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f2ae5dcc-e08a-4095-a5f2-c72f833ebdeb req-b1f73402-1c58-4d0b-afe9-ef2bcabc1872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4555bf70-c2fc-41af-a419-1d73394c45b5", "tag": "82eead50-79e9-431b-94d5-9dfd26d3d943"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:48:23.927642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f2ae5dcc-e08a-4095-a5f2-c72f833ebdeb req-b1f73402-1c58-4d0b-afe9-ef2bcabc1872 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:23.928144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f2ae5dcc-e08a-4095-a5f2-c72f833ebdeb req-b1f73402-1c58-4d0b-afe9-ef2bcabc1872 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:23.928598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f2ae5dcc-e08a-4095-a5f2-c72f833ebdeb req-b1f73402-1c58-4d0b-afe9-ef2bcabc1872 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:23.940967 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f2ae5dcc-e08a-4095-a5f2-c72f833ebdeb req-b1f73402-1c58-4d0b-afe9-ef2bcabc1872 service nova] Creating event network-changed:82eead50-79e9-431b-94d5-9dfd26d3d943 for instance 4555bf70-c2fc-41af-a419-1d73394c45b5 on n-h1-master-1 Oct 16 01:48:23.946162 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f2ae5dcc-e08a-4095-a5f2-c72f833ebdeb req-b1f73402-1c58-4d0b-afe9-ef2bcabc1872 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036433 Oct 16 01:48:23.946752 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3359/6585] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:48:53.817284 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:53.819542 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:53.820338 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=57 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:53.820671 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:48:53.833935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b027b307-938d-424b-897f-86435ecc15b4 req-04b93d1b-99d8-4d9b-909b-d0bf93e1975e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4555bf70-c2fc-41af-a419-1d73394c45b5", "tag": "82eead50-79e9-431b-94d5-9dfd26d3d943"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:48:53.836459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:53.837135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:53.846838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:53.846838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:53.846838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:53.846838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:53.847330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:53.847654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:53.870102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b027b307-938d-424b-897f-86435ecc15b4 req-04b93d1b-99d8-4d9b-909b-d0bf93e1975e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:53.870594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b027b307-938d-424b-897f-86435ecc15b4 req-04b93d1b-99d8-4d9b-909b-d0bf93e1975e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:53.871726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b027b307-938d-424b-897f-86435ecc15b4 req-04b93d1b-99d8-4d9b-909b-d0bf93e1975e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:53.878758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:48:53.885114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b027b307-938d-424b-897f-86435ecc15b4 req-04b93d1b-99d8-4d9b-909b-d0bf93e1975e service nova] Creating event network-changed:82eead50-79e9-431b-94d5-9dfd26d3d943 for instance 4555bf70-c2fc-41af-a419-1d73394c45b5 on n-h1-master-1 Oct 16 01:48:53.890850 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b027b307-938d-424b-897f-86435ecc15b4 req-04b93d1b-99d8-4d9b-909b-d0bf93e1975e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075747 Oct 16 01:48:53.891498 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3360/6586] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:48:53.974899 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e4ead84c-aa1a-4c62-9e41-0f7543f19a7a tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 204 len: 0 microversion: 2.1 time: 0.161825 Oct 16 01:48:53.979012 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3227/6587] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:48:53 2022] DELETE /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:48:53.985195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:53.985918 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:53.992789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:53.993302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:53.994395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:53.995173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:53.995651 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:53.996099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:54.142494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:54.151266 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abd00f0c-599a-4876-b3a7-e0e3d6b32e31 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1585 microversion: 2.1 time: 0.170274 Oct 16 01:48:54.151858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3361/6588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:53 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1585 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:55.175654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:55.176385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:55.184033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:55.184540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:55.184980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:55.185677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:55.186186 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:55.186581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:55.331701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:55.340255 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-240cfbc1-ed30-4c70-91eb-60e92fb79ae6 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1585 microversion: 2.1 time: 0.169094 Oct 16 01:48:55.340839 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3228/6589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:55 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1585 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:56.146050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-342eda2a-6caf-4ff6-a2b0-6e1ed5b9f4d9 req-f776b522-d9c9-4d47-9e6c-20099ed1e343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4555bf70-c2fc-41af-a419-1d73394c45b5", "name": "network-vif-deleted", "tag": "82eead50-79e9-431b-94d5-9dfd26d3d943"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:48:56.157708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-342eda2a-6caf-4ff6-a2b0-6e1ed5b9f4d9 req-f776b522-d9c9-4d47-9e6c-20099ed1e343 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:56.158409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-342eda2a-6caf-4ff6-a2b0-6e1ed5b9f4d9 req-f776b522-d9c9-4d47-9e6c-20099ed1e343 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:56.158870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-342eda2a-6caf-4ff6-a2b0-6e1ed5b9f4d9 req-f776b522-d9c9-4d47-9e6c-20099ed1e343 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:56.171235 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-342eda2a-6caf-4ff6-a2b0-6e1ed5b9f4d9 req-f776b522-d9c9-4d47-9e6c-20099ed1e343 service nova] Creating event network-vif-deleted:82eead50-79e9-431b-94d5-9dfd26d3d943 for instance 4555bf70-c2fc-41af-a419-1d73394c45b5 on n-h1-master-1 Oct 16 01:48:56.176590 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-342eda2a-6caf-4ff6-a2b0-6e1ed5b9f4d9 req-f776b522-d9c9-4d47-9e6c-20099ed1e343 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034345 Oct 16 01:48:56.177190 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3362/6590] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:48:56.364187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:56.365370 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:56.372705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:56.373195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:56.373637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:56.374367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:56.374829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:56.375283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:56.441534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:56.451315 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80238c97-b9d0-459b-b8f3-26901a50919c tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1230 microversion: 2.1 time: 0.091070 Oct 16 01:48:56.452222 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3229/6591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:56 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:57.477171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:57.477935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:57.484193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:57.484709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:57.485161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:57.485869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:57.486343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:57.486784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:57.552723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:57.561670 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f66ed2f0-5f17-40c5-91c6-6cad645979c2 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1230 microversion: 2.1 time: 0.089606 Oct 16 01:48:57.562572 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3363/6592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:57 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:58.585759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:58.586381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:58.594120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:58.594614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:58.595096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:58.595804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:58.596262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:58.596684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:58.661190 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:58.669733 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cf6ec65b-cd98-4e0a-9f81-f3145bfc1ebd tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1230 microversion: 2.1 time: 0.087927 Oct 16 01:48:58.670313 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3230/6593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:58 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:48:59.692797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:48:59.693430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:48:59.701823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:59.702342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:59.702799 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:59.703543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:48:59.704022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:48:59.704467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:48:59.795002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e325cdaac8b40b4ae75bf325163a943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3922018cb024e88a3bb28fb5fc66e66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:48:59.803414 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-115f8b47-297e-4d54-b76b-a540418e1b80 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 200 len: 1230 microversion: 2.1 time: 0.114753 Oct 16 01:48:59.804323 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3364/6594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:48:59 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:00.828292 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:00.828952 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] [instance: 4555bf70-c2fc-41af-a419-1d73394c45b5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:00.835970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:00.836494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:00.836992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:00.837775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:00.838257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:00.838689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:00.852051 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] HTTP exception thrown: Instance 4555bf70-c2fc-41af-a419-1d73394c45b5 could not be found. Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Request method failure captured: Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 HTTP/1.1 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2JTmB9xYxwutApRllyE839QdztI1ggL7ptLYJyFi9nPBFracc1oLZHufIKp4fkMddOZcDCc4IgOoM9WNzwnx5AwyWdujJoNBpXNS2QaQ3qaY0vpkGlBkDuMnESDsAzCXpnAjDZ48c1rTkweP0yhNFjMetF-bPZJg3QSVA-4XgKYjpE Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: a3922018cb024e88a3bb28fb5fc66e66 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestVolumeBackupRestore-1793763600 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3922018cb024e88a3bb28fb5fc66e66", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3922018cb024e88a3bb28fb5fc66e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3922018cb024e88a3bb28fb5fc66e66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3922018cb024e88a3bb28fb5fc66e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestVolumeBackupRestore-1793763600 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: a3922018cb024e88a3bb28fb5fc66e66 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1793763600 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestVolumeBackupRestore-1793763600-project Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 3e325cdaac8b40b4ae75bf325163a943 Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestVolumeBackupRestore-1793763600-project Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 4555bf70-c2fc-41af-a419-1d73394c45b5 could not be found. Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '4555bf70-c2fc-41af-a419-1d73394c45b5'} Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4555bf70-c2fc-41af-a419-1d73394c45b5 could not be found. Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4555bf70-c2fc-41af-a419-1d73394c45b5 could not be found. Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:49:00.854365 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4555bf70-c2fc-41af-a419-1d73394c45b5 could not be found. Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Returning 404 to user: Instance 4555bf70-c2fc-41af-a419-1d73394c45b5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0d806e93-c2f8-458b-b603-0faa4d533bf7 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5" status: 404 len: 111 microversion: 2.1 time: 0.031690 Oct 16 01:49:00.858664 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3231/6595] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:00 2022] GET /compute/v2.1/servers/4555bf70-c2fc-41af-a419-1d73394c45b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:49:01.018840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-adbcfac5-a4db-43ea-9f56-52d5543e9086 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] Calling method '.version_select at 0x7fd64e464310>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:01.039736 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-adbcfac5-a4db-43ea-9f56-52d5543e9086 tempest-TestVolumeBackupRestore-1793763600 tempest-TestVolumeBackupRestore-1793763600-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1733310917" status: 202 len: 0 microversion: 2.1 time: 0.024601 Oct 16 01:49:01.041246 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3365/6596] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Oct 16 01:49:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1733310917 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:49:25.699199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-240282979", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1266830298", "security_groups": [{"name": "tempest-secgroup-smoke-361426714"}], "block_device_mapping_v2": [{"uuid": "85fa1286-1492-4ea2-aff4-cfb8f3a1c9bf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61eb30c5-accf-4cf9-b162-43c4bdd26615"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:49:25.720772 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:25.721858 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:25.820098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] validate_networks() for [('61eb30c5-accf-4cf9-b162-43c4bdd26615', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:49:26.316969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:49:26.317389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:49:26.317895 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:49:26.318299 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:49:26.318760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:49:26.327747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:26.328224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:26.328655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:26.329376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:26.329832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:26.330258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:26.346675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:49:26.351921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Getting quotas for user 2eabe99e40ef44a09c3f7dc1c78d7608 and project 8eda337f3d1440489b32ada0eb50e9ea. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:49:26.410152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:49:26.412395 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85fa1286-1492-4ea2-aff4-cfb8f3a1c9bf',volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:49:26.541430 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-505b0757-4aab-4063-8513-82d7cdbeff83 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.846885 Oct 16 01:49:26.542086 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3232/6597] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:49:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:49:26.553509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abf4ba69-21ce-43f2-8dc1-0af0ddad9e86 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:26.554434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-abf4ba69-21ce-43f2-8dc1-0af0ddad9e86 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:26.557429 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=22 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:26.558741 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:26.618712 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abf4ba69-21ce-43f2-8dc1-0af0ddad9e86 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:26.625926 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abf4ba69-21ce-43f2-8dc1-0af0ddad9e86 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1094 microversion: 2.1 time: 0.076591 Oct 16 01:49:26.626504 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3366/6598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:26 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:49:27.648873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:27.650017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:27.656913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:27.657390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:27.657823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:27.658513 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:27.658993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:27.659422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:27.729113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:27.737298 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-00dfad62-8ebc-4734-872a-aaaf0986b2bb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1192 microversion: 2.1 time: 0.092495 Oct 16 01:49:27.737888 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3233/6599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:27 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:28.761985 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:28.763448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:28.772064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:28.772688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:28.773231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:28.775515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:28.776225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:28.776850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:28.924476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:28.933505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a1b8465b-2c92-4126-83f7-a962ba6e4182 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1277 microversion: 2.1 time: 0.176105 Oct 16 01:49:28.934272 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3367/6600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:28 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:49:29.210052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6b9b5da5-c682-490a-a619-6c706d8fc4eb req-6e34a7c7-fb65-4b98-b913-147c07bfb535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2884d407-87e9-4fba-8e8c-2fa6b2670fca", "tag": "735b5860-6f93-41c1-bc4d-8d5f657c7a2e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:49:29.224574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6b9b5da5-c682-490a-a619-6c706d8fc4eb req-6e34a7c7-fb65-4b98-b913-147c07bfb535 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:29.225278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6b9b5da5-c682-490a-a619-6c706d8fc4eb req-6e34a7c7-fb65-4b98-b913-147c07bfb535 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:29.225810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6b9b5da5-c682-490a-a619-6c706d8fc4eb req-6e34a7c7-fb65-4b98-b913-147c07bfb535 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:29.237860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6b9b5da5-c682-490a-a619-6c706d8fc4eb req-6e34a7c7-fb65-4b98-b913-147c07bfb535 service nova] Creating event network-changed:735b5860-6f93-41c1-bc4d-8d5f657c7a2e for instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca on n-h1-master-1 Oct 16 01:49:29.242898 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6b9b5da5-c682-490a-a619-6c706d8fc4eb req-6e34a7c7-fb65-4b98-b913-147c07bfb535 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036943 Oct 16 01:49:29.243664 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3234/6601] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:49:29.957444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:29.958216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:29.967752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:29.968210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:29.968668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:29.969569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:29.970226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:29.970701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:30.141787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:30.150972 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-703109df-4673-442f-9875-72c2fdcd33b4 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1277 microversion: 2.1 time: 0.197708 Oct 16 01:49:30.152606 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3368/6602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:29 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:31.178191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:31.179071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:31.185833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:31.186400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:31.186899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:31.187689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:31.188245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:31.188758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:31.329181 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:31.338122 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-973a3b8b-c872-48e3-ac07-cb2e6676c8a1 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1277 microversion: 2.1 time: 0.165034 Oct 16 01:49:31.338766 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3235/6603] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:31 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:32.362639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:32.363440 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:32.370335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:32.370835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:32.371308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:32.372021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:32.372561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:32.373053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:32.515411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:32.523663 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cb5c9d7-1c56-425c-8678-52e2292bd12e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1277 microversion: 2.1 time: 0.165093 Oct 16 01:49:32.524846 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3369/6604] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:32 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:33.548053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:33.548725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:33.557247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:33.557815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:33.558279 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:33.559115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:33.559581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:33.560005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:33.698706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:33.706600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0627d30f-46c5-4bb1-8117-00fd3499def8 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.162832 Oct 16 01:49:33.707202 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3236/6605] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:33 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:34.730478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:34.731123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:34.737709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:34.738199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:34.738641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:34.739370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:34.739837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:34.740273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:34.876812 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:34.884917 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e91d3383-0555-48b3-b4f6-32794848c119 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.159618 Oct 16 01:49:34.885505 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3370/6606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:34 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:35.907849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:35.908398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:35.916449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:35.916932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:35.917367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:35.918056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:35.918511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:35.918959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:36.050744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:36.059253 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef027cf5-718b-40c1-ad3c-56038c23909a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.155384 Oct 16 01:49:36.059830 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3237/6607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:35 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:37.085050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:37.085735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:37.089141 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:37.095216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:37.095669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:37.096199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:37.096999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:37.097561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:37.098046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:37.234000 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:37.241768 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9c7dd321-e9a8-4aed-b077-7b9dbfb25636 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.162890 Oct 16 01:49:37.242896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3371/6608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:37 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:38.265955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:38.266565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:38.268680 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:38.269534 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:49:38.276970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:38.277453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:38.277887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:38.278579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:38.279067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:38.279496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:38.409773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:38.418064 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-129d15c9-5a02-4d4b-bffe-ae84c7784dbc tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.156116 Oct 16 01:49:38.418633 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3238/6609] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:38 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:39.440870 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:39.441497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:39.448656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:39.449153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:39.449604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:39.450303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:39.450777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:39.451239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:39.584501 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:39.592785 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-46715430-3600-4948-a31c-0b3db2cac234 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.156081 Oct 16 01:49:39.593371 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3372/6610] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:39 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:40.615416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:40.616038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:40.623308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:40.623801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:40.624248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:40.624957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:40.625426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:40.625858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:40.757347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:40.765889 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-89a5079f-1613-4a99-9095-ae3034eeb1b5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.154403 Oct 16 01:49:40.766489 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3239/6611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:40 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:41.788689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:41.789323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:41.796863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:41.797368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:41.797817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:41.798523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:41.799024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:41.799467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:41.930758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:41.940733 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a01ec0f8-0f65-4940-94e6-3fcb80b6597b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.155893 Oct 16 01:49:41.953258 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3373/6612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:41 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:42.056744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-776c8ef9-d249-4f2d-aabc-3718fe4a0a2f req-6de9702f-a26c-4821-8346-41da47c6400c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2884d407-87e9-4fba-8e8c-2fa6b2670fca", "name": "network-vif-plugged", "status": "completed", "tag": "735b5860-6f93-41c1-bc4d-8d5f657c7a2e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:49:42.068382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-776c8ef9-d249-4f2d-aabc-3718fe4a0a2f req-6de9702f-a26c-4821-8346-41da47c6400c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:42.069061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-776c8ef9-d249-4f2d-aabc-3718fe4a0a2f req-6de9702f-a26c-4821-8346-41da47c6400c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:42.069858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-776c8ef9-d249-4f2d-aabc-3718fe4a0a2f req-6de9702f-a26c-4821-8346-41da47c6400c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:42.085150 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-776c8ef9-d249-4f2d-aabc-3718fe4a0a2f req-6de9702f-a26c-4821-8346-41da47c6400c service nova] Creating event network-vif-plugged:735b5860-6f93-41c1-bc4d-8d5f657c7a2e for instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca on n-h1-master-1 Oct 16 01:49:42.091234 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-776c8ef9-d249-4f2d-aabc-3718fe4a0a2f req-6de9702f-a26c-4821-8346-41da47c6400c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038540 Oct 16 01:49:42.091885 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3240/6613] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:49:42.966834 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:42.967549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:42.974341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:42.974834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:42.975306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:42.976007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:42.976468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:42.976899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:43.110035 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:43.119093 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f4292093-35cd-4aff-b21d-53939c317353 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1265 microversion: 2.1 time: 0.157212 Oct 16 01:49:43.120224 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3374/6614] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:42 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:44.143586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:44.144334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:44.150537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:44.151280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:44.151723 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:44.152420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:44.152908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:44.153335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:44.285196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:44.293639 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bf21939b-48a8-4031-b714-a1f1ae8c9726 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1451 microversion: 2.1 time: 0.155172 Oct 16 01:49:44.294220 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3241/6615] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:44 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:44.316116 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:49:44.316724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:49:44.323563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:44.324056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:44.324499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:44.325192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:44.325659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:44.326092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:44.461189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:49:44.469650 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-24332314-b69b-4079-87c1-ef7278e3e2a5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1451 microversion: 2.1 time: 0.157669 Oct 16 01:49:44.470219 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3375/6616] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:49:44 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:49:46.070023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d75a708c-96ea-4403-82f4-d46c589071a9 req-71f45d5b-be47-4cfd-b234-4e2f192779b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2884d407-87e9-4fba-8e8c-2fa6b2670fca", "tag": "735b5860-6f93-41c1-bc4d-8d5f657c7a2e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:49:46.080685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d75a708c-96ea-4403-82f4-d46c589071a9 req-71f45d5b-be47-4cfd-b234-4e2f192779b5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:49:46.081166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d75a708c-96ea-4403-82f4-d46c589071a9 req-71f45d5b-be47-4cfd-b234-4e2f192779b5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:49:46.081602 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d75a708c-96ea-4403-82f4-d46c589071a9 req-71f45d5b-be47-4cfd-b234-4e2f192779b5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:49:46.093546 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d75a708c-96ea-4403-82f4-d46c589071a9 req-71f45d5b-be47-4cfd-b234-4e2f192779b5 service nova] Creating event network-changed:735b5860-6f93-41c1-bc4d-8d5f657c7a2e for instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca on n-h1-master-1 Oct 16 01:49:46.099383 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d75a708c-96ea-4403-82f4-d46c589071a9 req-71f45d5b-be47-4cfd-b234-4e2f192779b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032688 Oct 16 01:49:46.099998 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3242/6617] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:51:18.275029 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=22 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:18.275799 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=54 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:18.276636 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:51:18.276787 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 01:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca (ip 10.222.0.39) !!! Oct 16 01:51:18.281412 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 01:51:18.282290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:18.282407 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 01:51:18.282808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:18.286239 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-cb92552a-1860-484b-8afe-6d9cdb38f494 req-6ad79f7b-ffd7-4071-a07c-22c00739dec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2884d407-87e9-4fba-8e8c-2fa6b2670fca", "tag": "735b5860-6f93-41c1-bc4d-8d5f657c7a2e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:51:18.290735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:18.291279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:18.291735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:18.292458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:18.292937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:18.293379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:18.297552 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:18.298185 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=50 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:51:18.302031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cb92552a-1860-484b-8afe-6d9cdb38f494 req-6ad79f7b-ffd7-4071-a07c-22c00739dec6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:18.302514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cb92552a-1860-484b-8afe-6d9cdb38f494 req-6ad79f7b-ffd7-4071-a07c-22c00739dec6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:18.303034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-cb92552a-1860-484b-8afe-6d9cdb38f494 req-6ad79f7b-ffd7-4071-a07c-22c00739dec6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:18.316162 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-cb92552a-1860-484b-8afe-6d9cdb38f494 req-6ad79f7b-ffd7-4071-a07c-22c00739dec6 service nova] Creating event network-changed:735b5860-6f93-41c1-bc4d-8d5f657c7a2e for instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca on n-h1-master-1 Oct 16 01:51:18.322708 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-cb92552a-1860-484b-8afe-6d9cdb38f494 req-6ad79f7b-ffd7-4071-a07c-22c00739dec6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045541 Oct 16 01:51:18.323690 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3243/6618] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:51:18.326050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:51:18.416497 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f0b3c7f1-a10a-4ef6-83ec-69260a7b4ec2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 204 len: 0 microversion: 2.1 time: 0.143913 Oct 16 01:51:18.417382 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3376/6619] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:51:18 2022] DELETE /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:51:18.427576 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:18.428691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:18.435750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:18.436832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:18.437589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:18.438801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:18.439499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:18.440153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:18.733731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:18.741548 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-232b4080-007b-4a16-8724-829f97ec2532 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1576 microversion: 2.1 time: 0.318229 Oct 16 01:51:18.742131 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3244/6620] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:18 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1576 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:19.766066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:19.766791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:19.774099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:19.774649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:19.775131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:19.775853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:19.776332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:19.776777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:19.969068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:19.977562 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bcc9a62f-e124-4914-9c47-2fc1cc0fe47e tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1576 microversion: 2.1 time: 0.215851 Oct 16 01:51:19.978076 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3377/6621] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:19 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:20.533814 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-4ccc367a-3da9-402e-9469-2a7d5678e2e1 req-66b1e655-49e7-4f02-b8f9-accc32c4038d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2884d407-87e9-4fba-8e8c-2fa6b2670fca", "name": "network-vif-deleted", "tag": "735b5860-6f93-41c1-bc4d-8d5f657c7a2e"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:51:20.548829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4ccc367a-3da9-402e-9469-2a7d5678e2e1 req-66b1e655-49e7-4f02-b8f9-accc32c4038d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:20.549496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4ccc367a-3da9-402e-9469-2a7d5678e2e1 req-66b1e655-49e7-4f02-b8f9-accc32c4038d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:20.549772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-4ccc367a-3da9-402e-9469-2a7d5678e2e1 req-66b1e655-49e7-4f02-b8f9-accc32c4038d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:20.561558 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60476. Oct 16 01:51:20.562673 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60474. Oct 16 01:51:20.565591 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-4ccc367a-3da9-402e-9469-2a7d5678e2e1 req-66b1e655-49e7-4f02-b8f9-accc32c4038d service nova] Creating event network-vif-deleted:735b5860-6f93-41c1-bc4d-8d5f657c7a2e for instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca on n-h1-master-1 Oct 16 01:51:20.570598 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-4ccc367a-3da9-402e-9469-2a7d5678e2e1 req-66b1e655-49e7-4f02-b8f9-accc32c4038d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040714 Oct 16 01:51:20.571256 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3245/6622] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:51:21.001342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:21.002061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:21.009613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:21.010185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:21.010702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:21.011515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:21.012060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:21.012503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:21.074809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:21.082800 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-64ed1296-3589-457d-a86e-bd7bec3b3fe6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1225 microversion: 2.1 time: 0.085493 Oct 16 01:51:21.083402 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3378/6623] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:20 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:22.107670 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:22.108372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:22.114708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:22.115720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:22.116199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:22.116875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:22.117337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:22.117765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:22.181788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:22.190421 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-24e9cf32-cd30-4758-900a-b7080fcaec1d tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1225 microversion: 2.1 time: 0.088212 Oct 16 01:51:22.191047 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3246/6624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:22 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:23.214023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:23.215443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:23.222275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:23.222777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:23.223258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:23.223966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:23.224441 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:23.225661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:23.288059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:23.296085 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a3979659-f632-4aba-a7b3-f06a2f90ac20 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1225 microversion: 2.1 time: 0.085987 Oct 16 01:51:23.296891 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3379/6625] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:23 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:24.319786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:24.320393 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:24.327751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:24.328233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:24.328666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:24.329360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:24.329821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:24.330246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:24.395694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:24.403986 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-398fbbe4-89c4-4055-a460-625440824704 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 200 len: 1225 microversion: 2.1 time: 0.088134 Oct 16 01:51:24.404562 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3247/6626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:24 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:25.428361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:25.429108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 2884d407-87e9-4fba-8e8c-2fa6b2670fca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:25.436571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:25.437134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:25.437896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:25.438624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:25.439129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:25.439575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:25.454643 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca could not be found. Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca HTTP/1.1 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca could not be found. Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '2884d407-87e9-4fba-8e8c-2fa6b2670fca'} Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca could not be found. Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca could not be found. Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:51:25.456379 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca could not be found. Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 2884d407-87e9-4fba-8e8c-2fa6b2670fca could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-86a22f1c-c62e-4fab-be1a-d5962c674336 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca" status: 404 len: 111 microversion: 2.1 time: 0.034175 Oct 16 01:51:25.460183 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3380/6627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:25 2022] GET /compute/v2.1/servers/2884d407-87e9-4fba-8e8c-2fa6b2670fca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:51:31.691156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:31.691685 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:31.693256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-fb4425c9-f01d-4be8-b710-56c4c384f7e6 req-6bd74308-4c59-4ecc-9894-a3513f1fbf58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5290dd10-8645-4a1f-a126-828b2267dbd3", "tag": "bbd2f57f-1925-4622-aaa8-cb9d25c5f877"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:51:31.699820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:31.700762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:31.701203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:31.702139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:31.702605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:31.703061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:31.705156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fb4425c9-f01d-4be8-b710-56c4c384f7e6 req-6bd74308-4c59-4ecc-9894-a3513f1fbf58 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:31.705716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fb4425c9-f01d-4be8-b710-56c4c384f7e6 req-6bd74308-4c59-4ecc-9894-a3513f1fbf58 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:31.706250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-fb4425c9-f01d-4be8-b710-56c4c384f7e6 req-6bd74308-4c59-4ecc-9894-a3513f1fbf58 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:31.718680 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-fb4425c9-f01d-4be8-b710-56c4c384f7e6 req-6bd74308-4c59-4ecc-9894-a3513f1fbf58 service nova] Creating event network-changed:bbd2f57f-1925-4622-aaa8-cb9d25c5f877 for instance 5290dd10-8645-4a1f-a126-828b2267dbd3 on n-h2-master-1 Oct 16 01:51:31.723941 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-fb4425c9-f01d-4be8-b710-56c4c384f7e6 req-6bd74308-4c59-4ecc-9894-a3513f1fbf58 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Oct 16 01:51:31.724776 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3381/6628] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:51:31.732750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:51:31.821259 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81f119fb-84bd-4611-923f-f77e7d802d2b tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 204 len: 0 microversion: 2.1 time: 0.133137 Oct 16 01:51:31.826001 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3248/6629] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:51:31 2022] DELETE /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:51:31.831270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:31.831991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:31.839191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:31.839732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:31.840187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:31.840913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:31.841390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:31.841834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:31.985998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:31.995781 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-afe620a6-26ca-420f-aff1-fca7781221c2 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1575 microversion: 2.1 time: 0.168616 Oct 16 01:51:31.996578 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3382/6630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:31 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:51:33.020158 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:33.020776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:33.027991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:33.028472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:33.028910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:33.029594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:33.030048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:33.030468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:33.218741 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:33.227533 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-07cab78d-8b55-4d0f-90a0-6b879b7634e6 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1575 microversion: 2.1 time: 0.211691 Oct 16 01:51:33.228485 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3249/6631] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:33 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:34.252226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:34.252850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:34.260495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:34.260988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:34.261432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:34.262136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:34.262605 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:34.263064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:34.402337 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:34.410612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4a026da7-008b-4421-b5ca-fef7190fec9a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1457 microversion: 2.1 time: 0.162269 Oct 16 01:51:34.411310 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3383/6632] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:34 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1457 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:34.600086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a682fb15-e0db-4cf3-994e-656e12507ff9 req-47fbaaef-5ce5-4901-8dc8-f56b4d5268e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5290dd10-8645-4a1f-a126-828b2267dbd3", "name": "network-vif-deleted", "tag": "bbd2f57f-1925-4622-aaa8-cb9d25c5f877"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:51:34.611759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a682fb15-e0db-4cf3-994e-656e12507ff9 req-47fbaaef-5ce5-4901-8dc8-f56b4d5268e8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:34.612244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a682fb15-e0db-4cf3-994e-656e12507ff9 req-47fbaaef-5ce5-4901-8dc8-f56b4d5268e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:34.612683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a682fb15-e0db-4cf3-994e-656e12507ff9 req-47fbaaef-5ce5-4901-8dc8-f56b4d5268e8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:34.624462 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a682fb15-e0db-4cf3-994e-656e12507ff9 req-47fbaaef-5ce5-4901-8dc8-f56b4d5268e8 service nova] Creating event network-vif-deleted:bbd2f57f-1925-4622-aaa8-cb9d25c5f877 for instance 5290dd10-8645-4a1f-a126-828b2267dbd3 on n-h2-master-1 Oct 16 01:51:34.629721 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a682fb15-e0db-4cf3-994e-656e12507ff9 req-47fbaaef-5ce5-4901-8dc8-f56b4d5268e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033168 Oct 16 01:51:34.630464 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3250/6633] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:51:35.434439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:35.435109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:35.442552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:35.443089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:35.443536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:35.444421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:35.445176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:35.445627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:35.511586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:35.519693 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d9b968df-7c23-4dab-9a26-848ae0a15095 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1225 microversion: 2.1 time: 0.089085 Oct 16 01:51:35.520284 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3384/6634] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:35 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:36.544697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:36.545356 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:36.552073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:36.552520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:36.552965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:36.554205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:36.554673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:36.555127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:36.618667 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:36.626467 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d8df8396-ebf4-408b-8f8b-33f29c67abeb tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1225 microversion: 2.1 time: 0.086983 Oct 16 01:51:36.627211 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3251/6635] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:36 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:37.649907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:37.650536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:37.657542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:37.658046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:37.658493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:37.659248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:37.659722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:37.660164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:37.728738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:37.736826 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ddae6d74-468f-489f-8d95-99a094bf59cd tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1225 microversion: 2.1 time: 0.090912 Oct 16 01:51:37.737415 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3385/6636] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:37 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:38.761164 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:38.762043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:38.769319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:38.769811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:38.770257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:38.771013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:38.771469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:38.771905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:38.802476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:38.802990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:38.804169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:38.804629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lazy-loading 'fault' on Instance uuid 5290dd10-8645-4a1f-a126-828b2267dbd3 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:51:38.847679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eabe99e40ef44a09c3f7dc1c78d7608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eda337f3d1440489b32ada0eb50e9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:51:38.856121 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b680caf-419f-4b78-b8d2-93bbbc20c5fa tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 200 len: 1230 microversion: 2.1 time: 0.099738 Oct 16 01:51:38.856702 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3252/6637] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:38 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:51:39.880076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:39.880612 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 5290dd10-8645-4a1f-a126-828b2267dbd3] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:39.888586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:39.889082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:39.889524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:39.890220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:39.890683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:39.891145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:39.905266 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 5290dd10-8645-4a1f-a126-828b2267dbd3 could not be found. Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 HTTP/1.1 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 5290dd10-8645-4a1f-a126-828b2267dbd3 could not be found. Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '5290dd10-8645-4a1f-a126-828b2267dbd3'} Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5290dd10-8645-4a1f-a126-828b2267dbd3 could not be found. Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5290dd10-8645-4a1f-a126-828b2267dbd3 could not be found. Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:51:39.906894 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5290dd10-8645-4a1f-a126-828b2267dbd3 could not be found. Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 5290dd10-8645-4a1f-a126-828b2267dbd3 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a90f62c-f837-4c39-8ccc-ed238651e308 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3" status: 404 len: 111 microversion: 2.1 time: 0.032199 Oct 16 01:51:39.911581 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3386/6638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:39 2022] GET /compute/v2.1/servers/5290dd10-8645-4a1f-a126-828b2267dbd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:51:40.347773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:40.348261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:40.355678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:40.356162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:40.356599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:40.357313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:40.357768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:40.358193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:40.371922 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b HTTP/1.1 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '6f6c8da3-c129-48f7-a984-07c016af226b'} Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:51:40.373587 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3e9a13b-f0df-4f45-a55d-ca2ba788fce5 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 404 len: 111 microversion: 2.1 time: 0.031151 Oct 16 01:51:40.377237 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3253/6639] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:51:40 2022] DELETE /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:51:40.383890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:40.384551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] [instance: 6f6c8da3-c129-48f7-a984-07c016af226b] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:51:40.390569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:40.391111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:40.391572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:40.392283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:51:40.392761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:51:40.393206 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:51:40.407073 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] HTTP exception thrown: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Request method failure captured: Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b HTTP/1.1 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2CfM36BML-VlmpWdevAHqAnrXezq1e3eMEJdFXfab_aVoqlJ283-1smo6Tp7rtauy95LSvAYD9uCyIt5qA32k84wI2bnz75r2nfnyWnzGUvbJ1W3qU8032-h8qlnHuEa-McejcZExWabfyUa5o4E-k7Yei7o0PgF97fauILVwLfHA8 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8eda337f3d1440489b32ada0eb50e9ea", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8eda337f3d1440489b32ada0eb50e9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8eda337f3d1440489b32ada0eb50e9ea Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestVolumeBootPattern-1424484974 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 2eabe99e40ef44a09c3f7dc1c78d7608 Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestVolumeBootPattern-1424484974-project Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6f6c8da3-c129-48f7-a984-07c016af226b'} Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:51:40.408602 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Returning 404 to user: Instance 6f6c8da3-c129-48f7-a984-07c016af226b could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bae1caa9-1117-4171-a6fe-c813ae0c248a tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b" status: 404 len: 111 microversion: 2.1 time: 0.030296 Oct 16 01:51:40.413300 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3387/6640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:51:40 2022] GET /compute/v2.1/servers/6f6c8da3-c129-48f7-a984-07c016af226b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:51:43.839377 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-04c88e3d-7067-4884-83ce-9a9874a98585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] Calling method '.version_select at 0x7fd652747820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:51:43.866443 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-04c88e3d-7067-4884-83ce-9a9874a98585 tempest-TestVolumeBootPattern-1424484974 tempest-TestVolumeBootPattern-1424484974-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1266830298" status: 202 len: 0 microversion: 2.1 time: 0.030761 Oct 16 01:51:43.871097 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3254/6641] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Oct 16 01:51:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1266830298 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:52:01.989676 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:01.990093 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:02.098731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-344409023", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:02.153425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] validate_networks() for None {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:52:02.680968 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:52:02.681403 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:52:02.681910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:52:02.682335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:52:02.682763 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:52:02.691968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:02.692471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:02.692925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:02.693675 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:02.694149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:02.695153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:02.712235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Getting quotas for project 9b527bb4b1034663ad0b86d62b5ec7dc. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:52:02.717477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Getting quotas for user fda81b2e6ba44b9291b86ae6581a7813 and project 9b527bb4b1034663ad0b86d62b5ec7dc. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:52:02.729740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:52:02.732042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:52:02.777008 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-beb9285d-6926-417e-b76e-e18454fcf709 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793317 Oct 16 01:52:02.777653 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3388/6642] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:52:02.790257 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b1914a1e-c6a8-4f96-aa10-3bea350610c1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:02.790996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b1914a1e-c6a8-4f96-aa10-3bea350610c1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:02.795305 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:02.796097 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:02.855032 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b1914a1e-c6a8-4f96-aa10-3bea350610c1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:02.862490 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b1914a1e-c6a8-4f96-aa10-3bea350610c1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1221 microversion: 2.1 time: 0.076152 Oct 16 01:52:02.863254 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3255/6643] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:02 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:03.886934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:03.887506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:03.894313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:03.894821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:03.895305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:03.896021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:03.896497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:03.896939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:03.962714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:03.971463 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ab18288-a0db-4c3a-8369-b8126e9f1112 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1273 microversion: 2.1 time: 0.089395 Oct 16 01:52:03.972518 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3389/6644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:03 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:04.997738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:04.998465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:05.005461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:05.005955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:05.006460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:05.007672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:05.008242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:05.008670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:05.158137 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:05.166230 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d13d8d5-0d48-4a0c-bbde-fa8b4bdf0ebd tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1321 microversion: 2.1 time: 0.172406 Oct 16 01:52:05.166826 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3256/6645] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:04 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:05.574507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0eaa3b52-24c8-46a5-8079-5f6b42ea948b req-e6491283-a52e-4812-ba51-f47d26e57fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c41b23c-e9cf-462c-b1dd-9c5973d0a217", "tag": "e8f3fa69-1167-4dc3-9a1a-45825a1976be"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:05.584467 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0eaa3b52-24c8-46a5-8079-5f6b42ea948b req-e6491283-a52e-4812-ba51-f47d26e57fb0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:05.585635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0eaa3b52-24c8-46a5-8079-5f6b42ea948b req-e6491283-a52e-4812-ba51-f47d26e57fb0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:05.586312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0eaa3b52-24c8-46a5-8079-5f6b42ea948b req-e6491283-a52e-4812-ba51-f47d26e57fb0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:05.600270 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0eaa3b52-24c8-46a5-8079-5f6b42ea948b req-e6491283-a52e-4812-ba51-f47d26e57fb0 service nova] Creating event network-changed:e8f3fa69-1167-4dc3-9a1a-45825a1976be for instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 on n-h1-master-1 Oct 16 01:52:05.607266 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0eaa3b52-24c8-46a5-8079-5f6b42ea948b req-e6491283-a52e-4812-ba51-f47d26e57fb0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037472 Oct 16 01:52:05.608267 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3390/6646] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:06.190276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:06.190892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:06.197869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:06.198361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:06.198799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:06.199520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:06.199980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:06.200411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:06.330030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:06.338284 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f67b1d89-cd5e-402d-949e-3ba7b5305f53 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1321 microversion: 2.1 time: 0.152263 Oct 16 01:52:06.338873 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3257/6647] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:06 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:07.362597 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:07.363479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:07.371556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:07.372048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:07.372493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:07.373216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:07.373682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:07.374116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:07.505688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:07.513451 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0efd41b0-f9b7-4b71-b273-ecf429ed6c2a tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1321 microversion: 2.1 time: 0.155415 Oct 16 01:52:07.514030 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3391/6648] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:07 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:08.535982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:08.536532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:08.543397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:08.544114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:08.544555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:08.545267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:08.545730 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:08.546165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:08.684229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:08.692192 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6dd0944-5e33-42ae-ad1a-85c0acdb31e1 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1321 microversion: 2.1 time: 0.160288 Oct 16 01:52:08.692768 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3258/6649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:08 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:09.716525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:09.717154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:09.724098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:09.724599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:09.725055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:09.726492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:09.726991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:09.727442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:09.862172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:09.870027 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f9d4a7ac-5946-4651-bd86-c3f2f2a01b42 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1321 microversion: 2.1 time: 0.157498 Oct 16 01:52:09.870597 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3392/6650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:09 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:10.622444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c0ce53b3-5bac-4f1e-9337-2bdf95f8cb76 req-dabed81a-196c-4d7c-ba17-543c930ae6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c41b23c-e9cf-462c-b1dd-9c5973d0a217", "name": "network-vif-plugged", "status": "completed", "tag": "e8f3fa69-1167-4dc3-9a1a-45825a1976be"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:10.634205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c0ce53b3-5bac-4f1e-9337-2bdf95f8cb76 req-dabed81a-196c-4d7c-ba17-543c930ae6e7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:10.635580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c0ce53b3-5bac-4f1e-9337-2bdf95f8cb76 req-dabed81a-196c-4d7c-ba17-543c930ae6e7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:10.636042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c0ce53b3-5bac-4f1e-9337-2bdf95f8cb76 req-dabed81a-196c-4d7c-ba17-543c930ae6e7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:10.648225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c0ce53b3-5bac-4f1e-9337-2bdf95f8cb76 req-dabed81a-196c-4d7c-ba17-543c930ae6e7 service nova] Creating event network-vif-plugged:e8f3fa69-1167-4dc3-9a1a-45825a1976be for instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 on n-h1-master-1 Oct 16 01:52:10.653501 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c0ce53b3-5bac-4f1e-9337-2bdf95f8cb76 req-dabed81a-196c-4d7c-ba17-543c930ae6e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Oct 16 01:52:10.654142 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3259/6651] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:10.893065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:10.893692 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:10.901098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:10.901598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:10.902049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:10.902756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:10.903254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:10.903695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:11.036531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:11.044819 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b51ec305-d871-4a0a-9ce2-4c6131e5f2c8 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1321 microversion: 2.1 time: 0.155666 Oct 16 01:52:11.045403 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3393/6652] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:10 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:12.070226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:12.070938 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:12.077131 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:12.077613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:12.078077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:12.078771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:12.079265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:12.079699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:12.207793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:12.215926 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3af365b8-821a-4991-8c0c-4d72813ae482 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1470 microversion: 2.1 time: 0.151537 Oct 16 01:52:12.216506 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3260/6653] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:12 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:12.291512 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e7b0eaf-c4e6-45fc-abdb-4761c63880ff tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Calling method '.version_select at 0x7fd64e1393a0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:12.357396 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e7b0eaf-c4e6-45fc-abdb-4761c63880ff tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/62367f9e21c34dc8905188d0d896c228" status: 200 len: 371 microversion: 2.1 time: 0.120480 Oct 16 01:52:12.357977 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3394/6654] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:52:12 2022] GET /compute/v2.1/os-quota-sets/62367f9e21c34dc8905188d0d896c228 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:12.370682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-28207018-baaf-4c0a-9d4b-f82d262da9db tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1936526307", "id": 876290963, "os-flavor-access:is_public": "True"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:12.388387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-28207018-baaf-4c0a-9d4b-f82d262da9db tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.021408 Oct 16 01:52:12.388965 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3261/6655] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:52:12 2022] POST /compute/v2.1/flavors => generated 435 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:12.401685 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "876290963"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:12.404087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:12.410616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:12.411142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:12.411589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:12.412284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:12.413330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:12.413930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:12.597115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cb9dfacb8b3f40d1b081ad000cd4fb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62367f9e21c34dc8905188d0d896c228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:12.603750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1936526307 {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:52:12.610290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:12.610784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:12.611282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:12.612011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:12.612470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:12.612900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:12.636371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Getting quotas for project 9b527bb4b1034663ad0b86d62b5ec7dc. Resources: {'ram', 'cores'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:52:12.641301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Getting quotas for user fda81b2e6ba44b9291b86ae6581a7813 and project 9b527bb4b1034663ad0b86d62b5ec7dc. Resources: {'ram', 'cores'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:52:12.654966 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] ram quota exceeded for 62367f9e21c34dc8905188d0d896c228, tried to resize instance. Oct 16 01:52:12.655511 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Request method failure captured: Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217/action HTTP/1.1 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 38 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2PBwpCBcET9ird4DphjAbX-TOND9cMqKjp2qSDeeaeGr8AC2bgecUasxVegsLoqr7xqHdgGvYxTNdcs9iSIXMUBNgdj7QDNEzALb0y4wscsA3eHLf2LJFBOBdFx3KGthVSS-oFGcKU895MdtxX_x67VqZzG9Ikyr3peyG9BqkJzYyE Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 62367f9e21c34dc8905188d0d896c228 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1438300002 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader,admin Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader,admin Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62367f9e21c34dc8905188d0d896c228", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62367f9e21c34dc8905188d0d896c228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62367f9e21c34dc8905188d0d896c228"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62367f9e21c34dc8905188d0d896c228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1438300002 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 62367f9e21c34dc8905188d0d896c228 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1438300002 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersAdminNegativeTestJSON-1438300002-project-admin Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: cb9dfacb8b3f40d1b081ad000cd4fb31 Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1438300002-project-admin Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: {"resize": {"flavorRef": "876290963"}} Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '7c41b23c-e9cf-462c-b1dd-9c5973d0a217', 'body': {'resize': {'flavorRef': '876290963'}}} Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:52:12.668126 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1002c8c6-21b4-4880-abe7-83f27d39fc79 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217/action" status: 403 len: 118 microversion: 2.1 time: 0.272195 Oct 16 01:52:12.672719 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3395/6656] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:52:12 2022] POST /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217/action => generated 118 bytes in 273 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:52:12.679485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0b5f8d8d-52e0-4281-8810-003d5d8446cf tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:12.696448 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0b5f8d8d-52e0-4281-8810-003d5d8446cf tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/876290963" status: 202 len: 0 microversion: 2.1 time: 0.021442 Oct 16 01:52:12.696997 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3262/6657] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Oct 16 01:52:12 2022] DELETE /compute/v2.1/flavors/876290963 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:52:12.704755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73d9a75c-830a-4be9-88a0-6c70aca0901e tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:12.725028 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-73d9a75c-830a-4be9-88a0-6c70aca0901e tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023850 Oct 16 01:52:12.726251 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3396/6658] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:52:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:12.746198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3baf12c3-c5c2-4e71-b402-c99dec666a46 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Calling method '.version_select at 0x7fd64d079820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:12.828939 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3baf12c3-c5c2-4e71-b402-c99dec666a46 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/62367f9e21c34dc8905188d0d896c228" status: 200 len: 371 microversion: 2.1 time: 0.086286 Oct 16 01:52:12.829626 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3263/6659] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Oct 16 01:52:12 2022] GET /compute/v2.1/os-quota-sets/62367f9e21c34dc8905188d0d896c228 => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:12.842141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-304a8e11-a5ab-408a-85d9-51997253ce17 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-427511885", "id": 1359891429, "os-flavor-access:is_public": "True"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:12.862674 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-304a8e11-a5ab-408a-85d9-51997253ce17 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024507 Oct 16 01:52:12.863317 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3397/6660] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:52:12 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:12.876582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1359891429"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:12.879197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:12.887346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:12.887909 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:12.888756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:12.889646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:12.890115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:12.890552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:13.001199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cb9dfacb8b3f40d1b081ad000cd4fb31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62367f9e21c34dc8905188d0d896c228', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:13.008530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-427511885 {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:52:13.015712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:13.016573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:13.017350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:13.018089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:13.018744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:13.019609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:13.044732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Getting quotas for project 9b527bb4b1034663ad0b86d62b5ec7dc. Resources: {'ram', 'cores'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:52:13.049828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Getting quotas for user fda81b2e6ba44b9291b86ae6581a7813 and project 9b527bb4b1034663ad0b86d62b5ec7dc. Resources: {'ram', 'cores'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:52:13.063309 n-d-master-1 devstack@n-api.service[120546]: INFO nova.compute.api [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] cores quota exceeded for 62367f9e21c34dc8905188d0d896c228, tried to resize instance. Oct 16 01:52:13.063859 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Request method failure captured: Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217/action HTTP/1.1 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 39 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2PBwpCBcET9ird4DphjAbX-TOND9cMqKjp2qSDeeaeGr8AC2bgecUasxVegsLoqr7xqHdgGvYxTNdcs9iSIXMUBNgdj7QDNEzALb0y4wscsA3eHLf2LJFBOBdFx3KGthVSS-oFGcKU895MdtxX_x67VqZzG9Ikyr3peyG9BqkJzYyE Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 62367f9e21c34dc8905188d0d896c228 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1438300002 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader,admin Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader,admin Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62367f9e21c34dc8905188d0d896c228", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62367f9e21c34dc8905188d0d896c228"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62367f9e21c34dc8905188d0d896c228"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62367f9e21c34dc8905188d0d896c228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1438300002 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 62367f9e21c34dc8905188d0d896c228 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1438300002 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersAdminNegativeTestJSON-1438300002-project-admin Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: cb9dfacb8b3f40d1b081ad000cd4fb31 Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1438300002-project-admin Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: {"resize": {"flavorRef": "1359891429"}} Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7c41b23c-e9cf-462c-b1dd-9c5973d0a217', 'body': {'resize': {'flavorRef': '1359891429'}}} Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:52:13.065963 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9dcde008-130e-474a-b5ef-b232e00ecfc3 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217/action" status: 403 len: 113 microversion: 2.1 time: 0.195524 Oct 16 01:52:13.071011 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3264/6661] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:52:12 2022] POST /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217/action => generated 113 bytes in 197 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:52:13.078562 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22b15a12-66a0-46f0-a186-a5e27fb46f03 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:13.099076 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22b15a12-66a0-46f0-a186-a5e27fb46f03 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1359891429" status: 202 len: 0 microversion: 2.1 time: 0.024156 Oct 16 01:52:13.099767 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3398/6662] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Oct 16 01:52:13 2022] DELETE /compute/v2.1/flavors/1359891429 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:52:13.108215 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-549b6461-e038-4f6d-bd29-f1ca26c74dd1 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:13.137588 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-549b6461-e038-4f6d-bd29-f1ca26c74dd1 tempest-ServersAdminNegativeTestJSON-1438300002 tempest-ServersAdminNegativeTestJSON-1438300002-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033113 Oct 16 01:52:13.138188 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3265/6663] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Oct 16 01:52:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:13.159805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:13.160341 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:13.167995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:13.168498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:13.168942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:13.169645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:13.170114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:13.170552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:13.206428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:52:13.294557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eef342b0-3c58-48a9-add7-b88e6a79c186 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 204 len: 0 microversion: 2.1 time: 0.138379 Oct 16 01:52:13.295412 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3399/6664] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:52:13 2022] DELETE /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:52:13.303884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:13.304716 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:13.311543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:13.312295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:13.312742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:13.314032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:13.314693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:13.315165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:13.465849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:13.476971 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-541e222d-ac7c-4c6a-a2fc-34c285b7b425 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1476 microversion: 2.1 time: 0.176733 Oct 16 01:52:13.477936 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3266/6665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:13 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1476 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:14.504954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:14.505837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:14.514042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:14.514546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:14.515032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:14.515741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:14.516216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:14.516656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:14.645018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:14.653300 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f72cbd94-bf13-46cf-8639-78eeb2197436 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1476 microversion: 2.1 time: 0.152794 Oct 16 01:52:14.653877 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3400/6666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:14 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:15.163196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1b519ef9-670c-4913-9af1-e8064292ab50 req-da48d20a-db49-402c-b355-1ad8c0bdd72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c41b23c-e9cf-462c-b1dd-9c5973d0a217", "name": "network-vif-deleted", "tag": "e8f3fa69-1167-4dc3-9a1a-45825a1976be"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:15.176656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b519ef9-670c-4913-9af1-e8064292ab50 req-da48d20a-db49-402c-b355-1ad8c0bdd72e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:15.177152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b519ef9-670c-4913-9af1-e8064292ab50 req-da48d20a-db49-402c-b355-1ad8c0bdd72e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:15.177589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1b519ef9-670c-4913-9af1-e8064292ab50 req-da48d20a-db49-402c-b355-1ad8c0bdd72e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:15.190532 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1b519ef9-670c-4913-9af1-e8064292ab50 req-da48d20a-db49-402c-b355-1ad8c0bdd72e service nova] Creating event network-vif-deleted:e8f3fa69-1167-4dc3-9a1a-45825a1976be for instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 on n-h1-master-1 Oct 16 01:52:15.197237 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1b519ef9-670c-4913-9af1-e8064292ab50 req-da48d20a-db49-402c-b355-1ad8c0bdd72e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038479 Oct 16 01:52:15.197862 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3267/6667] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:15.676610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:15.677233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:15.685023 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:15.685540 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:15.685989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:15.686722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:15.687575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:15.688197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:15.722075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:15.722578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:15.723056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:15.723514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lazy-loading 'fault' on Instance uuid 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:52:15.769759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81b2e6ba44b9291b86ae6581a7813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b527bb4b1034663ad0b86d62b5ec7dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:15.777025 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b16b27fc-317f-4bc4-a1b6-35a10ebbbc79 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 200 len: 1311 microversion: 2.1 time: 0.104599 Oct 16 01:52:15.777590 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3401/6668] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:15 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:16.802317 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:16.803999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] [instance: 7c41b23c-e9cf-462c-b1dd-9c5973d0a217] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:16.810613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:16.811137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:16.811629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:16.812519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:16.812974 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:16.813410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:16.826676 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] HTTP exception thrown: Instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 could not be found. Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Request method failure captured: Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 HTTP/1.1 Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2PBBssN6001eXOMk4aKOYI5A3zwzDhwoGDNPqm4l3ZB7mTDP3ROwyFvtr2asygCtiHOL1TbtvXy9FklzoCCCBavXtqcJJ-Gn4cFQfNLDuZTu-Rpl6B7Lc5LuSVkIHIMoDCiF2P_bmu6ae5ZAY3N9sVuZXjFYttpgRvy4kg0KQGSMTs Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 9b527bb4b1034663ad0b86d62b5ec7dc Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2123948317 Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b527bb4b1034663ad0b86d62b5ec7dc", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b527bb4b1034663ad0b86d62b5ec7dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b527bb4b1034663ad0b86d62b5ec7dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b527bb4b1034663ad0b86d62b5ec7dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2123948317 Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 9b527bb4b1034663ad0b86d62b5ec7dc Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2123948317 Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersAdminNegativeTestJSON-2123948317-project Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: fda81b2e6ba44b9291b86ae6581a7813 Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2123948317-project Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 could not be found. Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7c41b23c-e9cf-462c-b1dd-9c5973d0a217'} Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 could not be found. Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 could not be found. Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:16.828323 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 could not be found. Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] Returning 404 to user: Instance 7c41b23c-e9cf-462c-b1dd-9c5973d0a217 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-27ebaf2d-31be-4c2b-b4a7-7ff6abe15ea4 tempest-ServersAdminNegativeTestJSON-2123948317 tempest-ServersAdminNegativeTestJSON-2123948317-project] 10.222.0.39 "GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217" status: 404 len: 111 microversion: 2.1 time: 0.033440 Oct 16 01:52:16.832653 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3268/6669] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:16 2022] GET /compute/v2.1/servers/7c41b23c-e9cf-462c-b1dd-9c5973d0a217 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:52:22.920038 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:22.921306 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=5 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:23.042386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-201863456", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "e1911e56-9626-4eea-8286-ebd52ee59248"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:23.099533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] validate_networks() for [('e1911e56-9626-4eea-8286-ebd52ee59248', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:52:23.486540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:52:23.487039 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:52:23.487532 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:52:23.487958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:52:23.488387 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:52:23.497772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:23.498273 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:23.498724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:23.499514 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:23.499993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:23.500437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:23.517586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Getting quotas for project 924af2c85e58409f98d3f36ed18a2c54. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:52:23.523216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Getting quotas for user b7e66bc068b34d9d865a4cc9b73d28d2 and project 924af2c85e58409f98d3f36ed18a2c54. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:52:23.536210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:52:23.539266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:52:23.586108 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7be93c21-fa04-4871-8c54-efcec6f7d3bf tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671798 Oct 16 01:52:23.586771 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3402/6670] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:52:23.598076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-655924c7-735f-4510-b145-c383639ed7a1 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:23.598688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-655924c7-735f-4510-b145-c383639ed7a1 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:23.603718 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:23.604774 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:23.660816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-655924c7-735f-4510-b145-c383639ed7a1 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:23.668933 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-655924c7-735f-4510-b145-c383639ed7a1 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1214 microversion: 2.1 time: 0.074753 Oct 16 01:52:23.669513 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3269/6671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:23 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:24.694212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:24.695089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:24.702263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:24.703106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:24.703741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:24.704457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:24.704933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:24.705374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:24.775379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:24.783471 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca2bda69-ad8b-459f-b6b1-b962c3deb3d8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1274 microversion: 2.1 time: 0.094373 Oct 16 01:52:24.785930 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3403/6672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:24 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:25.809773 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:25.810560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:25.820771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:25.821600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:25.822942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:25.823899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:25.824573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:25.825217 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:26.001828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:26.010519 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2aeece73-0b06-4686-aef7-eadfc458c9a0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1314 microversion: 2.1 time: 0.206756 Oct 16 01:52:26.011139 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3270/6673] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:25 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:26.281716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3d2431e0-0f1d-4572-9b89-9813de8370c0 req-4a7e9b19-1de0-4e5c-934a-b3ba983dd236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5e88b5-6269-47bb-bbc9-d47452a13ab6", "tag": "40231dd0-fe94-40e0-814f-0901407543a8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:26.310278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d2431e0-0f1d-4572-9b89-9813de8370c0 req-4a7e9b19-1de0-4e5c-934a-b3ba983dd236 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:26.311315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d2431e0-0f1d-4572-9b89-9813de8370c0 req-4a7e9b19-1de0-4e5c-934a-b3ba983dd236 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:26.312239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d2431e0-0f1d-4572-9b89-9813de8370c0 req-4a7e9b19-1de0-4e5c-934a-b3ba983dd236 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:26.327822 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3d2431e0-0f1d-4572-9b89-9813de8370c0 req-4a7e9b19-1de0-4e5c-934a-b3ba983dd236 service nova] Creating event network-changed:40231dd0-fe94-40e0-814f-0901407543a8 for instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 on n-h1-master-1 Oct 16 01:52:26.338897 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3d2431e0-0f1d-4572-9b89-9813de8370c0 req-4a7e9b19-1de0-4e5c-934a-b3ba983dd236 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060727 Oct 16 01:52:26.339855 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3404/6674] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:27.034095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:27.034715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:27.041847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:27.042341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:27.042810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:27.043541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:27.044010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:27.044501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:27.174340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:27.182701 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-03901af2-9d8f-4147-92b9-e360ca52f154 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1314 microversion: 2.1 time: 0.152613 Oct 16 01:52:27.183324 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3271/6675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:27 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:28.207046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:28.207806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:28.214569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:28.215107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:28.215566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:28.216269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:28.216742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:28.217183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:28.357760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:28.365553 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a9b0c420-a8ed-4b44-a765-d8b7ca19ed4d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1314 microversion: 2.1 time: 0.163592 Oct 16 01:52:28.366248 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3405/6676] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:28 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:52:29.389836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:29.390479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:29.398181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:29.398689 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:29.399144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:29.399841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:29.400303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:29.400735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:29.530962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:29.539088 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-39efccfe-0351-40b5-a1a2-02a8fb68be57 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1314 microversion: 2.1 time: 0.153485 Oct 16 01:52:29.539675 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3272/6677] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:29 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:30.562721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:30.565275 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:30.572955 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:30.573765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:30.574344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:30.575388 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:30.575857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:30.576292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:30.713911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:30.722177 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5befb577-ffc5-4b08-9b63-912ab72568fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1314 microversion: 2.1 time: 0.163518 Oct 16 01:52:30.722814 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3406/6678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:30 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:30.776141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b28f52b0-750d-48b3-9809-ed0a841a5b14 req-71debf21-fa5b-419f-ab51-ff06e4737b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e88b5-6269-47bb-bbc9-d47452a13ab6", "name": "network-vif-plugged", "status": "completed", "tag": "40231dd0-fe94-40e0-814f-0901407543a8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:30.785519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b28f52b0-750d-48b3-9809-ed0a841a5b14 req-71debf21-fa5b-419f-ab51-ff06e4737b32 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:30.786024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b28f52b0-750d-48b3-9809-ed0a841a5b14 req-71debf21-fa5b-419f-ab51-ff06e4737b32 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:30.786459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b28f52b0-750d-48b3-9809-ed0a841a5b14 req-71debf21-fa5b-419f-ab51-ff06e4737b32 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:30.797338 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b28f52b0-750d-48b3-9809-ed0a841a5b14 req-71debf21-fa5b-419f-ab51-ff06e4737b32 service nova] Creating event network-vif-plugged:40231dd0-fe94-40e0-814f-0901407543a8 for instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 on n-h1-master-1 Oct 16 01:52:30.803626 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b28f52b0-750d-48b3-9809-ed0a841a5b14 req-71debf21-fa5b-419f-ab51-ff06e4737b32 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115764 Oct 16 01:52:30.804243 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3273/6679] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:52:31.746267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:31.746884 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:31.754000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:31.754499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:31.754980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:31.756314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:31.756861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:31.757292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:31.895998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:31.903827 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69e6bf4e-7bd2-40da-a4c0-36651d7337c6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1314 microversion: 2.1 time: 0.161464 Oct 16 01:52:31.904394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3407/6680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:31 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:32.929867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:32.930555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:32.932497 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:32.938089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:32.938590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:32.939039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:32.939732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:32.940187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:32.940610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:32.943862 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=70 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:33.071835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:33.079611 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af5ce2f8-ea2f-4cd3-97e1-403f86750c0b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1500 microversion: 2.1 time: 0.155442 Oct 16 01:52:33.080193 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3274/6681] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:32 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:33.102783 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:52:33.105230 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:33.108036 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:33.114083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:33.114624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:33.115113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:33.115820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:33.117251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:33.117695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:33.120867 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:33.195073 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:33.200977 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Old instance type m1.heat2, new instance type m1.heat {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:52:33.207448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:52:33.207881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:52:33.208365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:52:33.208783 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:52:33.209206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:52:33.319069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8b11255-ebd3-4694-baf4-17ca8c78a514 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "POST /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.220755 Oct 16 01:52:33.320189 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3408/6682] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:52:33 2022] POST /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:52:33.328349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:33.328960 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:33.336107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:33.336605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:33.337054 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:33.337759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:33.338276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:33.338705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:33.505155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:33.513710 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-40190a81-4190-4880-b05b-476e77e790cc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1509 microversion: 2.1 time: 0.189213 Oct 16 01:52:33.514303 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3275/6683] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:33 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:34.534493 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:34.535365 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:34.540668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:34.541293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:34.549406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:34.549913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:34.550359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:34.551099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:34.551568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:34.551998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:34.684807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:34.692711 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-160e8aa8-00d9-44a0-98d1-c671f113f1be tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1509 microversion: 2.1 time: 0.159054 Oct 16 01:52:34.693279 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3409/6684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:34 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:35.715948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:35.716648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:35.718573 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:52:35.724781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:35.725270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:35.725713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:35.726440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:35.727091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:35.727523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:35.866232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:35.875882 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1430b2e0-e1e1-4d4b-8af4-153188d3cafc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.163781 Oct 16 01:52:35.876469 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3276/6685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:35 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:36.900252 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:36.900875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:36.907800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:36.908303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:36.908797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:36.909550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:36.910029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:36.910462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:37.040310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:37.048046 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fae01d40-6e12-4230-a9e2-afe27ea368c2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.152455 Oct 16 01:52:37.048623 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3410/6686] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:36 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:38.071697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:38.072316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:38.079196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:38.079686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:38.080121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:38.080808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:38.081263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:38.081686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:38.214747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:38.222567 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88ab027c-c36d-4662-86c3-6dbc5e604e9a tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.155213 Oct 16 01:52:38.223186 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3277/6687] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:38 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:39.245990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:39.246605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:39.253372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:39.253856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:39.254294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:39.255012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:39.255483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:39.255915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:39.383715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:39.391506 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7ce7078c-0890-4596-952d-c10250a0cd6c tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.150506 Oct 16 01:52:39.392090 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3411/6688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:39 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:40.415597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:40.416652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:40.424002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:40.424533 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:40.424928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:40.425630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:40.426086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:40.426510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:40.560425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:40.571005 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b021cad7-b26f-47b9-a0b2-80e80da910fb tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.159366 Oct 16 01:52:40.571596 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3278/6689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:40 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:41.594650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:41.595293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:41.603161 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:41.603655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:41.604097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:41.604789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:41.605254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:41.605684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:41.735798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:41.743593 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-86b92fda-28bc-4659-96ac-799f187f7dcc tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.152771 Oct 16 01:52:41.744166 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3412/6690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:41 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:42.766695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:42.767343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:42.774239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:42.774727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:42.775198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:42.775896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:42.776357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:42.776785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:42.909566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:42.918497 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f115535c-535c-4bf8-aa47-cf8fc8d788e6 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.155736 Oct 16 01:52:42.919103 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3279/6691] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:42 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:43.942281 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:43.943082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:43.950055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:43.950554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:43.951048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:43.951763 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:43.952235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:43.952674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:44.084451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:44.093255 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ab1646c-526c-4c3c-aef8-1b2c16837e9b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.154977 Oct 16 01:52:44.093886 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3413/6692] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:43 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:45.117906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:45.118536 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:45.125468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:45.125953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:45.126394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:45.127125 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:45.127587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:45.128047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:45.255658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:45.263681 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4331ace1-21fb-424e-8c23-43bd595a06fe tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.150423 Oct 16 01:52:45.264260 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3280/6693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:45 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:46.287296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:46.287924 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:46.294888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:46.295426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:46.295879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:46.296581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:46.297054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:46.297495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:46.431267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:46.439206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7c0743bf-fb78-4f30-807e-c19e9e03e3a9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.155843 Oct 16 01:52:46.439783 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3414/6694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:46 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:47.462850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:47.463484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:47.470627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:47.471144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:47.471579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:47.472266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:47.472722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:47.473149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:47.602969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:47.610688 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af9f2048-1356-4f40-98ff-f04121bf5980 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.152226 Oct 16 01:52:47.611290 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3281/6695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:47 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:48.634330 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:48.634962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:48.642064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:48.642554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:48.643020 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:48.643710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:48.644174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:48.644602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:48.771415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:48.779304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5663990d-ffe2-4b37-ba4a-4387a691344b tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.148883 Oct 16 01:52:48.779919 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3415/6696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:48 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:49.803704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:49.804316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:49.812367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:49.812792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:49.813229 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:49.813916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:49.814369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:49.814792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:49.949760 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:49.957645 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-381124f4-641f-4434-9523-dc06ab60a4c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.157839 Oct 16 01:52:49.958227 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3282/6697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:49 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:50.980442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:50.980971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:50.987782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:50.988279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:50.988726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:50.989423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:50.989894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:50.990333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:51.116517 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:51.124589 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8fc85799-99b7-4ea0-be8a-94dedcfe9595 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.148141 Oct 16 01:52:51.125161 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3416/6698] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:50 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:52.148461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:52.148977 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:52.155964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:52.156452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:52.156887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:52.157576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:52.158032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:52.158455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:52.292182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:52.299817 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e3ee1de9-45f2-45c9-abb9-5c9fb9135ef2 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.155405 Oct 16 01:52:52.300392 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3283/6699] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:52 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:53.324583 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:53.325217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:53.332345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:53.332848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:53.333303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:53.334009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:53.334486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:53.334982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:53.467141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:53.474826 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad1d561e-b7ae-4709-8203-8f51d55534f0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.154880 Oct 16 01:52:53.475429 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3417/6700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:53 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:54.498079 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:54.498710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:54.505585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:54.506008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:54.506444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:54.507151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:54.507605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:54.508028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:54.640099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:54.647925 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-80f93b4f-eae3-4cc6-8fa2-ea93a1d90bd0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.154267 Oct 16 01:52:54.648516 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3284/6701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:54 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:52:55.672243 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:55.672862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:55.679718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:55.680246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:55.681260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:55.681960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:55.682429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:55.682865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:55.818057 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:55.826247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4495684c-96fa-400d-b2e8-616aada9cdea tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.157887 Oct 16 01:52:55.826825 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3418/6702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:55 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:56.850398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:56.851011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:56.858450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:56.858962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:56.859407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:56.860102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:56.860565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:56.861000 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:56.996240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:57.004288 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fd66d381-238e-4d19-bb59-58f8dcc0d22d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.157830 Oct 16 01:52:57.004928 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3285/6703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:56 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:58.028379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:58.028911 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:58.035802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:58.036294 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:58.036737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:58.037430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:58.037892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:58.038323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:58.170715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:58.178349 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e43bc540-5f86-4d13-bc8f-b170196519e0 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.154018 Oct 16 01:52:58.178935 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3419/6704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:58 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:52:59.203150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:52:59.203743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:52:59.206759 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:52:59.206887 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 01:52:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 (ip 10.222.0.39) !!! Oct 16 01:52:59.214442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:59.214939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:59.215402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:59.216104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:52:59.216564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:52:59.216993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:52:59.345645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:52:59.353460 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cea517d1-0722-459b-91a5-116dc27aa206 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.154304 Oct 16 01:52:59.354031 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3286/6705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:52:59 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:00.376706 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:00.377359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:00.385044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:00.385538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:00.385989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:00.386690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:00.387195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:00.387631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:00.523374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:00.531569 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45b800d6-e8d6-464c-b91a-0316e968083e tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.158732 Oct 16 01:53:00.532161 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3420/6706] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:00 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:01.555060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:01.555731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:01.563962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:01.564455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:01.564896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:01.565599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:01.566061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:01.566490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:01.693068 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:01.700875 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-045df006-d965-4e5c-b9ea-b108f2cd9294 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.149858 Oct 16 01:53:01.701448 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3287/6707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:01 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:02.724441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:02.725068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:02.732334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:02.732832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:02.733280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:02.733983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:02.734458 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:02.734899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:02.866858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:02.875600 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5fa954ee-4529-4b29-a7e7-7930eec6809f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.155027 Oct 16 01:53:02.876173 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3421/6708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:02 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:03.899063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:03.899588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:03.903054 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=28 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:03.908706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:03.909215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:03.909649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:03.910341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:03.910792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:03.911243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:03.913819 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=84 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:04.328679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:04.336497 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-95579742-0ccc-43b1-9dec-60bcc5884047 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.441497 Oct 16 01:53:04.337078 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3288/6709] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:03 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:53:05.360649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:05.361307 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:05.363639 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=32 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:05.369998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:05.370516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:05.370991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:05.371704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:05.372177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:05.372637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:05.375641 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:05.503121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:05.511069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7d36fa9-f6b0-4b60-b0b6-3aa55944426f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.154305 Oct 16 01:53:05.511742 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3422/6710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:05 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:06.535487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:06.536007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:06.544326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:06.545102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:06.545668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:06.546697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:06.547190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:06.547625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:06.684431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:06.693877 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c2f74538-b040-4d6d-83a3-f31bab51894f tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1514 microversion: 2.1 time: 0.162349 Oct 16 01:53:06.694451 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3289/6711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:06 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:07.720542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:07.722230 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:07.730150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:07.732428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:07.732428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:07.732428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:07.732428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:07.732773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:07.864363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:07.873104 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-387aef9a-15dc-42f2-9320-d0d3d67d18c3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1513 microversion: 2.1 time: 0.158864 Oct 16 01:53:07.873692 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3423/6712] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:07 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:08.242976 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5b6b4c72-ce2a-4e36-9b2f-06c55c655908 req-ad357c45-fad1-43c3-80b3-80464682bf22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e88b5-6269-47bb-bbc9-d47452a13ab6", "name": "network-vif-unplugged", "status": "completed", "tag": "40231dd0-fe94-40e0-814f-0901407543a8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:08.255937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5b6b4c72-ce2a-4e36-9b2f-06c55c655908 req-ad357c45-fad1-43c3-80b3-80464682bf22 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:08.256736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5b6b4c72-ce2a-4e36-9b2f-06c55c655908 req-ad357c45-fad1-43c3-80b3-80464682bf22 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:08.257240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5b6b4c72-ce2a-4e36-9b2f-06c55c655908 req-ad357c45-fad1-43c3-80b3-80464682bf22 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:08.270834 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5b6b4c72-ce2a-4e36-9b2f-06c55c655908 req-ad357c45-fad1-43c3-80b3-80464682bf22 service nova] Creating event network-vif-unplugged:40231dd0-fe94-40e0-814f-0901407543a8 for instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 on n-h2-master-1 Oct 16 01:53:08.277727 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-5b6b4c72-ce2a-4e36-9b2f-06c55c655908 req-ad357c45-fad1-43c3-80b3-80464682bf22 service nova] Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:53:08.289838 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5b6b4c72-ce2a-4e36-9b2f-06c55c655908 req-ad357c45-fad1-43c3-80b3-80464682bf22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119732 Oct 16 01:53:08.291036 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3290/6713] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:53:08.897744 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:08.898297 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:08.906695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:08.907237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:08.907690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:08.908408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:08.908886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:08.909328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:09.060195 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:09.068132 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-af0b310a-8e2c-4d32-abd7-993f8e99655d tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1513 microversion: 2.1 time: 0.174363 Oct 16 01:53:09.069003 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3424/6714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:08 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:10.093797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:10.094500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:10.100793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:10.101276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:10.101716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:10.102412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:10.103281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:10.103476 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:10.235486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:10.243736 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0d4145a5-c452-4b0a-9c96-9593019f5b00 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1511 microversion: 2.1 time: 0.154756 Oct 16 01:53:10.244522 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3291/6715] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:10 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:10.307170 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c469f872-f6dd-4cdb-9e6f-7f8b97d74522 req-517f05b5-5b16-42df-a546-bb15a290c53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5e88b5-6269-47bb-bbc9-d47452a13ab6", "tag": "40231dd0-fe94-40e0-814f-0901407543a8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:10.317850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c469f872-f6dd-4cdb-9e6f-7f8b97d74522 req-517f05b5-5b16-42df-a546-bb15a290c53e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:10.318369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c469f872-f6dd-4cdb-9e6f-7f8b97d74522 req-517f05b5-5b16-42df-a546-bb15a290c53e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:10.318810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c469f872-f6dd-4cdb-9e6f-7f8b97d74522 req-517f05b5-5b16-42df-a546-bb15a290c53e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:10.330033 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c469f872-f6dd-4cdb-9e6f-7f8b97d74522 req-517f05b5-5b16-42df-a546-bb15a290c53e service nova] Creating event network-changed:40231dd0-fe94-40e0-814f-0901407543a8 for instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 on n-h2-master-1 Oct 16 01:53:10.335203 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-c469f872-f6dd-4cdb-9e6f-7f8b97d74522 req-517f05b5-5b16-42df-a546-bb15a290c53e service nova] Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:53:10.346049 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c469f872-f6dd-4cdb-9e6f-7f8b97d74522 req-517f05b5-5b16-42df-a546-bb15a290c53e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043206 Oct 16 01:53:10.346571 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3425/6716] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:53:11.268149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:11.268896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:11.276055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:11.276547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:11.276986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:11.277690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:11.278148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:11.278580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:11.415501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:11.423261 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0fac4e07-b107-42e0-bfbe-d65c50752ba8 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1508 microversion: 2.1 time: 0.159053 Oct 16 01:53:11.423859 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3292/6717] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:11 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:11.449162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:11.449958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:11.456084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:11.456672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:11.457112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:11.457888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:11.458359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:11.458797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:11.488071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:53:11.537512 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Found an unconfirmed migration during delete, id: 16, status: finished Oct 16 01:53:12.991110 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68b10c07-e486-4cfe-874c-ae7b5a204416 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 204 len: 0 microversion: 2.1 time: 1.546639 Oct 16 01:53:12.991858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3426/6718] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:53:11 2022] DELETE /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 0 bytes in 1549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:53:13.001062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:13.001675 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:13.008449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:13.009655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:13.009998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:13.010783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:13.011178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:13.011578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:13.146692 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:13.155096 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5444a3a8-44ae-4277-907e-7f2dcdd1caf5 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1500 microversion: 2.1 time: 0.158065 Oct 16 01:53:13.155666 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3293/6719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:12 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:14.179199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:14.179928 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:14.187242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:14.187732 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:14.188171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:14.188864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:14.189327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:14.189758 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:14.321970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:14.329574 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c20e8f03-a7e2-41a3-a4ce-2851d405d1df tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1500 microversion: 2.1 time: 0.154618 Oct 16 01:53:14.330147 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3427/6720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:14 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:14.924065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c1e63630-c0d3-469a-9897-358476e4e54f req-ad0eb4a1-1e11-4e05-b0c6-525be965fe1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e88b5-6269-47bb-bbc9-d47452a13ab6", "name": "network-vif-plugged", "status": "completed", "tag": "40231dd0-fe94-40e0-814f-0901407543a8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:14.937595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c1e63630-c0d3-469a-9897-358476e4e54f req-ad0eb4a1-1e11-4e05-b0c6-525be965fe1e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:14.938029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c1e63630-c0d3-469a-9897-358476e4e54f req-ad0eb4a1-1e11-4e05-b0c6-525be965fe1e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:14.938462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c1e63630-c0d3-469a-9897-358476e4e54f req-ad0eb4a1-1e11-4e05-b0c6-525be965fe1e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:14.951265 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c1e63630-c0d3-469a-9897-358476e4e54f req-ad0eb4a1-1e11-4e05-b0c6-525be965fe1e service nova] Creating event network-vif-plugged:40231dd0-fe94-40e0-814f-0901407543a8 for instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 on n-h2-master-1 Oct 16 01:53:14.957260 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c1e63630-c0d3-469a-9897-358476e4e54f req-ad0eb4a1-1e11-4e05-b0c6-525be965fe1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036917 Oct 16 01:53:14.958097 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3294/6721] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:53:15.116163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-53e4112e-e611-4ee6-92b8-4aa2486bc850 req-a2426b99-cf18-46f0-b55f-b898032dd4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e88b5-6269-47bb-bbc9-d47452a13ab6", "name": "network-vif-deleted", "tag": "40231dd0-fe94-40e0-814f-0901407543a8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:15.130350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-53e4112e-e611-4ee6-92b8-4aa2486bc850 req-a2426b99-cf18-46f0-b55f-b898032dd4b8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:15.131028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-53e4112e-e611-4ee6-92b8-4aa2486bc850 req-a2426b99-cf18-46f0-b55f-b898032dd4b8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:15.131574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-53e4112e-e611-4ee6-92b8-4aa2486bc850 req-a2426b99-cf18-46f0-b55f-b898032dd4b8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:15.148003 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-53e4112e-e611-4ee6-92b8-4aa2486bc850 req-a2426b99-cf18-46f0-b55f-b898032dd4b8 service nova] Creating event network-vif-deleted:40231dd0-fe94-40e0-814f-0901407543a8 for instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 on n-h2-master-1 Oct 16 01:53:15.153874 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-53e4112e-e611-4ee6-92b8-4aa2486bc850 req-a2426b99-cf18-46f0-b55f-b898032dd4b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041267 Oct 16 01:53:15.154526 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3428/6722] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:53:15.354518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:15.355212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:15.362350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:15.362852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:15.363327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:15.364078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:15.364544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:15.364976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:15.400621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:15.401136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:15.401584 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:15.402039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lazy-loading 'fault' on Instance uuid aa5e88b5-6269-47bb-bbc9-d47452a13ab6 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:53:15.452996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e66bc068b34d9d865a4cc9b73d28d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924af2c85e58409f98d3f36ed18a2c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:15.464695 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-052cd70b-03e4-4ecd-985c-65231d027aa9 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 200 len: 1304 microversion: 2.1 time: 0.114276 Oct 16 01:53:15.465681 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3295/6723] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:15 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:16.490494 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:16.491220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:16.499571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:16.500063 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:16.500504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:16.501196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:16.501662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:16.502092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:16.516102 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] HTTP exception thrown: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Request method failure captured: Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 HTTP/1.1 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2PWnyvWFaZFUrzDXha7M6CuyF16n52Y1HCdLW7R1obaGnWETdQGQsK1-704I3a4B9T9JoQJR1Hcr8ZASilfRlR6zIXoO0udBNoj_02GYlRcyvD4GpdOy-ODfRhANKCTlR_SytY5c4DY32HCoIxHMvSAH5aWiCGqSQS0Qz6ZbjihI-U Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 924af2c85e58409f98d3f36ed18a2c54 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_924af2c85e58409f98d3f36ed18a2c54", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 924af2c85e58409f98d3f36ed18a2c54 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-702591287-project Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7e66bc068b34d9d865a4cc9b73d28d2 Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-702591287-project Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: exception: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'aa5e88b5-6269-47bb-bbc9-d47452a13ab6'} Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:53:16.517633 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Returning 404 to user: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a695c033-b06c-4112-bdc1-f38667cc1298 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 404 len: 111 microversion: 2.1 time: 0.032719 Oct 16 01:53:16.522536 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3429/6724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:16 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:53:16.535516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:16.536013 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:16.543649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:16.544132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:16.544574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:16.545262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:16.545715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:16.546138 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:16.561316 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] HTTP exception thrown: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Request method failure captured: Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 HTTP/1.1 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2PWnyvWFaZFUrzDXha7M6CuyF16n52Y1HCdLW7R1obaGnWETdQGQsK1-704I3a4B9T9JoQJR1Hcr8ZASilfRlR6zIXoO0udBNoj_02GYlRcyvD4GpdOy-ODfRhANKCTlR_SytY5c4DY32HCoIxHMvSAH5aWiCGqSQS0Qz6ZbjihI-U Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 924af2c85e58409f98d3f36ed18a2c54 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_924af2c85e58409f98d3f36ed18a2c54", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 924af2c85e58409f98d3f36ed18a2c54 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-DeleteServersTestJSON-702591287-project Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b7e66bc068b34d9d865a4cc9b73d28d2 Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-DeleteServersTestJSON-702591287-project Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: exception: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'aa5e88b5-6269-47bb-bbc9-d47452a13ab6'} Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:53:16.563776 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Returning 404 to user: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-181c9935-8061-45ec-b0fb-4b81100c63b3 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 404 len: 111 microversion: 2.1 time: 0.033027 Oct 16 01:53:16.567450 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3296/6725] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:53:16 2022] DELETE /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:53:16.573498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:16.574121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] [instance: aa5e88b5-6269-47bb-bbc9-d47452a13ab6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:16.580193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:16.580688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:16.581135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:16.581834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:16.582309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:16.582746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:16.596207 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] HTTP exception thrown: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Request method failure captured: Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 HTTP/1.1 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2PWnyvWFaZFUrzDXha7M6CuyF16n52Y1HCdLW7R1obaGnWETdQGQsK1-704I3a4B9T9JoQJR1Hcr8ZASilfRlR6zIXoO0udBNoj_02GYlRcyvD4GpdOy-ODfRhANKCTlR_SytY5c4DY32HCoIxHMvSAH5aWiCGqSQS0Qz6ZbjihI-U Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 924af2c85e58409f98d3f36ed18a2c54 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_924af2c85e58409f98d3f36ed18a2c54", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/924af2c85e58409f98d3f36ed18a2c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 924af2c85e58409f98d3f36ed18a2c54 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-DeleteServersTestJSON-702591287 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-DeleteServersTestJSON-702591287-project Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b7e66bc068b34d9d865a4cc9b73d28d2 Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-DeleteServersTestJSON-702591287-project Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: exception: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'aa5e88b5-6269-47bb-bbc9-d47452a13ab6'} Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:53:16.597703 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] Returning 404 to user: Instance aa5e88b5-6269-47bb-bbc9-d47452a13ab6 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3afc5c6b-a5fb-4030-9757-fa3e47869376 tempest-DeleteServersTestJSON-702591287 tempest-DeleteServersTestJSON-702591287-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6" status: 404 len: 111 microversion: 2.1 time: 0.029715 Oct 16 01:53:16.601995 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3430/6726] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:16 2022] GET /compute/v2.1/servers/aa5e88b5-6269-47bb-bbc9-d47452a13ab6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 01:53:25.089022 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1931126637", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "cadc8fe6-6e6a-470e-85ad-9fa0f1b73e49"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:25.153446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] validate_networks() for [('cadc8fe6-6e6a-470e-85ad-9fa0f1b73e49', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:53:25.581619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:53:25.582043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:53:25.582821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:53:25.583052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:53:25.583351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:53:25.592790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:25.593271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:25.593705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:25.594430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:25.594883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:25.595399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:25.613248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Getting quotas for project 59d41904861f49f18d0fd1011bba8ba5. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:53:25.618633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Getting quotas for user ca43706de46f42efa2a0883aff54aab8 and project 59d41904861f49f18d0fd1011bba8ba5. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:53:25.633346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:53:25.636629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:53:25.686212 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dbcaa064-b587-4da9-9f12-d5fb191f6ca2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738756 Oct 16 01:53:25.693273 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3297/6727] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:53:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:53:25.699344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5ea66efc-aa8b-49a1-a379-a737d48ab307 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:25.700113 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5ea66efc-aa8b-49a1-a379-a737d48ab307 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:25.762502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5ea66efc-aa8b-49a1-a379-a737d48ab307 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:25.773354 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5ea66efc-aa8b-49a1-a379-a737d48ab307 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1218 microversion: 2.1 time: 0.078442 Oct 16 01:53:25.774208 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3431/6728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:25 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:26.799434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:26.800182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:26.807646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:26.808208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:26.808715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:26.810527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:26.810527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:26.810527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:26.873657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:26.882751 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-02756ffd-bd21-417b-98b2-d99e3c313ac8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1270 microversion: 2.1 time: 0.088381 Oct 16 01:53:26.883525 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3298/6729] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:26 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:27.908581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:27.909487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:27.921886 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:27.925228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:27.925817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:27.926338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:27.927243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:27.927797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:27.928298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:28.098477 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:28.110524 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f54e4e7-13f7-4c41-bbda-6b5c76b55861 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1318 microversion: 2.1 time: 0.205758 Oct 16 01:53:28.111774 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3432/6730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:27 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:53:28.633548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c850d3a2-9ecc-4b8d-a385-5b844d96b9a9 req-b992c09d-446b-4d7e-a9e8-09ea9e8c43ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b57fc7a-3438-4810-9058-ab466b37352f", "tag": "b924d227-3a5b-4072-8111-2e77621365d8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:28.655961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c850d3a2-9ecc-4b8d-a385-5b844d96b9a9 req-b992c09d-446b-4d7e-a9e8-09ea9e8c43ff service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:28.656838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c850d3a2-9ecc-4b8d-a385-5b844d96b9a9 req-b992c09d-446b-4d7e-a9e8-09ea9e8c43ff service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:28.657492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c850d3a2-9ecc-4b8d-a385-5b844d96b9a9 req-b992c09d-446b-4d7e-a9e8-09ea9e8c43ff service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:28.669837 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c850d3a2-9ecc-4b8d-a385-5b844d96b9a9 req-b992c09d-446b-4d7e-a9e8-09ea9e8c43ff service nova] Creating event network-changed:b924d227-3a5b-4072-8111-2e77621365d8 for instance 6b57fc7a-3438-4810-9058-ab466b37352f on n-h2-master-1 Oct 16 01:53:28.690217 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c850d3a2-9ecc-4b8d-a385-5b844d96b9a9 req-b992c09d-446b-4d7e-a9e8-09ea9e8c43ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060447 Oct 16 01:53:28.693079 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3299/6731] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:53:29.133817 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:29.134449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:29.141699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:29.142201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:29.142646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:29.143396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:29.143862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:29.144298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:29.278543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:29.286496 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3aa318bb-146d-4cf4-837d-bfd378a5db4e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1318 microversion: 2.1 time: 0.156569 Oct 16 01:53:29.287710 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3433/6732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:29 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:30.311165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:30.312126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:30.318597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:30.319122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:30.319573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:30.320277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:30.320742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:30.321174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:30.461217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:30.472132 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be831d33-6f72-4811-a1f3-880c5ea3fbf0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1318 microversion: 2.1 time: 0.166065 Oct 16 01:53:30.472740 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3300/6733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:30 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:31.496648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:31.497267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:31.504136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:31.504632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:31.505080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:31.505778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:31.506250 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:31.506687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:31.635920 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:31.643475 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7394d6b3-89dc-48c7-950e-f2a661d8a4b1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1318 microversion: 2.1 time: 0.151355 Oct 16 01:53:31.644053 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3434/6734] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:31 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:32.666808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:32.667447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:32.674301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:32.674794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:32.675267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:32.675957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:32.676415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:32.676842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:32.807246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:32.816371 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b66a8784-439a-40fe-acc0-bc075825ee47 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1318 microversion: 2.1 time: 0.153377 Oct 16 01:53:32.816885 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3301/6735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:32 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:33.840470 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:33.841086 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:33.847839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:33.848334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:33.848781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:33.849475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:33.849942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:33.850377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:33.985549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:33.993084 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5d4c0ea4-29cd-4d17-9de8-2c408012b64a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1318 microversion: 2.1 time: 0.157488 Oct 16 01:53:33.993731 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3435/6736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:33 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:34.982768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2e39c623-d030-492a-bd79-1ab75b72350a req-fada03c5-213f-4420-9829-84b34b50dd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57fc7a-3438-4810-9058-ab466b37352f", "name": "network-vif-plugged", "status": "completed", "tag": "b924d227-3a5b-4072-8111-2e77621365d8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:34.989005 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:34.996199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e39c623-d030-492a-bd79-1ab75b72350a req-fada03c5-213f-4420-9829-84b34b50dd46 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:34.996685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e39c623-d030-492a-bd79-1ab75b72350a req-fada03c5-213f-4420-9829-84b34b50dd46 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:34.997126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2e39c623-d030-492a-bd79-1ab75b72350a req-fada03c5-213f-4420-9829-84b34b50dd46 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:35.001609 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=68 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:35.011236 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2e39c623-d030-492a-bd79-1ab75b72350a req-fada03c5-213f-4420-9829-84b34b50dd46 service nova] Creating event network-vif-plugged:b924d227-3a5b-4072-8111-2e77621365d8 for instance 6b57fc7a-3438-4810-9058-ab466b37352f on n-h2-master-1 Oct 16 01:53:35.016419 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2e39c623-d030-492a-bd79-1ab75b72350a req-fada03c5-213f-4420-9829-84b34b50dd46 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038297 Oct 16 01:53:35.017041 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:35.017537 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3302/6737] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:53:35.018054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:35.025178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:35.026257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:35.026733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:35.027479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:35.028009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:35.028446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:35.164613 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:35.172773 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e7c1c740-3ad2-410b-a542-fdb05264f514 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1318 microversion: 2.1 time: 0.159838 Oct 16 01:53:35.173555 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3436/6738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:35 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:36.193854 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:36.194804 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:36.199755 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:36.200473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:36.207586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:36.208071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:36.208509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:36.209201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:36.209661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:36.210087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:36.346882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:36.355795 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eecfdc36-9d97-401d-b4ff-d793e7160f2d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1318 microversion: 2.1 time: 0.162918 Oct 16 01:53:36.356371 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3303/6739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:36 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:37.379560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:37.380107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:37.382093 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:37.383657 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:37.389756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:37.390256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:37.390703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:37.391446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:37.391948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:37.392389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:37.527703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:37.535439 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2108e8f8-5aaf-49ea-bd23-9b009838499e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1509 microversion: 2.1 time: 0.159950 Oct 16 01:53:37.536012 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3437/6740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:37 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:37.558751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:37.559388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:37.566465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:37.566972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:37.567413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:37.568103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:37.568564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:37.568988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:37.701037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:37.708820 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3753c618-feb2-4241-a63c-451f24567988 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1509 microversion: 2.1 time: 0.154541 Oct 16 01:53:37.709398 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3304/6741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:37 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:37.732169 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:37.734576 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:37.740450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:37.740939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:37.741381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:37.742072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:37.742541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:37.742986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:37.804788 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9b555699-3e7c-4f64-937f-f103632407e5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "PUT /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1081 microversion: 2.1 time: 0.077375 Oct 16 01:53:37.805395 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3438/6742] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Oct 16 01:53:37 2022] PUT /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1081 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:37.825003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:37.825614 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:37.831538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:37.832024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:37.832454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:37.833145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:37.833593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:37.834015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:37.967055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:37.974754 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ab3b9282-244b-4b03-b110-2bdaf884406c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1507 microversion: 2.1 time: 0.153966 Oct 16 01:53:37.975377 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3305/6743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:37 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:37.997568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:37.998218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:38.004546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:38.005045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:38.005501 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:38.006204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:38.006678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:38.007152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:38.142135 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:38.149929 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8060800a-e627-4436-95b5-331bad4dcb3d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1507 microversion: 2.1 time: 0.156791 Oct 16 01:53:38.150553 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3439/6744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:37 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:38.178453 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:53:38.180691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:38.187595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:38.188084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:38.188522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:38.189210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:38.189666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:38.190090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:38.220606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:38.225935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:53:38.233099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:53:38.233519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:53:38.234003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:53:38.234415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:53:38.234825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:53:38.297122 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b62aa115-0409-48ea-8f9f-91b071dc8fbc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "POST /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f/action" status: 202 len: 0 microversion: 2.1 time: 0.122717 Oct 16 01:53:38.297751 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3306/6745] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:53:38 2022] POST /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:53:38.305608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:38.306367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:38.312961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:38.313519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:38.314570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:38.314711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:38.315134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:38.315568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:38.478046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:38.487053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4876085a-0749-49f2-a709-60c45186b395 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1518 microversion: 2.1 time: 0.185010 Oct 16 01:53:38.487654 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3440/6746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:38 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:39.512443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:39.513162 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:39.520292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:39.520780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:39.521221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:39.522439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:39.522899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:39.523603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:39.658278 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:39.666776 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-807730a1-cf62-4977-96f7-d2154382d269 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1518 microversion: 2.1 time: 0.160364 Oct 16 01:53:39.667391 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3307/6747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:39 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:40.689963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:40.690586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:40.697500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:40.697989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:40.698439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:40.699169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:40.699638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:40.700074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:40.831975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:40.840216 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0fdf52d3-90c5-403b-8cd3-371c9d347deb tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.154359 Oct 16 01:53:40.840818 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3441/6748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:40 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:41.864631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:41.865186 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:41.872665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:41.873149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:41.873586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:41.874285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:41.874744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:41.875201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:42.006540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:42.014817 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eec7b915-d727-4f99-a5dc-a60bbb16e689 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.154202 Oct 16 01:53:42.015423 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3308/6749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:41 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:43.039001 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:43.039531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:43.047110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:43.047609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:43.048066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:43.048771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:43.049242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:43.049680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:43.182108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:43.190117 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3f58b325-ecdb-46c3-af1f-d5ffd831b6aa tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.155186 Oct 16 01:53:43.190687 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3442/6750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:43 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:44.215529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:44.216139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:44.223077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:44.223566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:44.224005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:44.224698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:44.225159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:44.225591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:44.354519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:44.362181 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-829bdd7f-60f5-4ed5-8964-9e85f175a8dc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.150689 Oct 16 01:53:44.362754 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3309/6751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:44 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:45.386621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:45.388183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:45.396411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:45.397642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:45.398096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:45.398802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:45.399690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:45.401059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:45.534816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:45.542508 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ae82905f-a768-4e2a-b3a5-7d7687e180d4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.159890 Oct 16 01:53:45.543104 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3443/6752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:45 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:46.566000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:46.566624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:46.573717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:46.574205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:46.574652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:46.575395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:46.575863 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:46.576296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:46.705337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:46.713525 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23b2856c-369a-4066-adfe-67660e22a734 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.151498 Oct 16 01:53:46.714112 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3310/6753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:46 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:47.736619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:47.737274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:47.745047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:47.745536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:47.745984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:47.746674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:47.747168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:47.747598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:47.875835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:47.883562 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-010f67bf-faa6-4b1d-9b20-190ffa301627 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.150775 Oct 16 01:53:47.884151 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3444/6754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:47 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:48.907397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:48.907925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:48.914783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:48.915357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:48.915956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:48.916710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:48.917172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:48.917599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:49.052316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:49.060875 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-857801ad-5314-48f6-b4d2-e94f5973abd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.157546 Oct 16 01:53:49.061740 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3311/6755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:48 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:50.085103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:50.085833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:50.093806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:50.094303 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:50.094752 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:50.095485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:50.095985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:50.096426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:50.224803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:50.232792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8edb2d65-f13f-4cef-99e9-7fc518afc38b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.151548 Oct 16 01:53:50.233364 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3445/6756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:50 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:51.256999 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:51.257612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:51.264001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:51.264488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:51.264928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:51.265626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:51.266087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:51.266518 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:51.401055 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:51.408850 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d908925c-af51-4eaa-a39c-345eb2ad3c4a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.155757 Oct 16 01:53:51.409425 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3312/6757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:51 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:52.433880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:52.434497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:52.441545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:52.442040 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:52.442484 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:52.443223 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:52.443695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:52.444133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:52.575206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:52.582820 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-482687c3-dee5-4eb6-b476-b3b6e01b975b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.153535 Oct 16 01:53:52.583440 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3446/6758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:52 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:53.605905 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:53.606554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:53.613437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:53.613928 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:53.614370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:53.615096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:53.615563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:53.615996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:53.744717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:53.752567 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-42c5632f-e484-4fe1-b5d5-6d09ce6f7e24 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.150636 Oct 16 01:53:53.753149 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3313/6759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:53 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:54.776872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:54.777484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:54.784371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:54.784869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:54.785313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:54.786041 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:54.786505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:54.786968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:54.921749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:54.925588 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:53:54.930780 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-20a11e2a-00d4-4ae2-b647-2cd795d45cd5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.158242 Oct 16 01:53:54.932807 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3447/6760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:54 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:55.957165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:55.957728 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:55.965135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:55.965623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:55.966065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:55.966762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:55.967281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:55.967718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:56.095937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:56.104176 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0e97f97c-6953-458c-ba38-949279d3540a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.151183 Oct 16 01:53:56.104757 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3314/6761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:55 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:57.128019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:57.128633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:57.139222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:57.139718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:57.140167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:57.140868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:57.141333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:57.141770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:57.272484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:57.280828 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ed90fea-c634-4b05-a020-771a93410ced tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.157310 Oct 16 01:53:57.281394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3448/6762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:57 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:58.304113 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:58.304720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:58.312321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:58.312799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:58.313233 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:58.313922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:58.314375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:58.314798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:58.444906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:58.453191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35f0fcb1-21ab-4a8b-b16c-bb048ead8a4d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.153037 Oct 16 01:53:58.453770 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3315/6763] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:58 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:53:59.477568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:53:59.478189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:53:59.485214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:59.485717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:59.486163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:59.486864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:53:59.487359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:53:59.487796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:53:59.619926 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:53:59.627569 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-749ffe3b-2c1d-4f44-8893-66aa76ff528a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.153847 Oct 16 01:53:59.628132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3449/6764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:53:59 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:00.651981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:00.652599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:00.659487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:00.659972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:00.660411 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:00.661104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:00.661563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:00.661987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:00.790180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:00.798157 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8c65132-eea4-4ca1-9ca0-9f6e6e6cdd9e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.150892 Oct 16 01:54:00.798741 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3316/6765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:00 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:01.821886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:01.822452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:01.831109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:01.831607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:01.832048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:01.832754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:01.833220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:01.833652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:01.963591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:01.971258 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45634d69-e28f-46fb-bd0d-d7bab5281f2a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.153432 Oct 16 01:54:01.971822 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3450/6766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:01 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:54:02.996165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:02.996715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:03.003540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:03.004027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:03.004468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:03.005164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:03.005655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:03.006087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:03.138658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:03.146550 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9a5cb0a0-2310-4383-ba07-8b01a3a73111 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.155203 Oct 16 01:54:03.147154 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3317/6767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:02 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:04.170897 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:04.171533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:04.178404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:04.178901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:04.179366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:04.180091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:04.180557 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:04.181508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:04.315824 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:04.323537 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ebc6b86-8357-43d5-ac25-8148c47c03d9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.156558 Oct 16 01:54:04.324112 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3451/6768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:04 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:05.347038 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:05.347668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:05.350300 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=36 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:05.356500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:05.356984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:05.357419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:05.358104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:05.358556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:05.358997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:05.361542 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:05.500271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:05.507972 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1562d90c-7937-4ebb-ba2a-760cc313a426 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.164912 Oct 16 01:54:05.508562 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3318/6769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:05 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:06.531590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:06.532127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:06.538933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:06.539427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:06.539872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:06.541105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:06.541572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:06.542003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:06.671916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:06.679453 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2c3bafe3-f2b7-4ce9-aaaa-bce706a9b65c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1523 microversion: 2.1 time: 0.151776 Oct 16 01:54:06.680008 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3452/6770] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:06 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:07.703639 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:07.704255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:07.711129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:07.711619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:07.712210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:07.716141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:07.717323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:07.717323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:07.857036 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:07.864815 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b60e8ff-7796-48a2-9893-6c02c117e8b3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1522 microversion: 2.1 time: 0.165182 Oct 16 01:54:07.865407 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3319/6771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:07 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:08.148411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-31999daf-78c3-4fca-962c-c744c7d7bb6e req-3cbce2f6-b4a4-4d6d-ad90-3122471f04e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57fc7a-3438-4810-9058-ab466b37352f", "name": "network-vif-unplugged", "status": "completed", "tag": "b924d227-3a5b-4072-8111-2e77621365d8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:08.154867 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=32 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:08.161234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31999daf-78c3-4fca-962c-c744c7d7bb6e req-3cbce2f6-b4a4-4d6d-ad90-3122471f04e1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:08.161726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31999daf-78c3-4fca-962c-c744c7d7bb6e req-3cbce2f6-b4a4-4d6d-ad90-3122471f04e1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:08.162167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-31999daf-78c3-4fca-962c-c744c7d7bb6e req-3cbce2f6-b4a4-4d6d-ad90-3122471f04e1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:08.174083 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-31999daf-78c3-4fca-962c-c744c7d7bb6e req-3cbce2f6-b4a4-4d6d-ad90-3122471f04e1 service nova] Creating event network-vif-unplugged:b924d227-3a5b-4072-8111-2e77621365d8 for instance 6b57fc7a-3438-4810-9058-ab466b37352f on n-h1-master-1 Oct 16 01:54:08.179410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-31999daf-78c3-4fca-962c-c744c7d7bb6e req-3cbce2f6-b4a4-4d6d-ad90-3122471f04e1 service nova] Instance 6b57fc7a-3438-4810-9058-ab466b37352f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:54:08.190663 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-31999daf-78c3-4fca-962c-c744c7d7bb6e req-3cbce2f6-b4a4-4d6d-ad90-3122471f04e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046025 Oct 16 01:54:08.191308 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3453/6772] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:54:08.889537 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:08.890156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:08.897167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:08.897654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:08.898095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:08.898847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:08.900037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:08.900715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:09.045477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:09.054432 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81d020ff-79bd-4b8e-b123-254f1566af84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1522 microversion: 2.1 time: 0.168751 Oct 16 01:54:09.055105 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3320/6773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:08 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:54:10.080068 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:10.080841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:10.087156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:10.087658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:10.088107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:10.088810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:10.089279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:10.089717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:10.219779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-bce4c19a-822c-4c4f-baf0-01335800efe3 req-04347a89-82cf-4ed0-bf93-d7c4f1d73559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b57fc7a-3438-4810-9058-ab466b37352f", "tag": "b924d227-3a5b-4072-8111-2e77621365d8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:10.226382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:10.230783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bce4c19a-822c-4c4f-baf0-01335800efe3 req-04347a89-82cf-4ed0-bf93-d7c4f1d73559 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:10.231302 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bce4c19a-822c-4c4f-baf0-01335800efe3 req-04347a89-82cf-4ed0-bf93-d7c4f1d73559 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:10.231745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-bce4c19a-822c-4c4f-baf0-01335800efe3 req-04347a89-82cf-4ed0-bf93-d7c4f1d73559 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:10.234823 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c9ea1caf-036c-4e14-b057-f26ab94785e6 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1520 microversion: 2.1 time: 0.159935 Oct 16 01:54:10.235591 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3454/6774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:10 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:10.244512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-bce4c19a-822c-4c4f-baf0-01335800efe3 req-04347a89-82cf-4ed0-bf93-d7c4f1d73559 service nova] Creating event network-changed:b924d227-3a5b-4072-8111-2e77621365d8 for instance 6b57fc7a-3438-4810-9058-ab466b37352f on n-h1-master-1 Oct 16 01:54:10.250057 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-bce4c19a-822c-4c4f-baf0-01335800efe3 req-04347a89-82cf-4ed0-bf93-d7c4f1d73559 service nova] Instance 6b57fc7a-3438-4810-9058-ab466b37352f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:54:10.262321 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-bce4c19a-822c-4c4f-baf0-01335800efe3 req-04347a89-82cf-4ed0-bf93-d7c4f1d73559 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046256 Oct 16 01:54:10.263346 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3321/6775] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:54:11.260774 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:11.261320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:11.267500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:11.268001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:11.268447 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:11.269167 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:11.270633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:11.270633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:11.412826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:11.421158 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-56902663-72de-4b66-95ee-66755e527155 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1517 microversion: 2.1 time: 0.166094 Oct 16 01:54:11.421725 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3455/6776] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:11 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:11.444612 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:11.445240 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:11.452549 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:11.453036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:11.453479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:11.454174 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:11.454634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:11.455124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:11.513925 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d755f3a-787b-49ec-ab75-0ad6c242a09d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "POST /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f/action" status: 204 len: 0 microversion: 2.1 time: 0.073293 Oct 16 01:54:11.514482 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3322/6777] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:54:11 2022] POST /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:54:11.522593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:11.523487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:11.530418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:11.531112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:11.531562 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:11.532389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:11.532968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:11.533411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:11.677764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:11.686724 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ffda5e3a-ff5a-4933-af1f-2b335ae8cc8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1517 microversion: 2.1 time: 0.167681 Oct 16 01:54:11.687356 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3456/6778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:11 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:12.712560 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:12.713265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:12.719454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:12.719989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:12.720377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:12.721066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:12.721532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:12.721982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:12.860266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:12.868783 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a69c8b06-6627-44a4-a114-9cd155f9f30a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1517 microversion: 2.1 time: 0.161430 Oct 16 01:54:12.869372 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3323/6779] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:12 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:13.287444 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5ca8acff-c990-4769-87f8-9cfae7139b7a req-a05edd47-9d5a-45bb-9bd4-e013817ac83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57fc7a-3438-4810-9058-ab466b37352f", "name": "network-vif-plugged", "status": "completed", "tag": "b924d227-3a5b-4072-8111-2e77621365d8"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:13.300016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ca8acff-c990-4769-87f8-9cfae7139b7a req-a05edd47-9d5a-45bb-9bd4-e013817ac83b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:13.300518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ca8acff-c990-4769-87f8-9cfae7139b7a req-a05edd47-9d5a-45bb-9bd4-e013817ac83b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:13.300971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ca8acff-c990-4769-87f8-9cfae7139b7a req-a05edd47-9d5a-45bb-9bd4-e013817ac83b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:13.313174 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5ca8acff-c990-4769-87f8-9cfae7139b7a req-a05edd47-9d5a-45bb-9bd4-e013817ac83b service nova] Creating event network-vif-plugged:b924d227-3a5b-4072-8111-2e77621365d8 for instance 6b57fc7a-3438-4810-9058-ab466b37352f on n-h1-master-1 Oct 16 01:54:13.319549 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5ca8acff-c990-4769-87f8-9cfae7139b7a req-a05edd47-9d5a-45bb-9bd4-e013817ac83b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035076 Oct 16 01:54:13.320318 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3457/6780] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:54:13.892752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:13.893315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:13.900172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:13.900658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:13.901104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:13.901805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:13.902265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:13.902697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:14.030822 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:14.038618 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6cd4adda-957f-48d6-82ef-ffd3bd880363 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1509 microversion: 2.1 time: 0.149930 Oct 16 01:54:14.039233 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3324/6781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:13 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:14.062973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:14.063695 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:14.069818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:14.070342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:14.070796 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:14.071714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:14.072469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:14.072913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:14.202634 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:14.210375 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-17c564b9-82e2-4e99-9eb8-8bbd89ed2c12 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1509 microversion: 2.1 time: 0.151914 Oct 16 01:54:14.210967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3458/6782] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:14 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:14.236513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-682b40b4-7452-4b8d-915e-f66be9da759a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Action: 'create', calling method: .version_select at 0x7fd64d750af0>, body: {"keypair": {"name": "tempest-keypair-1232053057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4Vr9IFDT/f3T0Cc7y+Wv3rlXOzBDpSU/uq/6cJOYgSdnC32FbQ8NSmW6Exi6q4Ap4EXH8KF6wUghayljcMO6dBMbMNamg8wA6+sc28RuHwA93HrDBU0Q5SSKnNESLo5w=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:14.252935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-682b40b4-7452-4b8d-915e-f66be9da759a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Getting quotas for project 59d41904861f49f18d0fd1011bba8ba5. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:54:14.258094 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-682b40b4-7452-4b8d-915e-f66be9da759a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Getting quotas for user ca43706de46f42efa2a0883aff54aab8 and project 59d41904861f49f18d0fd1011bba8ba5. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:54:14.283800 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-682b40b4-7452-4b8d-915e-f66be9da759a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051242 Oct 16 01:54:14.284409 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3325/6783] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:54:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:54:15.762520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:15.763316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:15.770797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:15.771445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:15.772002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:15.772833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:15.773371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:15.774637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:15.905902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:15.913740 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f36f7703-8af5-463f-babb-5a21d8b2d517 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 200 len: 1509 microversion: 2.1 time: 0.155833 Oct 16 01:54:15.914240 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3459/6784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:15 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:15.937170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:15.937726 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:15.949126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:15.949618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:15.950058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:15.950763 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:15.951265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:15.951683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:15.976305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:54:16.051891 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35b9e925-e65c-4322-a06a-eb9a31a3ef09 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 204 len: 0 microversion: 2.1 time: 0.118226 Oct 16 01:54:16.052552 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3326/6785] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:54:15 2022] DELETE /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:54:16.110641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-341222477", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "cadc8fe6-6e6a-470e-85ad-9fa0f1b73e49"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:16.164439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] validate_networks() for [('cadc8fe6-6e6a-470e-85ad-9fa0f1b73e49', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:54:16.542509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:54:16.542957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:54:16.543455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:54:16.543876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:54:16.544303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:54:16.553751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:16.554255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:16.554762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:16.557802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:16.558313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:16.558768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:16.579119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Getting quotas for project 59d41904861f49f18d0fd1011bba8ba5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:54:16.587426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Getting quotas for user ca43706de46f42efa2a0883aff54aab8 and project 59d41904861f49f18d0fd1011bba8ba5. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:54:16.600109 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:54:16.602997 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:54:16.648760 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4bf71217-040f-4bba-8040-35e173d96ca4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541892 Oct 16 01:54:16.649917 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3460/6786] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:54:16.661671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-557f8b92-c95c-49cd-a317-48eee13719d8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:16.662366 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-557f8b92-c95c-49cd-a317-48eee13719d8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:16.726165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-557f8b92-c95c-49cd-a317-48eee13719d8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:16.734600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-557f8b92-c95c-49cd-a317-48eee13719d8 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1217 microversion: 2.1 time: 0.077056 Oct 16 01:54:16.735246 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3327/6787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:16 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:17.760495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:17.761346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:17.768689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:17.769200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:17.769650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:17.770376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:17.770848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:17.771389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:17.834581 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:17.842613 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b04ce5b2-a3a3-4abb-b2ca-b828a9f6319e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1269 microversion: 2.1 time: 0.087498 Oct 16 01:54:17.843206 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3461/6788] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:17 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:18.098281 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-87bfbea0-8453-4d5c-a488-b0574e7afdc8 req-ff43d94d-e895-4d9e-b89c-2002cba555e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b57fc7a-3438-4810-9058-ab466b37352f", "name": "network-vif-deleted", "tag": "b924d227-3a5b-4072-8111-2e77621365d8"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:18.114414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-87bfbea0-8453-4d5c-a488-b0574e7afdc8 req-ff43d94d-e895-4d9e-b89c-2002cba555e4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:18.115377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-87bfbea0-8453-4d5c-a488-b0574e7afdc8 req-ff43d94d-e895-4d9e-b89c-2002cba555e4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:18.116093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-87bfbea0-8453-4d5c-a488-b0574e7afdc8 req-ff43d94d-e895-4d9e-b89c-2002cba555e4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:18.135072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-87bfbea0-8453-4d5c-a488-b0574e7afdc8 req-ff43d94d-e895-4d9e-b89c-2002cba555e4 service nova] Creating event network-vif-deleted:b924d227-3a5b-4072-8111-2e77621365d8 for instance 6b57fc7a-3438-4810-9058-ab466b37352f on n-h1-master-1 Oct 16 01:54:18.142796 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-87bfbea0-8453-4d5c-a488-b0574e7afdc8 req-ff43d94d-e895-4d9e-b89c-2002cba555e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053029 Oct 16 01:54:18.144114 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3328/6789] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:54:18.866464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:18.867196 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:18.875923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:18.876411 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:18.876851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:18.877575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:18.878042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:18.878469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:19.016802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:19.025557 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-397c5d39-dc16-4419-a1f9-90e83d8aaa9d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1317 microversion: 2.1 time: 0.163059 Oct 16 01:54:19.026463 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3462/6790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:18 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:20.050203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:20.051073 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:20.058127 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:20.058603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:20.059076 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:20.059769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:20.060232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:20.060659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:20.165540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f5a0f18c-fd3e-4dd5-a5cf-1e319f70b032 req-c735dc3e-d739-40e6-ad88-2cf0695d8ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8da233-dc09-4b1a-bb19-674783a8a621", "tag": "1d6145c7-a270-42e7-a642-ca6b0fe0f844"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:20.175939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f5a0f18c-fd3e-4dd5-a5cf-1e319f70b032 req-c735dc3e-d739-40e6-ad88-2cf0695d8ed5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:20.176434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f5a0f18c-fd3e-4dd5-a5cf-1e319f70b032 req-c735dc3e-d739-40e6-ad88-2cf0695d8ed5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:20.176876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f5a0f18c-fd3e-4dd5-a5cf-1e319f70b032 req-c735dc3e-d739-40e6-ad88-2cf0695d8ed5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:20.188751 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f5a0f18c-fd3e-4dd5-a5cf-1e319f70b032 req-c735dc3e-d739-40e6-ad88-2cf0695d8ed5 service nova] Creating event network-changed:1d6145c7-a270-42e7-a642-ca6b0fe0f844 for instance 2a8da233-dc09-4b1a-bb19-674783a8a621 on n-h1-master-1 Oct 16 01:54:20.193757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f5a0f18c-fd3e-4dd5-a5cf-1e319f70b032 req-c735dc3e-d739-40e6-ad88-2cf0695d8ed5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031883 Oct 16 01:54:20.194538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:20.194698 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3463/6791] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:54:20.203202 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5738eec2-fb1e-49e2-a704-00f0da07faae tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1317 microversion: 2.1 time: 0.157212 Oct 16 01:54:20.203769 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3329/6792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:20 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:21.227339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:21.228063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:21.234413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:21.234907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:21.235385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:21.236096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:21.236994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:21.237128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:21.372910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:21.381034 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-15d0aca4-ac83-4663-90ea-b26989e777a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1317 microversion: 2.1 time: 0.158920 Oct 16 01:54:21.381612 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3464/6793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:21 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:22.405922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:22.406533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:22.412754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:22.413234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:22.413669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:22.414358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:22.414811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:22.415257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:22.547599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:22.555191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a60e1455-9d50-46e4-988c-4c8285eedfba tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1317 microversion: 2.1 time: 0.154430 Oct 16 01:54:22.555757 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3330/6794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:22 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:23.361713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-45124a08-9d9a-4293-b7c5-406bf523dac8 req-da6a00e2-e832-4242-92ae-ece206e929b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8da233-dc09-4b1a-bb19-674783a8a621", "name": "network-vif-plugged", "status": "completed", "tag": "1d6145c7-a270-42e7-a642-ca6b0fe0f844"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:23.375821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45124a08-9d9a-4293-b7c5-406bf523dac8 req-da6a00e2-e832-4242-92ae-ece206e929b3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:23.376522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45124a08-9d9a-4293-b7c5-406bf523dac8 req-da6a00e2-e832-4242-92ae-ece206e929b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:23.376969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-45124a08-9d9a-4293-b7c5-406bf523dac8 req-da6a00e2-e832-4242-92ae-ece206e929b3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:23.388971 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-45124a08-9d9a-4293-b7c5-406bf523dac8 req-da6a00e2-e832-4242-92ae-ece206e929b3 service nova] Creating event network-vif-plugged:1d6145c7-a270-42e7-a642-ca6b0fe0f844 for instance 2a8da233-dc09-4b1a-bb19-674783a8a621 on n-h1-master-1 Oct 16 01:54:23.393725 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-45124a08-9d9a-4293-b7c5-406bf523dac8 req-da6a00e2-e832-4242-92ae-ece206e929b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Oct 16 01:54:23.394485 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3465/6795] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:54:23.578348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:23.579143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:23.585985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:23.586477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:23.586938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:23.587636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:23.588287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:23.588744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:23.716586 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:23.724392 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0c5e13e4-dab2-404d-8174-5b55d505ba5f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1317 microversion: 2.1 time: 0.150042 Oct 16 01:54:23.724962 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3331/6796] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:23 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:24.748521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:24.749216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:24.756256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:24.756728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:24.757169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:24.757860 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:24.758324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:24.758754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:24.895553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:24.903675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aff24a5f-0cf3-4354-8aef-d1264e6f2c2c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1507 microversion: 2.1 time: 0.159736 Oct 16 01:54:24.904268 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3466/6797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:24 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:24.927089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:24.927705 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:24.937212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:24.937705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:24.938149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:24.938856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:24.939341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:24.939776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:25.075804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:25.084546 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-79653a6b-9488-4a74-b4aa-af821ddadd97 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1507 microversion: 2.1 time: 0.161523 Oct 16 01:54:25.085140 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3332/6798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:24 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:25.107215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:25.109412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:25.115409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:25.115859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:25.116306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:25.117009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:25.117472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:25.117905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:25.138101 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=100 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:25.147768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:25.154188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Old instance type m1.heat2, new instance type m1.heat {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:54:25.160853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:54:25.161280 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:54:25.161764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:54:25.162182 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:54:25.162601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:54:25.227202 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a52e2681-de52-40d8-b9af-b871c8b4c854 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "POST /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621/action" status: 202 len: 0 microversion: 2.1 time: 0.123663 Oct 16 01:54:25.230858 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3467/6799] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:54:25 2022] POST /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 01:54:25.237457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:25.238512 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:25.245761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:25.246381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:25.246878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:25.247612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:25.248354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:25.248998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:25.420312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:25.428921 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-53b9936a-d35e-4915-bdfb-9495f09df220 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1514 microversion: 2.1 time: 0.195785 Oct 16 01:54:25.429718 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3333/6800] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:25 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:26.455286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:26.455931 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:26.462688 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:26.463838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:26.464281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:26.464992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:26.465456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:26.465890 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:26.567449 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:26.594426 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:26.599596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:26.609874 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-75090470-c74f-491a-a7b1-bc33da1a55a0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1514 microversion: 2.1 time: 0.159597 Oct 16 01:54:26.611227 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3468/6801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:26 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:54:27.633869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:27.634488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:27.637874 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:27.643488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:27.643976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:27.644419 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:27.645116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:27.645576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:27.646006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:27.778436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:27.781972 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:27.787151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e460ba5e-ef6e-4113-87bf-977465dafd44 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.157134 Oct 16 01:54:27.787738 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3334/6802] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:27 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:28.811384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:28.812010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:28.819067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:28.819513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:28.819965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:28.820666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:28.821154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:28.821576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:28.952467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:28.960396 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b6fac1b6-62ae-487e-9759-32276e24d45a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.153297 Oct 16 01:54:28.960977 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3469/6803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:28 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:29.985779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:29.986315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:29.994320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:29.994805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:29.995899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:29.996599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:29.997059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:29.997486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:30.128205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:30.135951 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9b49c402-f629-48aa-b554-e7503aa94a61 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.154839 Oct 16 01:54:30.136560 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3335/6804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:29 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:31.159575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:31.160220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:31.166905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:31.167907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:31.168348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:31.169035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:31.169498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:31.169933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:31.299881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:31.308274 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-45ee2b01-ea24-4a4b-9670-678f29070657 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.151930 Oct 16 01:54:31.309001 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3470/6805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:31 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:32.332144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:32.332765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:32.340441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:32.340924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:32.341370 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:32.342087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:32.342546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:32.343006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:32.475170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:32.483609 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-251fc607-4048-4e10-b40e-750e1fe4d8b5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.155407 Oct 16 01:54:32.484191 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3336/6806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:32 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:33.506639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:33.507300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:33.514766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:33.515293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:33.515764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:33.516453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:33.516929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:33.517374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:33.646836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:33.655128 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85b1017f-5acb-48ac-9ed5-4d8675f4a09f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.152334 Oct 16 01:54:33.655698 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3471/6807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:33 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:34.678076 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:34.678691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:34.686225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:34.686715 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:34.687181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:34.687883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:34.688375 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:34.688805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:34.819434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:34.827511 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f18267fc-e6ed-4a0b-9aff-d521b803cdab tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.153316 Oct 16 01:54:34.828089 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3337/6808] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:34 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:35.850846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:35.851500 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:35.858943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:35.859486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:35.860004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:35.860671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:35.861099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:35.861538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:35.993733 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:36.001933 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a638bb59-b24d-4e0c-88e4-a6dc6938db35 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.155183 Oct 16 01:54:36.002505 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3472/6809] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:35 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:37.024696 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:37.025232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:37.028464 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:37.034553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:37.035590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:37.036030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:37.036747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:37.037202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:37.037626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:37.179914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:37.188628 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b30b4cc5-7ad2-4d53-8e18-cf959c0dadfc tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.167916 Oct 16 01:54:37.189205 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3338/6810] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:37 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:38.212424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:38.213043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:38.216516 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:38.221958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:38.222453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:38.222900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:38.223622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:38.224090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:38.224530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:38.612136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:38.620477 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dfa4ef6a-b7bd-45d5-8589-abefd0fe0078 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.411891 Oct 16 01:54:38.635084 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3473/6811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:38 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:39.645206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:39.645819 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:39.653825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:39.654305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:39.654744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:39.655463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:39.655925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:39.656353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:39.790806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:39.799029 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-25b37010-f7b2-432b-905c-7ec1a815980e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.157728 Oct 16 01:54:39.799623 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3339/6812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:39 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:40.823659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:40.824234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:40.827289 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:54:40.827419 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 01:54:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 (ip 10.222.0.39) !!! Oct 16 01:54:40.835745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:40.836236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:40.836702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:40.837397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:40.837864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:40.838296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:40.969100 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:40.976675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c4f18fce-ec15-45ef-a687-c7687cd8d37e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.156933 Oct 16 01:54:40.977243 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3474/6813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:40 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:42.000620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:42.001196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:42.008097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:42.008579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:42.009050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:42.009750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:42.010214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:42.010639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:42.139925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:42.147678 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-087bcea1-ea2f-494e-838c-1a9626ccb4c3 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.151745 Oct 16 01:54:42.148255 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3340/6814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:41 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:43.172650 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:43.173271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:43.179816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:43.180306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:43.180748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:43.181445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:43.181906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:43.182339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:43.314305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:43.321937 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3bbf210d-d933-4b30-ba1e-16f1039cb07e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.154194 Oct 16 01:54:43.322559 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3475/6815] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:43 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:44.345944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:44.346565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:44.353691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:44.354178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:44.354648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:44.355384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:44.355845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:44.356280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:44.486200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:44.494003 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-925f1fd7-36a4-45b3-88d0-b63ddedaa597 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.152063 Oct 16 01:54:44.494581 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3341/6816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:44 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:54:45.517386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:45.518042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:45.524879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:45.525370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:45.525813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:45.526504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:45.527000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:45.527437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:45.658441 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:45.666208 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c473ff24-2f02-4464-bb0c-a417a20515f5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.153213 Oct 16 01:54:45.666827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3476/6817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:45 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:46.690739 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:46.691376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:46.698204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:46.698688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:46.699223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:46.699930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:46.701022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:46.701454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:46.827410 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:46.835094 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98940913-6d2f-42da-85f1-7e68b29369a5 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.148224 Oct 16 01:54:46.835673 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3342/6818] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:46 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:47.857681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:47.858378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:47.865228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:47.865731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:47.866183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:47.866898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:47.867584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:47.868028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:47.999372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:48.007218 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-98362822-8f44-46ce-99bf-705688efdc05 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.153490 Oct 16 01:54:48.007789 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3477/6819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:47 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:49.033303 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:49.033876 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:49.039980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:49.040473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:49.040916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:49.041613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:49.042074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:49.042505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:49.174701 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:49.182394 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f1e76e66-3b7b-420d-ac16-e2f8970878a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.154634 Oct 16 01:54:49.182979 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3343/6820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:49 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:50.206089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:50.206751 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:50.213794 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:50.214300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:50.214754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:50.216152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:50.216682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:50.217133 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:50.347933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:50.355668 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58524480-8f1e-4e35-883e-915f5f4d2dc9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.153492 Oct 16 01:54:50.356239 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3478/6821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:50 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:51.379539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:51.380144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:51.386449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:51.386940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:51.387394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:51.388080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:51.388540 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:51.389561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:51.776371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:51.784323 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4bb0f82d-c48c-4490-8197-23990ca427a9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.408689 Oct 16 01:54:51.784907 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3344/6822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:51 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:52.807004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:52.807630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:52.815172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:52.815613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:52.816060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:52.816756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:52.817224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:52.817660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:52.945721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:52.954635 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-435b6d49-f3d6-468b-b4b9-7714c75eca83 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.151450 Oct 16 01:54:52.955357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3479/6823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:52 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:53.977812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:53.978355 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:53.985953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:53.986440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:53.986884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:53.987605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:53.988068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:53.988494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:54.125786 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:54.133551 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3b175482-7153-4775-ac18-831c2f3e77f1 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1519 microversion: 2.1 time: 0.159815 Oct 16 01:54:54.134124 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3345/6824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:53 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:54.584023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b833b2a8-3852-4667-ab55-c51f26e11fd3 req-19c76f7f-62cf-461c-a5f2-80622939f89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8da233-dc09-4b1a-bb19-674783a8a621", "name": "network-vif-unplugged", "status": "completed", "tag": "1d6145c7-a270-42e7-a642-ca6b0fe0f844"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:54.594659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b833b2a8-3852-4667-ab55-c51f26e11fd3 req-19c76f7f-62cf-461c-a5f2-80622939f89f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:54.595217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b833b2a8-3852-4667-ab55-c51f26e11fd3 req-19c76f7f-62cf-461c-a5f2-80622939f89f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:54.595672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b833b2a8-3852-4667-ab55-c51f26e11fd3 req-19c76f7f-62cf-461c-a5f2-80622939f89f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:54.608392 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b833b2a8-3852-4667-ab55-c51f26e11fd3 req-19c76f7f-62cf-461c-a5f2-80622939f89f service nova] Creating event network-vif-unplugged:1d6145c7-a270-42e7-a642-ca6b0fe0f844 for instance 2a8da233-dc09-4b1a-bb19-674783a8a621 on n-h2-master-1 Oct 16 01:54:54.614193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-b833b2a8-3852-4667-ab55-c51f26e11fd3 req-19c76f7f-62cf-461c-a5f2-80622939f89f service nova] Instance 2a8da233-dc09-4b1a-bb19-674783a8a621 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:54:54.626123 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b833b2a8-3852-4667-ab55-c51f26e11fd3 req-19c76f7f-62cf-461c-a5f2-80622939f89f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045923 Oct 16 01:54:54.626892 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3480/6825] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:54:55.157925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:55.158678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:55.165647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:55.166139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:55.166581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:55.167312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:55.167780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:55.168213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:55.298388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:55.306969 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0061646e-af52-4200-bbfc-92c5d3a43290 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1518 microversion: 2.1 time: 0.153383 Oct 16 01:54:55.307567 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3346/6826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:55 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:56.333527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:56.334232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:56.340689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:56.341181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:56.341665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:56.342550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:56.343054 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:56.343494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:56.346090 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:54:56.477377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:56.485775 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a90a0f76-912f-48e8-b1b2-3a920c7185e9 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1516 microversion: 2.1 time: 0.157450 Oct 16 01:54:56.486347 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3481/6827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:56 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:56.645424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-34b7eb71-d29d-4d9f-b933-61e9d9f31bae req-a08af3a7-6bb0-4fbb-92c0-3b9859e6e970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8da233-dc09-4b1a-bb19-674783a8a621", "tag": "1d6145c7-a270-42e7-a642-ca6b0fe0f844"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:56.656313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-34b7eb71-d29d-4d9f-b933-61e9d9f31bae req-a08af3a7-6bb0-4fbb-92c0-3b9859e6e970 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:56.656788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-34b7eb71-d29d-4d9f-b933-61e9d9f31bae req-a08af3a7-6bb0-4fbb-92c0-3b9859e6e970 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:56.657204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-34b7eb71-d29d-4d9f-b933-61e9d9f31bae req-a08af3a7-6bb0-4fbb-92c0-3b9859e6e970 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:56.669617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-34b7eb71-d29d-4d9f-b933-61e9d9f31bae req-a08af3a7-6bb0-4fbb-92c0-3b9859e6e970 service nova] Creating event network-changed:1d6145c7-a270-42e7-a642-ca6b0fe0f844 for instance 2a8da233-dc09-4b1a-bb19-674783a8a621 on n-h2-master-1 Oct 16 01:54:56.676295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-34b7eb71-d29d-4d9f-b933-61e9d9f31bae req-a08af3a7-6bb0-4fbb-92c0-3b9859e6e970 service nova] Instance 2a8da233-dc09-4b1a-bb19-674783a8a621 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:54:56.688369 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-34b7eb71-d29d-4d9f-b933-61e9d9f31bae req-a08af3a7-6bb0-4fbb-92c0-3b9859e6e970 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046595 Oct 16 01:54:56.689203 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3347/6828] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:54:57.509893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:57.510449 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:57.517992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:57.518504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:57.518988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:57.519721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:57.520201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:57.520650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:57.656054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:57.664071 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-017c6809-1950-4293-a2b5-4790f203ebd0 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1513 microversion: 2.1 time: 0.158206 Oct 16 01:54:57.664801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3482/6829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:57 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:54:57.689704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:54:57.690336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:57.696450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:57.696931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:57.697364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:57.698057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:57.698512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:57.698958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:57.763234 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-09b6cad9-8b5d-4732-88f4-1a1e736a3468 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "POST /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621/action" status: 204 len: 0 microversion: 2.1 time: 0.079092 Oct 16 01:54:57.764727 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3348/6830] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:54:57 2022] POST /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:54:57.773214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:57.773846 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:57.780737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:57.781249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:57.781975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:57.782862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:57.783532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:57.784134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:57.919373 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:57.928710 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cad06cf5-4857-4262-a28d-bf289c4d4245 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1513 microversion: 2.1 time: 0.159437 Oct 16 01:54:57.929301 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3483/6831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:57 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:54:58.954556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:54:58.956157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:54:58.963242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:58.963627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:58.964077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:58.964963 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:54:58.965433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:54:58.965893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:54:59.115020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:54:59.122972 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-56c0c866-bf2a-4f99-ab0e-2f86e3453a8a tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1513 microversion: 2.1 time: 0.174182 Oct 16 01:54:59.123835 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3349/6832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:54:58 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:00.147348 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:00.147975 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:00.154942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.155432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.155885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.156588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.157057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.157497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.286255 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:00.293933 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-eb9230f5-c8ba-41e5-8616-c7ce6e9b522c tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1505 microversion: 2.1 time: 0.150648 Oct 16 01:55:00.294507 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3484/6833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:00 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:00.317549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:00.318108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:00.324621 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.325107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.325550 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.327059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.327524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.327958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.330641 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:00.460223 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:00.468512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-96d69dee-d65b-450d-890f-af508c1734e7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1505 microversion: 2.1 time: 0.154874 Oct 16 01:55:00.469079 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3350/6834] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:00 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:00.491481 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:00.492110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:00.498626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.499158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.499613 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.500314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.500818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.501258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.639420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:00.647206 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e635583-f506-410f-8c63-b62b78d609a7 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1505 microversion: 2.1 time: 0.159830 Oct 16 01:55:00.647788 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3485/6835] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:00 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:00.670785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:00.671252 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:00.677281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.677775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.678212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.678910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.679393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.679826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.705902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:55:00.785114 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bfda6bad-2934-4200-bdcf-aef06c68654e tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 204 len: 0 microversion: 2.1 time: 0.118954 Oct 16 01:55:00.785751 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3351/6836] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:55:00 2022] DELETE /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:55:00.801635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:00.802153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:00.808117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.808628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.809081 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.809790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.810302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.811032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.835755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:55:00.880090 n-d-master-1 devstack@n-api.service[120545]: INFO nova.compute.api [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Instance is already in deleting state, ignoring this request Oct 16 01:55:00.880922 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a832845d-e41e-475a-8099-2515b0759946 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 204 len: 0 microversion: 2.1 time: 0.083321 Oct 16 01:55:00.881490 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3486/6837] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:55:00 2022] DELETE /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:55:00.890412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:00.891184 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:00.897072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.897567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.898006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:00.898702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:00.899199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:00.899628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:01.033078 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:01.040729 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-99f684a2-4cf4-40e2-bbca-21ca4f775db4 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1511 microversion: 2.1 time: 0.154828 Oct 16 01:55:01.041302 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3352/6838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:00 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:01.418631 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5d35b1ec-e5ab-474b-b1d0-d28668ac8cc1 req-0739f0b3-5390-481b-b571-5c7ee7ee1fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8da233-dc09-4b1a-bb19-674783a8a621", "name": "network-vif-plugged", "status": "completed", "tag": "1d6145c7-a270-42e7-a642-ca6b0fe0f844"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:55:01.429683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d35b1ec-e5ab-474b-b1d0-d28668ac8cc1 req-0739f0b3-5390-481b-b571-5c7ee7ee1fe4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:01.430186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d35b1ec-e5ab-474b-b1d0-d28668ac8cc1 req-0739f0b3-5390-481b-b571-5c7ee7ee1fe4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:01.430639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5d35b1ec-e5ab-474b-b1d0-d28668ac8cc1 req-0739f0b3-5390-481b-b571-5c7ee7ee1fe4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:01.442336 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5d35b1ec-e5ab-474b-b1d0-d28668ac8cc1 req-0739f0b3-5390-481b-b571-5c7ee7ee1fe4 service nova] Creating event network-vif-plugged:1d6145c7-a270-42e7-a642-ca6b0fe0f844 for instance 2a8da233-dc09-4b1a-bb19-674783a8a621 on n-h2-master-1 Oct 16 01:55:01.447387 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5d35b1ec-e5ab-474b-b1d0-d28668ac8cc1 req-0739f0b3-5390-481b-b571-5c7ee7ee1fe4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032390 Oct 16 01:55:01.447969 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3487/6839] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:55:02.065342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:02.065954 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:02.072837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:02.073321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:02.073757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:02.075100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:02.075565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:02.076067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:02.211123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:02.219508 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85aab7e4-d92d-4e99-8e9b-59fc5c524f84 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1511 microversion: 2.1 time: 0.158824 Oct 16 01:55:02.220078 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3353/6840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:02 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:02.952178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e5d14991-ae03-4c84-a69e-c080bd8dca09 req-8da6fe14-2cd4-432c-a488-2ac14c663f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8da233-dc09-4b1a-bb19-674783a8a621", "name": "network-vif-deleted", "tag": "1d6145c7-a270-42e7-a642-ca6b0fe0f844"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:55:02.964845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e5d14991-ae03-4c84-a69e-c080bd8dca09 req-8da6fe14-2cd4-432c-a488-2ac14c663f3d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:02.965322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e5d14991-ae03-4c84-a69e-c080bd8dca09 req-8da6fe14-2cd4-432c-a488-2ac14c663f3d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:02.965761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e5d14991-ae03-4c84-a69e-c080bd8dca09 req-8da6fe14-2cd4-432c-a488-2ac14c663f3d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:02.978610 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e5d14991-ae03-4c84-a69e-c080bd8dca09 req-8da6fe14-2cd4-432c-a488-2ac14c663f3d service nova] Creating event network-vif-deleted:1d6145c7-a270-42e7-a642-ca6b0fe0f844 for instance 2a8da233-dc09-4b1a-bb19-674783a8a621 on n-h2-master-1 Oct 16 01:55:02.984824 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e5d14991-ae03-4c84-a69e-c080bd8dca09 req-8da6fe14-2cd4-432c-a488-2ac14c663f3d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038121 Oct 16 01:55:02.985423 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3488/6841] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:55:03.243703 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:03.244329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:03.252323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:03.252818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:03.253267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:03.253979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:03.254441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:03.254870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:03.290239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:03.290728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:03.291192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:03.291646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lazy-loading 'fault' on Instance uuid 2a8da233-dc09-4b1a-bb19-674783a8a621 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:55:03.335096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca43706de46f42efa2a0883aff54aab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d41904861f49f18d0fd1011bba8ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:03.343735 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-51b546af-4d43-4ae1-b3c0-4257590dbb7b tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 200 len: 1305 microversion: 2.1 time: 0.104309 Oct 16 01:55:03.344332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3354/6842] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:03 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:04.369979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:04.370623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 2a8da233-dc09-4b1a-bb19-674783a8a621] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:04.378061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:04.378554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:04.379026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:04.379723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:04.380192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:04.380629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:04.393641 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] HTTP exception thrown: Instance 2a8da233-dc09-4b1a-bb19-674783a8a621 could not be found. Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Request method failure captured: Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 HTTP/1.1 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2QUGLFs30h7CdHxUMRcHnmrnl3gVe23lGc0I-gUVr7VmXZvjtG5jUzazA2TLeiqpfoP6SQB0pWYlB-y37j0YNsgPsh9j-2Yd0i3R1L6wyNGwWqx32kmeehmaY9n3ZQdwP0sxSC6cnDDXKId7rlecaPq_RWhxkzeorZam8FtIMDZuYY Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 59d41904861f49f18d0fd1011bba8ba5 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59d41904861f49f18d0fd1011bba8ba5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 59d41904861f49f18d0fd1011bba8ba5 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerDiskConfigTestJSON-1636464536-project Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ca43706de46f42efa2a0883aff54aab8 Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerDiskConfigTestJSON-1636464536-project Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 2a8da233-dc09-4b1a-bb19-674783a8a621 could not be found. Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '2a8da233-dc09-4b1a-bb19-674783a8a621'} Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8da233-dc09-4b1a-bb19-674783a8a621 could not be found. Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8da233-dc09-4b1a-bb19-674783a8a621 could not be found. Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:55:04.395351 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8da233-dc09-4b1a-bb19-674783a8a621 could not be found. Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Returning 404 to user: Instance 2a8da233-dc09-4b1a-bb19-674783a8a621 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e7a1b9e-291a-44fc-aad5-2af5097d702f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621" status: 404 len: 111 microversion: 2.1 time: 0.031152 Oct 16 01:55:04.400210 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3489/6843] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:04 2022] GET /compute/v2.1/servers/2a8da233-dc09-4b1a-bb19-674783a8a621 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:55:04.405923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ce9ce577-d12a-445c-96f2-b34cd1aea2b2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '.version_select at 0x7fd64e5468b0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:04.426373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ce9ce577-d12a-445c-96f2-b34cd1aea2b2 tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232053057" status: 202 len: 0 microversion: 2.1 time: 0.024542 Oct 16 01:55:04.427008 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3355/6844] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 01:55:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232053057 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:55:05.049539 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:05.050047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:05.056027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:05.056519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:05.056967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:05.057716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:05.058194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:05.058629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:05.072188 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] HTTP exception thrown: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Request method failure captured: Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f HTTP/1.1 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2QUGLFs30h7CdHxUMRcHnmrnl3gVe23lGc0I-gUVr7VmXZvjtG5jUzazA2TLeiqpfoP6SQB0pWYlB-y37j0YNsgPsh9j-2Yd0i3R1L6wyNGwWqx32kmeehmaY9n3ZQdwP0sxSC6cnDDXKId7rlecaPq_RWhxkzeorZam8FtIMDZuYY Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 59d41904861f49f18d0fd1011bba8ba5 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59d41904861f49f18d0fd1011bba8ba5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 59d41904861f49f18d0fd1011bba8ba5 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerDiskConfigTestJSON-1636464536-project Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: ca43706de46f42efa2a0883aff54aab8 Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerDiskConfigTestJSON-1636464536-project Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6b57fc7a-3438-4810-9058-ab466b37352f'} Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:55:05.073740 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Returning 404 to user: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-157e6afa-baee-481a-b5dc-46d4e25cee3f tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 404 len: 111 microversion: 2.1 time: 0.029527 Oct 16 01:55:05.078140 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3490/6845] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:55:05 2022] DELETE /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:55:05.084891 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:05.085505 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] [instance: 6b57fc7a-3438-4810-9058-ab466b37352f] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:05.092882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:05.093359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:05.093793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:05.094479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:05.094947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:05.095374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:05.108370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] HTTP exception thrown: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Request method failure captured: Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f HTTP/1.1 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2QUGLFs30h7CdHxUMRcHnmrnl3gVe23lGc0I-gUVr7VmXZvjtG5jUzazA2TLeiqpfoP6SQB0pWYlB-y37j0YNsgPsh9j-2Yd0i3R1L6wyNGwWqx32kmeehmaY9n3ZQdwP0sxSC6cnDDXKId7rlecaPq_RWhxkzeorZam8FtIMDZuYY Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 59d41904861f49f18d0fd1011bba8ba5 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_59d41904861f49f18d0fd1011bba8ba5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/59d41904861f49f18d0fd1011bba8ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 59d41904861f49f18d0fd1011bba8ba5 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1636464536 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerDiskConfigTestJSON-1636464536-project Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: ca43706de46f42efa2a0883aff54aab8 Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerDiskConfigTestJSON-1636464536-project Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '6b57fc7a-3438-4810-9058-ab466b37352f'} Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:55:05.110028 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] Returning 404 to user: Instance 6b57fc7a-3438-4810-9058-ab466b37352f could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4cfb6d25-d008-41ea-881b-4bafdbb29b6d tempest-ServerDiskConfigTestJSON-1636464536 tempest-ServerDiskConfigTestJSON-1636464536-project] 10.222.0.39 "GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f" status: 404 len: 111 microversion: 2.1 time: 0.030453 Oct 16 01:55:05.114493 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3356/6846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:05 2022] GET /compute/v2.1/servers/6b57fc7a-3438-4810-9058-ab466b37352f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:55:13.858759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-90234299-fd10-40e5-82d4-3200e6aceb01 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'create', calling method: .version_select at 0x7fd64d2f9ee0>, body: {"keypair": {"name": "tempest-keypair-1874351574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/EcqVyDq/O6MPpx+X6U/Q0LIrhAH993GPe/qvWJgKxghVaN7kCFnfIjhnQUiOI8YwqJ2A2bJUc35BWBXXkXPSjfvUc8PK2kswgtlaqmYGXS/L6i1ZaQ3q1Shht4f4IXg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:55:13.864391 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=36 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:13.876715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-90234299-fd10-40e5-82d4-3200e6aceb01 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for project f810218c158a4fb0baded3bbff983c71. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:55:13.882075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-90234299-fd10-40e5-82d4-3200e6aceb01 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for user b12139c2484c4e4fbbf9839ab577ee5c and project f810218c158a4fb0baded3bbff983c71. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:55:13.911777 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-90234299-fd10-40e5-82d4-3200e6aceb01 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178386 Oct 16 01:55:13.912386 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3491/6847] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 01:55:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:55:15.282330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1597586926", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ebe8e9-4dd7-4a5c-917a-e86f33c790b4"}], "security_groups": [{"name": "tempest-securitygroup--8587391"}], "key_name": "tempest-keypair-1874351574", "user_data": "}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:55:15.291956 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:15.292617 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:15.393375 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] validate_networks() for [('25ebe8e9-4dd7-4a5c-917a-e86f33c790b4', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:55:15.832446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:55:15.832869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:55:15.833339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:55:15.833747 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:55:15.834157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:55:15.843329 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:15.843810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:15.844246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:15.844988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:15.845425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:15.845845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:15.863163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:55:15.868388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for user b12139c2484c4e4fbbf9839ab577ee5c and project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:55:15.881427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:55:15.883763 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:55:15.932140 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7923116-d80d-48f0-a428-45113123c279 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.654994 Oct 16 01:55:15.933120 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3357/6848] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:55:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:55:15.944499 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec55f288-13b8-40f1-90c7-78bade6082ed tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:15.945323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec55f288-13b8-40f1-90c7-78bade6082ed tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:15.962555 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:16.029758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ec55f288-13b8-40f1-90c7-78bade6082ed tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:16.036879 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec55f288-13b8-40f1-90c7-78bade6082ed tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1239 microversion: 2.1 time: 0.096315 Oct 16 01:55:16.037464 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3492/6849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:15 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:17.062006 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:17.063309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:17.070618 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:17.071150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:17.071592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:17.072301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:17.072762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:17.073193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:17.137204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:17.146112 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d69e43b3-312f-4f4a-942c-8a3a7acbb91a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1291 microversion: 2.1 time: 0.089451 Oct 16 01:55:17.147840 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3358/6850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:17 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1291 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:18.170969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:18.171595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:18.178469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:18.178998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:18.179453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:18.180163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:18.180638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:18.181073 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:18.319283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:18.328021 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80e1476b-ce53-43f9-a3fd-d08a6ee7d66c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1362 microversion: 2.1 time: 0.160880 Oct 16 01:55:18.334306 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3493/6851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:18 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:18.761348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0f256553-32c2-4d66-9a91-86dd09fddf55 req-0cc5c5f9-e6b0-427e-ab3d-91c2221cd73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2", "tag": "6b82e16d-6474-4623-bdad-2786b84ada42"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:55:18.773678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0f256553-32c2-4d66-9a91-86dd09fddf55 req-0cc5c5f9-e6b0-427e-ab3d-91c2221cd73e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:18.774153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0f256553-32c2-4d66-9a91-86dd09fddf55 req-0cc5c5f9-e6b0-427e-ab3d-91c2221cd73e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:18.774636 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0f256553-32c2-4d66-9a91-86dd09fddf55 req-0cc5c5f9-e6b0-427e-ab3d-91c2221cd73e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:18.791084 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0f256553-32c2-4d66-9a91-86dd09fddf55 req-0cc5c5f9-e6b0-427e-ab3d-91c2221cd73e service nova] Creating event network-changed:6b82e16d-6474-4623-bdad-2786b84ada42 for instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 on n-h1-master-1 Oct 16 01:55:18.797319 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0f256553-32c2-4d66-9a91-86dd09fddf55 req-0cc5c5f9-e6b0-427e-ab3d-91c2221cd73e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040658 Oct 16 01:55:18.797945 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3359/6852] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:55:19.351667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:19.352292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:19.359646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:19.360155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:19.360614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:19.361326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:19.361806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:19.362253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:19.491524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:19.499579 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7a180cf3-5e5c-40a5-8ba0-435889c061c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1362 microversion: 2.1 time: 0.151920 Oct 16 01:55:19.500148 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3494/6853] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:19 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:20.523789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:20.524723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:20.532433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:20.533626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:20.534075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:20.534867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:20.535377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:20.535815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:20.671457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:20.679596 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16f7e89f-8702-4a95-a561-11b21d428d4b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1362 microversion: 2.1 time: 0.160759 Oct 16 01:55:20.680173 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3360/6854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:20 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:21.703209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:21.703836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:21.710572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:21.711116 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:21.711575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:21.712297 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:21.712781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:21.713224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:21.847862 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:21.855505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-41cdd357-b8e4-4e64-a706-5458201169c3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1362 microversion: 2.1 time: 0.156338 Oct 16 01:55:21.856073 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3495/6855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:21 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:22.879651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:22.880295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:22.887188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:22.887677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:22.888267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:22.888978 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:22.889442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:22.889873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:23.020300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:23.028078 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0f8b7136-ee3f-494f-8836-5182f2a76c77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1362 microversion: 2.1 time: 0.152364 Oct 16 01:55:23.028804 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3361/6856] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:22 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:23.669541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3d4bf5e7-bb15-4270-8b86-7d613e91a37a req-11381794-8f66-4169-bd73-f106d9871c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2", "name": "network-vif-plugged", "status": "completed", "tag": "6b82e16d-6474-4623-bdad-2786b84ada42"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:55:23.681869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d4bf5e7-bb15-4270-8b86-7d613e91a37a req-11381794-8f66-4169-bd73-f106d9871c81 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:23.682430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d4bf5e7-bb15-4270-8b86-7d613e91a37a req-11381794-8f66-4169-bd73-f106d9871c81 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:23.683310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3d4bf5e7-bb15-4270-8b86-7d613e91a37a req-11381794-8f66-4169-bd73-f106d9871c81 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:23.695176 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3d4bf5e7-bb15-4270-8b86-7d613e91a37a req-11381794-8f66-4169-bd73-f106d9871c81 service nova] Creating event network-vif-plugged:6b82e16d-6474-4623-bdad-2786b84ada42 for instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 on n-h1-master-1 Oct 16 01:55:23.700781 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3d4bf5e7-bb15-4270-8b86-7d613e91a37a req-11381794-8f66-4169-bd73-f106d9871c81 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034524 Oct 16 01:55:23.701388 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3496/6857] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:55:24.051484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:24.052126 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:24.059047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:24.060030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:24.060469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:24.061418 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:24.061881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:24.062310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:24.194174 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:24.202518 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-52a77bed-0a84-4f16-8130-7b1fdc671044 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1362 microversion: 2.1 time: 0.154959 Oct 16 01:55:24.203140 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3362/6858] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:24 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:25.226215 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:25.226826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:25.234889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:25.235424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:25.235880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:25.236597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:25.237077 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:25.237522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:25.369329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:55:25.377838 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-43dca3a5-838f-43e7-8080-e9683ff323c5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1550 microversion: 2.1 time: 0.156059 Oct 16 01:55:25.378413 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3497/6859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:55:25 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:55:25.400878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:55:25.401468 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:55:25.408959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:25.409553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:25.410066 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:25.410855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:25.411352 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:25.411786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:25.498437 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2ef08d2e-b549-400e-96c8-b0c6032c740f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101415 Oct 16 01:55:25.499064 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3363/6860] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:55:25 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:55:26.758801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e09f3e04-c095-4a6b-9a17-099f54c71c62 req-c054424e-0f17-444d-bdad-c5d52a4b54a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2", "tag": "6b82e16d-6474-4623-bdad-2786b84ada42"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:55:26.764226 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:55:26.770719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e09f3e04-c095-4a6b-9a17-099f54c71c62 req-c054424e-0f17-444d-bdad-c5d52a4b54a6 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:55:26.771275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e09f3e04-c095-4a6b-9a17-099f54c71c62 req-c054424e-0f17-444d-bdad-c5d52a4b54a6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:55:26.771734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e09f3e04-c095-4a6b-9a17-099f54c71c62 req-c054424e-0f17-444d-bdad-c5d52a4b54a6 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:55:26.783842 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e09f3e04-c095-4a6b-9a17-099f54c71c62 req-c054424e-0f17-444d-bdad-c5d52a4b54a6 service nova] Creating event network-changed:6b82e16d-6474-4623-bdad-2786b84ada42 for instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 on n-h1-master-1 Oct 16 01:55:26.789006 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e09f3e04-c095-4a6b-9a17-099f54c71c62 req-c054424e-0f17-444d-bdad-c5d52a4b54a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033907 Oct 16 01:55:26.790063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3498/6861] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:56:00.575025 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:00.575834 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:00.577705 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:00.578326 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=32 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:00.583553 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:00.584230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:00.592587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:00.593071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:00.593508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:00.594194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:00.594649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:00.595113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:00.726898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:00.734661 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f25f6abb-5841-49ce-b50f-a286b29f91e7 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1668 microversion: 2.1 time: 0.160537 Oct 16 01:56:00.735268 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3364/6862] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:00 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:00.758657 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:00.759499 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=28 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:00.763731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:00.764447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:00.772213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:00.772716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:00.773169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:00.773882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:00.774360 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:00.774833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:00.921134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:00.930972 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7101c801-30dc-4bf9-b6c4-75be30d69f20 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1668 microversion: 2.1 time: 0.174340 Oct 16 01:56:00.931562 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3499/6863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:00 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:00.955280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:00.955927 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:00.962472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:00.962973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:00.963425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:00.964134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:00.964609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:00.965042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:01.097300 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:01.105242 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e978fb09-8bed-4a1a-82b5-f1c04460406a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1668 microversion: 2.1 time: 0.153983 Oct 16 01:56:01.105821 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3365/6864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:00 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:01.128595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:01.130668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:01.136652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:01.137157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:01.137611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:01.138316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:01.138797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:01.139268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:01.167934 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:01.173262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Old instance type m1.heat2, new instance type m1.heat {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:56:01.179799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:56:01.180226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:56:01.180706 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:56:01.181123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:56:01.181543 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:56:01.244685 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c14d72ea-f2c7-4b38-9569-ab602335ef73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2/action" status: 202 len: 0 microversion: 2.1 time: 0.120286 Oct 16 01:56:01.245460 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3500/6865] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:56:01 2022] POST /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:56:01.260488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:01.261104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:01.267046 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:01.267541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:01.268002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:01.269628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:01.270283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:01.270740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:01.427706 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:01.436308 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-721e8cf9-5c4b-4823-b3ce-30d19d46ecea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1677 microversion: 2.1 time: 0.179661 Oct 16 01:56:01.437009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3366/6866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:01 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:02.462535 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:02.463198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:02.473575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:02.474075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:02.474555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:02.475319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:02.475789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:02.476226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:02.608772 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:02.617026 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a373c969-5ab2-4233-a68f-af997e5514e5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1677 microversion: 2.1 time: 0.159534 Oct 16 01:56:02.617624 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3501/6867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:02 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:03.641156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:03.641765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:03.648793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:03.649273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:03.649708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:03.650392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:03.650844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:03.651300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:03.781519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:03.789756 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0cfeb172-b724-4009-8590-cc5e119e93c0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.152524 Oct 16 01:56:03.790332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3367/6868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:03 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:04.814080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:04.814726 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:04.821552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:04.822051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:04.822500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:04.823225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:04.823696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:04.824135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:04.954767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:04.964335 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a5da82b6-da72-41e1-83ca-24f62657c53b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.154406 Oct 16 01:56:04.964908 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3502/6869] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:04 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:05.990352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:05.990881 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:05.997787 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:05.998266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:05.998709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:05.999427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:05.999884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:06.000311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:06.132150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:06.139976 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a6694447-533d-488a-b775-1394100d68f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.154763 Oct 16 01:56:06.140557 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3368/6870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:05 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:07.163647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:07.164271 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:07.171071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:07.171567 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:07.172016 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:07.172714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:07.173182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:07.173618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:07.303542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:07.311585 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-20dd7059-2cfd-42c6-bd9a-24479e9942c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.151999 Oct 16 01:56:07.312168 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3503/6871] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:07 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:08.335483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:08.336114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:08.342893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:08.343405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:08.343850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:08.344543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:08.345003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:08.345435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:08.479868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:08.487816 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-65f452e2-24ed-4edf-af87-e3e7a22c2e60 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.156393 Oct 16 01:56:08.488498 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3369/6872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:08 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:09.511433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:09.512065 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:09.519095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:09.519679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:09.520141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:09.520849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:09.521329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:09.521773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:09.652276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:09.660613 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d342633-6427-45bd-9e00-01b4aa29b6cf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.153088 Oct 16 01:56:09.661242 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3504/6873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:09 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:10.684852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:10.685659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:10.693468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:10.693946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:10.694381 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:10.695099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:10.695557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:10.695985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:10.828341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:10.836348 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7dc0b7f9-e288-4c29-92b0-090328897e61 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.155262 Oct 16 01:56:10.837543 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3370/6874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:10 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:11.860766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:11.861325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:11.868241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:11.868742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:11.869194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:11.869899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:11.870373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:11.871308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:12.001347 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:12.009709 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-79afa630-258c-4a42-bbd9-8bfe035f0691 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.153687 Oct 16 01:56:12.010279 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3505/6875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:11 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:13.033735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:13.034253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:13.041850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:13.042347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:13.042793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:13.043559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:13.044025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:13.044458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:13.172624 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:13.181179 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4392c1e4-5071-4dfa-b28d-90e04c58eed8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.151411 Oct 16 01:56:13.181758 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3371/6876] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:13 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:14.206017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:14.206929 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:14.213863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:14.214368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:14.214817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:14.215545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:14.216018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:14.216457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:14.348747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:14.357005 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-29572ac8-62b1-4186-932e-7f1f3e6104f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.154826 Oct 16 01:56:14.357759 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3506/6877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:14 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:15.381959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:15.382617 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:15.390013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:15.390500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:15.391248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:15.391945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:15.392397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:15.392821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:15.520656 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:15.528394 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-44c21049-1d4d-4085-bf59-ac057e6b32df tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.151019 Oct 16 01:56:15.528973 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3372/6878] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:15 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:16.552253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:16.552885 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:16.560055 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:16.560816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:16.561274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:16.561994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:16.562602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:16.562906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:16.698245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:16.707201 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de7de0b4-2716-4683-808b-5541283a6cad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.158339 Oct 16 01:56:16.707780 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3507/6879] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:16 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:17.730984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:17.731649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:17.739082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:17.739560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:17.740028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:17.740732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:17.741196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:17.741630 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:17.872746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:17.882187 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5106eae8-ebb9-46ca-9873-2c5ddd42ffaf tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.155443 Oct 16 01:56:17.882790 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3373/6880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:17 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:18.905860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:18.906412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:18.915194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:18.915699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:18.916268 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:18.916980 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:18.917453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:18.917891 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:19.060855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:19.070147 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34e38e51-141a-4915-b7ad-25baa8fa811d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.168315 Oct 16 01:56:19.070728 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3508/6881] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:18 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:20.095831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:20.096483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:20.104396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:20.104884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:20.105325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:20.106024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:20.106487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:20.106942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:20.318882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:20.326750 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2caacaf3-f4f7-4c2e-b8bc-52805366daa8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1682 microversion: 2.1 time: 0.234776 Oct 16 01:56:20.327558 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3374/6882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:20 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:20.691389 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-cbfedb05-af12-4f9e-8076-1e2012b69b4f req-2eec060b-91d9-4323-9a67-cf9b98f02893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "6b82e16d-6474-4623-bdad-2786b84ada42"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:20.701917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cbfedb05-af12-4f9e-8076-1e2012b69b4f req-2eec060b-91d9-4323-9a67-cf9b98f02893 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:20.702410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cbfedb05-af12-4f9e-8076-1e2012b69b4f req-2eec060b-91d9-4323-9a67-cf9b98f02893 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:20.702854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-cbfedb05-af12-4f9e-8076-1e2012b69b4f req-2eec060b-91d9-4323-9a67-cf9b98f02893 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:20.714731 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-cbfedb05-af12-4f9e-8076-1e2012b69b4f req-2eec060b-91d9-4323-9a67-cf9b98f02893 service nova] Creating event network-vif-unplugged:6b82e16d-6474-4623-bdad-2786b84ada42 for instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 on n-h2-master-1 Oct 16 01:56:20.720034 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-cbfedb05-af12-4f9e-8076-1e2012b69b4f req-2eec060b-91d9-4323-9a67-cf9b98f02893 service nova] Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:56:20.732156 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-cbfedb05-af12-4f9e-8076-1e2012b69b4f req-2eec060b-91d9-4323-9a67-cf9b98f02893 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045294 Oct 16 01:56:20.733146 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3509/6883] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:56:21.351236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:21.351862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:21.358309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:21.358800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:21.359271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:21.360021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:21.360487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:21.360920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:21.491774 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:21.499544 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-25620325-1389-4805-9c16-a48023082cfd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1681 microversion: 2.1 time: 0.152352 Oct 16 01:56:21.500127 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3375/6884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:21 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:22.526094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:22.526809 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:22.533370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:22.533876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:22.534329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:22.535072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:22.535551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:22.535997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:22.726900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:22.734944 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f27f3c16-4447-468a-8149-eafc012529eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1679 microversion: 2.1 time: 0.214562 Oct 16 01:56:22.735544 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3510/6885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:22 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:22.777160 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-91a17cfb-f57b-478e-93b5-8cc380b4fc65 req-c238b68c-ed20-4460-81fd-4a03918c8940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2", "tag": "6b82e16d-6474-4623-bdad-2786b84ada42"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:22.788226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-91a17cfb-f57b-478e-93b5-8cc380b4fc65 req-c238b68c-ed20-4460-81fd-4a03918c8940 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:22.788710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-91a17cfb-f57b-478e-93b5-8cc380b4fc65 req-c238b68c-ed20-4460-81fd-4a03918c8940 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:22.789147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-91a17cfb-f57b-478e-93b5-8cc380b4fc65 req-c238b68c-ed20-4460-81fd-4a03918c8940 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:22.801564 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-91a17cfb-f57b-478e-93b5-8cc380b4fc65 req-c238b68c-ed20-4460-81fd-4a03918c8940 service nova] Creating event network-changed:6b82e16d-6474-4623-bdad-2786b84ada42 for instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 on n-h2-master-1 Oct 16 01:56:22.806809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-91a17cfb-f57b-478e-93b5-8cc380b4fc65 req-c238b68c-ed20-4460-81fd-4a03918c8940 service nova] Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:56:22.817829 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-91a17cfb-f57b-478e-93b5-8cc380b4fc65 req-c238b68c-ed20-4460-81fd-4a03918c8940 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044387 Oct 16 01:56:22.818426 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3376/6886] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:56:23.760334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:23.761042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:23.767910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:23.768419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:23.769468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:23.770186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:23.770856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:23.771439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:23.902170 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:23.909989 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92540e83-1b55-4eb6-bb9e-02c33d785efd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1676 microversion: 2.1 time: 0.153964 Oct 16 01:56:23.910565 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3511/6887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:23 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:23.935716 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:23.936348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:23.943344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:23.943839 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:23.944497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:23.945202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:23.945675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:23.946112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:24.005727 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f15b1367-b59c-42a5-b590-ab47e65e8bb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2/action" status: 204 len: 0 microversion: 2.1 time: 0.075272 Oct 16 01:56:24.006376 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3377/6888] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:56:23 2022] POST /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:56:24.015412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:24.015973 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:24.022295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:24.022966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:24.023625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:24.024500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:24.025021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:24.025724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:24.162994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:24.170990 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-52b179b0-0fc5-4ab8-91f9-7689fd132aef tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1676 microversion: 2.1 time: 0.160203 Oct 16 01:56:24.171567 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3512/6889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:24 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:25.197490 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:25.198441 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:25.207119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:25.207908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:25.208410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:25.209182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:25.209712 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:25.210206 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:25.367256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:25.375196 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c568fe4e-aa1f-47c5-8787-25916a3a66c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1676 microversion: 2.1 time: 0.182376 Oct 16 01:56:25.375804 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3378/6890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:25 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:56:26.400358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:26.400990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:26.407856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:26.408361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:26.408814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:26.410092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:26.410566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:26.411072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:26.540857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:26.548718 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9e707c2a-90ce-4b56-b28a-6abb70ff62a8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1668 microversion: 2.1 time: 0.152328 Oct 16 01:56:26.549309 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3513/6891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:26 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:26.572309 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:26.572919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:26.579758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:26.580241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:26.580678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:26.582224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:26.582690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:26.583154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:26.714048 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:26.716370 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:26.723454 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ffc9588d-9922-48f8-8f6b-fa0710674de0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1668 microversion: 2.1 time: 0.155031 Oct 16 01:56:26.724035 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3379/6892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:26 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:26.746013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:26.746636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:26.752575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:26.753708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:26.754224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:26.754953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:26.755436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:26.755876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:26.774392 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:26.887413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:26.895706 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7c54b7da-6402-42c7-b5db-c53f60bf6f49 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1668 microversion: 2.1 time: 0.153511 Oct 16 01:56:26.896279 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3514/6893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:26 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:26.917976 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:26.918405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:26.926126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:26.926624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:26.927067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:26.927754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:26.928208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:26.928631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:26.957780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:56:27.036381 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba2536b8-47b8-4b00-8fbe-49d4bfd27fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 204 len: 0 microversion: 2.1 time: 0.121938 Oct 16 01:56:27.037217 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3380/6894] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:56:26 2022] DELETE /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:56:27.045694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:27.046374 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:27.053496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:27.053993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:27.054439 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:27.055170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:27.055643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:27.056080 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:27.188183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:27.197134 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91db6f52-2162-4aad-83a3-f525e41458c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1674 microversion: 2.1 time: 0.155323 Oct 16 01:56:27.197704 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3515/6895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:27 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:27.856559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-abadd2f9-1abf-4370-93ce-d073ef88a44f req-e6f3438a-b5fc-48e8-80c8-d93aa041fe97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2", "name": "network-vif-plugged", "status": "completed", "tag": "6b82e16d-6474-4623-bdad-2786b84ada42"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:27.869410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-abadd2f9-1abf-4370-93ce-d073ef88a44f req-e6f3438a-b5fc-48e8-80c8-d93aa041fe97 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:27.869904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-abadd2f9-1abf-4370-93ce-d073ef88a44f req-e6f3438a-b5fc-48e8-80c8-d93aa041fe97 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:27.870338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-abadd2f9-1abf-4370-93ce-d073ef88a44f req-e6f3438a-b5fc-48e8-80c8-d93aa041fe97 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:27.881271 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-abadd2f9-1abf-4370-93ce-d073ef88a44f req-e6f3438a-b5fc-48e8-80c8-d93aa041fe97 service nova] Creating event network-vif-plugged:6b82e16d-6474-4623-bdad-2786b84ada42 for instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 on n-h2-master-1 Oct 16 01:56:27.886413 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-abadd2f9-1abf-4370-93ce-d073ef88a44f req-e6f3438a-b5fc-48e8-80c8-d93aa041fe97 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033965 Oct 16 01:56:27.887216 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3381/6896] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:56:28.221308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:28.222049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:28.228682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:28.229178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:28.229630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:28.230338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:28.230813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:28.231421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:28.363611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:28.371559 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5c634b59-02e3-490b-8997-b3dba1aa1afa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1674 microversion: 2.1 time: 0.154266 Oct 16 01:56:28.372143 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3516/6897] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:28 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:29.396713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:29.397408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:29.404295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:29.404772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:29.405210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:29.405894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:29.406351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:29.406775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:29.544142 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:29.554860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-882d7a5e-0ad8-4d59-b203-e28e2abf1d4d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 200 len: 1674 microversion: 2.1 time: 0.163454 Oct 16 01:56:29.556302 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3382/6898] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:29 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:29.806982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c2308dd0-7795-43a2-b51d-48734423b211 req-95051e29-5b46-4eb0-98e7-1c6de7adb474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2", "name": "network-vif-deleted", "tag": "6b82e16d-6474-4623-bdad-2786b84ada42"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:29.820376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c2308dd0-7795-43a2-b51d-48734423b211 req-95051e29-5b46-4eb0-98e7-1c6de7adb474 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:29.820999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c2308dd0-7795-43a2-b51d-48734423b211 req-95051e29-5b46-4eb0-98e7-1c6de7adb474 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:29.821522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c2308dd0-7795-43a2-b51d-48734423b211 req-95051e29-5b46-4eb0-98e7-1c6de7adb474 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:29.835213 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c2308dd0-7795-43a2-b51d-48734423b211 req-95051e29-5b46-4eb0-98e7-1c6de7adb474 service nova] Creating event network-vif-deleted:6b82e16d-6474-4623-bdad-2786b84ada42 for instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 on n-h2-master-1 Oct 16 01:56:29.841829 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c2308dd0-7795-43a2-b51d-48734423b211 req-95051e29-5b46-4eb0-98e7-1c6de7adb474 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039659 Oct 16 01:56:29.842459 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3517/6899] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:56:30.581383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:30.582780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:30.590515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:30.591037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:30.591474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:30.592412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:30.592879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:30.593311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:30.608544 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 HTTP/1.1 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2'} Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:56:30.610351 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1b523fc-22a1-4e22-99f6-97313441f104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 404 len: 111 microversion: 2.1 time: 0.035090 Oct 16 01:56:30.615418 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3383/6900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:30 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:56:30.624910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:30.625623 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:30.632757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:30.633265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:30.633710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:30.634614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:30.635141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:30.635584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:30.650865 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 HTTP/1.1 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2'} Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:56:30.652697 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:56:30.657401 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2a709e91-257d-41e9-af8d-ad78b01480a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 404 len: 111 microversion: 2.1 time: 0.034035 Oct 16 01:56:30.665185 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3518/6901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:30 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:56:30.704731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-811070759", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "25ebe8e9-4dd7-4a5c-917a-e86f33c790b4"}], "security_groups": [{"name": "tempest-securitygroup--8587391"}], "key_name": "tempest-keypair-1874351574", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:30.714124 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:30.819570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] validate_networks() for [('25ebe8e9-4dd7-4a5c-917a-e86f33c790b4', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:56:31.218424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:56:31.218863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:56:31.219394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:56:31.219809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:56:31.220232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:56:31.229901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:31.230388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:31.230851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:31.231634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:31.232090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:31.232515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:31.249712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:56:31.256009 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for user b12139c2484c4e4fbbf9839ab577ee5c and project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:56:31.268099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:56:31.271455 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:56:31.318035 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4dffde99-041d-4105-8ca0-c04dae1f8ad6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.617200 Oct 16 01:56:31.319029 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3384/6902] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:56:30 2022] POST /compute/v2.1/servers => generated 403 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:56:31.329987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dc0d9090-4e6e-4454-9d80-00326b91c976 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:31.331390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dc0d9090-4e6e-4454-9d80-00326b91c976 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:31.345598 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=45 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:31.402198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dc0d9090-4e6e-4454-9d80-00326b91c976 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:31.410202 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dc0d9090-4e6e-4454-9d80-00326b91c976 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1238 microversion: 2.1 time: 0.084136 Oct 16 01:56:31.410776 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3519/6903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:31 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:32.434390 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:32.435198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:32.445304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:32.446245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:32.446678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:32.447416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:32.447886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:32.448320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:32.519916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:32.528060 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6647fd23-2ce7-4f7e-9aff-ad2abed48870 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1308 microversion: 2.1 time: 0.097984 Oct 16 01:56:32.528651 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3385/6904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:32 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:33.553006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:33.553731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:33.561446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:33.561952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:33.562844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:33.563142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:33.563615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:33.564053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:33.697311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:33.705222 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-91803ebd-a3eb-4af0-9530-2f729bf59f9d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1361 microversion: 2.1 time: 0.156886 Oct 16 01:56:33.706402 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3520/6905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:33 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:33.796644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-503a6de5-b5d8-42ff-ba3a-21a25c909d55 req-34e70ace-87b1-4b07-a49e-57c53f741034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8f83336-62c4-48da-801b-c47dcfee9224", "tag": "abbcc05b-0b72-400e-b697-308f3dde8be3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:33.809574 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-503a6de5-b5d8-42ff-ba3a-21a25c909d55 req-34e70ace-87b1-4b07-a49e-57c53f741034 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:33.810605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-503a6de5-b5d8-42ff-ba3a-21a25c909d55 req-34e70ace-87b1-4b07-a49e-57c53f741034 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:33.811139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-503a6de5-b5d8-42ff-ba3a-21a25c909d55 req-34e70ace-87b1-4b07-a49e-57c53f741034 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:33.822796 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-503a6de5-b5d8-42ff-ba3a-21a25c909d55 req-34e70ace-87b1-4b07-a49e-57c53f741034 service nova] Creating event network-changed:abbcc05b-0b72-400e-b697-308f3dde8be3 for instance a8f83336-62c4-48da-801b-c47dcfee9224 on n-h1-master-1 Oct 16 01:56:33.828796 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-503a6de5-b5d8-42ff-ba3a-21a25c909d55 req-34e70ace-87b1-4b07-a49e-57c53f741034 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036643 Oct 16 01:56:33.829398 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3386/6906] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:56:34.730630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:34.731198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:34.737833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:34.738323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:34.738771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:34.739500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:34.739978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:34.740415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:34.868457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:34.876191 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d152893-dac1-482c-a3f9-4da192691333 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1361 microversion: 2.1 time: 0.149608 Oct 16 01:56:34.876764 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3521/6907] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:34 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:35.902141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:35.902836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:35.910994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:35.911481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:35.911913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:35.912600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:35.913056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:35.913479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:36.042160 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:36.049964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-727f2d7f-5ed2-407a-9098-a8f7ce4094c6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1361 microversion: 2.1 time: 0.152124 Oct 16 01:56:36.050531 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3387/6908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:35 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:37.073950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:37.074568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:37.082179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:37.082681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:37.083162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:37.083866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:37.084339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:37.084779 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:37.224580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:37.232241 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9ffc3515-c940-4f27-b4b0-d1fd661fa577 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1361 microversion: 2.1 time: 0.162199 Oct 16 01:56:37.232815 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3522/6909] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:37 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:38.256719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:38.257339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:38.263898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:38.264390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:38.264835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:38.265539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:38.265999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:38.266428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:38.402152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:38.411197 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2e5c8e16-95b9-46a5-b08c-cf0aa17bd03a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1361 microversion: 2.1 time: 0.158870 Oct 16 01:56:38.411789 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3388/6910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:38 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:39.436179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:39.436801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:39.443981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:39.444477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:39.444921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:39.445624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:39.446093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:39.446529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:39.578042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:39.586212 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-497d5c4e-4b9c-47cf-b292-4648e901147a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1361 microversion: 2.1 time: 0.154206 Oct 16 01:56:39.586785 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3523/6911] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:39 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:39.963330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6cb68b9b-118a-480f-81a5-03d5191bcb9b req-72d3c878-515a-49cd-a76d-9157b06d6c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f83336-62c4-48da-801b-c47dcfee9224", "name": "network-vif-plugged", "status": "completed", "tag": "abbcc05b-0b72-400e-b697-308f3dde8be3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:39.974334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6cb68b9b-118a-480f-81a5-03d5191bcb9b req-72d3c878-515a-49cd-a76d-9157b06d6c68 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:39.974846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6cb68b9b-118a-480f-81a5-03d5191bcb9b req-72d3c878-515a-49cd-a76d-9157b06d6c68 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:39.975296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6cb68b9b-118a-480f-81a5-03d5191bcb9b req-72d3c878-515a-49cd-a76d-9157b06d6c68 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:39.986373 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6cb68b9b-118a-480f-81a5-03d5191bcb9b req-72d3c878-515a-49cd-a76d-9157b06d6c68 service nova] Creating event network-vif-plugged:abbcc05b-0b72-400e-b697-308f3dde8be3 for instance a8f83336-62c4-48da-801b-c47dcfee9224 on n-h1-master-1 Oct 16 01:56:39.991601 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6cb68b9b-118a-480f-81a5-03d5191bcb9b req-72d3c878-515a-49cd-a76d-9157b06d6c68 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032003 Oct 16 01:56:39.992255 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3389/6912] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:56:40.609857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:40.610508 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:40.617934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:40.618434 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:40.618879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:40.619601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:40.620072 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:40.620508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:40.749172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:40.757096 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-74819ae2-c04d-48b9-aba9-f896bd3a2920 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1361 microversion: 2.1 time: 0.151180 Oct 16 01:56:40.757688 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3524/6913] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:40 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:41.778355 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:41.779137 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:41.783233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:41.784005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:41.791092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:41.791581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:41.792026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:41.792720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:41.793188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:41.793619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:41.921919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:56:41.931353 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d7605caf-7db5-4e1f-a5a1-825a3f0b3dcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1548 microversion: 2.1 time: 0.154724 Oct 16 01:56:41.931943 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3390/6914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:56:41 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:56:41.955530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:56:41.956119 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:56:41.958026 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:56:41.963957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:41.964465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:41.964916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:41.965623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:41.966094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:41.966531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:42.045995 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-95541acb-2672-4237-a453-a75e3a0b36cc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094550 Oct 16 01:56:42.046602 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3525/6915] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:56:41 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:56:43.298480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f265e459-b1d3-4731-8341-27a8c66e0d21 req-01dc381f-608b-4361-b589-3ebb52ffd106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8f83336-62c4-48da-801b-c47dcfee9224", "tag": "abbcc05b-0b72-400e-b697-308f3dde8be3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:56:43.308399 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f265e459-b1d3-4731-8341-27a8c66e0d21 req-01dc381f-608b-4361-b589-3ebb52ffd106 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:56:43.308956 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f265e459-b1d3-4731-8341-27a8c66e0d21 req-01dc381f-608b-4361-b589-3ebb52ffd106 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:56:43.309454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f265e459-b1d3-4731-8341-27a8c66e0d21 req-01dc381f-608b-4361-b589-3ebb52ffd106 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:56:43.321601 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f265e459-b1d3-4731-8341-27a8c66e0d21 req-01dc381f-608b-4361-b589-3ebb52ffd106 service nova] Creating event network-changed:abbcc05b-0b72-400e-b697-308f3dde8be3 for instance a8f83336-62c4-48da-801b-c47dcfee9224 on n-h1-master-1 Oct 16 01:56:43.326621 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f265e459-b1d3-4731-8341-27a8c66e0d21 req-01dc381f-608b-4361-b589-3ebb52ffd106 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099543 Oct 16 01:56:43.327402 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3391/6916] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:57:16.159442 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=15 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:16.160267 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=52 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:16.165089 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-38b4f9f2-44eb-466f-8ada-4f3fdda0fe77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:16.171930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b4f9f2-44eb-466f-8ada-4f3fdda0fe77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:16.172440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b4f9f2-44eb-466f-8ada-4f3fdda0fe77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:16.172897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-38b4f9f2-44eb-466f-8ada-4f3fdda0fe77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:16.195813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-38b4f9f2-44eb-466f-8ada-4f3fdda0fe77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Going to try to stop instance {{(pid=120545) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 01:57:16.236111 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-38b4f9f2-44eb-466f-8ada-4f3fdda0fe77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/action" status: 202 len: 0 microversion: 2.1 time: 0.078598 Oct 16 01:57:16.236712 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3526/6917] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:57:16 2022] POST /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:57:16.244020 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:16.244764 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:16.248848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:16.249561 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:16.258113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:16.258642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:16.259291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:16.260083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:16.260548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:16.260981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:16.392589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:16.400603 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-84480fcf-3c36-470c-8a41-c610547d5765 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.159340 Oct 16 01:57:16.401176 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3392/6918] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:16 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:17.425506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:17.426214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:17.432407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:17.432908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:17.433357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:17.434064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:17.434537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:17.435008 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:17.565177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:17.574962 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c09515c5-a718-42a5-ac63-3e172e1d09d1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.154485 Oct 16 01:57:17.575546 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3527/6919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:17 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:18.599099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:18.599712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:18.608496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:18.609717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:18.610162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:18.610877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:18.611367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:18.611797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:18.744571 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:18.752263 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a60d5f1-996c-4dc3-9002-abbfdef8afb4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.157073 Oct 16 01:57:18.752838 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3393/6920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:18 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:57:19.778123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:19.778750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:19.785590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:19.786093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:19.786542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:19.787292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:19.787770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:19.788212 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:19.919284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:19.927053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3f98204c-43ee-4ad4-89f0-ac858e6cb436 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.152816 Oct 16 01:57:19.927630 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3528/6921] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:19 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:20.950290 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:20.951027 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:20.957425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:20.957945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:20.958376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:20.959118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:20.959577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:20.959999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:21.092845 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:21.100521 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5d21f175-90bf-415c-a057-e08e9cb08cf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.154371 Oct 16 01:57:21.102466 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3394/6922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:20 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:57:22.124945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:22.125564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:22.132425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:22.133127 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:22.133573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:22.134274 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:22.134741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:22.135205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:22.263534 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:22.271262 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65328da6-ea0f-41fd-ae5c-be6b9e60d965 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.150211 Oct 16 01:57:22.271843 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3529/6923] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:22 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:23.295448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:23.297495 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:23.303236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:23.303719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:23.304153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:23.304843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:23.305891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:23.306824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:23.442716 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:23.450698 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a28e8957-4d5c-4bcd-ac27-2435c3be8869 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.159174 Oct 16 01:57:23.451321 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3395/6924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:23 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:24.473555 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:24.474176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:24.481538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:24.482033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:24.482480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:24.483204 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:24.483681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:24.484114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:24.613006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:24.621685 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b7a6e3ec-000a-445a-a375-191e6e148910 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.152001 Oct 16 01:57:24.622295 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3530/6925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:24 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:25.645921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:25.646664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:25.654740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:25.655250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:25.655684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:25.656404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:25.656855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:25.657276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:25.787437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:25.796071 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b615f89f-7a87-40e4-b1d4-0d632e7f4dc5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.154047 Oct 16 01:57:25.796652 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3396/6926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:25 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:26.819983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:26.821200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:26.828172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:26.828666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:26.829119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:26.829817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:26.830286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:26.830721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:26.962154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:26.970495 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9eecc919-946e-4424-b9bb-f975831998f2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.154397 Oct 16 01:57:26.971110 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3531/6927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:26 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:27.995461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:27.995996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:28.002948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:28.003446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:28.003890 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:28.004582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:28.005045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:28.005471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:28.136034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:28.143806 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd08bfe0-f6ac-4afb-bfbf-b040958d54ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.153041 Oct 16 01:57:28.144412 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3397/6928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:27 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:29.167803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:29.168421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:29.175238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:29.175734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:29.176182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:29.176880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:29.177351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:29.177787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:29.309132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:29.317119 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f9d8eabc-141e-422b-ac77-a0de080a73a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.153263 Oct 16 01:57:29.317688 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3532/6929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:29 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:30.342112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:30.342748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:30.349581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:30.350107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:30.350542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:30.351261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:30.351719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:30.352145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:30.481437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:30.489133 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fbab8d47-1a97-4d95-aae4-4212eacae732 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.150926 Oct 16 01:57:30.489701 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3398/6930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:30 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:31.513679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:31.514300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:31.521211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:31.521711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:31.522172 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:31.522873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:31.523369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:31.523811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:31.657647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:31.665904 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ad5d3c32-5447-46c7-99f4-fe18f7aff8f0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.156307 Oct 16 01:57:31.666478 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3533/6931] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:31 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:32.689897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:32.690507 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:32.698261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:32.698740 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:32.699449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:32.700134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:32.700589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:32.701013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:32.832803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:32.840747 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-620a1fa4-828b-47cd-9c26-e48f1e953e07 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1653 microversion: 2.1 time: 0.154751 Oct 16 01:57:32.841318 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3399/6932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:32 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:32.864197 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:32.866527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:32.874404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:32.874898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:32.875443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:32.876145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:32.876617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:32.877053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:32.909439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:32.914771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Old instance type m1.heat2, new instance type m1.heat {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:57:32.921657 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:57:32.922087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:57:32.922569 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:57:32.923013 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:57:32.923465 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:57:32.986397 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5b316dd7-68d4-4e0a-81ab-f87e19803836 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/action" status: 202 len: 0 microversion: 2.1 time: 0.126080 Oct 16 01:57:32.987381 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3534/6933] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:57:32 2022] POST /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:57:32.996477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:32.997089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:33.003340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:33.003824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:33.004256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:33.004944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:33.005394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:33.005988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:33.172263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:33.180669 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa829deb-8930-4b04-8d30-b1b691fa3af1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.189402 Oct 16 01:57:33.194312 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3400/6934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:32 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:34.205956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:34.206588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:34.214492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:34.215067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:34.215536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:34.216254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:34.216733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:34.217180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:34.350342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:34.358302 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b17b73f-6878-4846-bc40-19d280a224b5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1676 microversion: 2.1 time: 0.157156 Oct 16 01:57:34.358882 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3535/6935] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:34 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:35.381772 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:35.382305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:35.390052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:35.390537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:35.391011 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:35.391708 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:35.392167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:35.392601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:35.525339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:35.533177 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-32ffe7d6-b0cc-466d-b117-8cd1f2b23434 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1681 microversion: 2.1 time: 0.155442 Oct 16 01:57:35.533754 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3401/6936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:35 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:36.557681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:36.558306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:36.565590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:36.566088 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:36.566534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:36.567269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:36.567739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:36.568177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:36.700557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:36.708223 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7838fabd-25ea-4a3c-8f5a-d4c62bb4531f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1681 microversion: 2.1 time: 0.155079 Oct 16 01:57:36.708829 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3536/6937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:36 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:37.599125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-8cc3d8dd-fc79-40a7-a858-99952f263858 req-75ad1276-1d42-468e-81e4-9fb386cc08a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f83336-62c4-48da-801b-c47dcfee9224", "name": "network-vif-unplugged", "status": "completed", "tag": "abbcc05b-0b72-400e-b697-308f3dde8be3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:37.611427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8cc3d8dd-fc79-40a7-a858-99952f263858 req-75ad1276-1d42-468e-81e4-9fb386cc08a5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:37.612047 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8cc3d8dd-fc79-40a7-a858-99952f263858 req-75ad1276-1d42-468e-81e4-9fb386cc08a5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:37.612561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8cc3d8dd-fc79-40a7-a858-99952f263858 req-75ad1276-1d42-468e-81e4-9fb386cc08a5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:37.627000 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-8cc3d8dd-fc79-40a7-a858-99952f263858 req-75ad1276-1d42-468e-81e4-9fb386cc08a5 service nova] Creating event network-vif-unplugged:abbcc05b-0b72-400e-b697-308f3dde8be3 for instance a8f83336-62c4-48da-801b-c47dcfee9224 on n-h2-master-1 Oct 16 01:57:37.632584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-8cc3d8dd-fc79-40a7-a858-99952f263858 req-75ad1276-1d42-468e-81e4-9fb386cc08a5 service nova] Instance a8f83336-62c4-48da-801b-c47dcfee9224 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:57:37.644437 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-8cc3d8dd-fc79-40a7-a858-99952f263858 req-75ad1276-1d42-468e-81e4-9fb386cc08a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048991 Oct 16 01:57:37.645379 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3402/6938] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:57:37.737874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:37.739610 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:37.748650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:37.749179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:37.749632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:37.750358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:37.750835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:37.751301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:37.887423 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:37.895651 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e142fc3f-16d1-4463-9630-0d86e45cfce2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1680 microversion: 2.1 time: 0.165757 Oct 16 01:57:37.896255 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3537/6939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:37 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:38.921498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:38.922189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:38.929226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:38.929702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:38.930136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:38.931413 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:38.931877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:38.932308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:39.073072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:39.080858 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eb310d50-e56f-42a5-8600-15374401d36b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1680 microversion: 2.1 time: 0.163558 Oct 16 01:57:39.081427 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3403/6940] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:38 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:39.690323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9a6a703e-39c0-4481-af5e-087b39f2d781 req-69081e88-7a56-4f9b-9ea4-91338868cae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8f83336-62c4-48da-801b-c47dcfee9224", "tag": "abbcc05b-0b72-400e-b697-308f3dde8be3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:39.701536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a6a703e-39c0-4481-af5e-087b39f2d781 req-69081e88-7a56-4f9b-9ea4-91338868cae3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:39.702033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a6a703e-39c0-4481-af5e-087b39f2d781 req-69081e88-7a56-4f9b-9ea4-91338868cae3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:39.702468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9a6a703e-39c0-4481-af5e-087b39f2d781 req-69081e88-7a56-4f9b-9ea4-91338868cae3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:39.714331 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9a6a703e-39c0-4481-af5e-087b39f2d781 req-69081e88-7a56-4f9b-9ea4-91338868cae3 service nova] Creating event network-changed:abbcc05b-0b72-400e-b697-308f3dde8be3 for instance a8f83336-62c4-48da-801b-c47dcfee9224 on n-h2-master-1 Oct 16 01:57:39.719518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-9a6a703e-39c0-4481-af5e-087b39f2d781 req-69081e88-7a56-4f9b-9ea4-91338868cae3 service nova] Instance a8f83336-62c4-48da-801b-c47dcfee9224 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:57:39.730563 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9a6a703e-39c0-4481-af5e-087b39f2d781 req-69081e88-7a56-4f9b-9ea4-91338868cae3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043975 Oct 16 01:57:39.731182 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3538/6941] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:57:40.105360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:40.105989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:40.112828 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:40.113306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:40.113772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:40.114461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:40.114930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:40.115356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:40.249353 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:40.257117 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c02f2136-edbb-4e07-b2fe-0f94bbe0385b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1678 microversion: 2.1 time: 0.156126 Oct 16 01:57:40.257696 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3404/6942] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:40 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:41.282717 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:41.283386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:41.289582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:41.290561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:41.290785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:41.291588 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:41.292068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:41.292513 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:41.424769 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:41.433301 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-10577bcf-3258-4a0c-ac66-f95c2160ee1c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1674 microversion: 2.1 time: 0.155858 Oct 16 01:57:41.433885 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3539/6943] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:41 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:41.456903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:41.457480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:41.464698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:41.465193 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:41.465658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:41.466384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:41.466874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:41.467328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:41.525539 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5ee42838-6e0a-46fd-b97e-6e9ee05ad963 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/action" status: 204 len: 0 microversion: 2.1 time: 0.072400 Oct 16 01:57:41.526185 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3405/6944] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:57:41 2022] POST /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 01:57:41.535682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:41.536306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:41.543681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:41.544230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:41.544755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:41.545747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:41.546231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:41.546684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:41.567489 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:41.692245 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:41.700855 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ce72d864-3970-46aa-8c3a-47cca1fc7c5b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1674 microversion: 2.1 time: 0.169512 Oct 16 01:57:41.701661 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3540/6945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:41 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:42.725159 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:42.725816 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:42.734406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:42.734896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:42.735355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:42.736051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:42.736501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:42.736924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:42.877294 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:42.885699 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-58755bb2-e223-4982-a7d1-900524bb15e0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1674 microversion: 2.1 time: 0.164947 Oct 16 01:57:42.886428 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3406/6946] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:42 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:43.909935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:43.910560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:43.918209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:43.918712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:43.919189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:43.919900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:43.920373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:43.920814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:44.058277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:44.066382 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1f80ff10-93d9-4dd8-b55f-8a5bfc964088 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1653 microversion: 2.1 time: 0.160360 Oct 16 01:57:44.067190 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3541/6947] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:43 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1653 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:44.089352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:44.089984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:44.096870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:44.097373 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:44.097812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:44.098511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:44.098995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:44.099426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:44.241312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-67a6f271-8a95-4adc-b65c-13bc0aeaad7c req-eb0594aa-e356-4e0a-90a7-bebdb9de7d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f83336-62c4-48da-801b-c47dcfee9224", "name": "network-vif-plugged", "status": "completed", "tag": "abbcc05b-0b72-400e-b697-308f3dde8be3"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:44.243867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:44.246330 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:44.251638 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-67a6f271-8a95-4adc-b65c-13bc0aeaad7c req-eb0594aa-e356-4e0a-90a7-bebdb9de7d89 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:44.252214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-67a6f271-8a95-4adc-b65c-13bc0aeaad7c req-eb0594aa-e356-4e0a-90a7-bebdb9de7d89 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:44.252578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-67a6f271-8a95-4adc-b65c-13bc0aeaad7c req-eb0594aa-e356-4e0a-90a7-bebdb9de7d89 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:44.254357 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35aa001d-7cab-45e3-b71e-a18366b842a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1653 microversion: 2.1 time: 0.169111 Oct 16 01:57:44.254968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3407/6948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:44 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1653 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:44.264855 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-67a6f271-8a95-4adc-b65c-13bc0aeaad7c req-eb0594aa-e356-4e0a-90a7-bebdb9de7d89 service nova] Creating event network-vif-plugged:abbcc05b-0b72-400e-b697-308f3dde8be3 for instance a8f83336-62c4-48da-801b-c47dcfee9224 on n-h2-master-1 Oct 16 01:57:44.270024 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-67a6f271-8a95-4adc-b65c-13bc0aeaad7c req-eb0594aa-e356-4e0a-90a7-bebdb9de7d89 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127428 Oct 16 01:57:44.270736 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3542/6949] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:57:44.278562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa6ce4c3-2b03-435e-a5c6-6b2b63b6cff3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:44.286165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa6ce4c3-2b03-435e-a5c6-6b2b63b6cff3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:44.286582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa6ce4c3-2b03-435e-a5c6-6b2b63b6cff3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:44.287048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa6ce4c3-2b03-435e-a5c6-6b2b63b6cff3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:44.310165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aa6ce4c3-2b03-435e-a5c6-6b2b63b6cff3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Going to try to start instance {{(pid=120546) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 01:57:44.352006 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa6ce4c3-2b03-435e-a5c6-6b2b63b6cff3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/action" status: 202 len: 0 microversion: 2.1 time: 0.077667 Oct 16 01:57:44.353624 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3408/6950] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:57:44 2022] POST /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:57:44.362329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:44.363095 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:44.370097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:44.370689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:44.371181 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:44.372095 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:44.372575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:44.373033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:44.508779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:44.516774 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-487ccfba-8892-4e29-a63d-0e14b53253ee tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1662 microversion: 2.1 time: 0.158667 Oct 16 01:57:44.517424 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3543/6951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:44 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:45.540867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:45.541566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:45.548764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:45.549251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:45.549736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:45.550436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:45.550886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:45.551403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:45.686285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:45.693945 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b104f4dc-e6af-48ec-a12e-d72aa5edaa39 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1666 microversion: 2.1 time: 0.157492 Oct 16 01:57:45.694515 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3409/6952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:45 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:45.717202 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:45.717721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:45.724640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:45.725149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:45.725609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:45.726324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:45.726805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:45.727326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:45.753055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:57:45.829884 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-65b14573-e822-4b6b-b343-2942c74ba42b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 204 len: 0 microversion: 2.1 time: 0.116024 Oct 16 01:57:45.830970 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3544/6953] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:57:45 2022] DELETE /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:57:45.839495 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:45.840106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:45.846130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:45.846614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:45.847092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:45.847786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:45.848245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:45.848672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:45.980599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:45.988339 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ef515016-940b-4341-ad4d-2684ed4c6911 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1672 microversion: 2.1 time: 0.152703 Oct 16 01:57:45.988914 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3410/6954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:45 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:47.017618 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:47.018327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:47.021348 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:47.027841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:47.028342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:47.028793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:47.029500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:47.029969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:47.030404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:47.167625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:47.175441 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-29165348-43b4-40af-b083-cb7429d1d1eb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1672 microversion: 2.1 time: 0.162125 Oct 16 01:57:47.176025 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3545/6955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:47 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:48.197197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6d06a038-9b61-4385-921f-beb8eaf2984a req-f323b0b6-5490-4026-947c-9659f876cd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f83336-62c4-48da-801b-c47dcfee9224", "name": "network-vif-deleted", "tag": "abbcc05b-0b72-400e-b697-308f3dde8be3"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:48.200505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:48.201153 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:48.204603 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=39 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:57:48.208703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:48.209292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:48.210146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:48.210753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6d06a038-9b61-4385-921f-beb8eaf2984a req-f323b0b6-5490-4026-947c-9659f876cd39 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:48.211155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:48.211412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6d06a038-9b61-4385-921f-beb8eaf2984a req-f323b0b6-5490-4026-947c-9659f876cd39 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:48.212783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6d06a038-9b61-4385-921f-beb8eaf2984a req-f323b0b6-5490-4026-947c-9659f876cd39 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:48.212967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:48.213483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:48.225217 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6d06a038-9b61-4385-921f-beb8eaf2984a req-f323b0b6-5490-4026-947c-9659f876cd39 service nova] Creating event network-vif-deleted:abbcc05b-0b72-400e-b697-308f3dde8be3 for instance a8f83336-62c4-48da-801b-c47dcfee9224 on n-h2-master-1 Oct 16 01:57:48.230342 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6d06a038-9b61-4385-921f-beb8eaf2984a req-f323b0b6-5490-4026-947c-9659f876cd39 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037448 Oct 16 01:57:48.231308 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3411/6956] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:57:48.287028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:48.295453 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-da793c32-f994-4e20-9d0c-cce3994cb22c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 200 len: 1607 microversion: 2.1 time: 0.099514 Oct 16 01:57:48.311514 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3546/6957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:48 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 1607 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:57:49.322604 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:49.323327 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:49.329526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:49.330009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:49.330446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:49.331157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:49.331617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:49.332043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:49.345832 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 HTTP/1.1 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a8f83336-62c4-48da-801b-c47dcfee9224'} Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:57:49.347475 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c9682b71-56cc-4944-a210-161cc1d61bce tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 404 len: 111 microversion: 2.1 time: 0.031724 Oct 16 01:57:49.351871 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3412/6958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:49 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:57:49.369575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:49.370372 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:49.377291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:49.377791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:49.378244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:49.378984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:49.379468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:49.379942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:49.396062 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 HTTP/1.1 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: exception: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'a8f83336-62c4-48da-801b-c47dcfee9224'} Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:57:49.397721 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-92724742-369d-427b-967f-5ecdc523fd38 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 404 len: 111 microversion: 2.1 time: 0.033689 Oct 16 01:57:49.407845 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3547/6959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:49 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:57:49.448809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-112660346", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "25ebe8e9-4dd7-4a5c-917a-e86f33c790b4"}], "security_groups": [{"name": "tempest-securitygroup--8587391"}], "key_name": "tempest-keypair-1874351574", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:49.552806 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] validate_networks() for [('25ebe8e9-4dd7-4a5c-917a-e86f33c790b4', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:57:49.922259 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:57:49.922715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:57:49.923212 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:57:49.923651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:57:49.924069 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:57:49.933071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:49.933560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:49.934027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:49.934784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:49.935750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:49.936184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:49.953629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:57:49.958865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for user b12139c2484c4e4fbbf9839ab577ee5c and project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:57:49.972913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:57:49.975297 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:57:50.021943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5517136-6458-4b26-a87b-0d196487618c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.576739 Oct 16 01:57:50.022532 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3413/6960] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:57:49 2022] POST /compute/v2.1/servers => generated 403 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:57:50.034106 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8ddd0a01-2e11-4803-b49c-c2b8bccb60e8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:50.034728 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8ddd0a01-2e11-4803-b49c-c2b8bccb60e8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:50.090380 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8ddd0a01-2e11-4803-b49c-c2b8bccb60e8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:50.097459 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8ddd0a01-2e11-4803-b49c-c2b8bccb60e8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1238 microversion: 2.1 time: 0.067266 Oct 16 01:57:50.098247 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3548/6961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:50 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:51.121381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:51.122088 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:51.131259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:51.131999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:51.132244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:51.132996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:51.134075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:51.134768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:51.208389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:51.219169 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-19d8f2eb-eb3c-4faa-9c57-cbf6ec9752e2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1298 microversion: 2.1 time: 0.101687 Oct 16 01:57:51.223139 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3414/6962] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:51 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:52.244686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:52.245335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:52.253328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:52.253825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:52.254272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:52.255002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:52.255473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:52.255910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:52.391317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:52.399374 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7f0c7da-b82a-4ced-a09c-6a5b511c7921 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1361 microversion: 2.1 time: 0.158919 Oct 16 01:57:52.400460 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3549/6963] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:52 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:52.587681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ff18af11-885e-4cee-b83e-cef874372e1b req-d1cebb83-08fb-4a8c-9ddf-573034741732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb", "tag": "9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:52.598679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff18af11-885e-4cee-b83e-cef874372e1b req-d1cebb83-08fb-4a8c-9ddf-573034741732 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:52.599227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff18af11-885e-4cee-b83e-cef874372e1b req-d1cebb83-08fb-4a8c-9ddf-573034741732 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:52.599645 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ff18af11-885e-4cee-b83e-cef874372e1b req-d1cebb83-08fb-4a8c-9ddf-573034741732 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:52.611709 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ff18af11-885e-4cee-b83e-cef874372e1b req-d1cebb83-08fb-4a8c-9ddf-573034741732 service nova] Creating event network-changed:9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48 for instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb on n-h1-master-1 Oct 16 01:57:52.616764 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ff18af11-885e-4cee-b83e-cef874372e1b req-d1cebb83-08fb-4a8c-9ddf-573034741732 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033864 Oct 16 01:57:52.617358 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3415/6964] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:57:53.424080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:53.424711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:53.431874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:53.432386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:53.432845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:53.433563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:53.434046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:53.434497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:53.563367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:53.571629 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-73221a87-d172-4e57-bc90-a0ca9fe14057 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1361 microversion: 2.1 time: 0.150995 Oct 16 01:57:53.572213 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3550/6965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:53 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:57:54.596925 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:54.597629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:54.604538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:54.605025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:54.605462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:54.606159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:54.606653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:54.607113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:54.746549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:54.754145 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-174024fc-6bda-4ba8-b325-27d067c70347 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1361 microversion: 2.1 time: 0.162316 Oct 16 01:57:54.754708 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3416/6966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:54 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:55.777858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:55.778426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:55.785451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:55.785962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:55.786421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:55.787187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:55.787670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:55.788120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:55.920925 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:55.928796 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5d05947a-f904-4962-a282-077fe94a223b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1361 microversion: 2.1 time: 0.155061 Oct 16 01:57:55.929378 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3551/6967] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:55 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:56.953748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:56.954307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:56.961159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:56.962130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:56.962572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:56.963287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:56.963742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:56.964165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:57.104081 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:57.111781 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5243bf13-3a88-49ad-b790-0f1fbf4c460d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1361 microversion: 2.1 time: 0.162006 Oct 16 01:57:57.112359 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3417/6968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:56 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:58.136446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:58.137079 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:58.143983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:58.144487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:58.144944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:58.145656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:58.146134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:58.146580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:58.278721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:58.287035 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0bbb1993-b66a-48c6-976a-4e597390268f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1361 microversion: 2.1 time: 0.155131 Oct 16 01:57:58.287702 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3552/6969] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:58 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:57:58.363948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e65ccb47-d6bb-4dd6-8a1a-abeb2b7fd5e1 req-6347fbab-3234-41ad-88e7-d0fc87136012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb", "name": "network-vif-plugged", "status": "completed", "tag": "9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:57:58.377462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e65ccb47-d6bb-4dd6-8a1a-abeb2b7fd5e1 req-6347fbab-3234-41ad-88e7-d0fc87136012 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:58.378090 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e65ccb47-d6bb-4dd6-8a1a-abeb2b7fd5e1 req-6347fbab-3234-41ad-88e7-d0fc87136012 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:58.378522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e65ccb47-d6bb-4dd6-8a1a-abeb2b7fd5e1 req-6347fbab-3234-41ad-88e7-d0fc87136012 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:58.391065 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e65ccb47-d6bb-4dd6-8a1a-abeb2b7fd5e1 req-6347fbab-3234-41ad-88e7-d0fc87136012 service nova] Creating event network-vif-plugged:9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48 for instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb on n-h1-master-1 Oct 16 01:57:58.396152 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e65ccb47-d6bb-4dd6-8a1a-abeb2b7fd5e1 req-6347fbab-3234-41ad-88e7-d0fc87136012 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035839 Oct 16 01:57:58.396751 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3418/6970] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:57:59.312950 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:57:59.313877 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:57:59.322118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:59.322632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:59.323121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:59.323887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:57:59.324365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:57:59.324814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:57:59.454108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:57:59.462450 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-feb6f421-7b9a-4c8e-ac2e-e3b9add618aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1361 microversion: 2.1 time: 0.154342 Oct 16 01:57:59.463070 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3553/6971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:57:59 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:00.484089 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:00.484848 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:00.489246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:00.489941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:00.497349 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:00.497831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:00.498271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:00.498991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:00.499449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:00.499875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:00.633231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:00.641032 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-42f7035d-c6f6-4866-98d5-a9589f8cb648 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1549 microversion: 2.1 time: 0.158740 Oct 16 01:58:00.641609 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3419/6972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:00 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:00.665361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:00.665880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:00.667697 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:00.673727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:00.674231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:00.674682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:00.675419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:00.675902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:00.676344 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:00.756249 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ae856245-ccc3-42c9-a91f-6bcbd48ecdea tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095433 Oct 16 01:58:00.756884 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3554/6973] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:58:00 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:58:01.974717 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5cd5a5c7-3698-4ba1-976f-8f8bd0ce6754 req-3ae843cd-0406-45e1-a927-072e36b694bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb", "tag": "9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:58:01.985856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5cd5a5c7-3698-4ba1-976f-8f8bd0ce6754 req-3ae843cd-0406-45e1-a927-072e36b694bb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:01.986330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5cd5a5c7-3698-4ba1-976f-8f8bd0ce6754 req-3ae843cd-0406-45e1-a927-072e36b694bb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:01.986755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5cd5a5c7-3698-4ba1-976f-8f8bd0ce6754 req-3ae843cd-0406-45e1-a927-072e36b694bb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:01.998941 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5cd5a5c7-3698-4ba1-976f-8f8bd0ce6754 req-3ae843cd-0406-45e1-a927-072e36b694bb service nova] Creating event network-changed:9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48 for instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb on n-h1-master-1 Oct 16 01:58:02.004113 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5cd5a5c7-3698-4ba1-976f-8f8bd0ce6754 req-3ae843cd-0406-45e1-a927-072e36b694bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035349 Oct 16 01:58:02.004725 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3420/6974] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:58:32.427770 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:58:32.428240 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 01:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb/action (ip 10.222.0.39) !!! Oct 16 01:58:32.429002 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=21 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:32.430424 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:32.434247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:58:32.436855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:32.447240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:32.447741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:32.448188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:32.448887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:32.449356 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:32.449790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:32.480376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:32.485654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Old instance type m1.heat2, new instance type m1.heat {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:58:32.492563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:58:32.492998 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:58:32.493482 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:58:32.493930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:58:32.494354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:58:32.561574 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d1251e06-8a23-4f97-a199-034c5483e5fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.135835 Oct 16 01:58:32.562819 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3555/6975] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:58:32 2022] POST /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:58:32.572279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:32.572982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:32.575143 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 01:58:32.575294 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 01:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb (ip 10.222.0.39) !!! Oct 16 01:58:32.577492 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:32.578206 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:32.593155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:32.593716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:32.594255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:32.594986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:32.595456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:32.595883 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:32.943785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:32.952718 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-107ca92b-0b62-4b58-a26c-07f8cff4d26e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1676 microversion: 2.1 time: 0.385526 Oct 16 01:58:32.953301 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3421/6976] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:32 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1676 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:33.977871 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:33.978510 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:33.985978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:33.986495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:33.987059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:33.987789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:33.988271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:33.988720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:34.249642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:34.257376 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-57f31e28-ae6c-4ada-a567-52c08ac3c002 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1676 microversion: 2.1 time: 0.284686 Oct 16 01:58:34.257951 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3556/6977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:33 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1676 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:35.281154 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:35.281780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:35.288868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:35.289347 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:35.289782 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:35.290471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:35.290947 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:35.292110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:35.423702 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:35.431496 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-04fd9b39-7a80-4e1b-94bf-0f5ed7501e41 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.154235 Oct 16 01:58:35.432726 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3422/6978] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:35 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:36.456837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:36.457474 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:36.464445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:36.464947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:36.465404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:36.466144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:36.466625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:36.467113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:36.598803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:36.606619 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-72285a53-3ca6-4159-a83c-944428496353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.153788 Oct 16 01:58:36.607228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3557/6979] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:36 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:37.630745 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:37.631385 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:37.638824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:37.639341 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:37.639788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:37.640469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:37.640931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:37.641356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:37.779427 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:37.787153 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-674a0db3-71d9-4d93-94f8-2f4f6d08b59d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.160416 Oct 16 01:58:37.787730 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3423/6980] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:37 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:38.811914 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:38.812541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:38.819486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:38.819987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:38.820438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:38.821146 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:38.821623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:38.822067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:38.955702 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:38.963514 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-81d88469-0d63-41c3-ae9e-f32ec8a4add8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.156415 Oct 16 01:58:38.964101 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3558/6981] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:38 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:39.987922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:39.988524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:39.995371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:39.996008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:39.996454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:39.997145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:39.997604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:39.998031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:40.129119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:40.137397 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e50b7f73-bc5a-4c7a-92fe-8f4bde4b120a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.153367 Oct 16 01:58:40.137970 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3424/6982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:39 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:41.160848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:41.161383 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:41.169018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:41.169524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:41.169977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:41.170694 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:41.171205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:41.171653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:41.300665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:41.309061 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ebe8a66-79f6-4d22-9b6e-8b874cc8e4d6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.152226 Oct 16 01:58:41.309627 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3559/6983] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:41 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:42.333884 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:42.334482 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:42.342083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:42.342552 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:42.343017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:42.343716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:42.344176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:42.344605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:42.477342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:42.485943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4949077d-2997-469e-ace1-739f39ea58d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.156045 Oct 16 01:58:42.486528 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3425/6984] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:42 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:43.509604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:43.510144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:43.517921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:43.518422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:43.518870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:43.519597 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:43.520071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:43.520518 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:43.653293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:43.661398 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7540c521-4a90-4cd4-a32a-05474499a7f5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.155982 Oct 16 01:58:43.661980 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3560/6985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:43 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:44.686523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:44.687115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:44.694034 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:44.694526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:44.694993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:44.695691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:44.696175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:44.696593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:44.825600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:44.833250 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d95ce00-b80a-4466-bad8-d1f6cb068d17 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.151590 Oct 16 01:58:44.833822 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3426/6986] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:44 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:45.857670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:45.858320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:45.865103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:45.865596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:45.866037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:45.866734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:45.867237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:45.867676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:46.002002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:46.009757 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b09f6d2f-c4ad-465c-8b83-fbb07286eb3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1681 microversion: 2.1 time: 0.156375 Oct 16 01:58:46.010328 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3561/6987] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:45 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:47.036061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:47.036631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:47.043628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:47.044108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:47.044543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:47.045237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:47.045695 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:47.046112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:47.177170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:47.186009 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dabf1cfd-d915-4819-a293-341708109fbb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1680 microversion: 2.1 time: 0.154457 Oct 16 01:58:47.186597 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3427/6988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:47 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:47.327979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6c02d835-af75-4243-ab72-c8624a355897 req-80a51fc2-188c-43cf-bd13-48b96379487c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb", "name": "network-vif-unplugged", "status": "completed", "tag": "9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:58:47.337754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c02d835-af75-4243-ab72-c8624a355897 req-80a51fc2-188c-43cf-bd13-48b96379487c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:47.338333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c02d835-af75-4243-ab72-c8624a355897 req-80a51fc2-188c-43cf-bd13-48b96379487c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:47.338790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6c02d835-af75-4243-ab72-c8624a355897 req-80a51fc2-188c-43cf-bd13-48b96379487c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:47.351193 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6c02d835-af75-4243-ab72-c8624a355897 req-80a51fc2-188c-43cf-bd13-48b96379487c service nova] Creating event network-vif-unplugged:9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48 for instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb on n-h2-master-1 Oct 16 01:58:47.357749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-6c02d835-af75-4243-ab72-c8624a355897 req-80a51fc2-188c-43cf-bd13-48b96379487c service nova] Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:58:47.369532 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6c02d835-af75-4243-ab72-c8624a355897 req-80a51fc2-188c-43cf-bd13-48b96379487c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110039 Oct 16 01:58:47.370173 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3562/6989] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:58:48.209690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:48.210376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:48.217638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:48.218133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:48.218568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:48.219288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:48.219742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:48.220162 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:48.358619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:48.367405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7a8c908d-bba6-4db4-ad1d-4707cfbf3104 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1680 microversion: 2.1 time: 0.161591 Oct 16 01:58:48.367990 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3428/6990] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:48 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:49.385357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-64c7f00b-cd81-4a21-be76-b6fc729bb8f3 req-7de15cb3-5309-489e-a2a1-f8cff6913514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb", "tag": "9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:58:49.391335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:49.391979 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:49.397130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64c7f00b-cd81-4a21-be76-b6fc729bb8f3 req-7de15cb3-5309-489e-a2a1-f8cff6913514 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:49.397618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64c7f00b-cd81-4a21-be76-b6fc729bb8f3 req-7de15cb3-5309-489e-a2a1-f8cff6913514 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:49.398059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64c7f00b-cd81-4a21-be76-b6fc729bb8f3 req-7de15cb3-5309-489e-a2a1-f8cff6913514 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:49.405119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:49.405617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:49.406059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:49.406768 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:49.407255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:49.407692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:49.409994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-64c7f00b-cd81-4a21-be76-b6fc729bb8f3 req-7de15cb3-5309-489e-a2a1-f8cff6913514 service nova] Creating event network-changed:9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48 for instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb on n-h2-master-1 Oct 16 01:58:49.415567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-64c7f00b-cd81-4a21-be76-b6fc729bb8f3 req-7de15cb3-5309-489e-a2a1-f8cff6913514 service nova] Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:58:49.427028 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-64c7f00b-cd81-4a21-be76-b6fc729bb8f3 req-7de15cb3-5309-489e-a2a1-f8cff6913514 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045639 Oct 16 01:58:49.427902 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3563/6991] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:58:49.543334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:49.552828 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5047fb17-2ad1-4bc3-8e0d-70dd5e432094 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1678 microversion: 2.1 time: 0.165277 Oct 16 01:58:49.553428 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3429/6992] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:49 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:58:50.580192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:50.580942 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:50.587222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:50.587731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:50.588188 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:50.588931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:50.590200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:50.590662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:50.723018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:50.730898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cac44423-a794-4625-8234-27ad04ae8605 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1675 microversion: 2.1 time: 0.155858 Oct 16 01:58:50.731505 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3564/6993] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:50 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:50.753973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:58:50.754533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:50.760733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:50.761838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:50.762284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:50.763091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:50.763561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:50.763990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:50.799886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:50.800363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:50.800800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:50.801516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:50.801975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:50.802400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:50.823581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:58:50.829518 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for user b12139c2484c4e4fbbf9839ab577ee5c and project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:58:50.930623 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1de25b27-6025-44d3-aa48-1eb5e30e9f3d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.180477 Oct 16 01:58:50.931522 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3430/6994] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:58:50 2022] POST /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:58:50.940466 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:50.941288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:50.947422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:50.947934 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:50.948387 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:50.949849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:50.950381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:50.950855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:51.086184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:51.094204 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2d9c2d61-fdd6-4647-92b0-49a55b3bfd77 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1674 microversion: 2.1 time: 0.157690 Oct 16 01:58:51.094788 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3565/6995] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:50 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:52.119527 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:52.120226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:52.127295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:52.127846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:52.128332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:52.129108 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:52.129568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:52.129997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:52.260437 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:52.268808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-052d6cee-78a2-49ba-bbad-3098e14cabcd tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1674 microversion: 2.1 time: 0.154457 Oct 16 01:58:52.269391 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3431/6996] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:52 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:53.292336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:53.292994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:53.299967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:53.300473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:53.300927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:53.301642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:53.302119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:53.302561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:53.335485 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:53.335973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:53.336419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:53.336873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lazy-loading 'fault' on Instance uuid 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:58:53.450324 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:53.458890 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-416fa726-db87-4a72-ab2b-58574101ccf8 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1832 microversion: 2.1 time: 0.170488 Oct 16 01:58:53.459518 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3566/6997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:53 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1832 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:53.485420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:53.486026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:53.492891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:53.493367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:53.493803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:53.494485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:53.494954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:53.495383 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:53.528750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:53.529214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:53.529644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:53.530084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lazy-loading 'fault' on Instance uuid 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:58:53.638112 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:53.645811 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-21db933b-c4bb-4837-bd13-cabd2d702a8b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1832 microversion: 2.1 time: 0.164313 Oct 16 01:58:53.646384 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3432/6998] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:53 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1832 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:54.544093 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6390c351-a59c-4f8d-8769-aff6ee87c0ba req-af3e3211-9da8-4eb9-b8b6-c317ffcda875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb", "name": "network-vif-plugged", "status": "completed", "tag": "9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:58:54.553764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6390c351-a59c-4f8d-8769-aff6ee87c0ba req-af3e3211-9da8-4eb9-b8b6-c317ffcda875 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:54.554261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6390c351-a59c-4f8d-8769-aff6ee87c0ba req-af3e3211-9da8-4eb9-b8b6-c317ffcda875 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:54.554709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6390c351-a59c-4f8d-8769-aff6ee87c0ba req-af3e3211-9da8-4eb9-b8b6-c317ffcda875 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:54.567858 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6390c351-a59c-4f8d-8769-aff6ee87c0ba req-af3e3211-9da8-4eb9-b8b6-c317ffcda875 service nova] Creating event network-vif-plugged:9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48 for instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb on n-h2-master-1 Oct 16 01:58:54.573152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-6390c351-a59c-4f8d-8769-aff6ee87c0ba req-af3e3211-9da8-4eb9-b8b6-c317ffcda875 service nova] Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:58:54.584538 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6390c351-a59c-4f8d-8769-aff6ee87c0ba req-af3e3211-9da8-4eb9-b8b6-c317ffcda875 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096164 Oct 16 01:58:54.585145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3567/6999] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:58:54.669125 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:54.669738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:54.676660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:54.677146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:54.677587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:54.678280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:54.678767 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:54.679234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:54.712171 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:54.712654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:54.713093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:54.713539 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lazy-loading 'fault' on Instance uuid 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:58:54.824084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:54.827684 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:54.832841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0413e64a-5a7e-49ac-a41b-8a7b961e6e03 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1832 microversion: 2.1 time: 0.167844 Oct 16 01:58:54.833415 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3433/7000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:54 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1832 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:54.857641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:54.858251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:54.864490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:54.864990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:54.865442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:54.866152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:54.866629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:54.867105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:54.895816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:58:54.973505 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c74d2bbd-8858-464d-bddd-f13d66cdcc62 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 204 len: 0 microversion: 2.1 time: 0.120472 Oct 16 01:58:54.974141 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3568/7001] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:58:54 2022] DELETE /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:58:54.983646 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:54.984286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:54.991377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:54.991864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:54.992305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:54.993004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:54.993465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:54.993894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:55.025873 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:55.026364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:55.026800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:55.027277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lazy-loading 'fault' on Instance uuid 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:58:55.135851 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:55.143783 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11c48883-2a7a-43c9-b658-a372923448f4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1838 microversion: 2.1 time: 0.165060 Oct 16 01:58:55.144368 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3434/7002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:54 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1838 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 01:58:56.169367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:56.170029 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:56.176976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:56.177475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:56.177925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:56.178633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:56.179145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:56.179587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:56.184388 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:58:56.216317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:56.216815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:56.217266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:56.217729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lazy-loading 'fault' on Instance uuid 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:58:56.330388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:56.338360 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-baeee693-9c65-41e6-a005-5a57253942ad tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1838 microversion: 2.1 time: 0.173443 Oct 16 01:58:56.338996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3569/7003] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:56 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1838 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:56.362596 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:56.363123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:56.369868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:56.370389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:56.370825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:56.372214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:56.372678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:56.373103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:56.401435 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 01:58:56.451636 n-d-master-1 devstack@n-api.service[120546]: INFO nova.compute.api [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Instance is already in deleting state, ignoring this request Oct 16 01:58:56.452456 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7acd1ef-5d0d-473a-af1d-132fc38aa29b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 204 len: 0 microversion: 2.1 time: 0.093831 Oct 16 01:58:56.453017 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3435/7004] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 01:58:56 2022] DELETE /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 01:58:56.461497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:56.462150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:56.468402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:56.468907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:56.469373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:56.470085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:56.470563 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:56.471047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:56.503895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:56.504397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:56.504854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:56.505319 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lazy-loading 'fault' on Instance uuid 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:58:56.617520 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:56.625504 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b61af150-baa9-4322-820e-8e94c139be71 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1838 microversion: 2.1 time: 0.167956 Oct 16 01:58:56.626093 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3570/7005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:56 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1838 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:57.512403 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-442d5489-72c0-4237-94dc-26bb356c6e0a req-93ff4182-4808-4303-b5a4-f3376a802660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb", "name": "network-vif-deleted", "tag": "9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:58:57.523004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-442d5489-72c0-4237-94dc-26bb356c6e0a req-93ff4182-4808-4303-b5a4-f3376a802660 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:57.523724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-442d5489-72c0-4237-94dc-26bb356c6e0a req-93ff4182-4808-4303-b5a4-f3376a802660 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:57.524344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-442d5489-72c0-4237-94dc-26bb356c6e0a req-93ff4182-4808-4303-b5a4-f3376a802660 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:57.536477 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-442d5489-72c0-4237-94dc-26bb356c6e0a req-93ff4182-4808-4303-b5a4-f3376a802660 service nova] Creating event network-vif-deleted:9cdf3ae8-f9df-40b5-af5c-dd3ddaba0e48 for instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb on n-h2-master-1 Oct 16 01:58:57.542404 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-442d5489-72c0-4237-94dc-26bb356c6e0a req-93ff4182-4808-4303-b5a4-f3376a802660 service nova] Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 01:58:57.555615 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-442d5489-72c0-4237-94dc-26bb356c6e0a req-93ff4182-4808-4303-b5a4-f3376a802660 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119244 Oct 16 01:58:57.556239 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3436/7006] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 01:58:57.650183 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:57.650880 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:57.660338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:57.661210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:57.661350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:57.662018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:57.662499 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:57.663792 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:57.715052 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:57.716635 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:57.717568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:57.718414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lazy-loading 'fault' on Instance uuid 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 01:58:57.773002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:57.787233 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-02126165-6a19-40da-8703-2ee58dd10808 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 200 len: 1510 microversion: 2.1 time: 0.141121 Oct 16 01:58:57.788502 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3571/7007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:57 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 1510 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:58:58.814863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:58.815515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:58.821727 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:58.822212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:58.822651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:58.823372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:58.823832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:58.824261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:58.837980 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb HTTP/1.1 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb'} Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:58:58.839621 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f344f0cf-8bf1-4fa8-bd45-7b4bdabf9938 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 404 len: 111 microversion: 2.1 time: 0.033241 Oct 16 01:58:58.845254 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3437/7008] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:58 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:58:58.863194 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:58.863823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:58.870561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:58.871099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:58.872132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:58.872849 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:58.873324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:58.873764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:58.887190 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb HTTP/1.1 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb'} Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 01:58:58.889200 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbdc1963-84fe-4caa-95e8-f68cae15ce3e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 404 len: 111 microversion: 2.1 time: 0.031347 Oct 16 01:58:58.893525 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3572/7009] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:58 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 01:58:58.940021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-886298415", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "25ebe8e9-4dd7-4a5c-917a-e86f33c790b4"}], "security_groups": [{"name": "tempest-securitygroup--8587391"}], "key_name": "tempest-keypair-1874351574", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:58:59.044016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] validate_networks() for [('25ebe8e9-4dd7-4a5c-917a-e86f33c790b4', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 01:58:59.486522 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:58:59.486968 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:58:59.487441 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:58:59.487873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:58:59.488280 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:58:59.497433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:59.497913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:59.498344 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:59.499168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:58:59.499622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:58:59.500043 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:58:59.516981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 01:58:59.522360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for user b12139c2484c4e4fbbf9839ab577ee5c and project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 01:58:59.537023 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 01:58:59.539350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 01:58:59.588600 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9f8066b4-1cc6-4cbf-8b9d-11963c237999 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.652490 Oct 16 01:58:59.589459 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3438/7010] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 01:58:58 2022] POST /compute/v2.1/servers => generated 403 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 01:58:59.600970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b28bc94c-6582-4de5-89c3-93c41cb1d584 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:58:59.601605 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b28bc94c-6582-4de5-89c3-93c41cb1d584 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:58:59.663433 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b28bc94c-6582-4de5-89c3-93c41cb1d584 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:58:59.671876 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b28bc94c-6582-4de5-89c3-93c41cb1d584 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1238 microversion: 2.1 time: 0.074941 Oct 16 01:58:59.672459 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3573/7011] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:58:59 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:00.697072 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:00.697711 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:00.705762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:00.706245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:00.706676 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:00.707397 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:00.707850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:00.708273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:00.771463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:00.783014 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-09f23db9-2a70-454a-8f64-3015a0543b69 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1290 microversion: 2.1 time: 0.090754 Oct 16 01:59:00.788952 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3439/7012] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:00 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:01.810748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:01.811393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:01.819229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:01.819862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:01.820318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:01.821030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:01.821533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:01.821945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:01.983134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:01.991605 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f59ced28-75e0-4abb-bba6-9b40719eb88f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1361 microversion: 2.1 time: 0.185485 Oct 16 01:59:01.992423 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3574/7013] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:01 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:02.592739 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f04eb0a3-f6e2-459c-8adf-f0e8bc6b9a87 req-4d3a3020-7b8b-474d-b17d-0053bf780e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b7f22d-bb58-4353-b17c-ce6a85d68708", "tag": "4c7c6314-0044-4728-9e5c-548e2fc5602d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:59:02.603950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f04eb0a3-f6e2-459c-8adf-f0e8bc6b9a87 req-4d3a3020-7b8b-474d-b17d-0053bf780e03 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:02.604430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f04eb0a3-f6e2-459c-8adf-f0e8bc6b9a87 req-4d3a3020-7b8b-474d-b17d-0053bf780e03 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:02.604867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f04eb0a3-f6e2-459c-8adf-f0e8bc6b9a87 req-4d3a3020-7b8b-474d-b17d-0053bf780e03 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:02.616521 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f04eb0a3-f6e2-459c-8adf-f0e8bc6b9a87 req-4d3a3020-7b8b-474d-b17d-0053bf780e03 service nova] Creating event network-changed:4c7c6314-0044-4728-9e5c-548e2fc5602d for instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 on n-h2-master-1 Oct 16 01:59:02.621195 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f04eb0a3-f6e2-459c-8adf-f0e8bc6b9a87 req-4d3a3020-7b8b-474d-b17d-0053bf780e03 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032550 Oct 16 01:59:02.622484 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3440/7014] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:59:03.016051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:03.016677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:03.019408 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:03.025032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:03.025536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:03.025985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:03.026695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:03.027195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:03.027640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:03.167243 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:03.175523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-68ae3a3b-027b-4ae0-8cad-12896c5b4d25 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1361 microversion: 2.1 time: 0.163392 Oct 16 01:59:03.176089 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3575/7015] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:03 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:04.200875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:04.201564 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:04.203547 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:04.209452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:04.209940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:04.210403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:04.211133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:04.211592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:04.212021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:04.345095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:04.352752 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74bcc51a-f94c-4184-8895-7934466068e9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1361 microversion: 2.1 time: 0.157013 Oct 16 01:59:04.353325 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3441/7016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:04 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:05.376479 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:05.377141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:05.383788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:05.384296 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:05.384756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:05.385468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:05.385954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:05.386402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:05.517715 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:05.525418 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-00f4c75d-eb0c-4e12-8df0-3e501b9c35d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1361 microversion: 2.1 time: 0.153036 Oct 16 01:59:05.525998 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3576/7017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:05 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:06.549815 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:06.550431 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:06.557764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:06.558259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:06.558749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:06.559577 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:06.560044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:06.560724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:06.692636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:06.700718 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-944ae043-6844-40f0-9c59-b421380c8867 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1361 microversion: 2.1 time: 0.154829 Oct 16 01:59:06.701288 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3442/7018] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:06 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:07.725050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:07.725679 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:07.733537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:07.734030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:07.734482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:07.735232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:07.735711 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:07.736144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:07.866810 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:07.875071 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8e57d9b4-7c76-4a0d-b50e-036edcbd149d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1361 microversion: 2.1 time: 0.153970 Oct 16 01:59:07.875655 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3577/7019] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:07 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:08.519467 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c7bc9848-e22b-40e6-9522-dc64a9bcc020 req-17bad074-17f2-42a7-9987-4878e2e69600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b7f22d-bb58-4353-b17c-ce6a85d68708", "name": "network-vif-plugged", "status": "completed", "tag": "4c7c6314-0044-4728-9e5c-548e2fc5602d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:59:08.530024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c7bc9848-e22b-40e6-9522-dc64a9bcc020 req-17bad074-17f2-42a7-9987-4878e2e69600 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:08.530507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c7bc9848-e22b-40e6-9522-dc64a9bcc020 req-17bad074-17f2-42a7-9987-4878e2e69600 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:08.530958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c7bc9848-e22b-40e6-9522-dc64a9bcc020 req-17bad074-17f2-42a7-9987-4878e2e69600 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:08.545602 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c7bc9848-e22b-40e6-9522-dc64a9bcc020 req-17bad074-17f2-42a7-9987-4878e2e69600 service nova] Creating event network-vif-plugged:4c7c6314-0044-4728-9e5c-548e2fc5602d for instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 on n-h2-master-1 Oct 16 01:59:08.550663 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c7bc9848-e22b-40e6-9522-dc64a9bcc020 req-17bad074-17f2-42a7-9987-4878e2e69600 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034873 Oct 16 01:59:08.551492 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3443/7020] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:59:08.899568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:08.900198 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:08.907631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:08.908136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:08.908592 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:08.909302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:08.909781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:08.910226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:09.044626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:09.052340 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-33e2f5ab-7c05-4665-8488-eb3f072aca28 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1361 microversion: 2.1 time: 0.156764 Oct 16 01:59:09.052917 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3578/7021] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:08 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:10.073233 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=5 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:10.074816 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:10.079657 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:10.080363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:10.087385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:10.087866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:10.088303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:10.088995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:10.089456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:10.089881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:10.217791 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:10.225517 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a676922a-2a2b-40af-8c9a-74e977b760dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1549 microversion: 2.1 time: 0.153265 Oct 16 01:59:10.226088 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3444/7022] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:10 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:10.249076 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:10.249585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:10.251406 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:10.257746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:10.258246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:10.258697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:10.259456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:10.259926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:10.260362 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:10.336999 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3441210c-15d5-4269-ad1a-5c1789afab1a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092253 Oct 16 01:59:10.337628 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3579/7023] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 01:59:10 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:59:11.382075 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c64cf4bd-fd3f-4d19-867b-2f8ca8343416 req-b484de4e-9f40-4d93-a914-ecb59a0ba331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b7f22d-bb58-4353-b17c-ce6a85d68708", "tag": "4c7c6314-0044-4728-9e5c-548e2fc5602d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:59:11.393146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c64cf4bd-fd3f-4d19-867b-2f8ca8343416 req-b484de4e-9f40-4d93-a914-ecb59a0ba331 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:11.393635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c64cf4bd-fd3f-4d19-867b-2f8ca8343416 req-b484de4e-9f40-4d93-a914-ecb59a0ba331 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:11.394055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c64cf4bd-fd3f-4d19-867b-2f8ca8343416 req-b484de4e-9f40-4d93-a914-ecb59a0ba331 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:11.407007 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c64cf4bd-fd3f-4d19-867b-2f8ca8343416 req-b484de4e-9f40-4d93-a914-ecb59a0ba331 service nova] Creating event network-changed:4c7c6314-0044-4728-9e5c-548e2fc5602d for instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 on n-h2-master-1 Oct 16 01:59:11.412037 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c64cf4bd-fd3f-4d19-867b-2f8ca8343416 req-b484de4e-9f40-4d93-a914-ecb59a0ba331 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087035 Oct 16 01:59:11.412659 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3445/7024] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 01:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:59:47.686036 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=9 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:47.687978 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=58 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:47.691850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:47.692484 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:47.702479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:47.702945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:47.703462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:47.704177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:47.704655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:47.705101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:47.840425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:47.848565 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-338b5bd6-74dd-417a-9d71-9e1534b103da tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1667 microversion: 2.1 time: 0.164842 Oct 16 01:59:47.849142 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3580/7025] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:47 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 01:59:47.870711 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=9 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:47.871558 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:47.876955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e5fea7a-f6c8-4b8c-81be-e8eb6fadfb1d"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:59:47.879420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:47.889844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:47.890150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:47.890590 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:47.891325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:47.891790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:47.892259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:48.160908 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ec98caa4-3f62-4024-bcdf-ecf0ceb429a4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292188 Oct 16 01:59:48.161526 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3446/7026] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 01:59:47 2022] POST /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 01:59:58.873848 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 01:59:58.876270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:58.879044 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:58.879707 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:58.886867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:58.887399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:58.887845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:58.888554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:58.889024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:58.889459 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:58.917537 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:58.923766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Old instance type m1.heat2, new instance type m1.heat {{(pid=120545) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 01:59:58.931036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 01:59:58.931480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 01:59:58.931971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 01:59:58.932398 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 01:59:58.932827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 01:59:58.997044 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-81385c11-5d29-482d-b7a7-3e3b3d40e6ff tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/action" status: 202 len: 0 microversion: 2.1 time: 0.126615 Oct 16 01:59:58.997790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3581/7027] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 01:59:58 2022] POST /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 01:59:59.007066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 01:59:59.007712 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 01:59:59.011528 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:59.012197 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:59:59.016448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:59.017114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:59.017461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:59.018170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 01:59:59.018640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 01:59:59.019110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 01:59:59.192637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 01:59:59.201128 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b6784fdc-cccd-43d6-9620-fbde755a2353 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1722 microversion: 2.1 time: 0.198390 Oct 16 01:59:59.201840 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3447/7028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 01:59:59 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:00.226591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:00.227242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:00.238435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:00.238959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:00.239412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:00.240151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:00.240624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:00.241060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:00.372480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:00.380887 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42670f61-bc32-4655-9501-3d4db28e5074 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1722 microversion: 2.1 time: 0.158189 Oct 16 02:00:00.381469 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3582/7029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:00 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:01.406213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:01.406839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:01.412999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:01.413485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:01.413927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:01.414623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:01.415112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:01.415541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:01.544030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:01.553142 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c9598d02-10e4-455c-ad17-8023968a31b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.151693 Oct 16 02:00:01.553722 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3448/7030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:01 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:02.577691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:02.578334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:02.585821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:02.586328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:02.586790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:02.587536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:02.588019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:02.588474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:02.724588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:02.733299 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bf42bc2e-d1b6-406f-bf95-c11c23d9b76a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.159545 Oct 16 02:00:02.733886 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3583/7031] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:02 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:03.757433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:03.758026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:03.764838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:03.765327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:03.766351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:03.767094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:03.768286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:03.768741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:03.901417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:03.910569 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3ab6a161-c827-4c49-bc99-9d01dfcebd3c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.156407 Oct 16 02:00:03.911209 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3449/7032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:03 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:04.934531 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:04.935178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:04.942042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:04.942534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:04.943007 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:04.943708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:04.944179 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:04.944617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:05.072589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:05.082102 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-484ea9de-3e6f-40cf-82d5-2b59c11e79c9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.151392 Oct 16 02:00:05.082675 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3584/7033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:04 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:06.106367 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:06.107007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:06.114365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:06.114792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:06.115509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:06.116207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:06.116670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:06.117100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:06.248203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:06.256915 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5adcc8e7-f63f-4115-a2bf-11155a7a9bd4 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.154414 Oct 16 02:00:06.257492 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3450/7034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:06 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:07.280971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:07.281597 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:07.289173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:07.289669 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:07.290119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:07.290854 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:07.291350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:07.291790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:07.419108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:07.427612 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ea3075d-0800-4c27-a88e-d04647e7e95f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.150550 Oct 16 02:00:07.428192 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3585/7035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:07 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:08.451594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:08.452203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:08.459291 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:08.459774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:08.460208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:08.460894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:08.461351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:08.461773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:08.596249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:08.604866 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0a12f83d-34de-4e38-9176-347a42b7ec73 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.157151 Oct 16 02:00:08.605441 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3451/7036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:08 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:09.628638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:09.629258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:09.638192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:09.638690 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:09.639174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:09.639880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:09.640353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:09.640791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:09.771236 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:09.779709 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ebb5588-4609-4b33-b829-9c5366bebcdc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.155051 Oct 16 02:00:09.780284 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3586/7037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:09 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:10.804306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:10.804961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:10.812843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:10.813277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:10.813718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:10.814936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:10.815532 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:10.815975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:10.947801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:10.956800 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6ea2ce83-949a-422f-9f93-e52efc8e07aa tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.156718 Oct 16 02:00:10.957383 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3452/7038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:10 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:11.981665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:11.982209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:11.988710 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:11.989211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:11.989664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:11.990373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:11.990847 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:11.991310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:12.120696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:12.129725 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1269acaa-3e16-4708-8fd9-7923dab5a854 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.152859 Oct 16 02:00:12.130309 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3587/7039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:11 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:00:13.153772 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:13.154383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:13.164390 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:13.164869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:13.165303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:13.165998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:13.166457 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:13.166884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:13.295957 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:13.304943 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0cfddde7-533c-478e-8152-f4c65ab48dd2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.155113 Oct 16 02:00:13.305517 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3453/7040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:13 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:14.378235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:14.378860 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:14.384988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:14.385493 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:14.385947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:14.386656 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:14.387171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:14.387618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:14.526110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:14.535448 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-985ab6ae-75fb-481b-a55c-50c8677fb3f6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.209688 Oct 16 02:00:14.536049 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3588/7041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:14 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:15.560315 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:15.561163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:15.571388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:15.571871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:15.572300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:15.572989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:15.573441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:15.573860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:15.709273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:15.717445 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5b406c07-cf3d-414e-a18b-a60fa342568e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.161045 Oct 16 02:00:15.718032 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3454/7042] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:15 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:16.740969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:16.741593 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:16.748469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:16.748969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:16.749420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:16.750125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:16.750594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:16.751057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:16.888053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:16.897042 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cf7d5837-314e-452f-8fc2-39ad4107f2d3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.160163 Oct 16 02:00:16.897626 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3589/7043] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:16 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:17.920590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:17.921133 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:17.928525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:17.929001 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:17.929433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:17.930118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:17.930568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:17.931026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:18.062407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:18.071533 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f0afcb59-02f5-46c5-9485-495c2d52dc74 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.154910 Oct 16 02:00:18.072116 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3455/7044] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:17 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:19.095410 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:19.097060 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:19.103927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:19.104425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:19.104871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:19.105573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:19.106050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:19.106487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:19.244273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:19.253888 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2644e81e-57b6-4760-bdf4-3035957ed4a3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.162347 Oct 16 02:00:19.254480 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3590/7045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:19 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:20.278289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:20.278910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:20.286389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:20.286877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:20.287376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:20.288072 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:20.288536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:20.288968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:20.420919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:20.429209 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d7d27e5-2958-4642-94dd-8164ad2335b9 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.154804 Oct 16 02:00:20.429782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3456/7046] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:20 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:21.453233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:21.453859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:21.460859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:21.461355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:21.461803 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:21.462503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:21.462993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:21.463436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:21.592458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:21.601712 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4c5f0f14-f619-481b-b193-81b2f95932dc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.152342 Oct 16 02:00:21.602296 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3591/7047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:21 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:22.626034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:22.626648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:22.633343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:22.633823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:22.634259 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:22.634962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:22.635422 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:22.635850 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:23.033089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:23.041903 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be88d5cd-d188-4439-8922-ccc9f0efbe18 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.420057 Oct 16 02:00:23.042479 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3457/7048] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:22 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:24.066002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:24.066732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:24.073699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:24.074129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:24.074610 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:24.075368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:24.075821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:24.076259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:24.209944 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:24.218805 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1215ec0-ac82-426b-a862-2fe33afc9411 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.156804 Oct 16 02:00:24.219404 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3592/7049] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:24 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:25.242304 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:25.242940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:25.250166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:25.250656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:25.251137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:25.251845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:25.252308 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:25.252761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:25.406837 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:25.416512 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-41084d37-a196-4957-8105-6a421309a413 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1727 microversion: 2.1 time: 0.177976 Oct 16 02:00:25.417955 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3458/7050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:25 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:26.203378 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3a995895-18e5-4d2a-8305-b2ae2208374e req-7f792e4a-ecae-4698-a18f-e4a37ececb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b7f22d-bb58-4353-b17c-ce6a85d68708", "name": "network-vif-unplugged", "status": "completed", "tag": "4c7c6314-0044-4728-9e5c-548e2fc5602d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:00:26.215531 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3a995895-18e5-4d2a-8305-b2ae2208374e req-7f792e4a-ecae-4698-a18f-e4a37ececb2a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:26.216065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3a995895-18e5-4d2a-8305-b2ae2208374e req-7f792e4a-ecae-4698-a18f-e4a37ececb2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:26.216682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3a995895-18e5-4d2a-8305-b2ae2208374e req-7f792e4a-ecae-4698-a18f-e4a37ececb2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:26.232812 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3a995895-18e5-4d2a-8305-b2ae2208374e req-7f792e4a-ecae-4698-a18f-e4a37ececb2a service nova] Creating event network-vif-unplugged:4c7c6314-0044-4728-9e5c-548e2fc5602d for instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 on n-h1-master-1 Oct 16 02:00:26.239161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-3a995895-18e5-4d2a-8305-b2ae2208374e req-7f792e4a-ecae-4698-a18f-e4a37ececb2a service nova] Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 02:00:26.251016 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3a995895-18e5-4d2a-8305-b2ae2208374e req-7f792e4a-ecae-4698-a18f-e4a37ececb2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051265 Oct 16 02:00:26.252357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3593/7051] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:00:26.442643 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:26.443194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:26.450039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:26.450531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:26.450995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:26.451709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:26.452173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:26.452603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:26.586241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:26.594371 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-31c713f1-b706-487a-a2c1-974ae2b24f0b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1726 microversion: 2.1 time: 0.156414 Oct 16 02:00:26.595000 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3459/7052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:26 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:27.619723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:27.620368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:27.628444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:27.629062 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:27.629755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:27.630583 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:27.631230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:27.631724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:27.776979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:27.785361 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ceae6ca2-4edc-4418-a96d-16142a37980e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.170070 Oct 16 02:00:27.785948 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3594/7053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:27 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:28.267389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fbda774b-7e16-48eb-a2ad-3fd316bcfa8b req-cb703707-cb48-41f7-97da-479a8fd2567f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b7f22d-bb58-4353-b17c-ce6a85d68708", "tag": "4c7c6314-0044-4728-9e5c-548e2fc5602d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:00:28.278307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fbda774b-7e16-48eb-a2ad-3fd316bcfa8b req-cb703707-cb48-41f7-97da-479a8fd2567f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:28.278804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fbda774b-7e16-48eb-a2ad-3fd316bcfa8b req-cb703707-cb48-41f7-97da-479a8fd2567f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:28.279244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fbda774b-7e16-48eb-a2ad-3fd316bcfa8b req-cb703707-cb48-41f7-97da-479a8fd2567f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:28.291803 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fbda774b-7e16-48eb-a2ad-3fd316bcfa8b req-cb703707-cb48-41f7-97da-479a8fd2567f service nova] Creating event network-changed:4c7c6314-0044-4728-9e5c-548e2fc5602d for instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 on n-h1-master-1 Oct 16 02:00:28.297165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-fbda774b-7e16-48eb-a2ad-3fd316bcfa8b req-cb703707-cb48-41f7-97da-479a8fd2567f service nova] Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 02:00:28.307740 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fbda774b-7e16-48eb-a2ad-3fd316bcfa8b req-cb703707-cb48-41f7-97da-479a8fd2567f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044017 Oct 16 02:00:28.308354 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3460/7054] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:00:28.811101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:28.811730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:28.818584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:28.819053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:28.819507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:28.820646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:28.821123 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:28.821566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:28.964835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:28.967377 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:00:28.977738 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-07567bbd-dbea-48c4-81c5-0b3bb570bf04 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.171929 Oct 16 02:00:28.988444 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3595/7055] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:28 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:30.003858 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:30.004595 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:30.006623 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=29 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:00:30.012356 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:30.012852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:30.013305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:30.014013 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:30.014478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:30.014944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:30.018334 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=83 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:00:30.147648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:30.156416 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8d03598-13cc-4411-8de7-7ceb6a841c86 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.157762 Oct 16 02:00:30.157009 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3461/7056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:29 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:31.181180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:31.181813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:31.184507 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=35 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:00:31.191258 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:31.191773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:31.192230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:31.192954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:31.193424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:31.193871 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:31.329840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:31.338503 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-28768b6a-3141-47b2-af2f-9685da61a004 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.162171 Oct 16 02:00:31.339121 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3596/7057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:31 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:32.361593 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:32.362211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:32.369098 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:32.369582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:32.370021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:32.370714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:32.371216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:32.371632 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:32.503644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:32.511860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-722fb23f-067a-4daa-a72b-24704f558157 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.154178 Oct 16 02:00:32.512447 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3462/7058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:32 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:33.536063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:33.536689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:33.543663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:33.544169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:33.544624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:33.545334 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:33.545818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:33.546261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:33.679108 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:33.687530 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a9a64bbc-ffde-4639-ae26-c9657732cb19 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.155634 Oct 16 02:00:33.688099 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3597/7059] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:33 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:34.712825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:34.713436 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:34.720300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:34.720781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:34.721215 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:34.721949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:34.722578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:34.723036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:34.851942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:34.860432 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2aa6bffd-19df-4016-8283-8a7fbdfc537b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.151558 Oct 16 02:00:34.861008 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3463/7060] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:34 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:35.884231 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:35.884955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:35.891670 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:35.892175 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:35.892624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:35.893339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:35.893813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:35.894254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:36.024483 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:36.032870 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2bdeeaf6-10a8-40b2-ad88-0a2978875ce3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.152667 Oct 16 02:00:36.033455 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3598/7061] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:35 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:00:37.057285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:37.057949 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:37.065079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:37.065561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:37.065994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:37.067310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:37.067663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:37.068088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:37.207067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:37.215944 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-21cf3c35-bfc7-4048-998d-e1fca9589341 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.162596 Oct 16 02:00:37.216524 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3464/7062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:37 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:38.241575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:38.242173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:38.249166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:38.249664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:38.250117 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:38.250821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:38.251321 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:38.251762 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:38.382667 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:38.390936 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a913458a-8e8b-44d5-8136-176d61e97031 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1724 microversion: 2.1 time: 0.153291 Oct 16 02:00:38.391526 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3599/7063] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:38 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:39.414424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:39.415096 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:39.421810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:39.422287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:39.422717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:39.423442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:39.423894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:39.424312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:39.560182 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:39.570144 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0501fefc-4529-41bb-a952-f88ba5788149 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1721 microversion: 2.1 time: 0.159638 Oct 16 02:00:39.570713 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3465/7064] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:39 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:39.593145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:00:39.593696 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:39.603060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:39.603560 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:39.604010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:39.604712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:39.605182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:39.605620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:39.647578 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:39.648070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:39.648519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:39.649253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:39.649724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:39.650158 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:39.685024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:00:39.695767 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Getting quotas for user b12139c2484c4e4fbbf9839ab577ee5c and project f810218c158a4fb0baded3bbff983c71. Resources: {'ram', 'cores'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:00:39.805380 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1ec147fc-c455-4fc9-9ac0-7a00e4122ac0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "POST /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/action" status: 202 len: 0 microversion: 2.1 time: 0.215847 Oct 16 02:00:39.806243 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3600/7065] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:00:39 2022] POST /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:00:39.819412 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:39.820379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:39.830603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:39.831166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:39.831841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:39.832733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:39.833280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:39.833711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:39.969904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:39.978724 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e0214b45-bf13-49b2-a0ef-2f46dbbf752c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.166470 Oct 16 02:00:39.979327 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3466/7066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:39 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:41.005150 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:41.005899 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:41.012888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:41.013397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:41.013857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:41.014566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:41.015075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:41.015526 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:41.157031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:41.165691 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cfc95094-13f7-4d20-9446-6da65705446c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.165511 Oct 16 02:00:41.166277 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3601/7067] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:40 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:00:42.190446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:42.191083 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:42.198287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:42.198774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:42.199244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:42.199927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:42.200379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:42.200799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:42.334719 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:42.343670 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-85461b35-d126-42b1-b2b4-b12a10d4a90c tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.157034 Oct 16 02:00:42.344261 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3467/7068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:42 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:43.369575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:43.370276 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:43.377089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:43.377595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:43.378048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:43.378767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:43.380105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:43.380516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:43.512371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:43.521466 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fbe4d790-817f-40ab-8fae-81ae46ff19a1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.155980 Oct 16 02:00:43.522266 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3602/7069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:43 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:44.550808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:44.552475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:44.559414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:44.560008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:44.560458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:44.561416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:44.561874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:44.562487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:44.700797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:44.710469 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5a71ed54-85fb-4e9b-afa0-0d3dde917da2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.168742 Oct 16 02:00:44.711063 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3468/7070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:44 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:45.673331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1a997c88-44d1-499d-8ec6-069cf51236a8 req-664de014-8aaf-409c-bca6-63b194697d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b7f22d-bb58-4353-b17c-ce6a85d68708", "tag": "4c7c6314-0044-4728-9e5c-548e2fc5602d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:00:45.685202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1a997c88-44d1-499d-8ec6-069cf51236a8 req-664de014-8aaf-409c-bca6-63b194697d9f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:45.685957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1a997c88-44d1-499d-8ec6-069cf51236a8 req-664de014-8aaf-409c-bca6-63b194697d9f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:45.686399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1a997c88-44d1-499d-8ec6-069cf51236a8 req-664de014-8aaf-409c-bca6-63b194697d9f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:45.699311 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1a997c88-44d1-499d-8ec6-069cf51236a8 req-664de014-8aaf-409c-bca6-63b194697d9f service nova] Creating event network-changed:4c7c6314-0044-4728-9e5c-548e2fc5602d for instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 on n-h2-master-1 Oct 16 02:00:45.705286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-1a997c88-44d1-499d-8ec6-069cf51236a8 req-664de014-8aaf-409c-bca6-63b194697d9f service nova] Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 02:00:45.718705 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1a997c88-44d1-499d-8ec6-069cf51236a8 req-664de014-8aaf-409c-bca6-63b194697d9f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048993 Oct 16 02:00:45.719363 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3603/7071] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:00:45.735104 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:45.735794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:45.743275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:45.743908 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:45.744417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:45.745211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:45.745692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:45.746119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:45.886279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:45.896003 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d077f71b-f06d-4841-adec-1125474584c1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.164515 Oct 16 02:00:45.896828 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3469/7072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:45 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:46.980107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:46.980964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:46.988191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:46.988912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:46.989374 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:46.990103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:46.990764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:46.991243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:47.174616 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:47.183692 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aeeaf6b7-2a5f-487a-98f6-fcaddd88ee59 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.208011 Oct 16 02:00:47.184356 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3604/7073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:46 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:48.208964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:48.209573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:48.216500 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:48.216980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:48.217412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:48.218109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:48.218560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:48.219006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:48.352446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:48.360809 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cb4902c1-5378-4a3d-8b75-837641d5b423 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.156371 Oct 16 02:00:48.361396 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3470/7074] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:48 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:49.386224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:49.386836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:49.393745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:49.394242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:49.395897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:49.396617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:49.397097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:49.397539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:49.535726 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:49.544780 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc22acf2-05ae-4afc-8b50-cb8b4a1de8e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.162403 Oct 16 02:00:49.545698 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3605/7075] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:49 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:50.569388 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:50.570001 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:50.576996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:50.577479 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:50.577915 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:50.578609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:50.579095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:50.579527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:50.715906 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:50.724850 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8831c850-25d6-4ab7-8387-3d1c3f5ba810 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.159554 Oct 16 02:00:50.725428 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3471/7076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:50 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:51.748338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:51.748963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:51.750957 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:00:51.757085 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:51.757580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:51.758027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:51.758727 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:51.759295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:51.759733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:51.891864 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:51.900066 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-23e3c994-f068-4bc7-b9ed-43d7ab387cd0 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.155621 Oct 16 02:00:51.900642 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3606/7077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:51 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:52.925092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:52.925768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:52.932570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:52.933057 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:52.933499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:52.934191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:52.934649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:52.935112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:53.069267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:53.077562 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-af8c9ed0-1c4d-4278-850a-a0fef5a881fb tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.156413 Oct 16 02:00:53.078127 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3472/7078] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:52 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:54.101486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:54.102112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:54.109010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:54.109509 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:54.109960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:54.110672 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:54.111177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:54.111616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:54.240478 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:54.248736 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f517d824-5e88-4377-b8d7-f8978f6360de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.151829 Oct 16 02:00:54.249317 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3607/7079] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:54 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:55.272793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:55.273351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:55.280262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:55.280750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:55.281192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:55.281889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:55.282348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:55.282779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:55.417765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:55.426280 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1e835e1c-9e99-4528-b9c5-329c9451a0b3 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.157465 Oct 16 02:00:55.426864 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3473/7080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:55 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:56.450740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:56.451386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:56.458148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:56.459691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:56.461000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:56.461713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:56.462190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:56.462636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:56.591689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:56.600683 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-81ae2ca3-5225-4eb0-a8bf-d330ec01acae tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.153822 Oct 16 02:00:56.601294 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3608/7081] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:56 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:57.624677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:57.625285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:57.633180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:57.633654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:57.634084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:57.634765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:57.635243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:57.635670 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:57.771307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:57.779927 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-87f09ad9-75ab-466c-8f02-5339c87a4a56 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.159184 Oct 16 02:00:57.780512 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3474/7082] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:57 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:58.805184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:58.805819 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:58.812991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:58.813498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:58.813951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:58.814668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:58.815170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:58.815617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:58.955129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:00:58.957383 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:00:58.964776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2626cb47-010a-4e28-a1b3-2eebfd8af864 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1720 microversion: 2.1 time: 0.164609 Oct 16 02:00:58.965371 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3609/7083] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:58 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:00:59.990256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:00:59.990869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:00:59.997587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:59.998064 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:00:59.998503 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:00:59.999207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:00:59.999662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.000083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.127517 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:00.129711 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=88 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:00.137868 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-35f45d3c-ddc7-4543-9dab-9728f6cbd31f tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1713 microversion: 2.1 time: 0.151501 Oct 16 02:01:00.138450 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3475/7084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:00:59 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:00.161737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:00.162516 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:00.170365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:00.170868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.171347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.172058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:00.172537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.172982 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.304359 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:00.312820 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2b6d4a45-42da-4aaa-9576-d2d737b6acb5 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1713 microversion: 2.1 time: 0.155335 Oct 16 02:01:00.313373 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3610/7085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:00 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:00.336607 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:00.337210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:00.339016 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=30 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:00.344427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:00.344905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.345336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.346016 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:00.346468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.346889 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.476521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:00.484726 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37534b7a-5ffa-41fe-8733-e5c7d661d03b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1713 microversion: 2.1 time: 0.152848 Oct 16 02:01:00.485311 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3476/7086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:00 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:00.507958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:00.508469 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:00.514291 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:00.514782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.515263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.515958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:00.516427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.516862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.542984 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:01:00.620534 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-961b89c1-31ed-412b-b38e-0498122033de tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 204 len: 0 microversion: 2.1 time: 0.116616 Oct 16 02:01:00.621200 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3611/7087] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:01:00 2022] DELETE /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:01:00.630976 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:00.631589 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:00.637580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:00.638061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.638497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.639242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:00.639717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:00.640129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:00.768559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:00.777455 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2077f804-2983-48b0-ad6a-5358817e3cfc tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1719 microversion: 2.1 time: 0.150410 Oct 16 02:01:00.778236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3477/7088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:00 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:01.148379 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2d33e49b-71a9-4e5c-8b3a-1a302be2522c req-8461553b-34bf-49c6-8860-1fc80c9ab315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b7f22d-bb58-4353-b17c-ce6a85d68708", "name": "network-vif-plugged", "status": "completed", "tag": "4c7c6314-0044-4728-9e5c-548e2fc5602d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:01.157924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2d33e49b-71a9-4e5c-8b3a-1a302be2522c req-8461553b-34bf-49c6-8860-1fc80c9ab315 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:01.158425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2d33e49b-71a9-4e5c-8b3a-1a302be2522c req-8461553b-34bf-49c6-8860-1fc80c9ab315 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:01.158875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2d33e49b-71a9-4e5c-8b3a-1a302be2522c req-8461553b-34bf-49c6-8860-1fc80c9ab315 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:01.175306 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2d33e49b-71a9-4e5c-8b3a-1a302be2522c req-8461553b-34bf-49c6-8860-1fc80c9ab315 service nova] Creating event network-vif-plugged:4c7c6314-0044-4728-9e5c-548e2fc5602d for instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 on n-h2-master-1 Oct 16 02:01:01.180857 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2d33e49b-71a9-4e5c-8b3a-1a302be2522c req-8461553b-34bf-49c6-8860-1fc80c9ab315 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037564 Oct 16 02:01:01.181468 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3612/7089] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:01:01.801858 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:01.803198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:01.810234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:01.811003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:01.811430 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:01.812109 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:01.812567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:01.813267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:01.950902 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:01.959840 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e6eebf6-6909-4fc0-9cf7-46ecbcd2a20a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1719 microversion: 2.1 time: 0.161855 Oct 16 02:01:01.960416 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3478/7090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:01 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:02.986670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:02.987422 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:02.990016 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:02.995828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:02.996342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:02.996793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:02.997516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:02.997992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:02.998435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:03.141306 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:03.152560 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abf3a344-1c54-4a8d-b148-be591783fe6a tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1719 microversion: 2.1 time: 0.171523 Oct 16 02:01:03.153157 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3613/7091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:02 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:03.370443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-b596db9b-755a-484c-b387-b4d6f684a00c req-69ec155d-90b5-4b62-9293-e784d193ef98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b7f22d-bb58-4353-b17c-ce6a85d68708", "name": "network-vif-deleted", "tag": "4c7c6314-0044-4728-9e5c-548e2fc5602d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:03.381471 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b596db9b-755a-484c-b387-b4d6f684a00c req-69ec155d-90b5-4b62-9293-e784d193ef98 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:03.381803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b596db9b-755a-484c-b387-b4d6f684a00c req-69ec155d-90b5-4b62-9293-e784d193ef98 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:03.382346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-b596db9b-755a-484c-b387-b4d6f684a00c req-69ec155d-90b5-4b62-9293-e784d193ef98 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:03.394966 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-b596db9b-755a-484c-b387-b4d6f684a00c req-69ec155d-90b5-4b62-9293-e784d193ef98 service nova] Creating event network-vif-deleted:4c7c6314-0044-4728-9e5c-548e2fc5602d for instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 on n-h2-master-1 Oct 16 02:01:03.400779 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-b596db9b-755a-484c-b387-b4d6f684a00c req-69ec155d-90b5-4b62-9293-e784d193ef98 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035595 Oct 16 02:01:03.404744 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3479/7092] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:01:04.176452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:04.177514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:04.184224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:04.184739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:04.185194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:04.186176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:04.186655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:04.187130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:04.263952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:04.274371 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-191e84e6-45b1-4799-8bfa-4b457c1a850b tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1369 microversion: 2.1 time: 0.101585 Oct 16 02:01:04.275003 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3614/7093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:04 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:05.298601 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:05.299447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:05.307451 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:05.308009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:05.308599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:05.309311 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:05.309770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:05.310196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:05.374170 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:05.382563 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7f551d82-e9da-42a0-9404-00647e692321 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1369 microversion: 2.1 time: 0.088464 Oct 16 02:01:05.383168 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3480/7094] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:05 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:06.405773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:06.406619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:06.414876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:06.415473 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:06.416009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:06.416821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:06.417359 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:06.417874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:06.481567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:06.490799 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d0c748c6-e764-4996-909c-f3c16bba2a93 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1369 microversion: 2.1 time: 0.088885 Oct 16 02:01:06.491506 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3615/7095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:06 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:07.514679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:07.515348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:07.523386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:07.523881 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:07.524325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:07.525032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:07.525487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:07.525910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:07.591445 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12139c2484c4e4fbbf9839ab577ee5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f810218c158a4fb0baded3bbff983c71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:07.600191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-380d8eb7-512f-4261-9309-5f859444d75e tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 200 len: 1369 microversion: 2.1 time: 0.089545 Oct 16 02:01:07.600755 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3481/7096] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:07 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:08.624542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:08.625174 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:08.631987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:08.632495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:08.632948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:08.633662 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:08.634141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:08.634585 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:08.648376 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 HTTP/1.1 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '28b7f22d-bb58-4353-b17c-ce6a85d68708'} Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:08.650026 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2f42c4c7-34a8-497a-8038-1831de00d985 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 404 len: 111 microversion: 2.1 time: 0.030855 Oct 16 02:01:08.655154 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3616/7097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:08 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:08.713103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:08.715358 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:08.722901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:08.723512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:08.723951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:08.725257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:08.725713 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:08.726141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:08.741443 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/os-volume_attachments HTTP/1.1 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': '28b7f22d-bb58-4353-b17c-ce6a85d68708'} Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:08.743176 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-591d86e8-2645-4f2a-89ad-3940b1fd0b57 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036000 Oct 16 02:01:08.747989 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3482/7098] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:01:08 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:12.076404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.076954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:12.083633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.084132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.084586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.085930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.086426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.086869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.100525 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 HTTP/1.1 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '28b7f22d-bb58-4353-b17c-ce6a85d68708'} Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:12.102317 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9a758afc-1e4d-4df9-aade-5b2fcfec11e6 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 404 len: 111 microversion: 2.1 time: 0.031366 Oct 16 02:01:12.106588 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3617/7099] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:01:12 2022] DELETE /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:12.112506 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.113115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 28b7f22d-bb58-4353-b17c-ce6a85d68708] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:12.120181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.120660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.121092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.121772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.122223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.122643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.136740 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 HTTP/1.1 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '28b7f22d-bb58-4353-b17c-ce6a85d68708'} Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.138255 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 28b7f22d-bb58-4353-b17c-ce6a85d68708 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6c7aac0-20ef-4714-ae38-b97bc653e47d tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708" status: 404 len: 111 microversion: 2.1 time: 0.031152 Oct 16 02:01:12.143359 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3483/7100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:12 2022] GET /compute/v2.1/servers/28b7f22d-bb58-4353-b17c-ce6a85d68708 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:12.149168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.149681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:12.155861 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.156366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.156820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.157528 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.157997 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.158433 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.173463 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb HTTP/1.1 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb'} Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:12.175121 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-acc262bf-956c-45b4-99eb-2e8510467861 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 404 len: 111 microversion: 2.1 time: 0.032134 Oct 16 02:01:12.179487 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3618/7101] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:01:12 2022] DELETE /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:12.185413 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.186277 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:12.192379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.192885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.193321 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.194035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.194492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.195519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.210103 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb HTTP/1.1 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb'} Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.212364 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4e7c9e4f-1abc-4caa-b635-ed9ebd2efdd1 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb" status: 404 len: 111 microversion: 2.1 time: 0.032259 Oct 16 02:01:12.217734 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3484/7102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:12 2022] GET /compute/v2.1/servers/38488dbe-5057-4cdd-9cb9-6d3cb43ba4bb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:12.223018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.223540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:12.230033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.230548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.231028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.231793 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.232337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.232743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.247409 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 HTTP/1.1 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: exception: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'a8f83336-62c4-48da-801b-c47dcfee9224'} Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:12.249007 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3cda52cc-4217-47ec-8525-71684234b0c2 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 404 len: 111 microversion: 2.1 time: 0.031852 Oct 16 02:01:12.253261 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3619/7103] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:01:12 2022] DELETE /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:12.259730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.260351 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: a8f83336-62c4-48da-801b-c47dcfee9224] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:12.266416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.266900 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.267384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.268084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.268547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.268976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.282721 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 HTTP/1.1 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a8f83336-62c4-48da-801b-c47dcfee9224'} Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.284329 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance a8f83336-62c4-48da-801b-c47dcfee9224 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f6709193-ce67-4759-8344-af6a5f245795 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224" status: 404 len: 111 microversion: 2.1 time: 0.030684 Oct 16 02:01:12.290146 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3485/7104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:12 2022] GET /compute/v2.1/servers/a8f83336-62c4-48da-801b-c47dcfee9224 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 02:01:12.295468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.295986 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:12.302226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.302701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.303182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.304022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.305787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.306855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.321682 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 HTTP/1.1 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2'} Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:12.323281 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2baa3d7c-4506-4a3e-ba05-54a1839f7035 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 404 len: 111 microversion: 2.1 time: 0.033715 Oct 16 02:01:12.328536 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3620/7105] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:01:12 2022] DELETE /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 02:01:12.333554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.334319 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] [instance: 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:12.341119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.341609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.342045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.342743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:12.343232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:12.343661 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:12.358080 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] HTTP exception thrown: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Request method failure captured: Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 HTTP/1.1 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2SBp3iH7Nv56Whj2XNamkFWujskA26LMN8aFycHWzq8dB-hTLfTkD7oph-XwM_z1tXR5ASZis-nyEpHijkCsSt_6RLSlFc_5wHYXBsxZaolKkNlpQdHCiVE2OyGbyQcp_WJ6WoRuAiAIh9bvRxH5eWXxFKSLlnuqyd-nkdDQkoiveI Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f810218c158a4fb0baded3bbff983c71", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f810218c158a4fb0baded3bbff983c71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: f810218c158a4fb0baded3bbff983c71 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServerActionsTestJSON-335838033 Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: b12139c2484c4e4fbbf9839ab577ee5c Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServerActionsTestJSON-335838033-project Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2'} Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:12.359641 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Returning 404 to user: Instance 9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2acec261-98d0-4b57-a949-b516dd3a1e50 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2" status: 404 len: 111 microversion: 2.1 time: 0.032130 Oct 16 02:01:12.368199 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3486/7106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:12 2022] GET /compute/v2.1/servers/9fa9afd8-1bf6-4b5a-80ab-7767320e0fe2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:12.372949 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b3095f2-f1bb-4210-b568-3b7532791270 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] Calling method '.version_select at 0x7fd64ddfd670>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:12.397149 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b3095f2-f1bb-4210-b568-3b7532791270 tempest-ServerActionsTestJSON-335838033 tempest-ServerActionsTestJSON-335838033-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874351574" status: 202 len: 0 microversion: 2.1 time: 0.028725 Oct 16 02:01:12.398193 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3621/7107] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Oct 16 02:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874351574 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:01:21.942813 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1846392576", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "ea8391c3-14a5-4c26-ac14-1a9d70b2992f"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:22.001847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] validate_networks() for [('ea8391c3-14a5-4c26-ac14-1a9d70b2992f', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:01:22.348323 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=43 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:22.385360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:01:22.385780 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:01:22.386251 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:01:22.386658 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:01:22.387097 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:01:22.398573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:22.399216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:22.399657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:22.400388 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:22.400848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:22.401271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:22.420203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Getting quotas for project b908aa65085943a49bd50c6d41e5caa7. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:01:22.425334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Getting quotas for user c34a4956a1ed41f6b33789186cc35f14 and project b908aa65085943a49bd50c6d41e5caa7. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:01:22.438138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:01:22.440528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:01:22.485801 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-638d7aba-29ba-4325-94f4-9272e5cb3a3e tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690414 Oct 16 02:01:22.486541 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3487/7108] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:01:22.496617 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:22.497458 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:22.501641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80882892-78c8-49fa-a952-531a8ba1b5b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:22.502421 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80882892-78c8-49fa-a952-531a8ba1b5b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:22.578498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-80882892-78c8-49fa-a952-531a8ba1b5b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:22.591364 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80882892-78c8-49fa-a952-531a8ba1b5b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1217 microversion: 2.1 time: 0.096430 Oct 16 02:01:22.591976 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3622/7109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:22 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:01:23.616324 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b38a72fc-6201-44a4-b947-90ddfae8c33d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:23.617245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b38a72fc-6201-44a4-b947-90ddfae8c33d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:23.674061 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b38a72fc-6201-44a4-b947-90ddfae8c33d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:23.682974 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b38a72fc-6201-44a4-b947-90ddfae8c33d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1217 microversion: 2.1 time: 0.071357 Oct 16 02:01:23.683528 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3488/7110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:23 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:24.705909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e8c44574-12fb-419b-9b45-fdd3317e740c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:24.706807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e8c44574-12fb-419b-9b45-fdd3317e740c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:24.783615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e8c44574-12fb-419b-9b45-fdd3317e740c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:24.791188 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e8c44574-12fb-419b-9b45-fdd3317e740c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1217 microversion: 2.1 time: 0.089079 Oct 16 02:01:24.806569 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3623/7111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:24 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:25.814274 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-438fd0d2-592f-47b5-8785-6a18715cb120 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:25.814997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-438fd0d2-592f-47b5-8785-6a18715cb120 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:25.869621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-438fd0d2-592f-47b5-8785-6a18715cb120 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:25.877065 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-438fd0d2-592f-47b5-8785-6a18715cb120 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1217 microversion: 2.1 time: 0.067017 Oct 16 02:01:25.877679 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3489/7112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:25 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:26.902658 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:26.903350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:26.910836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:26.911370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:26.911820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:26.912530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:26.913006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:26.913449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:26.975094 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:26.983281 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85619b1f-b63b-47a7-b5e6-950259a3a3ad tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1221 microversion: 2.1 time: 0.085181 Oct 16 02:01:26.983862 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3624/7113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:26 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:28.007462 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:28.008588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:28.016470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:28.016954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:28.017408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:28.018106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:28.018572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:28.019029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:28.088493 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:28.096594 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-04b4a3d9-b22a-496e-8ad0-d103233efd43 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1275 microversion: 2.1 time: 0.092948 Oct 16 02:01:28.097183 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3490/7114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:28 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:01:29.120101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:29.120842 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:29.127699 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:29.128270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:29.128783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:29.129553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:29.130112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:29.131002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:29.190582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-112d2266-9ed5-43d9-bf13-955ee04d685e req-69ef0b66-4c70-41ad-8821-fa6a33270585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726f44ad-f7a0-4d5f-a34b-086c34c2e9ae", "tag": "af96ae2a-391f-4741-83c4-f576b0fd34fd"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:29.204336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-112d2266-9ed5-43d9-bf13-955ee04d685e req-69ef0b66-4c70-41ad-8821-fa6a33270585 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:29.204964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-112d2266-9ed5-43d9-bf13-955ee04d685e req-69ef0b66-4c70-41ad-8821-fa6a33270585 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:29.205622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-112d2266-9ed5-43d9-bf13-955ee04d685e req-69ef0b66-4c70-41ad-8821-fa6a33270585 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:29.220963 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-112d2266-9ed5-43d9-bf13-955ee04d685e req-69ef0b66-4c70-41ad-8821-fa6a33270585 service nova] Creating event network-changed:af96ae2a-391f-4741-83c4-f576b0fd34fd for instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae on n-h1-master-1 Oct 16 02:01:29.226457 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-112d2266-9ed5-43d9-bf13-955ee04d685e req-69ef0b66-4c70-41ad-8821-fa6a33270585 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040591 Oct 16 02:01:29.227753 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3491/7115] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:01:29.280385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:29.288375 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82a3d5cb-80ab-4250-964e-0b460befc6dc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1317 microversion: 2.1 time: 0.172195 Oct 16 02:01:29.289029 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3625/7116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:29 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:30.313005 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:30.313694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:30.321469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:30.322366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:30.322806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:30.323520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:30.323977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:30.324401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:30.454753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:30.463115 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9a3b61af-11fa-40f3-98fb-abeab24f7e2f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1317 microversion: 2.1 time: 0.154597 Oct 16 02:01:30.463692 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3492/7117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:30 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:31.485756 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:31.486293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:31.493338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:31.493839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:31.494289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:31.495025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:31.495503 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:31.495948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:31.628555 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:31.637053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-704c8586-36b6-476c-ba39-3a3ab64db805 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1317 microversion: 2.1 time: 0.155324 Oct 16 02:01:31.637629 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3626/7118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:31 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:32.661071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:32.661678 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:32.665116 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:32.665876 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:32.672237 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:32.672717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:32.673154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:32.673858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:32.674290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:32.674709 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:32.809481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:32.817514 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fbcf138b-f5d2-44b5-af45-00c3bafd98ff tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1317 microversion: 2.1 time: 0.160337 Oct 16 02:01:32.818107 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3493/7119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:32 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:33.841759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:33.842288 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:33.848737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:33.849241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:33.849696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:33.850449 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:33.850938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:33.851391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:33.981625 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:33.990174 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-46a7f782-8652-46ff-805f-809eed061818 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1317 microversion: 2.1 time: 0.152974 Oct 16 02:01:33.990791 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3627/7120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:33 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:35.013634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:35.014246 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:35.021153 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:35.021639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:35.022075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:35.022764 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:35.023249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:35.023681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:35.156764 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:35.164551 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-47db7f38-47ad-452b-9848-35c96fe710e4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1317 microversion: 2.1 time: 0.154949 Oct 16 02:01:35.165131 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3494/7121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:35 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:35.602391 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-1e72e286-3dcd-415a-b710-39143109f63f req-e8f3e036-3cf0-4934-a051-dd7b08d5a673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726f44ad-f7a0-4d5f-a34b-086c34c2e9ae", "name": "network-vif-plugged", "status": "completed", "tag": "af96ae2a-391f-4741-83c4-f576b0fd34fd"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:35.607344 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:35.613822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e72e286-3dcd-415a-b710-39143109f63f req-e8f3e036-3cf0-4934-a051-dd7b08d5a673 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:35.614322 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e72e286-3dcd-415a-b710-39143109f63f req-e8f3e036-3cf0-4934-a051-dd7b08d5a673 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:35.614845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-1e72e286-3dcd-415a-b710-39143109f63f req-e8f3e036-3cf0-4934-a051-dd7b08d5a673 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:35.627182 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-1e72e286-3dcd-415a-b710-39143109f63f req-e8f3e036-3cf0-4934-a051-dd7b08d5a673 service nova] Creating event network-vif-plugged:af96ae2a-391f-4741-83c4-f576b0fd34fd for instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae on n-h1-master-1 Oct 16 02:01:35.632176 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-1e72e286-3dcd-415a-b710-39143109f63f req-e8f3e036-3cf0-4934-a051-dd7b08d5a673 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033665 Oct 16 02:01:35.632785 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3628/7122] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:01:36.188480 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:36.189130 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:36.190999 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=10 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:36.197151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:36.197484 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:36.197920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:36.198610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:36.199102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:36.199530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:36.327284 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:36.334841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-79e7645c-255a-491d-8e17-7529f75a778c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1317 microversion: 2.1 time: 0.150505 Oct 16 02:01:36.335442 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3495/7123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:36 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:37.360840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:37.361553 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:37.367683 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:37.368180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:37.368622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:37.369812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:37.370764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:37.371239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:37.507509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:37.515432 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-69468d85-4374-4868-a352-a74dff12b1b1 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1506 microversion: 2.1 time: 0.159720 Oct 16 02:01:37.516008 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3629/7124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:37 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:37.578380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8651895", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "ea8391c3-14a5-4c26-ac14-1a9d70b2992f"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:37.632693 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] validate_networks() for [('ea8391c3-14a5-4c26-ac14-1a9d70b2992f', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:01:38.004910 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:01:38.005342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:01:38.005818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:01:38.006279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:01:38.006694 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:01:38.016009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:38.016516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:38.016948 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:38.017666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:38.018118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:38.018538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:38.035319 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Getting quotas for project b908aa65085943a49bd50c6d41e5caa7. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:01:38.040387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Getting quotas for user c34a4956a1ed41f6b33789186cc35f14 and project b908aa65085943a49bd50c6d41e5caa7. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:01:38.054655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:01:38.057091 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:01:38.102466 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fed12c2e-e543-49b8-a246-77d3fbea8197 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527972 Oct 16 02:01:38.104521 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3496/7125] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:01:38.114858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58be7779-9c31-4ad0-93ea-958123bbd8ec tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:38.115526 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58be7779-9c31-4ad0-93ea-958123bbd8ec tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:38.170050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58be7779-9c31-4ad0-93ea-958123bbd8ec tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:38.177225 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58be7779-9c31-4ad0-93ea-958123bbd8ec tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1214 microversion: 2.1 time: 0.066332 Oct 16 02:01:38.177807 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3630/7126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:38 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:39.201566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:39.202139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:39.208785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:39.209267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:39.209711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:39.210402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:39.210860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:39.211315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:39.275330 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:39.283843 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d9a80ef1-a391-4f26-b78f-3c525009460c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1266 microversion: 2.1 time: 0.087102 Oct 16 02:01:39.284415 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3497/7127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:39 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:40.308270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:40.309028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:40.325408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:40.326192 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:40.326377 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:40.328521 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:40.329021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:40.329472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:40.475962 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:40.484530 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7a5a10ac-ceb9-42a7-8f72-7ab9bfa7c4c9 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1314 microversion: 2.1 time: 0.180748 Oct 16 02:01:40.485492 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3631/7128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:40 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:41.047931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9dc5dcf2-1c7a-4029-888f-41a854f53aff req-7a6580a7-be93-4610-b83d-7ee153805e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0544ef82-fcbe-48dc-b971-aed37d1b25d5", "tag": "f06d693f-bc50-49eb-b835-e4efe3752764"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:41.060293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9dc5dcf2-1c7a-4029-888f-41a854f53aff req-7a6580a7-be93-4610-b83d-7ee153805e78 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:41.061696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9dc5dcf2-1c7a-4029-888f-41a854f53aff req-7a6580a7-be93-4610-b83d-7ee153805e78 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:41.062140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9dc5dcf2-1c7a-4029-888f-41a854f53aff req-7a6580a7-be93-4610-b83d-7ee153805e78 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:41.076073 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9dc5dcf2-1c7a-4029-888f-41a854f53aff req-7a6580a7-be93-4610-b83d-7ee153805e78 service nova] Creating event network-changed:f06d693f-bc50-49eb-b835-e4efe3752764 for instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 on n-h2-master-1 Oct 16 02:01:41.081061 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9dc5dcf2-1c7a-4029-888f-41a854f53aff req-7a6580a7-be93-4610-b83d-7ee153805e78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036860 Oct 16 02:01:41.081602 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3498/7129] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:01:41.508327 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:41.508957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:41.515975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:41.516482 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:41.516939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:41.517655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:41.518134 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:41.518580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:41.652346 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:41.660061 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d33492e-1c24-4bc0-aa05-e63f0bd4cd3d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1314 microversion: 2.1 time: 0.155757 Oct 16 02:01:41.660636 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3632/7130] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:41 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:42.685704 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:42.686655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:42.692910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:42.693396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:42.693836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:42.694528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:42.695012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:42.695449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:42.826045 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:42.833792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b2528673-b68d-4134-8f7d-f2c3a6fdf282 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1314 microversion: 2.1 time: 0.153722 Oct 16 02:01:42.834371 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3499/7131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:42 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:43.856563 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:43.857145 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:43.863857 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:43.864363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:43.864820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:43.865533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:43.866019 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:43.866463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:44.001382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:44.009114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ce607bdd-b640-4080-8c8a-9461b8e29eba tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1314 microversion: 2.1 time: 0.156774 Oct 16 02:01:44.009690 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3633/7132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:43 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:45.032541 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:45.033153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:45.039997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:45.040489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:45.040922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:45.041615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:45.042699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:45.043164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:45.175325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:45.183872 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c41de81c-bf61-4fe7-a959-5ea289367c3c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1314 microversion: 2.1 time: 0.155265 Oct 16 02:01:45.184461 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3500/7133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:45 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:46.207187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:46.207813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:46.214564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:46.215677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:46.216217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:46.216921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:46.217391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:46.217828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:46.348791 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:46.356896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-98aa0118-8cff-49d1-9a11-cd644173cf57 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1314 microversion: 2.1 time: 0.153649 Oct 16 02:01:46.357456 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3634/7134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:46 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:47.380549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:47.381150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:47.388601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:47.389083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:47.389515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:47.390318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:47.390647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:47.391096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:47.425819 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4b6f4d0c-297a-4117-9df8-34e0d92e9c7b req-98dbb983-97a0-4469-b1ec-6335f52678c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0544ef82-fcbe-48dc-b971-aed37d1b25d5", "name": "network-vif-plugged", "status": "completed", "tag": "f06d693f-bc50-49eb-b835-e4efe3752764"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:47.438405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4b6f4d0c-297a-4117-9df8-34e0d92e9c7b req-98dbb983-97a0-4469-b1ec-6335f52678c7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:47.438956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4b6f4d0c-297a-4117-9df8-34e0d92e9c7b req-98dbb983-97a0-4469-b1ec-6335f52678c7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:47.439397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4b6f4d0c-297a-4117-9df8-34e0d92e9c7b req-98dbb983-97a0-4469-b1ec-6335f52678c7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:47.451980 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4b6f4d0c-297a-4117-9df8-34e0d92e9c7b req-98dbb983-97a0-4469-b1ec-6335f52678c7 service nova] Creating event network-vif-plugged:f06d693f-bc50-49eb-b835-e4efe3752764 for instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 on n-h2-master-1 Oct 16 02:01:47.457312 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4b6f4d0c-297a-4117-9df8-34e0d92e9c7b req-98dbb983-97a0-4469-b1ec-6335f52678c7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035064 Oct 16 02:01:47.457935 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3635/7135] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:01:47.530534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:47.538353 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-52531535-9ab0-4f56-9118-b75572d08915 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1314 microversion: 2.1 time: 0.161776 Oct 16 02:01:47.539004 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3501/7136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:47 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:48.559583 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:48.565703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:48.566416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:48.572808 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:48.573308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:48.573785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:48.574494 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:48.574989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:48.575428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:48.706004 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:48.714774 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9cc47534-fb75-433f-8810-b7ac4cd5a3f3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1314 microversion: 2.1 time: 0.156754 Oct 16 02:01:48.716133 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3636/7137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:48 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:49.738302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:49.738962 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:49.740931 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:49.741593 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:49.748650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:49.749136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:49.749576 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:49.750303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:49.750761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:49.751210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:49.882492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:49.890751 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2d10da92-1c2f-4726-80e3-d839f5b24656 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1504 microversion: 2.1 time: 0.156398 Oct 16 02:01:49.891357 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3502/7138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:49 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:49.914027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:49.914564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:49.921953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:49.922462 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:49.922927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:49.923637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:49.924108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:49.924546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:49.953173 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:01:50.028842 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-93b70aab-42a8-4295-b49d-d6ac44046125 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 204 len: 0 microversion: 2.1 time: 0.117682 Oct 16 02:01:50.029446 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3637/7139] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:01:49 2022] DELETE /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:01:50.037735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:50.038383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:50.044364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:50.044853 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:50.045294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:50.045991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:50.046449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:50.046877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:50.176465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:50.184766 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eb766b9f-4c2c-4117-a801-dc493402d092 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1510 microversion: 2.1 time: 0.151126 Oct 16 02:01:50.185351 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3503/7140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:50 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:01:51.210024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:51.210731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:51.218641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:51.219168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:51.219611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:51.220308 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:51.220776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:51.221210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:51.356300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:51.364066 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8eaf81be-cf80-4ce2-aac3-b7e3aae1493d tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1510 microversion: 2.1 time: 0.158345 Oct 16 02:01:51.364637 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3638/7141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:51 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:52.060085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0e29657b-9b80-4101-951a-18e4071e3b71 req-62c16138-2b44-46ab-8101-3abc7d0cb685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0544ef82-fcbe-48dc-b971-aed37d1b25d5", "name": "network-vif-deleted", "tag": "f06d693f-bc50-49eb-b835-e4efe3752764"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:52.071110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0e29657b-9b80-4101-951a-18e4071e3b71 req-62c16138-2b44-46ab-8101-3abc7d0cb685 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:52.071514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0e29657b-9b80-4101-951a-18e4071e3b71 req-62c16138-2b44-46ab-8101-3abc7d0cb685 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:52.071936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0e29657b-9b80-4101-951a-18e4071e3b71 req-62c16138-2b44-46ab-8101-3abc7d0cb685 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:52.086231 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0e29657b-9b80-4101-951a-18e4071e3b71 req-62c16138-2b44-46ab-8101-3abc7d0cb685 service nova] Creating event network-vif-deleted:f06d693f-bc50-49eb-b835-e4efe3752764 for instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 on n-h2-master-1 Oct 16 02:01:52.097611 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0e29657b-9b80-4101-951a-18e4071e3b71 req-62c16138-2b44-46ab-8101-3abc7d0cb685 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041865 Oct 16 02:01:52.098240 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3504/7142] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:01:52.387835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:52.388507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:52.395428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:52.395948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:52.396407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:52.397119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:52.397607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:52.398061 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:52.429917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:52.430420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:52.430873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:52.431362 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lazy-loading 'fault' on Instance uuid 0544ef82-fcbe-48dc-b971-aed37d1b25d5 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:01:52.471608 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:52.479186 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1775376d-f18b-470a-b8bb-75c76286cd08 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 200 len: 1304 microversion: 2.1 time: 0.095479 Oct 16 02:01:52.479770 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3639/7143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:52 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:53.501631 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:01:53.502234 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 (ip 10.222.0.39) !!! Oct 16 02:01:53.506177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:53.506875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:53.514157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:53.514874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:53.515343 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:53.516045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:53.516502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:53.516927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:53.521843 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=77 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:53.532599 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] HTTP exception thrown: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Request method failure captured: Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 HTTP/1.1 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2XxOI8hNUTN1VQ4Ioed142SWBKg3EGrrzEW2Z6AGFcKKBkpwBxbGXwr_vKMKX_1kKhPaKa2FiEqorh7q53fgmu_uPk4TcYJvRqIRX_9cCwVZYLmcfdS9g6lOiJlVGPlgAPxcU2FT8SF8Df_Twtq-vfcdJffDqCuc3D9a6OgKqBsj48 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b908aa65085943a49bd50c6d41e5caa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: c34a4956a1ed41f6b33789186cc35f14 Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '0544ef82-fcbe-48dc-b971-aed37d1b25d5'} Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:53.535020 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Returning 404 to user: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b310f10-382b-4198-b569-a10dd3099327 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 404 len: 111 microversion: 2.1 time: 0.036041 Oct 16 02:01:53.540093 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3505/7144] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:53 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:53.547293 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:53.548019 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:53.551024 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:53.556481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:53.557068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:53.557591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:53.558382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:53.559537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:53.560059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:53.564562 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:01:53.695626 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:53.704089 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-54f4a8cf-c598-4e74-9649-b714d0dc7ffb tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1506 microversion: 2.1 time: 0.161907 Oct 16 02:01:53.704668 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3640/7145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:53 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:53.726732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bdd0037f-935b-467b-8c04-39c212f5f8bf tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:53.729039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bdd0037f-935b-467b-8c04-39c212f5f8bf tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: a5810bc7-6ec5-4646-8db2-e5604016a3d6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:53.735178 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-bdd0037f-935b-467b-8c04-39c212f5f8bf tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] HTTP exception thrown: Instance a5810bc7-6ec5-4646-8db2-e5604016a3d6 could not be found. Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bdd0037f-935b-467b-8c04-39c212f5f8bf tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Request method failure captured: Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/a5810bc7-6ec5-4646-8db2-e5604016a3d6/action HTTP/1.1 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 32 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2XxOI8hNUTN1VQ4Ioed142SWBKg3EGrrzEW2Z6AGFcKKBkpwBxbGXwr_vKMKX_1kKhPaKa2FiEqorh7q53fgmu_uPk4TcYJvRqIRX_9cCwVZYLmcfdS9g6lOiJlVGPlgAPxcU2FT8SF8Df_Twtq-vfcdJffDqCuc3D9a6OgKqBsj48 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b908aa65085943a49bd50c6d41e5caa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: c34a4956a1ed41f6b33789186cc35f14 Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: {"resize": {"flavorRef": "452"}} Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: exception: Instance a5810bc7-6ec5-4646-8db2-e5604016a3d6 could not be found. Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'a5810bc7-6ec5-4646-8db2-e5604016a3d6', 'body': {'resize': {'flavorRef': '452'}}} Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5810bc7-6ec5-4646-8db2-e5604016a3d6 could not be found. Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:53.736724 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5810bc7-6ec5-4646-8db2-e5604016a3d6 could not be found. Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5810bc7-6ec5-4646-8db2-e5604016a3d6 could not be found. Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bdd0037f-935b-467b-8c04-39c212f5f8bf tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Returning 404 to user: Instance a5810bc7-6ec5-4646-8db2-e5604016a3d6 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bdd0037f-935b-467b-8c04-39c212f5f8bf tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "POST /compute/v2.1/servers/a5810bc7-6ec5-4646-8db2-e5604016a3d6/action" status: 404 len: 111 microversion: 2.1 time: 0.015374 Oct 16 02:01:53.741339 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3506/7146] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:01:53 2022] POST /compute/v2.1/servers/a5810bc7-6ec5-4646-8db2-e5604016a3d6/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 02:01:53.747729 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:53.748363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:53.754317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:53.754815 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:53.755293 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:53.755998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:53.756476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:53.756911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:53.891778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:53.899791 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b43f3223-d4be-4713-aae2-d619b2810886 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1506 microversion: 2.1 time: 0.156836 Oct 16 02:01:53.900376 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3641/7147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:53 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:53.923886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:53.924526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:53.931905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:53.932396 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:53.932842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:53.934031 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:53.934497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:53.934949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.067497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:54.076617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b32188ab-7a36-4c78-bb5b-279ba93b793b tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1506 microversion: 2.1 time: 0.156600 Oct 16 02:01:54.077200 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3507/7148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:53 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:54.100242 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2775d73a-75ca-4381-8f69-f7b68cc2ad26"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:54.102541 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:54.108530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.109029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.109476 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.110180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.110649 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.111109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.138994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:54.143655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] HTTP exception thrown: Flavor 2775d73a-75ca-4381-8f69-f7b68cc2ad26 could not be found. Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Request method failure captured: Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: request: POST /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae/action HTTP/1.1 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 65 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2XxOI8hNUTN1VQ4Ioed142SWBKg3EGrrzEW2Z6AGFcKKBkpwBxbGXwr_vKMKX_1kKhPaKa2FiEqorh7q53fgmu_uPk4TcYJvRqIRX_9cCwVZYLmcfdS9g6lOiJlVGPlgAPxcU2FT8SF8Df_Twtq-vfcdJffDqCuc3D9a6OgKqBsj48 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b908aa65085943a49bd50c6d41e5caa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c34a4956a1ed41f6b33789186cc35f14 Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: {"resize": {"flavorRef": "2775d73a-75ca-4381-8f69-f7b68cc2ad26"}} Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: exception: Flavor 2775d73a-75ca-4381-8f69-f7b68cc2ad26 could not be found. Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '726f44ad-f7a0-4d5f-a34b-086c34c2e9ae', 'body': {'resize': {'flavorRef': '2775d73a-75ca-4381-8f69-f7b68cc2ad26'}}} Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:54.145554 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2775d73a-75ca-4381-8f69-f7b68cc2ad26 could not be found. Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2775d73a-75ca-4381-8f69-f7b68cc2ad26 could not be found. Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2775d73a-75ca-4381-8f69-f7b68cc2ad26 could not be found. Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Returning 400 to user: Flavor 2775d73a-75ca-4381-8f69-f7b68cc2ad26 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-00f2673f-b690-41f8-b97f-0e6ef64c0ba2 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "POST /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae/action" status: 400 len: 107 microversion: 2.1 time: 0.050788 Oct 16 02:01:54.150082 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3642/7149] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:01:54 2022] POST /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae/action => generated 107 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 16 02:01:54.156575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:54.157191 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:54.163223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.163702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.164144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.164835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.165294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.165721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.296744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:54.304379 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6bbc65f5-734d-4808-8166-d8dddef102d4 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1506 microversion: 2.1 time: 0.152319 Oct 16 02:01:54.304945 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3508/7150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:54 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:54.328495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:54.329139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:54.336184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.336677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.337120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.337818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.338290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.338724 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.471367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:54.479163 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3f2f15e0-b934-4f90-b618-0961f09354dd tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1506 microversion: 2.1 time: 0.155079 Oct 16 02:01:54.479735 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3643/7151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:54 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:54.501619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-858853e6-1381-4002-ad4d-9bc6e2e8315c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-858853e6-1381-4002-ad4d-9bc6e2e8315c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Request method failure captured: Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: request: POST /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae/action HTTP/1.1 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 29 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2XxOI8hNUTN1VQ4Ioed142SWBKg3EGrrzEW2Z6AGFcKKBkpwBxbGXwr_vKMKX_1kKhPaKa2FiEqorh7q53fgmu_uPk4TcYJvRqIRX_9cCwVZYLmcfdS9g6lOiJlVGPlgAPxcU2FT8SF8Df_Twtq-vfcdJffDqCuc3D9a6OgKqBsj48 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b908aa65085943a49bd50c6d41e5caa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: c34a4956a1ed41f6b33789186cc35f14 Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: {"resize": {"flavorRef": ""}} Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '726f44ad-f7a0-4d5f-a34b-086c34c2e9ae', 'body': {'resize': {'flavorRef': ''}}} Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise error Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi '' Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.505138 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-858853e6-1381-4002-ad4d-9bc6e2e8315c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-858853e6-1381-4002-ad4d-9bc6e2e8315c tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "POST /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae/action" status: 400 len: 113 microversion: 2.1 time: 0.008950 Oct 16 02:01:54.510756 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3509/7152] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:01:54 2022] POST /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 16 02:01:54.515430 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:54.516062 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:54.521961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.522457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.522904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.523626 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.524099 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.524539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.656269 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:54.663985 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a0655c6a-fe91-4376-9788-14a6370e9cdc tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1506 microversion: 2.1 time: 0.153057 Oct 16 02:01:54.664552 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3644/7153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:54 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:01:54.692515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:54.693041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:54.702527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.703058 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.703501 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.704192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.704652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.705097 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.718684 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] HTTP exception thrown: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Request method failure captured: Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 HTTP/1.1 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2XxOI8hNUTN1VQ4Ioed142SWBKg3EGrrzEW2Z6AGFcKKBkpwBxbGXwr_vKMKX_1kKhPaKa2FiEqorh7q53fgmu_uPk4TcYJvRqIRX_9cCwVZYLmcfdS9g6lOiJlVGPlgAPxcU2FT8SF8Df_Twtq-vfcdJffDqCuc3D9a6OgKqBsj48 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b908aa65085943a49bd50c6d41e5caa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: c34a4956a1ed41f6b33789186cc35f14 Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '0544ef82-fcbe-48dc-b971-aed37d1b25d5'} Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:54.720273 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Returning 404 to user: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-02d75faa-a9a7-4c43-922c-26b7d357d10f tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 404 len: 111 microversion: 2.1 time: 0.034086 Oct 16 02:01:54.724697 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3510/7154] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:01:54 2022] DELETE /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:01:54.731054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:54.732129 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 0544ef82-fcbe-48dc-b971-aed37d1b25d5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:54.737971 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.738465 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.738940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.739632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.740103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.740538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.754596 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] HTTP exception thrown: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Request method failure captured: Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 HTTP/1.1 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2XxOI8hNUTN1VQ4Ioed142SWBKg3EGrrzEW2Z6AGFcKKBkpwBxbGXwr_vKMKX_1kKhPaKa2FiEqorh7q53fgmu_uPk4TcYJvRqIRX_9cCwVZYLmcfdS9g6lOiJlVGPlgAPxcU2FT8SF8Df_Twtq-vfcdJffDqCuc3D9a6OgKqBsj48 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b908aa65085943a49bd50c6d41e5caa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c34a4956a1ed41f6b33789186cc35f14 Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '0544ef82-fcbe-48dc-b971-aed37d1b25d5'} Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:54.756093 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Returning 404 to user: Instance 0544ef82-fcbe-48dc-b971-aed37d1b25d5 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-adaf0743-7121-4055-aa92-0201c560cf09 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5" status: 404 len: 111 microversion: 2.1 time: 0.031125 Oct 16 02:01:54.761009 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3645/7155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:54 2022] GET /compute/v2.1/servers/0544ef82-fcbe-48dc-b971-aed37d1b25d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 02:01:54.766391 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:54.766883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:54.772745 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.773221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.773655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.774333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.774784 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.775236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.801817 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:01:54.877021 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aad06499-fbaa-4f16-bb8a-41916609c2c3 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "DELETE /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 204 len: 0 microversion: 2.1 time: 0.114519 Oct 16 02:01:54.877789 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3511/7156] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:01:54 2022] DELETE /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:01:54.887990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:54.889448 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:54.895836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.896333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.896778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:54.897507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:54.897977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:54.898414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:55.035896 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:55.043663 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80395764-42a0-41f3-880c-4c6b89ab3788 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1512 microversion: 2.1 time: 0.160745 Oct 16 02:01:55.044241 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3646/7157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:54 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:56.067808 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:56.068508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:56.075452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:56.075935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:56.076372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:56.077061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:56.077516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:56.077943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:56.213917 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:56.222289 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6003dd80-dea2-48af-bdaa-8e052a42df62 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1512 microversion: 2.1 time: 0.158807 Oct 16 02:01:56.222862 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3512/7158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:56 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:56.846468 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-0493cc94-6e9d-49f8-afbe-b6b0169f56bf req-a4f38d04-213b-4551-93c6-6ff70efd4750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726f44ad-f7a0-4d5f-a34b-086c34c2e9ae", "name": "network-vif-deleted", "tag": "af96ae2a-391f-4741-83c4-f576b0fd34fd"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:01:56.858421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0493cc94-6e9d-49f8-afbe-b6b0169f56bf req-a4f38d04-213b-4551-93c6-6ff70efd4750 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:56.858995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0493cc94-6e9d-49f8-afbe-b6b0169f56bf req-a4f38d04-213b-4551-93c6-6ff70efd4750 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:56.859400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-0493cc94-6e9d-49f8-afbe-b6b0169f56bf req-a4f38d04-213b-4551-93c6-6ff70efd4750 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:56.872428 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-0493cc94-6e9d-49f8-afbe-b6b0169f56bf req-a4f38d04-213b-4551-93c6-6ff70efd4750 service nova] Creating event network-vif-deleted:af96ae2a-391f-4741-83c4-f576b0fd34fd for instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae on n-h1-master-1 Oct 16 02:01:56.877912 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-0493cc94-6e9d-49f8-afbe-b6b0169f56bf req-a4f38d04-213b-4551-93c6-6ff70efd4750 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035900 Oct 16 02:01:56.878536 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3647/7159] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:01:57.245580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:57.246196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:57.253656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:57.254143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:57.254586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:57.255317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:57.255779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:57.256208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:57.286936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:57.287369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:57.287811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:57.288268 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lazy-loading 'fault' on Instance uuid 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:01:57.334497 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34a4956a1ed41f6b33789186cc35f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b908aa65085943a49bd50c6d41e5caa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:01:57.342850 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e49dd2b0-fd04-4be6-8685-a41715d79b41 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 200 len: 1307 microversion: 2.1 time: 0.101104 Oct 16 02:01:57.350411 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3513/7160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:57 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:01:58.368644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:01:58.369363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] [instance: 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:01:58.376338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:58.376949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:58.377474 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:58.378253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:01:58.378802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:01:58.379399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:01:58.394353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] HTTP exception thrown: Instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae could not be found. Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Request method failure captured: Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae HTTP/1.1 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2XxOI8hNUTN1VQ4Ioed142SWBKg3EGrrzEW2Z6AGFcKKBkpwBxbGXwr_vKMKX_1kKhPaKa2FiEqorh7q53fgmu_uPk4TcYJvRqIRX_9cCwVZYLmcfdS9g6lOiJlVGPlgAPxcU2FT8SF8Df_Twtq-vfcdJffDqCuc3D9a6OgKqBsj48 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b908aa65085943a49bd50c6d41e5caa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b908aa65085943a49bd50c6d41e5caa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: b908aa65085943a49bd50c6d41e5caa7 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-ServersNegativeTestJSON-651508734 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: c34a4956a1ed41f6b33789186cc35f14 Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-ServersNegativeTestJSON-651508734-project Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae could not be found. Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '726f44ad-f7a0-4d5f-a34b-086c34c2e9ae'} Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae could not be found. Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae could not be found. Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:01:58.396258 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae could not be found. Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] Returning 404 to user: Instance 726f44ad-f7a0-4d5f-a34b-086c34c2e9ae could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3ef7a1f8-0c0f-4967-98bb-787f452ff365 tempest-ServersNegativeTestJSON-651508734 tempest-ServersNegativeTestJSON-651508734-project] 10.222.0.39 "GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae" status: 404 len: 111 microversion: 2.1 time: 0.034945 Oct 16 02:01:58.400841 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3648/7161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:01:58 2022] GET /compute/v2.1/servers/726f44ad-f7a0-4d5f-a34b-086c34c2e9ae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:02:29.847732 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:29.848975 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:30.037407 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ff08f478-c396-4f93-ae80-289968d7e7b8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: .version_select at 0x7fd64e4a9550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-428564771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFMvRSNX8pACtmQ2wDeGh5ABfb3cIImb04dkW1Wzo1oAfaUNqiygZpSL4w4m/o/oj4jNXlZXgMVBTpXjcPk6qYBgNR6usVLOOiV+QD1EVF6uLAaNPRG/5ENu5wzC6ya8A=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:02:30.053753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ff08f478-c396-4f93-ae80-289968d7e7b8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:02:30.061526 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-ff08f478-c396-4f93-ae80-289968d7e7b8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for user be072007df754e6ba88faf58d27f543e and project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:02:30.095488 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ff08f478-c396-4f93-ae80-289968d7e7b8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.252963 Oct 16 02:02:30.096111 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3514/7162] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:02:29 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:02:30.150400 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-107500156", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-428564771", "networks": [{"uuid": "a0208616-32d4-4249-b618-ade565fdd642"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:02:30.161915 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=19 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:30.162728 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=39 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:30.207354 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] validate_networks() for [('a0208616-32d4-4249-b618-ade565fdd642', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:02:30.717672 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:02:30.718105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:02:30.718584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:02:30.719040 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:02:30.719467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:02:30.728313 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:30.728809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:30.729257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:30.729994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:30.730463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:30.730908 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:30.749548 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:02:30.754805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for user be072007df754e6ba88faf58d27f543e and project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:02:30.767713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:02:30.770055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:02:30.819072 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4d4eae0a-bb1c-4825-83aa-f57265a09f7f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672422 Oct 16 02:02:30.819643 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3649/7163] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:02:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:02:30.830898 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dfdcec98-73af-47b1-afb7-42ccf6bf376c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:30.831532 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dfdcec98-73af-47b1-afb7-42ccf6bf376c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:30.887515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dfdcec98-73af-47b1-afb7-42ccf6bf376c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:30.895403 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dfdcec98-73af-47b1-afb7-42ccf6bf376c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1261 microversion: 2.1 time: 0.068393 Oct 16 02:02:30.895956 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3515/7164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:30 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:31.919453 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:31.920087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:31.928928 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:31.929445 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:31.929902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:31.930645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:31.931156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:31.931607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:32.016290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:32.024855 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d83819be-1f9c-4154-b542-d38650589286 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1321 microversion: 2.1 time: 0.109844 Oct 16 02:02:32.025625 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3650/7165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:31 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1321 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:33.049688 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:33.050983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:33.059975 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:33.061297 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:33.061960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:33.062937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:33.063492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:33.064124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:33.207842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:33.216507 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4d08e2dd-3780-41e1-95b1-a6349a2aabba tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1361 microversion: 2.1 time: 0.170660 Oct 16 02:02:33.217464 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3516/7166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:33 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:33.578388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-ad80f37f-ff69-4020-8aca-fc3fb55dcef9 req-ee708f19-f368-4159-8b5d-d7aee6d80c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34de473e-202f-4647-8ef7-af1548468552", "tag": "92c78904-0bf1-4246-a116-51e1585e90e0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:02:33.599037 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ad80f37f-ff69-4020-8aca-fc3fb55dcef9 req-ee708f19-f368-4159-8b5d-d7aee6d80c45 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:33.599537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ad80f37f-ff69-4020-8aca-fc3fb55dcef9 req-ee708f19-f368-4159-8b5d-d7aee6d80c45 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:33.600156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-ad80f37f-ff69-4020-8aca-fc3fb55dcef9 req-ee708f19-f368-4159-8b5d-d7aee6d80c45 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:33.614188 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-ad80f37f-ff69-4020-8aca-fc3fb55dcef9 req-ee708f19-f368-4159-8b5d-d7aee6d80c45 service nova] Creating event network-changed:92c78904-0bf1-4246-a116-51e1585e90e0 for instance 34de473e-202f-4647-8ef7-af1548468552 on n-h1-master-1 Oct 16 02:02:33.620318 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-ad80f37f-ff69-4020-8aca-fc3fb55dcef9 req-ee708f19-f368-4159-8b5d-d7aee6d80c45 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047800 Oct 16 02:02:33.621023 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3651/7167] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:02:34.241449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:34.241959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:34.248937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:34.249427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:34.249855 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:34.250547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:34.251033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:34.251461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:34.384282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:34.392722 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-adceb9f9-e8ac-4344-b7f0-1bd4d1229ab9 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1361 microversion: 2.1 time: 0.155272 Oct 16 02:02:34.393307 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3517/7168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:34 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:35.417054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:35.417859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:35.424224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:35.424712 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:35.425154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:35.425848 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:35.426318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:35.426754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:35.564042 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:35.572272 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ef143c54-dd62-4d5f-a298-7f52293d0c49 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1361 microversion: 2.1 time: 0.160368 Oct 16 02:02:35.572855 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3652/7169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:35 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:36.595796 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:36.596439 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:36.603597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:36.604089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:36.604528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:36.605220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:36.606431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:36.606871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:36.740231 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:36.748503 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a4ab153b-b0b2-4c70-a15b-22e18e0afc45 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1361 microversion: 2.1 time: 0.156647 Oct 16 02:02:36.749078 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3518/7170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:36 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:37.770839 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:37.771496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:37.778354 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:37.778863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:37.779348 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:37.780068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:37.780544 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:37.780990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:37.915184 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:37.923852 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d478689-743c-4bed-8810-672f22d11540 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1361 microversion: 2.1 time: 0.156954 Oct 16 02:02:37.924430 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3653/7171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:37 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:38.947494 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:38.948062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:38.955095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:38.955580 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:38.956018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:38.956711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:38.957165 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:38.957589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:39.093647 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:39.101332 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dde0c718-45ab-41d6-a9f4-b71d81e7cf15 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1361 microversion: 2.1 time: 0.157931 Oct 16 02:02:39.101908 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3519/7172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:38 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:39.701850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c6cccdad-98f5-4d91-ada7-bb3ef410cc96 req-49c338d0-6c19-474a-b7a3-334dae3633ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34de473e-202f-4647-8ef7-af1548468552", "name": "network-vif-plugged", "status": "completed", "tag": "92c78904-0bf1-4246-a116-51e1585e90e0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:02:39.714617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c6cccdad-98f5-4d91-ada7-bb3ef410cc96 req-49c338d0-6c19-474a-b7a3-334dae3633ee service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:39.716064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c6cccdad-98f5-4d91-ada7-bb3ef410cc96 req-49c338d0-6c19-474a-b7a3-334dae3633ee service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:39.716515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c6cccdad-98f5-4d91-ada7-bb3ef410cc96 req-49c338d0-6c19-474a-b7a3-334dae3633ee service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:39.728289 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c6cccdad-98f5-4d91-ada7-bb3ef410cc96 req-49c338d0-6c19-474a-b7a3-334dae3633ee service nova] Creating event network-vif-plugged:92c78904-0bf1-4246-a116-51e1585e90e0 for instance 34de473e-202f-4647-8ef7-af1548468552 on n-h1-master-1 Oct 16 02:02:39.734382 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c6cccdad-98f5-4d91-ada7-bb3ef410cc96 req-49c338d0-6c19-474a-b7a3-334dae3633ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036711 Oct 16 02:02:39.735394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3654/7173] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:02:40.125166 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:40.125732 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:40.132690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:40.133175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:40.133615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:40.134306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:40.134770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:40.135226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:40.263597 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:40.271283 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df860c39-6fb3-4277-ab81-430c73f8f53e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1361 microversion: 2.1 time: 0.150110 Oct 16 02:02:40.271860 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3520/7174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:40 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:41.294743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:41.295425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:41.298207 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:41.299002 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:41.305630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:41.306137 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:41.306591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:41.307335 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:41.307818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:41.309028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:41.442865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:41.451368 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1e7172f6-7c6c-409a-b3bd-7b6d5b32f7cc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1553 microversion: 2.1 time: 0.161019 Oct 16 02:02:41.451942 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3655/7175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:41 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:41.474025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:41.474735 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:41.476595 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:41.483599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:41.484078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:41.484509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:41.485194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:41.485648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:41.486069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:41.615337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:02:41.624128 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a87f90a-63cf-4d7e-bd2c-9f5899781c03 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1553 microversion: 2.1 time: 0.153884 Oct 16 02:02:41.624694 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3521/7176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:02:41 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:02:43.480829 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bf4e07f-70ce-45dd-99d0-72c5f5ee074c"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:02:43.483253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:43.489844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:43.490352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:43.490818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:43.491550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:43.492030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:43.492504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:43.754556 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c788f53a-c95d-4726-bd4c-4b3106bfdafb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277704 Oct 16 02:02:43.755212 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3656/7177] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 02:02:43 2022] POST /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:02:54.482528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:54.483067 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:54.485010 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:54.485818 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=36 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:54.491591 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:54.492074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:54.492539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:54.493223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:54.493674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:54.494092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:54.575916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lazy-loading 'services' on Instance uuid 34de473e-202f-4647-8ef7-af1548468552 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:02:54.645370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30604185-18ec-4fe3-a2bd-f650e80415b4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments/4bf4e07f-70ce-45dd-99d0-72c5f5ee074c" status: 202 len: 0 microversion: 2.1 time: 0.167026 Oct 16 02:02:54.645969 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3522/7178] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:02:54 2022] DELETE /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments/4bf4e07f-70ce-45dd-99d0-72c5f5ee074c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:02:54.652590 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:54.653237 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:02:54.658167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:54.660589 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:54.669145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:54.669735 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:54.670228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:54.670977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:54.671472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:54.671920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:54.705220 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5e690611-085f-45ff-8036-88bfc810dc50 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054754 Oct 16 02:02:54.705991 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3657/7179] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:02:54 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:02:55.720265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:55.722744 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:55.729328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:55.729996 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:55.731230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:55.732039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:55.732622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:55.733147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:55.768187 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c49f7aa-003b-40c1-96ec-33b50e1fe3b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054172 Oct 16 02:02:55.768858 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3523/7180] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:02:55 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:02:56.781131 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:56.783464 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:56.790602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:56.791151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:56.791608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:56.792371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:56.793575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:56.794047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:56.829044 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d10f4ed-906b-4a71-b30c-eabe697d04ce tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052082 Oct 16 02:02:56.829624 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3658/7181] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:02:56 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:02:57.842402 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:57.844572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:57.851972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:57.852452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:57.852886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:57.853573 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:57.854023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:57.854444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:57.885523 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-904585c9-9e2a-4cb7-a671-70e403597a90 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047727 Oct 16 02:02:57.886096 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3524/7182] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:02:57 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:02:58.898820 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:58.901045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:58.909287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:58.909787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:58.910234 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:58.910960 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:58.911429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:58.911863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:58.942776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d1958f75-2f31-443f-ac81-693f4d701862 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047901 Oct 16 02:02:58.943393 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3659/7183] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:02:58 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:02:59.955988 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:02:59.958059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:02:59.965203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:59.965686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:59.966120 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:59.966801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:02:59.967278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:02:59.967699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:02:59.997669 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-69e151c2-9bb1-4411-ac19-8f20c2d18968 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045760 Oct 16 02:02:59.998243 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3525/7184] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:02:59 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 02:03:00.009232 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:00.009723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:00.017066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:00.017564 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:00.018013 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:00.018713 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:00.019214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:00.019655 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:00.094823 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] HTTP exception thrown: Instance 34de473e-202f-4647-8ef7-af1548468552 is not attached to volume 4bf4e07f-70ce-45dd-99d0-72c5f5ee074c Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Request method failure captured: Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments/4bf4e07f-70ce-45dd-99d0-72c5f5ee074c HTTP/1.1 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2YwHxfNOFtoOHGEj7Djy--QPSnLfNtR9wOlDrK-klITeWfC_LlwWIda6C5wfeL0G98iDs3ZAllFJktwjHSPPMgVnEbeR9kaazdA3kt05nWpxquwK2bj-JNulfIxjZQQW6TsefJNZ-_5Ig70aYhb51Mu6_rdEWh_weqy3sDfGkUqNWM Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8bf0ac8730fd471cb2ebb6168f341540", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: be072007df754e6ba88faf58d27f543e Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 34de473e-202f-4647-8ef7-af1548468552 is not attached to volume 4bf4e07f-70ce-45dd-99d0-72c5f5ee074c Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': '34de473e-202f-4647-8ef7-af1548468552', 'id': '4bf4e07f-70ce-45dd-99d0-72c5f5ee074c'} Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4bf4e07f-70ce-45dd-99d0-72c5f5ee074c. Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34de473e-202f-4647-8ef7-af1548468552 is not attached to volume 4bf4e07f-70ce-45dd-99d0-72c5f5ee074c Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:03:00.107546 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:03:00.112585 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:03:00.112585 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:03:00.112585 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34de473e-202f-4647-8ef7-af1548468552 is not attached to volume 4bf4e07f-70ce-45dd-99d0-72c5f5ee074c Oct 16 02:03:00.112585 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:00.112585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Returning 404 to user: Instance 34de473e-202f-4647-8ef7-af1548468552 is not attached to volume 4bf4e07f-70ce-45dd-99d0-72c5f5ee074c {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:03:00.112585 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d0e0e73b-d2aa-4292-9978-611bed6b5bb5 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments/4bf4e07f-70ce-45dd-99d0-72c5f5ee074c" status: 404 len: 154 microversion: 2.1 time: 0.103810 Oct 16 02:03:00.112585 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3660/7185] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:03:00 2022] DELETE /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552/os-volume_attachments/4bf4e07f-70ce-45dd-99d0-72c5f5ee074c => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:03:03.459555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:03.460225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:03.467615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:03.469181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:03.469737 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:03.470520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:03.471096 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:03.471595 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:03.499813 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:03:03.586387 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e8c84146-a93c-4381-a65b-a1d056aa1ae8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 204 len: 0 microversion: 2.1 time: 0.130827 Oct 16 02:03:03.587454 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3526/7186] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:03:03 2022] DELETE /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:03:03.596486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:03.597138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:03.606265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:03.607024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:03.607477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:03.608276 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:03.608746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:03.609191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:03.746235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:03.754126 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-75bd9e01-fc23-40c7-be8c-70a48fb90972 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1559 microversion: 2.1 time: 0.162179 Oct 16 02:03:03.754702 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3661/7187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:03 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:04.782166 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:04.782865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:04.789654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:04.790132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:04.790563 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:04.791287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:04.791741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:04.792169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:04.922483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:04.930218 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3c84e3f3-1337-4178-847c-d6a72a366abe tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1559 microversion: 2.1 time: 0.156159 Oct 16 02:03:04.930801 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3527/7188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:04 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:05.738333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6ac5ec10-7c70-412f-a59e-201120462de0 req-41ab8b4a-06b3-4213-99ea-c9997e6d3761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34de473e-202f-4647-8ef7-af1548468552", "name": "network-vif-deleted", "tag": "92c78904-0bf1-4246-a116-51e1585e90e0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:05.750593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6ac5ec10-7c70-412f-a59e-201120462de0 req-41ab8b4a-06b3-4213-99ea-c9997e6d3761 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:05.753129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6ac5ec10-7c70-412f-a59e-201120462de0 req-41ab8b4a-06b3-4213-99ea-c9997e6d3761 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:05.753486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6ac5ec10-7c70-412f-a59e-201120462de0 req-41ab8b4a-06b3-4213-99ea-c9997e6d3761 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:05.767819 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6ac5ec10-7c70-412f-a59e-201120462de0 req-41ab8b4a-06b3-4213-99ea-c9997e6d3761 service nova] Creating event network-vif-deleted:92c78904-0bf1-4246-a116-51e1585e90e0 for instance 34de473e-202f-4647-8ef7-af1548468552 on n-h1-master-1 Oct 16 02:03:05.772647 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6ac5ec10-7c70-412f-a59e-201120462de0 req-41ab8b4a-06b3-4213-99ea-c9997e6d3761 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037977 Oct 16 02:03:05.773257 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3662/7189] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:05.954165 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:05.954713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:05.961560 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:05.962055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:05.962469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:05.963189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:05.963652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:05.964081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:05.994736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:05.995252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:05.996443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:05.996896 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lazy-loading 'fault' on Instance uuid 34de473e-202f-4647-8ef7-af1548468552 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:03:06.038508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:06.047271 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c28c6bc9-ed6d-489f-97bf-b1aa45395776 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 200 len: 1351 microversion: 2.1 time: 0.096897 Oct 16 02:03:06.047871 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3528/7190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:05 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:07.073218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:07.074083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 34de473e-202f-4647-8ef7-af1548468552] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:07.080194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:07.080704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:07.081160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:07.081878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:07.082357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:07.082804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:07.096248 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] HTTP exception thrown: Instance 34de473e-202f-4647-8ef7-af1548468552 could not be found. Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Request method failure captured: Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 HTTP/1.1 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2YwHxfNOFtoOHGEj7Djy--QPSnLfNtR9wOlDrK-klITeWfC_LlwWIda6C5wfeL0G98iDs3ZAllFJktwjHSPPMgVnEbeR9kaazdA3kt05nWpxquwK2bj-JNulfIxjZQQW6TsefJNZ-_5Ig70aYhb51Mu6_rdEWh_weqy3sDfGkUqNWM Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8bf0ac8730fd471cb2ebb6168f341540", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: be072007df754e6ba88faf58d27f543e Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 34de473e-202f-4647-8ef7-af1548468552 could not be found. Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '34de473e-202f-4647-8ef7-af1548468552'} Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34de473e-202f-4647-8ef7-af1548468552 could not be found. Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34de473e-202f-4647-8ef7-af1548468552 could not be found. Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:03:07.097889 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34de473e-202f-4647-8ef7-af1548468552 could not be found. Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Returning 404 to user: Instance 34de473e-202f-4647-8ef7-af1548468552 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6ac87ff6-e8f7-40b1-a429-90519fd9fc43 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552" status: 404 len: 111 microversion: 2.1 time: 0.031357 Oct 16 02:03:07.102168 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3663/7191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:07 2022] GET /compute/v2.1/servers/34de473e-202f-4647-8ef7-af1548468552 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:03:07.108855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9045533a-2d1d-4867-8a79-ff1b78f51f80 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '.version_select at 0x7fd6527a0820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:07.130135 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9045533a-2d1d-4867-8a79-ff1b78f51f80 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-428564771" status: 202 len: 0 microversion: 2.1 time: 0.025798 Oct 16 02:03:07.130717 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3529/7192] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 02:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-428564771 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 02:03:07.148678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a058cde1-3855-4c28-bad5-7f83b34d0411 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: .version_select at 0x7fd64e62af70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1982611965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAh6uTSgAtuZpfrZDnF99iZnwmo5BV8dQAtamAbZMVJqS6kUW11/OtF6j27zNjyaWrN3bfEFYaAjC6U5YSKHPEMkuCc1Lal6vtG4QrL3+nPpjrR/+MeEpzw8xNObCWUBdw=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:07.168524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a058cde1-3855-4c28-bad5-7f83b34d0411 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:03:07.174852 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-a058cde1-3855-4c28-bad5-7f83b34d0411 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for user be072007df754e6ba88faf58d27f543e and project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:03:07.199907 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a058cde1-3855-4c28-bad5-7f83b34d0411 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055240 Oct 16 02:03:07.200571 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3664/7193] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:03:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:07.251689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1614751386", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1982611965", "networks": [{"uuid": "a0208616-32d4-4249-b618-ade565fdd642"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:07.307313 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] validate_networks() for [('a0208616-32d4-4249-b618-ade565fdd642', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:03:07.680975 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:03:07.681405 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:03:07.681874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:03:07.682279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:03:07.682689 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:03:07.692360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:07.692836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:07.693271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:07.693991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:07.694448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:07.694870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:07.711874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:03:07.717098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for user be072007df754e6ba88faf58d27f543e and project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:03:07.729095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:03:07.732213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:03:07.783922 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9907a5c1-175c-4359-86b4-d2587f8b374f tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536290 Oct 16 02:03:07.784809 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3530/7194] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:03:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:03:07.796438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-414c9035-d3fd-49e3-bcf9-6dc32f0e4172 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:07.797101 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-414c9035-d3fd-49e3-bcf9-6dc32f0e4172 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:07.856736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-414c9035-d3fd-49e3-bcf9-6dc32f0e4172 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:07.863792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-414c9035-d3fd-49e3-bcf9-6dc32f0e4172 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1263 microversion: 2.1 time: 0.071924 Oct 16 02:03:07.864379 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3665/7195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:07 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:08.889314 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:08.889950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:08.897059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:08.897545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:08.897981 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:08.898672 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:08.899158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:08.899587 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:08.963533 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:08.971371 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fff71e9a-b369-4458-9859-56098868664d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1315 microversion: 2.1 time: 0.087770 Oct 16 02:03:08.971952 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3531/7196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:08 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1315 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:09.996077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:09.997047 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:10.002994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:10.003508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:10.004000 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:10.004726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:10.005205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:10.005660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:10.140983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:10.148810 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca6823f9-327a-48a8-89b8-0159ee840119 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1363 microversion: 2.1 time: 0.157904 Oct 16 02:03:10.149394 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3666/7197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:09 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:10.361415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c8b40cd4-4f0f-4b07-b3f5-d96271e237c0 req-cae513cf-e4a5-483f-8ca2-90b146fd75a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bede3087-06d8-41b3-9d8a-de8fc7dca2e2", "tag": "300aeb31-f8cb-4d56-b9c7-e928b24696ec"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:10.372674 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c8b40cd4-4f0f-4b07-b3f5-d96271e237c0 req-cae513cf-e4a5-483f-8ca2-90b146fd75a1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:10.373221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c8b40cd4-4f0f-4b07-b3f5-d96271e237c0 req-cae513cf-e4a5-483f-8ca2-90b146fd75a1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:10.374285 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c8b40cd4-4f0f-4b07-b3f5-d96271e237c0 req-cae513cf-e4a5-483f-8ca2-90b146fd75a1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:10.386228 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c8b40cd4-4f0f-4b07-b3f5-d96271e237c0 req-cae513cf-e4a5-483f-8ca2-90b146fd75a1 service nova] Creating event network-changed:300aeb31-f8cb-4d56-b9c7-e928b24696ec for instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 on n-h1-master-1 Oct 16 02:03:10.392437 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c8b40cd4-4f0f-4b07-b3f5-d96271e237c0 req-cae513cf-e4a5-483f-8ca2-90b146fd75a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034736 Oct 16 02:03:10.393224 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3532/7198] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:11.173467 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:11.174099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:11.180993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:11.181497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:11.181954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:11.182668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:11.183176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:11.183641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:11.318011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:11.325772 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e3651a1a-5aef-4f55-89d7-5f2a63caa9e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1363 microversion: 2.1 time: 0.156337 Oct 16 02:03:11.326359 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3667/7199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:11 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:12.349864 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:12.350682 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:12.357190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:12.357683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:12.358119 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:12.358823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:12.359317 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:12.359744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:12.489754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:12.497482 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2b872176-b0c2-448c-9701-28e25f64ec3d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1363 microversion: 2.1 time: 0.152732 Oct 16 02:03:12.498068 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3533/7200] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:12 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:13.521079 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:13.521703 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:13.529280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:13.529777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:13.530228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:13.530949 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:13.531423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:13.531863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:13.662414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:13.670773 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e9e07e6a-3106-4fc0-95bd-7fd87e584508 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1363 microversion: 2.1 time: 0.153663 Oct 16 02:03:13.671374 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3668/7201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:13 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:14.693183 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:14.693803 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:14.700791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:14.701281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:14.701722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:14.702420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:14.702932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:14.703359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:14.838430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:14.847046 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bbf1d1ad-3fa3-4ca0-8fb4-f16356c9fded tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1363 microversion: 2.1 time: 0.157784 Oct 16 02:03:14.847624 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3534/7202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:14 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:03:15.870971 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:15.871622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:15.879991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:15.880495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:15.880943 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:15.881677 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:15.882132 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:15.882577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:15.974370 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fb0832f6-c781-45c3-bae6-8a4c2abb87ea req-6f06da60-f596-45c7-83b4-81e730434183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bede3087-06d8-41b3-9d8a-de8fc7dca2e2", "name": "network-vif-plugged", "status": "completed", "tag": "300aeb31-f8cb-4d56-b9c7-e928b24696ec"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:15.986474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fb0832f6-c781-45c3-bae6-8a4c2abb87ea req-6f06da60-f596-45c7-83b4-81e730434183 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:15.986969 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fb0832f6-c781-45c3-bae6-8a4c2abb87ea req-6f06da60-f596-45c7-83b4-81e730434183 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:15.987641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fb0832f6-c781-45c3-bae6-8a4c2abb87ea req-6f06da60-f596-45c7-83b4-81e730434183 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:16.002411 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fb0832f6-c781-45c3-bae6-8a4c2abb87ea req-6f06da60-f596-45c7-83b4-81e730434183 service nova] Creating event network-vif-plugged:300aeb31-f8cb-4d56-b9c7-e928b24696ec for instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 on n-h1-master-1 Oct 16 02:03:16.007561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fb0832f6-c781-45c3-bae6-8a4c2abb87ea req-6f06da60-f596-45c7-83b4-81e730434183 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036862 Oct 16 02:03:16.008530 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3535/7203] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:03:16.030023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:16.038064 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e937b5f8-c73a-4784-94fd-a15495041cb8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1363 microversion: 2.1 time: 0.170996 Oct 16 02:03:16.038657 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3669/7204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:15 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:17.064253 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:17.065071 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:17.071449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:17.071950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:17.072380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:17.073074 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:17.073536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:17.073964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:17.212594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:17.222180 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1de1f77b-94bd-4de6-aaad-839cb4d678c3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1363 microversion: 2.1 time: 0.164208 Oct 16 02:03:17.222762 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3536/7205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:17 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:18.245652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:18.246286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:18.249187 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:18.255214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:18.255725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:18.256227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:18.256939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:18.257417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:18.257862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:18.387694 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:18.395673 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-655bf8b0-4611-4e77-a378-5ff1899f9852 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1555 microversion: 2.1 time: 0.153965 Oct 16 02:03:18.396253 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3670/7206] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:18 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:18.417869 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:18.418488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:18.421017 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:18.421672 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:18.428469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:18.428954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:18.429393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:18.430083 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:18.430541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:18.430983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:18.571959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:18.580100 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-da885d32-ebda-44c0-9159-5ef31f5cd615 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1555 microversion: 2.1 time: 0.166013 Oct 16 02:03:18.580911 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3537/7207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:18 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:20.085496 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88288d0a-d752-4e66-9eaf-c11f9a7dbacf"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:20.087964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:20.095278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:20.095783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:20.096239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:20.096956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:20.097448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:20.097872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:20.384119 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c93abbbd-226e-42fb-8c27-b400278c220c tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303258 Oct 16 02:03:20.384748 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3671/7208] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 02:03:20 2022] POST /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:31.106286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:31.107321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:31.109539 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:31.110283 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:31.116882 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:31.117360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:31.117791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:31.118472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:31.118935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:31.119368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:31.203531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lazy-loading 'services' on Instance uuid bede3087-06d8-41b3-9d8a-de8fc7dca2e2 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:03:31.275309 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-08c5ff5b-d700-4b1e-92b5-2060c024d440 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments/88288d0a-d752-4e66-9eaf-c11f9a7dbacf" status: 202 len: 0 microversion: 2.1 time: 0.172362 Oct 16 02:03:31.275902 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3538/7209] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:03:31 2022] DELETE /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments/88288d0a-d752-4e66-9eaf-c11f9a7dbacf => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:03:31.284029 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:31.284859 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:31.289123 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:31.291530 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:31.300066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:31.300568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:31.301021 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:31.301731 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:31.302203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:31.302641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:31.335411 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8bec0738-94a8-455e-98fe-9598cf826fd4 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052980 Oct 16 02:03:31.335994 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3672/7210] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:03:31 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:32.349059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:32.351416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:32.359489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:32.359982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:32.360424 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:32.361124 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:32.361583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:32.362012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:32.392505 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3d2462b1-bf54-4c97-b55f-449f835b6322 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047819 Oct 16 02:03:32.393084 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3539/7211] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:03:32 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:33.405808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:33.408055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:33.415199 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:33.415704 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:33.416149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:33.416870 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:33.417337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:33.417775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:33.454466 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b8dc2a9c-0a5f-4eb7-b22d-1412b13239c0 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053384 Oct 16 02:03:33.455071 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3673/7212] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:03:33 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:34.467985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:34.470114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:34.477257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:34.477744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:34.478182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:34.478876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:34.479355 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:34.479780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:34.510140 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e25da00d-3efb-4891-860d-af87ec641069 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Oct 16 02:03:34.510711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3540/7213] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:03:34 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:35.521983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:35.524216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:35.531202 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:35.531701 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:35.532140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:35.532837 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:35.533300 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:35.533788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:35.567020 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-456fb218-837e-4116-ba2b-82aa22c9f71a tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049131 Oct 16 02:03:35.567616 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3674/7214] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:03:35 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:36.580430 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:36.582625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:36.589495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:36.589985 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:36.590427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:36.591154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:36.591610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:36.592037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:36.622386 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-026cf902-929d-435e-bc3d-2ca86800f05e tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046843 Oct 16 02:03:36.622970 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3541/7215] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:03:36 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 02:03:36.634318 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:36.634855 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:36.642832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:36.643353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:36.643801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:36.644497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:36.644965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:36.645401 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:36.803900 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] HTTP exception thrown: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 is not attached to volume 88288d0a-d752-4e66-9eaf-c11f9a7dbacf Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Request method failure captured: Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments/88288d0a-d752-4e66-9eaf-c11f9a7dbacf HTTP/1.1 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2YwHxfNOFtoOHGEj7Djy--QPSnLfNtR9wOlDrK-klITeWfC_LlwWIda6C5wfeL0G98iDs3ZAllFJktwjHSPPMgVnEbeR9kaazdA3kt05nWpxquwK2bj-JNulfIxjZQQW6TsefJNZ-_5Ig70aYhb51Mu6_rdEWh_weqy3sDfGkUqNWM Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8bf0ac8730fd471cb2ebb6168f341540", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: be072007df754e6ba88faf58d27f543e Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: exception: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 is not attached to volume 88288d0a-d752-4e66-9eaf-c11f9a7dbacf Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': 'bede3087-06d8-41b3-9d8a-de8fc7dca2e2', 'id': '88288d0a-d752-4e66-9eaf-c11f9a7dbacf'} Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 88288d0a-d752-4e66-9eaf-c11f9a7dbacf. Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 is not attached to volume 88288d0a-d752-4e66-9eaf-c11f9a7dbacf Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:03:36.805513 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:03:36.810328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:03:36.810328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:03:36.810328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 is not attached to volume 88288d0a-d752-4e66-9eaf-c11f9a7dbacf Oct 16 02:03:36.810328 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:36.810328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Returning 404 to user: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 is not attached to volume 88288d0a-d752-4e66-9eaf-c11f9a7dbacf {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:03:36.810328 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a6fa779d-236f-40ab-9e17-51d036266ab3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments/88288d0a-d752-4e66-9eaf-c11f9a7dbacf" status: 404 len: 154 microversion: 2.1 time: 0.176715 Oct 16 02:03:36.810328 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3675/7216] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:03:36 2022] DELETE /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2/os-volume_attachments/88288d0a-d752-4e66-9eaf-c11f9a7dbacf => generated 154 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:03:40.180340 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:40.180930 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:40.188323 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:40.188822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:40.189267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:40.189965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:40.190420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:40.190846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:40.218636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:03:40.299139 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b10aa2e8-807d-4e69-b08a-e0f3ba7c7047 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 204 len: 0 microversion: 2.1 time: 0.122331 Oct 16 02:03:40.300093 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3542/7217] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:03:40 2022] DELETE /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:03:40.308211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:40.309674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:40.318543 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:40.319171 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:40.319750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:40.320534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:40.321102 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:40.321598 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:40.452923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:40.460851 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d058f4d-3b83-4ffd-b53e-c90c944307f8 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1561 microversion: 2.1 time: 0.156577 Oct 16 02:03:40.461421 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3676/7218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:40 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:03:41.485748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:41.486441 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:41.493263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:41.493742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:41.494175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:41.494854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:41.495332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:41.495752 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:41.679000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:41.687232 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fbda35a6-6160-47e2-afc7-f323a775fdef tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1561 microversion: 2.1 time: 0.205926 Oct 16 02:03:41.687808 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3543/7219] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:41 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1561 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:42.458107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-e7dce2c4-6e77-4122-b874-5367786a5f24 req-300830d3-eb72-4c15-a6da-346aed6e5eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bede3087-06d8-41b3-9d8a-de8fc7dca2e2", "name": "network-vif-deleted", "tag": "300aeb31-f8cb-4d56-b9c7-e928b24696ec"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:42.470419 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e7dce2c4-6e77-4122-b874-5367786a5f24 req-300830d3-eb72-4c15-a6da-346aed6e5eeb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:42.470909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e7dce2c4-6e77-4122-b874-5367786a5f24 req-300830d3-eb72-4c15-a6da-346aed6e5eeb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:42.471370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-e7dce2c4-6e77-4122-b874-5367786a5f24 req-300830d3-eb72-4c15-a6da-346aed6e5eeb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:42.489935 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-e7dce2c4-6e77-4122-b874-5367786a5f24 req-300830d3-eb72-4c15-a6da-346aed6e5eeb service nova] Creating event network-vif-deleted:300aeb31-f8cb-4d56-b9c7-e928b24696ec for instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 on n-h1-master-1 Oct 16 02:03:42.494764 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-e7dce2c4-6e77-4122-b874-5367786a5f24 req-300830d3-eb72-4c15-a6da-346aed6e5eeb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040468 Oct 16 02:03:42.495443 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3677/7220] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:42.710825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:42.711459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:42.719022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:42.719509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:42.719937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:42.720637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:42.721089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:42.721509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:42.754999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:42.755489 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:42.755926 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:42.756384 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lazy-loading 'fault' on Instance uuid bede3087-06d8-41b3-9d8a-de8fc7dca2e2 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:03:42.803556 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:42.812104 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c71d805-321b-4aca-b620-fc2fea47fda3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 200 len: 1353 microversion: 2.1 time: 0.104765 Oct 16 02:03:42.812698 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3544/7221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:42 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 1353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:43.837385 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:43.838031 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: bede3087-06d8-41b3-9d8a-de8fc7dca2e2] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:43.844856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:43.845363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:43.845812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:43.846522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:43.847029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:43.847477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:43.861108 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] HTTP exception thrown: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 could not be found. Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Request method failure captured: Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 HTTP/1.1 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2YwHxfNOFtoOHGEj7Djy--QPSnLfNtR9wOlDrK-klITeWfC_LlwWIda6C5wfeL0G98iDs3ZAllFJktwjHSPPMgVnEbeR9kaazdA3kt05nWpxquwK2bj-JNulfIxjZQQW6TsefJNZ-_5Ig70aYhb51Mu6_rdEWh_weqy3sDfGkUqNWM Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8bf0ac8730fd471cb2ebb6168f341540", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: be072007df754e6ba88faf58d27f543e Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: exception: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 could not be found. Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'bede3087-06d8-41b3-9d8a-de8fc7dca2e2'} Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 could not be found. Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 could not be found. Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:03:43.862736 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 could not be found. Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Returning 404 to user: Instance bede3087-06d8-41b3-9d8a-de8fc7dca2e2 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb6b0ebe-e11a-45ad-acc7-d625ed3803e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2" status: 404 len: 111 microversion: 2.1 time: 0.032078 Oct 16 02:03:43.867722 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3678/7222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:43 2022] GET /compute/v2.1/servers/bede3087-06d8-41b3-9d8a-de8fc7dca2e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:03:43.872937 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a9adcf9b-a48f-4e83-81f5-89727043040d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '.version_select at 0x7fd64d0bd700>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:43.893509 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a9adcf9b-a48f-4e83-81f5-89727043040d tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1982611965" status: 202 len: 0 microversion: 2.1 time: 0.024409 Oct 16 02:03:43.894097 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3545/7223] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Oct 16 02:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1982611965 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:03:43.911910 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-543c9499-6e51-4bed-a4b4-60028eda5812 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: .version_select at 0x7fd64e080820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-402089251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLaNDc8mdCcMFfxJW4OAECQNew8Eh/9vdZqfMyhqJ2q/6+EYU5UzxUCekPWTy/GzVy635yIWKj2GNKT0o/waDnepR7sqjySBDNqrtOSDWXayeShUwRr+5mlt12lw1auwA=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:43.927471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-543c9499-6e51-4bed-a4b4-60028eda5812 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:03:43.933782 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-543c9499-6e51-4bed-a4b4-60028eda5812 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for user be072007df754e6ba88faf58d27f543e and project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:03:43.957250 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-543c9499-6e51-4bed-a4b4-60028eda5812 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049335 Oct 16 02:03:43.957848 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3679/7224] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:03:43 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:03:44.008020 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-11867892", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-402089251", "networks": [{"uuid": "a0208616-32d4-4249-b618-ade565fdd642"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:44.060271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] validate_networks() for [('a0208616-32d4-4249-b618-ade565fdd642', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:03:44.444466 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:03:44.444883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:03:44.445346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:03:44.445748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:03:44.446276 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:03:44.456009 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:44.456490 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:44.456924 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:44.457640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:44.458093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:44.458516 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:44.476347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:03:44.481389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Getting quotas for user be072007df754e6ba88faf58d27f543e and project 8bf0ac8730fd471cb2ebb6168f341540. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:03:44.493636 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:03:44.495975 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:03:44.543734 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-da182286-cd69-4edd-b463-ca39091bacbb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539963 Oct 16 02:03:44.550250 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3546/7225] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:03:44.556261 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c97da1a2-213c-4c89-9514-6fa67c325bd6 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:44.556907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c97da1a2-213c-4c89-9514-6fa67c325bd6 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:44.615085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c97da1a2-213c-4c89-9514-6fa67c325bd6 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:44.622247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c97da1a2-213c-4c89-9514-6fa67c325bd6 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1260 microversion: 2.1 time: 0.070054 Oct 16 02:03:44.622827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3680/7226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:44 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1260 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:45.648502 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:45.649411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:45.657678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:45.658167 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:45.658599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:45.660199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:45.660199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:45.660199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:45.736432 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:45.744637 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-10da0bb8-90d3-4df5-b3d9-3eb025732952 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1320 microversion: 2.1 time: 0.102589 Oct 16 02:03:45.753225 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3547/7227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:45 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1320 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:46.769457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:46.770085 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:46.776897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:46.777403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:46.777855 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:46.778573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:46.779075 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:46.779524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:46.912833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:46.921809 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a9796dd8-6e3a-4c61-af57-7a7927ee89dc tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1360 microversion: 2.1 time: 0.155813 Oct 16 02:03:46.926967 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3681/7228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:46 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:47.052982 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6e2db3d9-2290-450f-ae57-d93303fbdf7b req-aba18ac0-8459-4013-9094-393d72039b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6511b5c0-8268-4300-b6ec-92756fc567b8", "tag": "d8c47dcf-8961-44a1-b9f6-0735a3433c50"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:47.068514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6e2db3d9-2290-450f-ae57-d93303fbdf7b req-aba18ac0-8459-4013-9094-393d72039b2a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:47.069004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6e2db3d9-2290-450f-ae57-d93303fbdf7b req-aba18ac0-8459-4013-9094-393d72039b2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:47.069467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6e2db3d9-2290-450f-ae57-d93303fbdf7b req-aba18ac0-8459-4013-9094-393d72039b2a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:47.081309 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6e2db3d9-2290-450f-ae57-d93303fbdf7b req-aba18ac0-8459-4013-9094-393d72039b2a service nova] Creating event network-changed:d8c47dcf-8961-44a1-b9f6-0735a3433c50 for instance 6511b5c0-8268-4300-b6ec-92756fc567b8 on n-h1-master-1 Oct 16 02:03:47.086098 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6e2db3d9-2290-450f-ae57-d93303fbdf7b req-aba18ac0-8459-4013-9094-393d72039b2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041434 Oct 16 02:03:47.086953 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3548/7229] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:03:47.945673 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:47.946217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:47.953926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:47.954432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:47.954881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:47.955629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:47.956098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:47.956535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:48.093659 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:48.101353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d39b7226-694d-44dd-8a25-b8c402dfb3f3 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1360 microversion: 2.1 time: 0.159735 Oct 16 02:03:48.101937 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3682/7230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:47 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:49.125606 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:49.126322 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:49.132504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:49.132987 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:49.133426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:49.134116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:49.134569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:49.135022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:49.265447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:49.273107 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-16fd582a-482c-4f50-b4bb-4a42b9abf4a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1360 microversion: 2.1 time: 0.152720 Oct 16 02:03:49.273688 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3549/7231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:49 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:50.296051 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:50.296724 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:50.303935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:50.304442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:50.304897 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:50.305612 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:50.306093 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:50.306538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:50.439838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:50.447678 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82a10c51-eb60-454c-8aba-8927bc0a3421 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1360 microversion: 2.1 time: 0.155722 Oct 16 02:03:50.448462 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3683/7232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:50 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:51.469997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:51.470637 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:51.476894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:51.477378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:51.477814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:51.478506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:51.479026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:51.479491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:51.609433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:51.617350 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-357a8a34-8375-4255-a98c-2d7e9454277b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1360 microversion: 2.1 time: 0.151628 Oct 16 02:03:51.617917 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3550/7233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:51 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:52.142863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f15f51f6-0799-4208-9c16-2a6c328756f1 req-d6df82a5-151c-4b7e-bb55-eb2a7c0ee61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6511b5c0-8268-4300-b6ec-92756fc567b8", "name": "network-vif-plugged", "status": "completed", "tag": "d8c47dcf-8961-44a1-b9f6-0735a3433c50"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:52.153729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f15f51f6-0799-4208-9c16-2a6c328756f1 req-d6df82a5-151c-4b7e-bb55-eb2a7c0ee61b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:52.154233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f15f51f6-0799-4208-9c16-2a6c328756f1 req-d6df82a5-151c-4b7e-bb55-eb2a7c0ee61b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:52.155330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f15f51f6-0799-4208-9c16-2a6c328756f1 req-d6df82a5-151c-4b7e-bb55-eb2a7c0ee61b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:52.168353 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f15f51f6-0799-4208-9c16-2a6c328756f1 req-d6df82a5-151c-4b7e-bb55-eb2a7c0ee61b service nova] Creating event network-vif-plugged:d8c47dcf-8961-44a1-b9f6-0735a3433c50 for instance 6511b5c0-8268-4300-b6ec-92756fc567b8 on n-h1-master-1 Oct 16 02:03:52.173537 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f15f51f6-0799-4208-9c16-2a6c328756f1 req-d6df82a5-151c-4b7e-bb55-eb2a7c0ee61b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035158 Oct 16 02:03:52.174241 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3684/7234] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:03:52.641400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:52.642000 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:52.649069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:52.649559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:52.649995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:52.650687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:52.651169 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:52.651598 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:52.786479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:52.794289 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5c9f63f5-9a7c-4b1a-bbd5-093173847945 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1360 microversion: 2.1 time: 0.157882 Oct 16 02:03:52.794905 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3551/7235] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:52 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:53.820348 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:53.820976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:53.827907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:53.828407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:53.828859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:53.829570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:53.830042 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:53.830483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:53.960547 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:53.968459 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0ec92841-d425-4a58-b7c8-f99d95318bca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1552 microversion: 2.1 time: 0.153471 Oct 16 02:03:53.969037 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3685/7236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:53 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:53.991457 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:03:53.992068 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:53.999826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:54.000316 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:54.000760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:54.001453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:54.001913 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:54.002340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:54.131850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:03:54.140098 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-23c2485e-a264-47ea-b0f4-7757f4b94455 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1552 microversion: 2.1 time: 0.152434 Oct 16 02:03:54.140679 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3552/7237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:03:53 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:03:55.641755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:03:55.644223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:03:55.646180 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:03:55.652292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:55.652825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:55.653279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:55.653988 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:03:55.655165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:03:55.655705 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:03:55.920221 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-319e5ad4-6743-400e-a950-b7183886163b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "POST /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282890 Oct 16 02:03:55.920892 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3686/7238] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 02:03:55 2022] POST /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:04:06.635779 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:06.636316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:06.638195 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:06.639471 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:06.641325 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:06.642011 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:06.649912 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:06.650405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:06.650837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:06.651561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:06.652010 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:06.652433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:06.740156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lazy-loading 'services' on Instance uuid 6511b5c0-8268-4300-b6ec-92756fc567b8 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:04:06.815021 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8bd7d45-dbb1-4757-ae82-3366349dfc77 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments/dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48" status: 202 len: 0 microversion: 2.1 time: 0.182936 Oct 16 02:04:06.815626 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3553/7239] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:04:06 2022] DELETE /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments/dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:04:06.822410 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:06.823268 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:06.828078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:06.830976 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:06.839084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:06.839606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:06.840057 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:06.840771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:06.841247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:06.841689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:06.874025 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-447b4c05-2150-41b2-9fc5-c0c15363044b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053516 Oct 16 02:04:06.874598 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3687/7240] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:04:06 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:04:07.887334 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:07.889691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:07.897505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:07.898214 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:07.898941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:07.900129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:07.900760 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:07.901192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:07.935058 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f79fdddb-8b53-4fae-b485-ccd452e9f3ca tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052061 Oct 16 02:04:07.936054 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3554/7241] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:04:07 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:04:08.948018 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:08.950226 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:08.957646 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:08.958140 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:08.958586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:08.959318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:08.959787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:08.960220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:08.994304 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2dc8c146-fd16-4c99-a53f-abc9c5bf15a7 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050233 Oct 16 02:04:08.995017 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3688/7242] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:04:08 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:04:10.007213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:10.009475 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:10.016268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:10.016756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:10.017198 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:10.020487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:10.020986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:10.021436 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:10.052331 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-47a2bd1c-7c8b-4055-8f60-4a9cbfc2e765 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049088 Oct 16 02:04:10.052902 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3555/7243] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:04:10 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:04:11.067283 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:11.070127 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:11.078840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:11.079515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:11.080189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:11.081533 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:11.082082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:11.082702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:11.115728 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-194f9258-e80a-4394-b456-3a47e07049e2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055030 Oct 16 02:04:11.116602 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3689/7244] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:04:11 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:04:12.129226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:12.131470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:12.138286 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:12.138772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:12.139251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:12.139949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:12.140409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:12.140838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:12.169466 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f06117e8-9aa4-4ed3-8c4b-9645919afa4b tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044983 Oct 16 02:04:12.170032 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3556/7245] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:04:12 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 02:04:12.181266 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:12.181771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:12.188790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:12.189285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:12.190983 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:12.191695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:12.192165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:12.192601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:12.268924 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] HTTP exception thrown: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 is not attached to volume dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Request method failure captured: Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments/dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48 HTTP/1.1 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2YwHxfNOFtoOHGEj7Djy--QPSnLfNtR9wOlDrK-klITeWfC_LlwWIda6C5wfeL0G98iDs3ZAllFJktwjHSPPMgVnEbeR9kaazdA3kt05nWpxquwK2bj-JNulfIxjZQQW6TsefJNZ-_5Ig70aYhb51Mu6_rdEWh_weqy3sDfGkUqNWM Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8bf0ac8730fd471cb2ebb6168f341540", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: be072007df754e6ba88faf58d27f543e Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 is not attached to volume dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': '6511b5c0-8268-4300-b6ec-92756fc567b8', 'id': 'dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48'} Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48. Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 is not attached to volume dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48 Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:04:12.270540 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:04:12.275331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:04:12.275331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:04:12.275331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 is not attached to volume dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48 Oct 16 02:04:12.275331 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:12.275331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Returning 404 to user: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 is not attached to volume dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:04:12.275331 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f5d6504f-5dbd-4bb5-a224-6b05420f1adf tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments/dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48" status: 404 len: 154 microversion: 2.1 time: 0.094802 Oct 16 02:04:12.275331 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3690/7246] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:04:12 2022] DELETE /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8/os-volume_attachments/dcaf7237-dc7f-47c2-ad45-27a8ac9a8e48 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:04:15.632914 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:15.633516 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:15.640523 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:15.641017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:15.641465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:15.642170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:15.642625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:15.643075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:15.673244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:04:15.755472 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b345e2df-b6e8-4aa5-af8f-45e42b9ca188 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 204 len: 0 microversion: 2.1 time: 0.126070 Oct 16 02:04:15.756544 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3557/7247] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:04:15 2022] DELETE /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:04:15.766161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:15.766709 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:15.776601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:15.777201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:15.777714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:15.778589 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:15.779155 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:15.779659 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:15.919740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:15.928019 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-051823d3-5f66-4d27-b47f-7e770a244ccb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1558 microversion: 2.1 time: 0.167102 Oct 16 02:04:15.928599 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3691/7248] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:15 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:16.952371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:16.953065 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:16.959961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:16.960433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:16.960859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:16.961539 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:16.961989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:16.962410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:17.092605 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:17.101056 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-42a493ec-1d1c-4f52-9bad-dbfcf90ee5fb tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1558 microversion: 2.1 time: 0.152925 Oct 16 02:04:17.101625 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3558/7249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:16 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:17.955180 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a532a8ff-e419-4956-a82a-330e4f60a233 req-2ff0cfde-01ac-47bb-9baa-99c3501c6681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6511b5c0-8268-4300-b6ec-92756fc567b8", "name": "network-vif-deleted", "tag": "d8c47dcf-8961-44a1-b9f6-0735a3433c50"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:04:17.965730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a532a8ff-e419-4956-a82a-330e4f60a233 req-2ff0cfde-01ac-47bb-9baa-99c3501c6681 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:17.966252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a532a8ff-e419-4956-a82a-330e4f60a233 req-2ff0cfde-01ac-47bb-9baa-99c3501c6681 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:17.966696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a532a8ff-e419-4956-a82a-330e4f60a233 req-2ff0cfde-01ac-47bb-9baa-99c3501c6681 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:17.978431 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a532a8ff-e419-4956-a82a-330e4f60a233 req-2ff0cfde-01ac-47bb-9baa-99c3501c6681 service nova] Creating event network-vif-deleted:d8c47dcf-8961-44a1-b9f6-0735a3433c50 for instance 6511b5c0-8268-4300-b6ec-92756fc567b8 on n-h1-master-1 Oct 16 02:04:17.983392 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a532a8ff-e419-4956-a82a-330e4f60a233 req-2ff0cfde-01ac-47bb-9baa-99c3501c6681 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097957 Oct 16 02:04:17.983993 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3692/7250] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:04:18.125034 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:18.125651 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:18.132801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:18.133292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:18.133739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:18.134578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:18.134898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:18.135351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:18.168123 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:18.168623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:18.169028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:18.169483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lazy-loading 'fault' on Instance uuid 6511b5c0-8268-4300-b6ec-92756fc567b8 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:04:18.211044 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be072007df754e6ba88faf58d27f543e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf0ac8730fd471cb2ebb6168f341540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:18.219102 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6b5d040b-d7d1-45a9-ab49-6cf6a0a23351 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 200 len: 1350 microversion: 2.1 time: 0.097888 Oct 16 02:04:18.219686 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3559/7251] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:18 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:19.244640 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:19.245355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] [instance: 6511b5c0-8268-4300-b6ec-92756fc567b8] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:19.251568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:19.252066 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:19.252516 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:19.253255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:19.253725 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:19.254168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:19.267796 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] HTTP exception thrown: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 could not be found. Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Request method failure captured: Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 HTTP/1.1 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2YwHxfNOFtoOHGEj7Djy--QPSnLfNtR9wOlDrK-klITeWfC_LlwWIda6C5wfeL0G98iDs3ZAllFJktwjHSPPMgVnEbeR9kaazdA3kt05nWpxquwK2bj-JNulfIxjZQQW6TsefJNZ-_5Ig70aYhb51Mu6_rdEWh_weqy3sDfGkUqNWM Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8bf0ac8730fd471cb2ebb6168f341540", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8bf0ac8730fd471cb2ebb6168f341540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 8bf0ac8730fd471cb2ebb6168f341540 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-489806263 Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: be072007df754e6ba88faf58d27f543e Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestEncryptedCinderVolumes-489806263-project Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 could not be found. Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6511b5c0-8268-4300-b6ec-92756fc567b8'} Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 could not be found. Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 could not be found. Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:04:19.269498 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 could not be found. Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Returning 404 to user: Instance 6511b5c0-8268-4300-b6ec-92756fc567b8 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b90a8661-3169-4417-9d16-9347af157356 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8" status: 404 len: 111 microversion: 2.1 time: 0.031483 Oct 16 02:04:19.274681 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3693/7252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:19 2022] GET /compute/v2.1/servers/6511b5c0-8268-4300-b6ec-92756fc567b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:04:19.279746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-98c70317-455a-4f08-b037-f247d502f1b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] Calling method '.version_select at 0x7fd64e1d4820>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:19.299582 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-98c70317-455a-4f08-b037-f247d502f1b2 tempest-TestEncryptedCinderVolumes-489806263 tempest-TestEncryptedCinderVolumes-489806263-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-402089251" status: 202 len: 0 microversion: 2.1 time: 0.023648 Oct 16 02:04:19.301413 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3560/7253] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Oct 16 02:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-402089251 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 02:04:46.584420 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-82863a9d-0526-44e6-9443-61af8326a0f9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'create', calling method: .version_select at 0x7fd64ddc84c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1521517944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdE46FW65XmavEVbMy02U7wEiIrEnox+uKGNolFv1jkQDnZELpfF+uT1k5kQxh3Fcb5cvyDpKidOqM+V4s6k1JccJId0sSukQtCKSAGPLVMqq79cW7rAGYFeT+bdD625A=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:04:46.590200 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=14 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:46.590845 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=34 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:46.604393 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-82863a9d-0526-44e6-9443-61af8326a0f9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Getting quotas for project 32a38ba59a1e47b589ff171e62a00b13. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:04:46.609439 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-82863a9d-0526-44e6-9443-61af8326a0f9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Getting quotas for user e06c1f399bf04625baf6b8633cc8dd1b and project 32a38ba59a1e47b589ff171e62a00b13. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:04:46.633131 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-82863a9d-0526-44e6-9443-61af8326a0f9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053985 Oct 16 02:04:46.633723 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3694/7254] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:04:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:04:46.682712 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:46.683484 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:46.687973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2061943134", "imageRef": "c07c8828-24cf-4682-829f-6bb13cb2ae78", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1521517944", "networks": [{"uuid": "c7f3e504-37e1-46c3-a0df-96b0ebfc0c17"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:04:46.743509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] validate_networks() for [('c7f3e504-37e1-46c3-a0df-96b0ebfc0c17', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:04:47.224783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:04:47.225205 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:04:47.225672 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:04:47.226077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:04:47.226478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:04:47.235232 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:47.235651 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:47.236088 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:47.237692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:47.238149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:47.238592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:47.256007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Getting quotas for project 32a38ba59a1e47b589ff171e62a00b13. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:04:47.261150 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Getting quotas for user e06c1f399bf04625baf6b8633cc8dd1b and project 32a38ba59a1e47b589ff171e62a00b13. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:04:47.273590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:04:47.275800 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c07c8828-24cf-4682-829f-6bb13cb2ae78',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:04:47.320728 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2cb727f8-7188-4afc-b0b7-04d1d19c7027 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639946 Oct 16 02:04:47.321580 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3561/7255] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 16 02:04:47.333071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e9ad92cc-c65c-4b5a-811e-ec09df39147c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:47.333698 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e9ad92cc-c65c-4b5a-811e-ec09df39147c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:47.388982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e9ad92cc-c65c-4b5a-811e-ec09df39147c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:47.396660 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e9ad92cc-c65c-4b5a-811e-ec09df39147c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1259 microversion: 2.1 time: 0.068085 Oct 16 02:04:47.397242 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3695/7256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:47 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:04:48.420263 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:48.420935 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:48.428940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:48.429779 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:48.430448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:48.431194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:48.431697 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:48.432136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:48.507033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:48.515267 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fb2c2876-e06d-4c0a-b808-d4e3f1376499 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1319 microversion: 2.1 time: 0.099879 Oct 16 02:04:48.516075 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3562/7257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:48 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:49.541053 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:49.541621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:49.549060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:49.549953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:49.550624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:49.551404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:49.551876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:49.552315 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:49.703614 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:49.712605 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a4a6f652-ae63-4507-a183-15458ae38a0b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.175534 Oct 16 02:04:49.715374 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3696/7258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:49 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:50.736189 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:50.738625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:50.746140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:50.746735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:50.747268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:50.748404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:50.748935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:50.749374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:50.889093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:50.896982 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c0ceeca1-c435-4b5f-b975-901140c63cb4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.164851 Oct 16 02:04:50.897578 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3563/7259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:50 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:51.920731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:51.921311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:51.928968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:51.929631 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:51.930278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:51.931128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:51.931661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:51.932257 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:52.101633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:52.109675 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-16d4c853-3343-4bca-806d-9677d0dda3ce tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.192931 Oct 16 02:04:52.110467 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3697/7260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:51 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:53.134674 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:53.135508 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:53.142790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:53.144038 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:53.144542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:53.145240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:53.145694 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:53.146114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:53.301858 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:53.310773 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-be9a113b-7634-4195-9b8a-8b21c95ebcf2 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.180763 Oct 16 02:04:53.311388 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3564/7261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:53 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:54.335653 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:54.336282 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:54.344170 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:54.344668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:54.345178 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:54.345887 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:54.346591 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:54.348767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:54.487437 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:54.496901 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89dbe87c-af96-40b3-9bfd-969202173b35 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.165632 Oct 16 02:04:54.498383 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3698/7262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:54 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:55.523570 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:55.524485 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:55.531869 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:55.532567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:55.533023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:55.534348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:55.534817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:55.535284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:55.687089 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:55.696261 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-64a5ac8b-351f-40c9-bdc7-6c8dfcb3cc87 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.178749 Oct 16 02:04:55.697237 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3565/7263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:55 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:56.722312 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:56.722960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:56.730875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:56.731532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:56.732702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:56.733022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:56.733260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:56.733702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:56.865140 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:56.872765 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d1fb0b73-f3e6-4c06-97b5-1f541d991a50 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.155110 Oct 16 02:04:56.873342 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3699/7264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:56 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:57.759531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-84371faa-f87f-45cd-a6c4-d830074429ef req-d6fb7bf8-04c3-4b9c-a001-39c7c1f52a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6abb2b-3441-4f51-9b5e-493d56d66a3e", "tag": "300d97d5-8fd7-467f-843a-427d7018f4d0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:04:57.766206 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:57.767026 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:57.773725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-84371faa-f87f-45cd-a6c4-d830074429ef req-d6fb7bf8-04c3-4b9c-a001-39c7c1f52a89 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:57.774204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-84371faa-f87f-45cd-a6c4-d830074429ef req-d6fb7bf8-04c3-4b9c-a001-39c7c1f52a89 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:57.774719 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-84371faa-f87f-45cd-a6c4-d830074429ef req-d6fb7bf8-04c3-4b9c-a001-39c7c1f52a89 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:57.787585 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-84371faa-f87f-45cd-a6c4-d830074429ef req-d6fb7bf8-04c3-4b9c-a001-39c7c1f52a89 service nova] Creating event network-changed:300d97d5-8fd7-467f-843a-427d7018f4d0 for instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e on n-h1-master-1 Oct 16 02:04:57.792778 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-84371faa-f87f-45cd-a6c4-d830074429ef req-d6fb7bf8-04c3-4b9c-a001-39c7c1f52a89 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037779 Oct 16 02:04:57.794214 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3566/7265] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:04:57.896979 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:57.897635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:57.899514 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:04:57.905881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:57.906385 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:57.906838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:57.907579 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:57.908110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:57.908551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:58.045125 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:58.053976 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5f47cba3-b7eb-4f36-9d35-c05795c3bc98 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.161931 Oct 16 02:04:58.054563 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3700/7266] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:57 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:04:59.079559 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:04:59.081093 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:04:59.088860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:59.089437 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:59.090105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:59.091075 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:04:59.091665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:04:59.092175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:04:59.246460 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:04:59.254351 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c28d1953-3913-4eb5-8956-1e590a23e6b8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.180282 Oct 16 02:04:59.254954 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3567/7267] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:04:59 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:00.277704 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:00.278328 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:00.285539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:00.286033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:00.286477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:00.287207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:00.287676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:00.288113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:00.420485 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:00.428944 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f487c1e9-0a40-4a8a-9ddc-faeac61ca0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.155141 Oct 16 02:05:00.429518 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3701/7268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:00 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:01.451805 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:01.452418 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:01.459946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:01.460428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:01.460856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:01.461538 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:01.462270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:01.462707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:01.592016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:01.600458 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1890d398-aa7c-42d4-8d94-3a812475fcf0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.152521 Oct 16 02:05:01.601042 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3568/7269] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:01 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:02.624981 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:02.625575 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:02.632412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:02.634460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:02.635028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:02.635759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:02.636237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:02.636676 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:02.763194 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f7a0f76f-95e8-44a3-8cb2-8ea3d5ddb835 req-e8250040-ddaa-4ba4-a190-c085ef4836d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6abb2b-3441-4f51-9b5e-493d56d66a3e", "name": "network-vif-plugged", "status": "completed", "tag": "300d97d5-8fd7-467f-843a-427d7018f4d0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:05:02.773267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7a0f76f-95e8-44a3-8cb2-8ea3d5ddb835 req-e8250040-ddaa-4ba4-a190-c085ef4836d1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:02.773885 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7a0f76f-95e8-44a3-8cb2-8ea3d5ddb835 req-e8250040-ddaa-4ba4-a190-c085ef4836d1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:02.774312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f7a0f76f-95e8-44a3-8cb2-8ea3d5ddb835 req-e8250040-ddaa-4ba4-a190-c085ef4836d1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:02.783264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:02.786287 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f7a0f76f-95e8-44a3-8cb2-8ea3d5ddb835 req-e8250040-ddaa-4ba4-a190-c085ef4836d1 service nova] Creating event network-vif-plugged:300d97d5-8fd7-467f-843a-427d7018f4d0 for instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e on n-h1-master-1 Oct 16 02:05:02.791870 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f7a0f76f-95e8-44a3-8cb2-8ea3d5ddb835 req-e8250040-ddaa-4ba4-a190-c085ef4836d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163495 Oct 16 02:05:02.792052 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-233957d1-56cc-442d-aa1d-df18b7baff18 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.171333 Oct 16 02:05:02.792529 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3702/7271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:02 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:02.792651 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3569/7271] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:05:03.816883 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:03.817549 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:03.824370 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:03.824872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:03.825325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:03.826033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:03.826507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:03.826976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:03.964877 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:03.972999 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4b34e137-fe71-44a4-99d6-1bf12659b823 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1359 microversion: 2.1 time: 0.160928 Oct 16 02:05:03.973560 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3703/7272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:03 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:04.998101 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:04.998885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:05.005999 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:05.006790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:05.007567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:05.008638 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:05.009561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:05.010252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:05.143007 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:05.151334 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d0d352bb-2acc-4b8b-91d4-e33789cb5759 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1549 microversion: 2.1 time: 0.158280 Oct 16 02:05:05.151925 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3570/7273] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:04 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:05.174299 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:05.175615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:05.182284 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:05.182775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:05.183251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:05.183948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:05.184417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:05.184850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:05.317771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:05.325718 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc44b72c-ca8a-4034-8e37-19d7fac84438 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1549 microversion: 2.1 time: 0.155245 Oct 16 02:05:05.326301 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3704/7274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:05 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:05.347842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:05.352492 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:05.353241 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Searching by: {'deleted': False, 'project_id': '32a38ba59a1e47b589ff171e62a00b13'} {{(pid=120546) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 02:05:05.358491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:05.359012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:05.359578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:05.360300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:05.360751 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:05.361172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:05.389923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.multi_cell_list [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120546) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 02:05:05.419166 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e904bf40-1fbe-42e0-b883-fb2cc50d6552 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.075283 Oct 16 02:05:05.419756 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3571/7275] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 02:05:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:05:05.431827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:05.432457 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:05.438607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:05.439145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:05.439596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:05.440383 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:05.440917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:05.441357 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:05.567805 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:05.575479 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0aacfab5-2d44-4e97-9fd3-7919ad6c1bb5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1549 microversion: 2.1 time: 0.147599 Oct 16 02:05:05.576053 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3705/7276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:05 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:07.139249 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7482e94c-39d9-4e67-bbad-95eb0ca17241"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:05:07.141580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:07.148445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:07.148935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:07.149376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:07.150082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:07.150546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:07.151003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:07.420540 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d989da11-7194-441f-8de6-d6a2cc821d29 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285067 Oct 16 02:05:07.421104 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3572/7277] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 02:05:07 2022] POST /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:05:20.467454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:20.468077 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:20.470557 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:05:20.471377 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:05:20.471577 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 02:05:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e (ip 10.222.0.39) !!! Oct 16 02:05:20.474527 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=60 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:05:20.483471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:20.483975 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:20.484430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:20.485152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:20.485632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:20.486078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:20.618567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:20.626905 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8108ebf6-b8b0-4790-94b3-9bcfea79b4ef tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1595 microversion: 2.1 time: 0.163719 Oct 16 02:05:20.627504 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3706/7278] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:20 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1595 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:05:22.663244 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:05:22.664013 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:05:22.664863 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:05:22.734985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-166aa800-b3f4-45ff-9195-a9c8fb7b7731 req-a87d1a51-750b-436a-9839-b3a4fb602e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6abb2b-3441-4f51-9b5e-493d56d66a3e", "tag": "300d97d5-8fd7-467f-843a-427d7018f4d0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:05:22.746254 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-166aa800-b3f4-45ff-9195-a9c8fb7b7731 req-a87d1a51-750b-436a-9839-b3a4fb602e8b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:22.746746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-166aa800-b3f4-45ff-9195-a9c8fb7b7731 req-a87d1a51-750b-436a-9839-b3a4fb602e8b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:22.747234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-166aa800-b3f4-45ff-9195-a9c8fb7b7731 req-a87d1a51-750b-436a-9839-b3a4fb602e8b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:22.760318 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-166aa800-b3f4-45ff-9195-a9c8fb7b7731 req-a87d1a51-750b-436a-9839-b3a4fb602e8b service nova] Creating event network-changed:300d97d5-8fd7-467f-843a-427d7018f4d0 for instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e on n-h1-master-1 Oct 16 02:05:22.765524 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-166aa800-b3f4-45ff-9195-a9c8fb7b7731 req-a87d1a51-750b-436a-9839-b3a4fb602e8b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108449 Oct 16 02:05:22.766216 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3573/7279] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:05:23.927595 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-568358883"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:05:23.928290 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:23.935341 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:23.935877 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:23.936333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:23.937307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:23.937786 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:23.938233 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:24.066899 n-d-master-1 devstack@n-api.service[120545]: INFO nova.network.security_group_api [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Adding security group 79caf233-8d13-4cb8-af27-cd28d6b0011d to port 300d97d5-8fd7-467f-843a-427d7018f4d0 Oct 16 02:05:24.388194 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5712b987-37d8-40bd-8a20-45c473803b5c tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.465083 Oct 16 02:05:24.389293 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3707/7280] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:05:23 2022] POST /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:05:24.400012 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:05:24.400742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:05:24.407494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:24.407976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:24.408410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:24.409337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:24.410314 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:24.411852 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:24.567976 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:05:24.577576 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b5b71476-8595-4be4-9755-60be6a020291 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1758 microversion: 2.1 time: 0.183762 Oct 16 02:05:24.578150 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3574/7281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:05:24 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:05:24.780426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f3a76d05-23af-42d9-bef4-d48cfa78fafa req-a4f4a4c5-821c-49e5-b7ee-e8d6364a5f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6abb2b-3441-4f51-9b5e-493d56d66a3e", "tag": "300d97d5-8fd7-467f-843a-427d7018f4d0"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:05:24.789942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f3a76d05-23af-42d9-bef4-d48cfa78fafa req-a4f4a4c5-821c-49e5-b7ee-e8d6364a5f89 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:05:24.790460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f3a76d05-23af-42d9-bef4-d48cfa78fafa req-a4f4a4c5-821c-49e5-b7ee-e8d6364a5f89 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:05:24.790895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f3a76d05-23af-42d9-bef4-d48cfa78fafa req-a4f4a4c5-821c-49e5-b7ee-e8d6364a5f89 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:05:24.803811 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f3a76d05-23af-42d9-bef4-d48cfa78fafa req-a4f4a4c5-821c-49e5-b7ee-e8d6364a5f89 service nova] Creating event network-changed:300d97d5-8fd7-467f-843a-427d7018f4d0 for instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e on n-h1-master-1 Oct 16 02:05:24.809343 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f3a76d05-23af-42d9-bef4-d48cfa78fafa req-a4f4a4c5-821c-49e5-b7ee-e8d6364a5f89 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 Oct 16 02:05:24.809994 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3708/7282] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:07:02.145788 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:07:02.146528 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:07:02.148855 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:07:02.149147 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:07:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/action (ip 10.222.0.39) !!! Oct 16 02:07:02.153821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:07:02.156110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:07:02.166477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:07:02.166980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:07:02.167415 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:07:02.168100 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:07:02.168553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:07:02.168976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:07:02.243428 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-17f1b558-a81c-4937-af5e-62579dbc1ab3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.099362 Oct 16 02:07:02.244070 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3575/7283] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:07:02 2022] POST /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:07:02.251798 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:07:02.252561 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=12 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:07:02.258893 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:07:02.259735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:07:02.268414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:07:02.268923 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:07:02.269378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:07:02.270100 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:07:02.270576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:07:02.271056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:07:02.423305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:07:02.432263 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-096482bc-5a41-46d5-9110-5076e4137865 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1760 microversion: 2.1 time: 0.183416 Oct 16 02:07:02.433040 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3709/7284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:07:02 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1760 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:07:03.454558 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:07:03.455116 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e (ip 10.222.0.39) !!! Oct 16 02:07:03.461008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:07:03.461695 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:07:03.473906 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:07:03.474395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:07:03.474877 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:07:03.475749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:07:03.476141 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:07:03.476571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:07:03.625153 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:07:03.634295 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f046d37e-70a8-4e12-ad2e-c3540a442561 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1758 microversion: 2.1 time: 0.181200 Oct 16 02:07:03.634817 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3576/7285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:07:03 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:08:16.239174 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:16.239934 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:16.244178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-568358883"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:08:16.244734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:16.251456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:16.251959 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:16.252410 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:16.253115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:16.253594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:16.254036 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:16.380247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.network.security_group_api [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Removing security group 79caf233-8d13-4cb8-af27-cd28d6b0011d from port 300d97d5-8fd7-467f-843a-427d7018f4d0 Oct 16 02:08:16.684412 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1363f722-1a79-4b97-ac47-ca87ffd45e15 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.447003 Oct 16 02:08:16.685081 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3710/7286] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:08:16 2022] POST /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:08:16.691871 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:16.692630 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:16.697310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fc31cfc9-5cf3-4d82-ad4b-dfeb300ca518 req-fd791dbc-3afb-4741-a125-8ee0852fb3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6abb2b-3441-4f51-9b5e-493d56d66a3e", "tag": "300d97d5-8fd7-467f-843a-427d7018f4d0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:08:16.709555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fc31cfc9-5cf3-4d82-ad4b-dfeb300ca518 req-fd791dbc-3afb-4741-a125-8ee0852fb3b2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:16.710044 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fc31cfc9-5cf3-4d82-ad4b-dfeb300ca518 req-fd791dbc-3afb-4741-a125-8ee0852fb3b2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:16.710477 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fc31cfc9-5cf3-4d82-ad4b-dfeb300ca518 req-fd791dbc-3afb-4741-a125-8ee0852fb3b2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:16.725662 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fc31cfc9-5cf3-4d82-ad4b-dfeb300ca518 req-fd791dbc-3afb-4741-a125-8ee0852fb3b2 service nova] Creating event network-changed:300d97d5-8fd7-467f-843a-427d7018f4d0 for instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e on n-h1-master-1 Oct 16 02:08:16.732728 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fc31cfc9-5cf3-4d82-ad4b-dfeb300ca518 req-fd791dbc-3afb-4741-a125-8ee0852fb3b2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044613 Oct 16 02:08:16.733689 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3577/7287] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:08:17.840714 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:17.841279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:17.847253 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:17.847764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:17.848218 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:17.848936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:17.849416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:17.849864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:17.936270 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lazy-loading 'services' on Instance uuid 8e6abb2b-3441-4f51-9b5e-493d56d66a3e {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:08:18.008302 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [4cac0ff4-e6c3-47e7-8e35-031e267a4b03] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 16 02:08:18.749295 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-f6b2fc1f-78f4-42b7-940b-62502f494c45 req-2f2e6497-730f-4af5-806d-0851c5f6582b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6abb2b-3441-4f51-9b5e-493d56d66a3e", "tag": "300d97d5-8fd7-467f-843a-427d7018f4d0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:08:18.765589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f6b2fc1f-78f4-42b7-940b-62502f494c45 req-2f2e6497-730f-4af5-806d-0851c5f6582b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:18.766061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f6b2fc1f-78f4-42b7-940b-62502f494c45 req-2f2e6497-730f-4af5-806d-0851c5f6582b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:18.766495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-f6b2fc1f-78f4-42b7-940b-62502f494c45 req-2f2e6497-730f-4af5-806d-0851c5f6582b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:18.777343 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-f6b2fc1f-78f4-42b7-940b-62502f494c45 req-2f2e6497-730f-4af5-806d-0851c5f6582b service nova] Creating event network-changed:300d97d5-8fd7-467f-843a-427d7018f4d0 for instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e on n-h1-master-1 Oct 16 02:08:18.782257 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-f6b2fc1f-78f4-42b7-940b-62502f494c45 req-2f2e6497-730f-4af5-806d-0851c5f6582b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037913 Oct 16 02:08:18.782845 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3578/7288] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:08:19.015442 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [4cac0ff4-e6c3-47e7-8e35-031e267a4b03] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35464. Oct 16 02:08:19.019032 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2ab42f62-e7d8-4b86-84da-884f75f81df6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments/7482e94c-39d9-4e67-bbad-95eb0ca17241" status: 202 len: 0 microversion: 2.1 time: 1.183307 Oct 16 02:08:19.019841 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3711/7289] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:08:17 2022] DELETE /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments/7482e94c-39d9-4e67-bbad-95eb0ca17241 => generated 0 bytes in 1185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:08:19.030141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:19.032580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:19.039668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:19.040122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:19.040581 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:19.041319 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:19.042469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:19.042949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:19.075971 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aeec0a4b-8ed7-400b-b5d2-a3a137dca38f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051624 Oct 16 02:08:19.076548 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3579/7290] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:08:19 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:08:20.090779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:20.093331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:20.100642 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:20.101176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:20.101629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:20.102365 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:20.102841 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:20.103311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:20.132655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-40961d23-f566-4e88-8ebc-7040d060964d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Oct 16 02:08:20.133228 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3712/7291] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:08:20 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:08:21.145929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:21.148143 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:21.154744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:21.155277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:21.155714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:21.156417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:21.156903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:21.157335 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:21.189774 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-519fe4ed-3314-44ae-8c7e-1fd3a8afcc39 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047963 Oct 16 02:08:21.190354 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3580/7292] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:08:21 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:08:22.202684 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:22.204851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:22.212343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:22.212843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:22.213909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:22.214757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:22.215283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:22.215719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:22.246057 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dfacd383-76fa-4fdd-afc0-91c5d9c9ab7a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048219 Oct 16 02:08:22.246621 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3713/7293] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:08:22 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:08:23.258579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:23.260794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:23.267699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:23.268179 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:23.268613 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:23.269303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:23.269754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:23.270176 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:23.300541 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4c85a467-e942-4108-9d7d-a750b3875765 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Oct 16 02:08:23.301119 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3581/7294] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:08:23 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:08:24.314540 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:24.316827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:24.324525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:24.325030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:24.325502 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:24.326210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:24.326682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:24.327182 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:24.355530 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58e445e3-8c29-4c75-94be-8963cfb20bf5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045338 Oct 16 02:08:24.356087 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3714/7295] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:08:24 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 02:08:24.366618 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:24.367147 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:24.374505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:24.375022 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:24.375453 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:24.376161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:24.376612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:24.377027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:24.451721 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] HTTP exception thrown: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e is not attached to volume 7482e94c-39d9-4e67-bbad-95eb0ca17241 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Request method failure captured: Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: request: DELETE /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments/7482e94c-39d9-4e67-bbad-95eb0ca17241 HTTP/1.1 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2avs6rPcXt6QRrZ5Ex8Obv7rlazpks9KDvNNb1kw2o2SsnUd1vy0ZOowmPgseRlxYJyMpYaUbiob0MoaUSQxNlaynhmg_LclOBvHj_G7P9FFmby0KXCIhvjWq18fc2pylGaFh2gC3clycgZnwXzaveD8WJusLQdn5s4PUKU45c20MY Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 32a38ba59a1e47b589ff171e62a00b13 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_32a38ba59a1e47b589ff171e62a00b13", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 32a38ba59a1e47b589ff171e62a00b13 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestMinimumBasicScenario-1205044005-project Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e06c1f399bf04625baf6b8633cc8dd1b Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestMinimumBasicScenario-1205044005-project Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e is not attached to volume 7482e94c-39d9-4e67-bbad-95eb0ca17241 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: action_args: {'server_id': '8e6abb2b-3441-4f51-9b5e-493d56d66a3e', 'id': '7482e94c-39d9-4e67-bbad-95eb0ca17241'} Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7482e94c-39d9-4e67-bbad-95eb0ca17241. Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e is not attached to volume 7482e94c-39d9-4e67-bbad-95eb0ca17241 Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:08:24.453618 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:08:24.458721 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:08:24.458721 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:08:24.458721 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e is not attached to volume 7482e94c-39d9-4e67-bbad-95eb0ca17241 Oct 16 02:08:24.458721 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:24.458721 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Returning 404 to user: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e is not attached to volume 7482e94c-39d9-4e67-bbad-95eb0ca17241 {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:08:24.458721 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-336bcf84-5a7c-43dc-9944-b63b211dc3d6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments/7482e94c-39d9-4e67-bbad-95eb0ca17241" status: 404 len: 154 microversion: 2.1 time: 0.092441 Oct 16 02:08:24.458721 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3582/7296] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:08:24 2022] DELETE /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e/os-volume_attachments/7482e94c-39d9-4e67-bbad-95eb0ca17241 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:08:27.719529 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:27.720066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:27.726814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:27.727340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:27.727788 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:27.728496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:27.728970 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:27.729432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:27.754827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:08:27.835657 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0f64b516-dc4a-4529-8d8b-8c5b0cd13ed4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 204 len: 0 microversion: 2.1 time: 0.119554 Oct 16 02:08:27.836379 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3715/7297] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:08:27 2022] DELETE /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:08:27.844713 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:27.845343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:27.852804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:27.853284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:27.853716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:27.855427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:27.855887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:27.856312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:27.996444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:28.004526 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8fb11f37-18cb-48f5-8705-5bccf8275f6f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1555 microversion: 2.1 time: 0.163670 Oct 16 02:08:28.005096 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3583/7298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:27 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:29.029193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:29.029794 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:29.037584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:29.038092 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:29.038546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:29.039283 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:29.039759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:29.040203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:29.168627 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:29.176449 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-924a7024-87b6-497f-88cf-13855930283f tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1555 microversion: 2.1 time: 0.152241 Oct 16 02:08:29.177028 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3716/7299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:29 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:30.013733 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-763edb02-e9a5-4274-a0a0-a394cd650196 req-7d14eff0-5cb8-41e5-9d42-a9f38f4f1f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6abb2b-3441-4f51-9b5e-493d56d66a3e", "name": "network-vif-deleted", "tag": "300d97d5-8fd7-467f-843a-427d7018f4d0"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:08:30.025360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-763edb02-e9a5-4274-a0a0-a394cd650196 req-7d14eff0-5cb8-41e5-9d42-a9f38f4f1f0c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:30.026391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-763edb02-e9a5-4274-a0a0-a394cd650196 req-7d14eff0-5cb8-41e5-9d42-a9f38f4f1f0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:30.026762 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-763edb02-e9a5-4274-a0a0-a394cd650196 req-7d14eff0-5cb8-41e5-9d42-a9f38f4f1f0c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:30.039267 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-763edb02-e9a5-4274-a0a0-a394cd650196 req-7d14eff0-5cb8-41e5-9d42-a9f38f4f1f0c service nova] Creating event network-vif-deleted:300d97d5-8fd7-467f-843a-427d7018f4d0 for instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e on n-h1-master-1 Oct 16 02:08:30.045679 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-763edb02-e9a5-4274-a0a0-a394cd650196 req-7d14eff0-5cb8-41e5-9d42-a9f38f4f1f0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035741 Oct 16 02:08:30.047418 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3584/7300] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:08:30.201706 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:30.202493 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:30.209850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:30.210426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:30.211070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:30.211828 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:30.212373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:30.212822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:30.248931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:30.249436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:30.249892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:30.250355 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lazy-loading 'fault' on Instance uuid 8e6abb2b-3441-4f51-9b5e-493d56d66a3e {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:08:30.294957 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:30.303587 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dfb53e4a-1aa8-423f-b48e-6f03fced16b0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 200 len: 1349 microversion: 2.1 time: 0.106501 Oct 16 02:08:30.304203 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3717/7301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:30 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:31.331196 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:31.331801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 8e6abb2b-3441-4f51-9b5e-493d56d66a3e] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:31.338514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:31.339037 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:31.339508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:31.340201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:31.340786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:31.341351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:31.356408 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] HTTP exception thrown: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e could not be found. Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Request method failure captured: Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e HTTP/1.1 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2avs6rPcXt6QRrZ5Ex8Obv7rlazpks9KDvNNb1kw2o2SsnUd1vy0ZOowmPgseRlxYJyMpYaUbiob0MoaUSQxNlaynhmg_LclOBvHj_G7P9FFmby0KXCIhvjWq18fc2pylGaFh2gC3clycgZnwXzaveD8WJusLQdn5s4PUKU45c20MY Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 32a38ba59a1e47b589ff171e62a00b13 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_32a38ba59a1e47b589ff171e62a00b13", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 32a38ba59a1e47b589ff171e62a00b13 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestMinimumBasicScenario-1205044005-project Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: e06c1f399bf04625baf6b8633cc8dd1b Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestMinimumBasicScenario-1205044005-project Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e could not be found. Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '8e6abb2b-3441-4f51-9b5e-493d56d66a3e'} Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e could not be found. Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e could not be found. Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:08:31.358025 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e could not be found. Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Returning 404 to user: Instance 8e6abb2b-3441-4f51-9b5e-493d56d66a3e could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8e541ead-5a56-4a25-a25b-e02a8fa8f3da tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e" status: 404 len: 111 microversion: 2.1 time: 0.034518 Oct 16 02:08:31.363420 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3585/7302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:31 2022] GET /compute/v2.1/servers/8e6abb2b-3441-4f51-9b5e-493d56d66a3e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:08:31.368144 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b9b1970b-da06-4cda-bb3f-cdd27de34cff tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '.version_select at 0x7fd64ddec700>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:31.389667 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b9b1970b-da06-4cda-bb3f-cdd27de34cff tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1521517944" status: 202 len: 0 microversion: 2.1 time: 0.025258 Oct 16 02:08:31.390253 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3718/7303] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Oct 16 02:08:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1521517944 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:08:40.581861 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8a09c79d-85ec-435d-abfd-4997f68a7153 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'create', calling method: .version_select at 0x7fd64cf845e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-24638851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIwakow5Hz0ugJ7uxPcyWGtxDoE87Ye+uX4f7ihFxy16PHfPW56krcmhfDcLBgm/6HVkN8+OTnWwZJuWlnFV9Ng1/WkuX3U8s0IA6+t+EbCyunSaRkKoLCULWwlBChzgw=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:08:40.601084 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8a09c79d-85ec-435d-abfd-4997f68a7153 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Getting quotas for project 32a38ba59a1e47b589ff171e62a00b13. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:08:40.607484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-8a09c79d-85ec-435d-abfd-4997f68a7153 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Getting quotas for user e06c1f399bf04625baf6b8633cc8dd1b and project 32a38ba59a1e47b589ff171e62a00b13. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:08:40.641696 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8a09c79d-85ec-435d-abfd-4997f68a7153 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.063569 Oct 16 02:08:40.642515 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3586/7304] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:08:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:08:40.729904 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:40.735248 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-594981909", "imageRef": "ec858637-9a17-4561-be16-ae062befcaa7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-24638851", "networks": [{"uuid": "c7f3e504-37e1-46c3-a0df-96b0ebfc0c17"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:08:40.933591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] validate_networks() for [('c7f3e504-37e1-46c3-a0df-96b0ebfc0c17', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:08:41.636384 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:08:41.636822 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:08:41.637443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:08:41.637863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:08:41.638286 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:08:41.647025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:41.647520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:41.647968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:41.648706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:41.649177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:41.649615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:41.666564 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Getting quotas for project 32a38ba59a1e47b589ff171e62a00b13. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:08:41.672434 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Getting quotas for user e06c1f399bf04625baf6b8633cc8dd1b and project 32a38ba59a1e47b589ff171e62a00b13. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:08:41.684486 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:08:41.686801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ec858637-9a17-4561-be16-ae062befcaa7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:08:41.730238 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [c2d50605-1477-476d-aa05-778ca77e8984] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 16 02:08:42.737495 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [c2d50605-1477-476d-aa05-778ca77e8984] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35608. Oct 16 02:08:42.741853 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c4102914-d2df-47c0-803a-0c513d0f88a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.014162 Oct 16 02:08:42.742514 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3719/7305] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:08:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:08:42.751066 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=38 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:42.756282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a741f70c-1873-4785-90d1-ff0062c4e308 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:42.756893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a741f70c-1873-4785-90d1-ff0062c4e308 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:42.865499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a741f70c-1873-4785-90d1-ff0062c4e308 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:42.872602 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a741f70c-1873-4785-90d1-ff0062c4e308 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1256 microversion: 2.1 time: 0.122360 Oct 16 02:08:42.873165 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3587/7306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:42 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1256 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:43.897305 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e116f50-288a-49d1-bc75-62b6ff50943d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:43.897938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6e116f50-288a-49d1-bc75-62b6ff50943d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:43.951049 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e116f50-288a-49d1-bc75-62b6ff50943d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:43.958655 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e116f50-288a-49d1-bc75-62b6ff50943d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1256 microversion: 2.1 time: 0.066307 Oct 16 02:08:43.959255 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3720/7307] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:43 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1256 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:44.981797 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-15f02789-4640-4eb4-8638-801c73088133 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:44.982444 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-15f02789-4640-4eb4-8638-801c73088133 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:45.036621 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-15f02789-4640-4eb4-8638-801c73088133 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:45.045272 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-15f02789-4640-4eb4-8638-801c73088133 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1256 microversion: 2.1 time: 0.067951 Oct 16 02:08:45.045855 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3588/7308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:44 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1256 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:46.069740 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-46585556-bd19-49b5-bbfe-bdc60d6eb3c9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:46.070363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-46585556-bd19-49b5-bbfe-bdc60d6eb3c9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:46.128879 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-46585556-bd19-49b5-bbfe-bdc60d6eb3c9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:46.136650 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-46585556-bd19-49b5-bbfe-bdc60d6eb3c9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1256 microversion: 2.1 time: 0.070757 Oct 16 02:08:46.137233 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3721/7309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:46 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1256 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:08:47.164992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:47.165628 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:47.168299 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:47.174798 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:47.175307 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:47.175742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:47.176440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:47.176901 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:47.177330 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:47.238863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:47.249671 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aa86b0a4-c254-479a-b69b-dc1904329267 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1260 microversion: 2.1 time: 0.088572 Oct 16 02:08:47.250267 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3589/7310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:47 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1260 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:48.273480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:48.274105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:48.279549 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:48.283455 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:48.283958 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:48.284406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:48.285126 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:48.285599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:48.286032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:48.355551 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:48.365784 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e6ecb3b5-77fd-4680-b788-833f5c8932ed tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1314 microversion: 2.1 time: 0.096011 Oct 16 02:08:48.371541 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3722/7311] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:48 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1314 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:49.389971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:49.390579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:49.405884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:49.406377 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:49.406813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:49.407564 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:49.408023 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:49.408447 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:49.553245 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:49.561111 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b055759e-7fb0-4421-ae1c-59e18e024d49 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.175077 Oct 16 02:08:49.561705 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3590/7312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:49 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:50.585982 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:50.587802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:50.595470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:50.596277 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:50.597109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:50.597927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:50.598881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:50.599661 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:50.759527 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:50.768666 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5c9d6fab-e8ff-4cd4-83b1-ac9eb3c37db8 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.186665 Oct 16 02:08:50.785015 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3723/7313] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:50 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:51.792903 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:51.793534 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:51.800874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:51.801353 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:51.801789 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:51.802497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:51.802979 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:51.803404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:51.942156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:51.950604 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e32aa7ff-7c74-455e-aa19-fd2c9f56bc25 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.161556 Oct 16 02:08:51.958187 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3591/7314] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:51 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:52.976737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:52.978344 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:52.981357 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:52.988804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:52.989391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:52.989905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:52.990687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:52.991249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:52.991755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:53.134103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:53.142266 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49174f3a-5c43-4468-8406-14d9320ca4fb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.170452 Oct 16 02:08:53.142837 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3724/7315] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:52 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:54.165731 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:54.167219 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:54.176655 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:54.177537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:54.178210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:54.179184 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:54.179857 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:54.180497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:54.319750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:54.328022 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b46138fd-3c8c-4046-a63b-a7f47d56a960 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.166202 Oct 16 02:08:54.328591 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3592/7316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:54 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:55.351930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:55.352601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:55.360195 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:55.360723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:55.361177 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:55.361913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:55.362413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:55.362840 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:55.513200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:55.535839 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-53d23171-2690-4a27-a4c2-0551b0d72d71 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.187738 Oct 16 02:08:55.536443 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3725/7317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:55 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:56.560379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:56.560991 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:56.562855 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=8 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:56.569310 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:56.569800 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:56.570242 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:56.570965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:56.571432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:56.571864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:56.699029 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:56.707314 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e159cb12-5a37-4bdc-bc09-01e159d5d8bb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.151099 Oct 16 02:08:56.707883 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3593/7318] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:56 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:57.730322 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:57.731054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:57.733171 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=10 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:08:57.743400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:57.743827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:57.744275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:57.744984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:57.745451 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:57.745888 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:57.887919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:57.896139 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-9bfcf5a1-0759-480b-a55f-999ea430a920 req-d44337f6-58aa-4b71-a8c8-991570aa93e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa172b7-1d86-4696-9039-f93467052cc6", "tag": "40d9c596-d319-48bf-9824-531859b28892"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:08:57.896789 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1711f8fb-68a3-46a9-8774-b310c7648aa9 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.170347 Oct 16 02:08:57.897352 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3726/7319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:57 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:08:57.906601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9bfcf5a1-0759-480b-a55f-999ea430a920 req-d44337f6-58aa-4b71-a8c8-991570aa93e3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:57.907442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9bfcf5a1-0759-480b-a55f-999ea430a920 req-d44337f6-58aa-4b71-a8c8-991570aa93e3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:57.907682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-9bfcf5a1-0759-480b-a55f-999ea430a920 req-d44337f6-58aa-4b71-a8c8-991570aa93e3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:57.923148 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-9bfcf5a1-0759-480b-a55f-999ea430a920 req-d44337f6-58aa-4b71-a8c8-991570aa93e3 service nova] Creating event network-changed:40d9c596-d319-48bf-9824-531859b28892 for instance 6aa172b7-1d86-4696-9039-f93467052cc6 on n-h2-master-1 Oct 16 02:08:57.929483 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-9bfcf5a1-0759-480b-a55f-999ea430a920 req-d44337f6-58aa-4b71-a8c8-991570aa93e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037445 Oct 16 02:08:57.930114 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3594/7320] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:08:58.922455 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:08:58.923066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:08:58.929901 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:58.930393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:58.930839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:58.931556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:08:58.932022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:08:58.932457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:08:59.063152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:08:59.071090 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0dfb35fd-5ec0-4556-bcb9-d6f96cfe137e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.153180 Oct 16 02:08:59.071667 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3727/7321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:08:58 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:00.096301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:00.097321 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:00.103693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:00.104170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:00.104603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:00.105292 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:00.105931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:00.106152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:00.242824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:00.251175 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-06e2e896-3229-43ad-b400-f86f9eef0eee tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.160493 Oct 16 02:09:00.251728 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3595/7322] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:00 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:01.273678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:01.274332 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:01.281416 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:01.281919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:01.282369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:01.283111 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:01.283586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:01.284025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:01.419921 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:01.427629 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e39836d-6ab9-4407-ad92-16288feb7e68 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.157877 Oct 16 02:09:01.428218 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3728/7323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:01 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:02.452233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:02.452839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:02.459739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:02.460220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:02.460653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:02.461369 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:02.461825 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:02.462248 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:02.590579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:02.599340 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a07a2a46-7421-42a1-a2f2-52bcbd0109d0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.151474 Oct 16 02:09:02.599916 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3596/7324] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:02 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:03.286308 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d8e279f6-2369-46a8-9695-6b1067d79711 req-d2c14360-8bd1-489c-96a9-7f854b112179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa172b7-1d86-4696-9039-f93467052cc6", "name": "network-vif-plugged", "status": "completed", "tag": "40d9c596-d319-48bf-9824-531859b28892"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:09:03.297486 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d8e279f6-2369-46a8-9695-6b1067d79711 req-d2c14360-8bd1-489c-96a9-7f854b112179 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:03.297987 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d8e279f6-2369-46a8-9695-6b1067d79711 req-d2c14360-8bd1-489c-96a9-7f854b112179 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:03.298443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d8e279f6-2369-46a8-9695-6b1067d79711 req-d2c14360-8bd1-489c-96a9-7f854b112179 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:03.309894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d8e279f6-2369-46a8-9695-6b1067d79711 req-d2c14360-8bd1-489c-96a9-7f854b112179 service nova] Creating event network-vif-plugged:40d9c596-d319-48bf-9824-531859b28892 for instance 6aa172b7-1d86-4696-9039-f93467052cc6 on n-h2-master-1 Oct 16 02:09:03.315574 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d8e279f6-2369-46a8-9695-6b1067d79711 req-d2c14360-8bd1-489c-96a9-7f854b112179 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033033 Oct 16 02:09:03.316368 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3729/7325] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:09:03.623489 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:03.624487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:03.631262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:03.631741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:03.632173 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:03.632856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:03.633304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:03.633726 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:03.765292 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:03.776109 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-67dbc14c-2753-4b1f-8fa1-08d934118050 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1356 microversion: 2.1 time: 0.156981 Oct 16 02:09:03.776827 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3597/7326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:03 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:04.802969 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:04.804026 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:04.810272 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:04.810766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:04.811239 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:04.811940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:04.812408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:04.812898 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:04.942568 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:04.950460 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d718d0ad-f5d7-4ba7-9a98-6a95c1b67e5d tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1547 microversion: 2.1 time: 0.154405 Oct 16 02:09:04.951142 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3730/7327] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:04 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:04.974106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:04.974714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:04.981446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:04.981921 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:04.982961 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:04.983635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:04.984082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:04.984502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:05.113916 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:05.121673 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c34688b1-c561-4dbf-b9e1-b54483b83474 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1547 microversion: 2.1 time: 0.151678 Oct 16 02:09:05.122240 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3598/7328] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:04 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:05.144424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:05.149349 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:05.150133 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Searching by: {'deleted': False, 'project_id': '32a38ba59a1e47b589ff171e62a00b13'} {{(pid=120545) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 16 02:09:05.156090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:05.156607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:05.157036 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:05.157771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:05.158241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:05.158682 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:05.182620 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.multi_cell_list [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120545) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 16 02:09:05.209069 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c2bbfa37-6725-4a9d-8be0-5e75e5a62f8b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068478 Oct 16 02:09:05.209651 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3731/7329] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Oct 16 02:09:05 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:09:05.221874 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:05.222488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:05.228511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:05.228991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:05.229449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:05.230133 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:05.230588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:05.231121 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:05.362547 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:05.370281 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cb426f3d-c63f-4ff8-a5ab-3c81482730cf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1547 microversion: 2.1 time: 0.152271 Oct 16 02:09:05.370857 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3599/7330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:05 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:06.887103 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e762fb7c-107a-4fbb-9fe0-cb51c250e189"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:09:06.889615 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:06.896805 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:06.897306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:06.897760 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:06.898472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:06.898976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:06.899424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:07.169447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-549dc026-5d12-4724-964a-7129ceb99276 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285378 Oct 16 02:09:07.170529 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3732/7331] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Oct 16 02:09:06 2022] POST /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:09:17.951743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:17.952459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:17.955482 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=21 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:17.956136 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=62 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:17.961691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:17.962175 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:17.962612 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:17.963336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:17.963791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:17.964219 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:18.096364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:18.104480 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-30de77dd-92ca-485f-a787-e7f2bc6bc6d4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1593 microversion: 2.1 time: 0.157305 Oct 16 02:09:18.105051 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3600/7332] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:17 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:19.716952 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-50e47b2f-00e2-462f-bf52-d20dd12d0c48 req-0cf4ca57-fb1d-4fbc-b2eb-1cab8a6ac438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa172b7-1d86-4696-9039-f93467052cc6", "tag": "40d9c596-d319-48bf-9824-531859b28892"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:09:19.723927 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:19.724991 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=21 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:19.725921 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:19.733033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-50e47b2f-00e2-462f-bf52-d20dd12d0c48 req-0cf4ca57-fb1d-4fbc-b2eb-1cab8a6ac438 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:19.733529 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-50e47b2f-00e2-462f-bf52-d20dd12d0c48 req-0cf4ca57-fb1d-4fbc-b2eb-1cab8a6ac438 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:19.733968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-50e47b2f-00e2-462f-bf52-d20dd12d0c48 req-0cf4ca57-fb1d-4fbc-b2eb-1cab8a6ac438 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:19.747944 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-50e47b2f-00e2-462f-bf52-d20dd12d0c48 req-0cf4ca57-fb1d-4fbc-b2eb-1cab8a6ac438 service nova] Creating event network-changed:40d9c596-d319-48bf-9824-531859b28892 for instance 6aa172b7-1d86-4696-9039-f93467052cc6 on n-h2-master-1 Oct 16 02:09:19.753404 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-50e47b2f-00e2-462f-bf52-d20dd12d0c48 req-0cf4ca57-fb1d-4fbc-b2eb-1cab8a6ac438 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040845 Oct 16 02:09:19.754013 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3733/7333] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:09:20.739562 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:09:20.743419 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1949335982"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:09:20.744032 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:20.746437 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:09:20.755663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:20.756192 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:20.756657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:20.757365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:20.757997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:20.758460 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:20.897680 n-d-master-1 devstack@n-api.service[120546]: INFO nova.network.security_group_api [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Adding security group e8991ac4-35a1-4df3-afd4-851ec61748d7 to port 40d9c596-d319-48bf-9824-531859b28892 Oct 16 02:09:21.210032 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59828770-d39a-4a1d-9cc0-410f4fb94468 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/action" status: 202 len: 0 microversion: 2.1 time: 0.471889 Oct 16 02:09:21.210695 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3601/7334] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:09:20 2022] POST /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:09:21.221238 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:21.221948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:21.228814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:21.229319 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:21.229770 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:21.231318 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:21.231935 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:21.232611 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:21.393155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:21.401447 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f55dbb1c-7049-4af9-be08-bbd919a4f0f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1758 microversion: 2.1 time: 0.185887 Oct 16 02:09:21.402026 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3734/7335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:21 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:09:21.771740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0690796b-d442-4040-b79c-57f0fbee3515 req-389ea255-b591-424a-be0c-0c8849d4a5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa172b7-1d86-4696-9039-f93467052cc6", "tag": "40d9c596-d319-48bf-9824-531859b28892"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:09:21.785116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0690796b-d442-4040-b79c-57f0fbee3515 req-389ea255-b591-424a-be0c-0c8849d4a5a3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:21.786101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0690796b-d442-4040-b79c-57f0fbee3515 req-389ea255-b591-424a-be0c-0c8849d4a5a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:21.786209 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0690796b-d442-4040-b79c-57f0fbee3515 req-389ea255-b591-424a-be0c-0c8849d4a5a3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:21.793115 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35786. Oct 16 02:09:21.801189 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35784. Oct 16 02:09:21.804206 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0690796b-d442-4040-b79c-57f0fbee3515 req-389ea255-b591-424a-be0c-0c8849d4a5a3 service nova] Creating event network-changed:40d9c596-d319-48bf-9824-531859b28892 for instance 6aa172b7-1d86-4696-9039-f93467052cc6 on n-h2-master-1 Oct 16 02:09:21.808995 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0690796b-d442-4040-b79c-57f0fbee3515 req-389ea255-b591-424a-be0c-0c8849d4a5a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044635 Oct 16 02:09:21.809601 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3602/7336] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:09:44.192038 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:44.192837 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=8 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:44.244218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:09:44.246644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:44.253138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:44.253634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:44.254082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:44.254800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:44.255281 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:44.255717 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:44.326595 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7059e77-c453-4c54-a822-832dfdc6514a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/action" status: 202 len: 0 microversion: 2.1 time: 0.139486 Oct 16 02:09:44.327267 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3735/7337] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:09:44 2022] POST /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:09:44.336350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:44.337058 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:44.340176 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:44.341873 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=12 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:09:44.347155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:44.347647 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:44.348087 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:44.348790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:44.349246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:44.349673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:44.497409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:44.505796 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f2253ebb-a43b-4fac-b603-679027dfb99e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1750 microversion: 2.1 time: 0.174079 Oct 16 02:09:44.506374 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3603/7338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:44 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:09:45.531386 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:45.532105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:45.538366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:45.538868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:45.539349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:45.540060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:45.540538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:45.541011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:45.689030 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:45.697616 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2510035e-2a91-49ac-8c3d-27a1737f94b6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.171455 Oct 16 02:09:45.698198 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3736/7339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:45 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:46.721584 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:46.722236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:46.729115 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:46.729597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:46.730032 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:46.730724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:46.731208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:46.732363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:46.872581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:46.880891 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f74be59b-ecc8-4818-9145-967ff9f56dcb tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.163184 Oct 16 02:09:46.881461 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3604/7340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:46 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:47.904480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:47.905138 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:47.911976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:47.912470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:47.912914 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:47.913614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:47.914087 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:47.914522 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:48.060177 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:48.068818 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b04ada44-f22c-463b-8b8e-6241a053d2a6 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.168749 Oct 16 02:09:48.069406 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3737/7341] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:47 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:49.093862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:49.094473 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:49.101465 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:49.101942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:49.102371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:49.103079 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:49.103534 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:49.103957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:49.249017 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:49.257584 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b301d840-7fb7-484d-8334-209523a43c99 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.168559 Oct 16 02:09:49.258219 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3605/7342] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:49 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:50.282631 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:50.283309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:50.290154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:50.290657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:50.291139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:50.291851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:50.292327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:50.292773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:50.438017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:50.446498 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-89f7d74d-090f-483a-a1de-0f3df87cadbd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.168416 Oct 16 02:09:50.447096 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3738/7343] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:50 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:51.470051 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:51.470673 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:51.477579 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:51.478069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:51.478507 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:51.479227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:51.479687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:51.480116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:51.626177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:51.634403 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b288dfbb-470a-4f4c-9182-5b6f04000407 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.168400 Oct 16 02:09:51.634993 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3606/7344] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:51 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:52.658802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:52.659456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:52.666217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:52.666721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:52.667207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:52.667919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:52.668395 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:52.669643 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:52.809285 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:52.817861 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-052d79e6-c79e-4409-8ad3-06fea43b8915 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.162959 Oct 16 02:09:52.818366 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3739/7345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:52 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:53.843103 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:53.843625 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:53.849547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:53.850021 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:53.850450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:53.851161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:53.851615 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:53.852039 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:53.997842 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:54.006267 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8ed29c09-e3d0-4cc5-b248-115a1c14eb4b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.168077 Oct 16 02:09:54.006842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3607/7346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:53 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:55.029799 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:55.030424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:55.037850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:55.038355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:55.038809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:55.039550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:55.040027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:55.040469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:55.184801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:55.193297 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b559a468-602c-4068-ac9c-79cb2d71858b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.167563 Oct 16 02:09:55.193873 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3740/7347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:55 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:56.218555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:56.219213 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:56.226747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:56.227272 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:56.227711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:56.228414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:56.228868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:56.229289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:56.379513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:56.388361 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-241bf316-212b-4843-8dcf-0b03b29f4b42 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.174029 Oct 16 02:09:56.388933 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3608/7348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:56 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:57.412514 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:57.413045 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:57.419930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:57.420768 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:57.421265 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:57.421956 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:57.422428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:57.422869 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:57.571390 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:57.580415 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-aa0fe20a-38d0-4350-a6c7-62f70c283c1b tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.171935 Oct 16 02:09:57.580996 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3741/7349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:57 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:58.604443 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:58.605077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:58.612859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:58.613338 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:58.613770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:58.614452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:58.614905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:58.615348 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:58.756011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:58.764963 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-334af40f-4bdf-40ab-90c3-77db0fa4dbd7 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.163926 Oct 16 02:09:58.764963 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3609/7350] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:58 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:09:59.788445 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:09:59.789074 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:09:59.796089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:59.796587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:59.797038 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:59.797747 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:09:59.798220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:09:59.798665 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:09:59.943759 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:09:59.952854 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c14a1c1f-920c-4de2-886f-10f884801831 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1755 microversion: 2.1 time: 0.168307 Oct 16 02:09:59.953438 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3742/7351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:09:59 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:10:00.975980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:00.976568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:00.984600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:00.985082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:00.985517 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:00.986241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:00.986658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:00.987106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:01.133998 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:10:01.142561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bf2c47d0-5d03-4ff0-8555-6374f219ba9a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1758 microversion: 2.1 time: 0.170573 Oct 16 02:10:01.143169 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3610/7352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:10:00 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:10:33.723972 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1949335982"}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:10:33.724602 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:33.726968 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:33.727628 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:33.729031 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:10:33.729202 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 02:10:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/action (ip 10.222.0.39) !!! Oct 16 02:10:33.744782 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:33.745280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:33.745726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:33.746431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:33.746899 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:33.747369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:33.877217 n-d-master-1 devstack@n-api.service[120545]: INFO nova.network.security_group_api [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Removing security group e8991ac4-35a1-4df3-afd4-851ec61748d7 from port 40d9c596-d319-48bf-9824-531859b28892 Oct 16 02:10:34.190197 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c00b6351-3fa6-4799-8d9b-78c0365402c0 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "POST /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/action" status: 202 len: 0 microversion: 2.1 time: 0.469903 Oct 16 02:10:34.190826 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3743/7353] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:10:33 2022] POST /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:10:34.195683 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=16 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:34.196493 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=48 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:10:34.198167 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:10:34.198312 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:10:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 16 02:10:34.285003 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-3c76266f-2a34-4157-bd24-a71fdb625920 req-2d77233b-3cb3-4a8b-916e-019d69db9f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa172b7-1d86-4696-9039-f93467052cc6", "tag": "40d9c596-d319-48bf-9824-531859b28892"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:10:34.295358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3c76266f-2a34-4157-bd24-a71fdb625920 req-2d77233b-3cb3-4a8b-916e-019d69db9f25 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:34.296669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3c76266f-2a34-4157-bd24-a71fdb625920 req-2d77233b-3cb3-4a8b-916e-019d69db9f25 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:34.297435 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-3c76266f-2a34-4157-bd24-a71fdb625920 req-2d77233b-3cb3-4a8b-916e-019d69db9f25 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:34.310828 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-3c76266f-2a34-4157-bd24-a71fdb625920 req-2d77233b-3cb3-4a8b-916e-019d69db9f25 service nova] Creating event network-changed:40d9c596-d319-48bf-9824-531859b28892 for instance 6aa172b7-1d86-4696-9039-f93467052cc6 on n-h2-master-1 Oct 16 02:10:34.316587 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-3c76266f-2a34-4157-bd24-a71fdb625920 req-2d77233b-3cb3-4a8b-916e-019d69db9f25 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121986 Oct 16 02:10:34.320326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3611/7354] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:10:35.507054 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:35.507604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:35.513718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:35.514415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:35.514666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:35.515399 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:35.515884 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:35.516327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:35.603781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lazy-loading 'services' on Instance uuid 6aa172b7-1d86-4696-9039-f93467052cc6 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:10:35.678476 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9041cb20-f175-4219-90a3-b1eeaf30e5f5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments/e762fb7c-107a-4fbb-9fe0-cb51c250e189" status: 202 len: 0 microversion: 2.1 time: 0.176603 Oct 16 02:10:35.679216 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3744/7355] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:10:35 2022] DELETE /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments/e762fb7c-107a-4fbb-9fe0-cb51c250e189 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:10:35.689538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:35.692134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:35.707444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:35.707939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:35.708456 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:35.709117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:35.709545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:35.710221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:35.747381 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e157fd77-870c-4a03-a51d-9144dc5d7e55 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063239 Oct 16 02:10:35.747875 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3612/7356] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:10:35 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:10:36.333339 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d55a0933-187a-461a-b75f-932bf59fae9d req-6db2a9e5-7a90-41fc-8578-cb8e19aa14d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa172b7-1d86-4696-9039-f93467052cc6", "tag": "40d9c596-d319-48bf-9824-531859b28892"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:10:36.344835 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d55a0933-187a-461a-b75f-932bf59fae9d req-6db2a9e5-7a90-41fc-8578-cb8e19aa14d5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:36.346128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d55a0933-187a-461a-b75f-932bf59fae9d req-6db2a9e5-7a90-41fc-8578-cb8e19aa14d5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:36.346816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d55a0933-187a-461a-b75f-932bf59fae9d req-6db2a9e5-7a90-41fc-8578-cb8e19aa14d5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:36.360421 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d55a0933-187a-461a-b75f-932bf59fae9d req-6db2a9e5-7a90-41fc-8578-cb8e19aa14d5 service nova] Creating event network-changed:40d9c596-d319-48bf-9824-531859b28892 for instance 6aa172b7-1d86-4696-9039-f93467052cc6 on n-h2-master-1 Oct 16 02:10:36.365524 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d55a0933-187a-461a-b75f-932bf59fae9d req-6db2a9e5-7a90-41fc-8578-cb8e19aa14d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036203 Oct 16 02:10:36.367023 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3745/7357] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:10:36.761320 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:36.763619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:36.770902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:36.771402 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:36.771841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:36.772541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:36.773006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:36.773562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:36.805045 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-68d5cfe0-a140-4539-9bdb-eebfbb70743e tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048097 Oct 16 02:10:36.805798 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3613/7358] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:10:36 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:10:37.819795 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:37.822078 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:37.829692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:37.830203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:37.830657 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:37.831415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:37.831889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:37.832327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:37.867765 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ec797907-df86-4c17-ad40-71f98f8638e5 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053583 Oct 16 02:10:37.868383 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3746/7359] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:10:37 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:10:38.880720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:38.882873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:38.889780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:38.890265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:38.890701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:38.891414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:38.891866 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:38.892290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:38.925543 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9469e853-acde-4398-bba6-00878e409064 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048759 Oct 16 02:10:38.926235 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3614/7360] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:10:38 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:10:39.938518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:39.941009 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:39.947913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:39.948420 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:39.948880 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:39.949593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:39.950089 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:39.950517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:39.980930 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ae8ade7e-34ff-4e63-b730-af4d2653177a tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 Oct 16 02:10:39.981701 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3747/7361] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:10:39 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:10:40.994119 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:40.996229 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:41.003820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:41.004300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:41.004742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:41.005427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:41.005878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:41.006300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:41.034545 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2be47a18-ed99-4f13-9506-13a2f64677a4 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044510 Oct 16 02:10:41.035339 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3615/7362] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Oct 16 02:10:40 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 16 02:10:41.047050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:41.047502 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:41.055429 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:41.055931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:41.056378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:41.057082 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:41.057554 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:41.057985 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:41.137910 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] HTTP exception thrown: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 is not attached to volume e762fb7c-107a-4fbb-9fe0-cb51c250e189 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Request method failure captured: Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: request: DELETE /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments/e762fb7c-107a-4fbb-9fe0-cb51c250e189 HTTP/1.1 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2avs6rPcXt6QRrZ5Ex8Obv7rlazpks9KDvNNb1kw2o2SsnUd1vy0ZOowmPgseRlxYJyMpYaUbiob0MoaUSQxNlaynhmg_LclOBvHj_G7P9FFmby0KXCIhvjWq18fc2pylGaFh2gC3clycgZnwXzaveD8WJusLQdn5s4PUKU45c20MY Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 32a38ba59a1e47b589ff171e62a00b13 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_32a38ba59a1e47b589ff171e62a00b13", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 32a38ba59a1e47b589ff171e62a00b13 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestMinimumBasicScenario-1205044005-project Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e06c1f399bf04625baf6b8633cc8dd1b Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestMinimumBasicScenario-1205044005-project Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 is not attached to volume e762fb7c-107a-4fbb-9fe0-cb51c250e189 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: action_args: {'server_id': '6aa172b7-1d86-4696-9039-f93467052cc6', 'id': 'e762fb7c-107a-4fbb-9fe0-cb51c250e189'} Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e762fb7c-107a-4fbb-9fe0-cb51c250e189. Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 is not attached to volume e762fb7c-107a-4fbb-9fe0-cb51c250e189 Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:10:41.140216 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:10:41.144876 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:10:41.144876 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:10:41.144876 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 is not attached to volume e762fb7c-107a-4fbb-9fe0-cb51c250e189 Oct 16 02:10:41.144876 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:41.144876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Returning 404 to user: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 is not attached to volume e762fb7c-107a-4fbb-9fe0-cb51c250e189 {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:10:41.144876 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e679008a-44c6-4947-95ca-569f145cc769 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments/e762fb7c-107a-4fbb-9fe0-cb51c250e189" status: 404 len: 154 microversion: 2.1 time: 0.098972 Oct 16 02:10:41.144876 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3748/7363] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Oct 16 02:10:41 2022] DELETE /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6/os-volume_attachments/e762fb7c-107a-4fbb-9fe0-cb51c250e189 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:10:44.409889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:44.410478 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:44.417685 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:44.418258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:44.418761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:44.419575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:44.420029 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:44.420997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:44.448285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:10:44.524174 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bae09081-8d85-4b10-9c87-3020e272c218 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 204 len: 0 microversion: 2.1 time: 0.118015 Oct 16 02:10:44.524724 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3616/7364] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:10:44 2022] DELETE /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 16 02:10:44.533262 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:44.533900 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:44.541067 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:44.541576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:44.542026 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:44.542746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:44.543244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:44.546043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:44.696497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:10:44.706546 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff759bdf-00c8-4626-8d61-7104272480cd tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1553 microversion: 2.1 time: 0.177226 Oct 16 02:10:44.707233 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3749/7365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:10:44 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:10:45.732085 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:45.733376 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:45.740467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:45.740955 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:45.741395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:45.742086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:45.742546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:45.743006 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:45.871440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:10:45.879427 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-610ad2f7-faee-41fb-ab3a-aeaf3cced8bf tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1553 microversion: 2.1 time: 0.151625 Oct 16 02:10:45.880029 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3617/7366] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:10:45 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:10:46.903716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:46.904357 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:46.912035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:46.912542 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:46.912998 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:46.913737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:46.914197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:46.914637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:47.047642 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06c1f399bf04625baf6b8633cc8dd1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32a38ba59a1e47b589ff171e62a00b13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:10:47.055610 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-36e2c3f8-7b85-45ae-9222-8a4874793de3 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 200 len: 1553 microversion: 2.1 time: 0.155846 Oct 16 02:10:47.056393 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3750/7367] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:10:46 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:10:47.299417 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-71d8174b-281f-4e50-843f-6b16b2c0797a req-a9734a43-2a1e-4143-bdcf-1e4e5979eb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa172b7-1d86-4696-9039-f93467052cc6", "name": "network-vif-deleted", "tag": "40d9c596-d319-48bf-9824-531859b28892"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:10:47.308933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71d8174b-281f-4e50-843f-6b16b2c0797a req-a9734a43-2a1e-4143-bdcf-1e4e5979eb5e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:47.309409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71d8174b-281f-4e50-843f-6b16b2c0797a req-a9734a43-2a1e-4143-bdcf-1e4e5979eb5e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:47.309836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-71d8174b-281f-4e50-843f-6b16b2c0797a req-a9734a43-2a1e-4143-bdcf-1e4e5979eb5e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:47.321225 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-71d8174b-281f-4e50-843f-6b16b2c0797a req-a9734a43-2a1e-4143-bdcf-1e4e5979eb5e service nova] Creating event network-vif-deleted:40d9c596-d319-48bf-9824-531859b28892 for instance 6aa172b7-1d86-4696-9039-f93467052cc6 on n-h2-master-1 Oct 16 02:10:47.327023 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-71d8174b-281f-4e50-843f-6b16b2c0797a req-a9734a43-2a1e-4143-bdcf-1e4e5979eb5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086471 Oct 16 02:10:47.328332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3618/7368] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:10:48.083200 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:48.083827 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] [instance: 6aa172b7-1d86-4696-9039-f93467052cc6] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:10:48.090715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:48.091249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:48.091698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:48.092403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:10:48.093524 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:10:48.093967 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:10:48.110012 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] HTTP exception thrown: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 could not be found. Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Request method failure captured: Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 HTTP/1.1 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2avs6rPcXt6QRrZ5Ex8Obv7rlazpks9KDvNNb1kw2o2SsnUd1vy0ZOowmPgseRlxYJyMpYaUbiob0MoaUSQxNlaynhmg_LclOBvHj_G7P9FFmby0KXCIhvjWq18fc2pylGaFh2gC3clycgZnwXzaveD8WJusLQdn5s4PUKU45c20MY Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 32a38ba59a1e47b589ff171e62a00b13 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_32a38ba59a1e47b589ff171e62a00b13", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32a38ba59a1e47b589ff171e62a00b13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 32a38ba59a1e47b589ff171e62a00b13 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1205044005 Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestMinimumBasicScenario-1205044005-project Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: e06c1f399bf04625baf6b8633cc8dd1b Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestMinimumBasicScenario-1205044005-project Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 could not be found. Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '6aa172b7-1d86-4696-9039-f93467052cc6'} Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 could not be found. Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 could not be found. Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:10:48.111590 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 could not be found. Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Returning 404 to user: Instance 6aa172b7-1d86-4696-9039-f93467052cc6 could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-edb5c2aa-f7f1-4219-8582-456ea06fd680 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6" status: 404 len: 111 microversion: 2.1 time: 0.033838 Oct 16 02:10:48.116688 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3751/7369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:10:48 2022] GET /compute/v2.1/servers/6aa172b7-1d86-4696-9039-f93467052cc6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:10:48.122168 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1887a7ba-2b8d-4aa5-b087-64aeee3d4a66 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] Calling method '.version_select at 0x7fd64d003040>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:10:48.142983 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1887a7ba-2b8d-4aa5-b087-64aeee3d4a66 tempest-TestMinimumBasicScenario-1205044005 tempest-TestMinimumBasicScenario-1205044005-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-24638851" status: 202 len: 0 microversion: 2.1 time: 0.024928 Oct 16 02:10:48.143554 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3619/7370] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Oct 16 02:10:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-24638851 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:10:57.147758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c2923628-7cad-4876-8c33-afc6b052f7bf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: .version_select at 0x7fd64de4f8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-710200157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoM0rVZsacq90ClZwGC35EsvU/BmRWPididrHReSrIrem+Pl8rQUjtDngWDh/5S3SzEH5OwTl+SfrUnX7yRpwz4QvDXyp0seXBhEc41PQkcM9d9Del71kPAALEGpjQbDg=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:10:57.163489 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c2923628-7cad-4876-8c33-afc6b052f7bf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:10:57.168677 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-c2923628-7cad-4876-8c33-afc6b052f7bf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:10:57.198264 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c2923628-7cad-4876-8c33-afc6b052f7bf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.213512 Oct 16 02:10:57.198870 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3752/7371] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:10:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:11:02.898102 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:02.898852 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:02.903230 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1510576290", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "9229418e-bcce-43f1-8c0a-57464b1460e5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-710200157", "security_groups": [{"name": "tempest-secgroup-smoke-1481396065"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:03.018167 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] validate_networks() for [('9229418e-bcce-43f1-8c0a-57464b1460e5', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:11:03.503854 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:11:03.504408 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:11:03.504838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:11:03.505622 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:11:03.506152 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:11:03.516480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:03.517093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:03.517682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:03.518653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:03.519367 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:03.519989 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:03.549308 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:11:03.562540 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:11:03.579871 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:11:03.582810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:11:03.643091 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-01b5e319-26a0-4ad2-9d99-439f0f437be6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746796 Oct 16 02:11:03.652154 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3620/7372] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:11:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:11:03.654394 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:03.659935 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e110ee1e-9517-449a-9e85-3071433c1a2d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:03.661506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e110ee1e-9517-449a-9e85-3071433c1a2d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:03.752912 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e110ee1e-9517-449a-9e85-3071433c1a2d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:03.768997 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e110ee1e-9517-449a-9e85-3071433c1a2d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1266 microversion: 2.1 time: 0.115682 Oct 16 02:11:03.770407 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3753/7373] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:03 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:04.797619 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:04.798242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:04.805468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:04.806166 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:04.806609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:04.807387 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:04.807832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:04.808262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:04.872265 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:04.881055 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c645a7a2-e0ec-48bc-bf69-26e9cb3fa47e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1318 microversion: 2.1 time: 0.088342 Oct 16 02:11:04.881711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3621/7374] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:04 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:11:05.906768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:05.908217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:05.911643 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:05.917936 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:05.918742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:05.919231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:05.919992 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:05.920590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:05.921921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:05.992881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:06.001298 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-85d047c9-1bea-4f12-8032-382697c52a93 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1324 microversion: 2.1 time: 0.099749 Oct 16 02:11:06.002138 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3754/7375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:05 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1324 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:06.932107 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-8ce54f69-9a91-414d-8b87-9ff03eb7efd8 req-b2c735b1-2297-4c8c-b96e-15f3d7126d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12291d1-1a81-4b3d-9505-9bb1c676ebe5", "tag": "649872cb-4f66-4806-acba-fbbf4684b579"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:06.944404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8ce54f69-9a91-414d-8b87-9ff03eb7efd8 req-b2c735b1-2297-4c8c-b96e-15f3d7126d7c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:06.944980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8ce54f69-9a91-414d-8b87-9ff03eb7efd8 req-b2c735b1-2297-4c8c-b96e-15f3d7126d7c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:06.945482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8ce54f69-9a91-414d-8b87-9ff03eb7efd8 req-b2c735b1-2297-4c8c-b96e-15f3d7126d7c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:06.959927 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-8ce54f69-9a91-414d-8b87-9ff03eb7efd8 req-b2c735b1-2297-4c8c-b96e-15f3d7126d7c service nova] Creating event network-changed:649872cb-4f66-4806-acba-fbbf4684b579 for instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 on n-h1-master-1 Oct 16 02:11:06.964831 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-8ce54f69-9a91-414d-8b87-9ff03eb7efd8 req-b2c735b1-2297-4c8c-b96e-15f3d7126d7c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036413 Oct 16 02:11:06.965532 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3622/7376] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:11:07.025560 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:07.026279 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:07.033620 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:07.034122 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:07.034571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:07.035309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:07.035784 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:07.036216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:07.173596 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:07.185346 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb235666-e713-49d2-8f4f-46e91e370ef2 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1392 microversion: 2.1 time: 0.163388 Oct 16 02:11:07.186545 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3755/7377] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:07 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:08.210885 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:08.211528 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:08.218213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:08.219669 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:08.220136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:08.220971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:08.221528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:08.221992 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:08.359634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:08.368275 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7091772c-8599-49eb-9f35-5f6a8fbe203a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1392 microversion: 2.1 time: 0.162528 Oct 16 02:11:08.368889 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3623/7378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:08 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:09.392303 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:09.392930 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:09.399881 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:09.400361 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:09.400813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:09.401515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:09.401986 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:09.402427 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:09.533136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:09.541014 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9262e0a1-641b-446a-bdfd-6b5754675140 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1392 microversion: 2.1 time: 0.152779 Oct 16 02:11:09.541592 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3756/7379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:09 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:10.566049 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:10.566659 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:10.573384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:10.573886 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:10.574318 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:10.575060 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:10.575511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:10.575930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:10.712802 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:10.721031 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c6b29eb2-a64f-4325-af0b-2a2e45f3de4a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1392 microversion: 2.1 time: 0.160236 Oct 16 02:11:10.721616 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3624/7380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:10 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:11.744708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:11.745326 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:11.752695 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:11.753189 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:11.753636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:11.754329 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:11.754797 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:11.755261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:11.890785 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:11.898877 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-476c98cd-b060-4b55-a43c-67011d31c529 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1392 microversion: 2.1 time: 0.158000 Oct 16 02:11:11.899492 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3757/7381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:11 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:12.379883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c3e5646f-41b7-435f-8d54-0141ec7aa06b req-31245ecc-34a8-4f3d-a46e-b836e198484f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12291d1-1a81-4b3d-9505-9bb1c676ebe5", "name": "network-vif-plugged", "status": "completed", "tag": "649872cb-4f66-4806-acba-fbbf4684b579"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:12.389935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c3e5646f-41b7-435f-8d54-0141ec7aa06b req-31245ecc-34a8-4f3d-a46e-b836e198484f service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:12.390458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c3e5646f-41b7-435f-8d54-0141ec7aa06b req-31245ecc-34a8-4f3d-a46e-b836e198484f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:12.390904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c3e5646f-41b7-435f-8d54-0141ec7aa06b req-31245ecc-34a8-4f3d-a46e-b836e198484f service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:12.402270 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c3e5646f-41b7-435f-8d54-0141ec7aa06b req-31245ecc-34a8-4f3d-a46e-b836e198484f service nova] Creating event network-vif-plugged:649872cb-4f66-4806-acba-fbbf4684b579 for instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 on n-h1-master-1 Oct 16 02:11:12.408121 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c3e5646f-41b7-435f-8d54-0141ec7aa06b req-31245ecc-34a8-4f3d-a46e-b836e198484f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101094 Oct 16 02:11:12.408737 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3625/7382] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:11:12.922686 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:12.923340 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:12.930168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:12.930671 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:12.931156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:12.931865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:12.932337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:12.932778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:13.066722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:13.074386 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1d92f110-3d23-41f3-9502-c186b6b9d127 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1392 microversion: 2.1 time: 0.155624 Oct 16 02:11:13.075117 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3758/7383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:12 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:14.099251 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:14.099945 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:14.103886 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:14.104583 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:14.111939 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:14.112458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:14.112898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:14.113592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:14.114050 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:14.114486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:14.249422 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:14.257669 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-08432d1c-fc06-4bdb-9fc9-6343befd118d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1564 microversion: 2.1 time: 0.162678 Oct 16 02:11:14.258264 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3626/7384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:14 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:11:14.281191 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:14.281823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:14.283699 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:14.289836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:14.290340 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:14.290800 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:14.291555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:14.292154 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:14.292628 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:14.433755 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:14.442323 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1aa81bf9-68cb-41b2-bc1f-2dce113a0eb8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1564 microversion: 2.1 time: 0.165613 Oct 16 02:11:14.442924 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3759/7385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:14 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:16.025980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:16.026593 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:16.034295 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:16.034876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:16.035491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:16.035710 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a7124c20-6f55-4946-9c4b-479e045166a1 req-cb3f70e7-a522-44ba-aad0-fd2df7d3e191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12291d1-1a81-4b3d-9505-9bb1c676ebe5", "tag": "649872cb-4f66-4806-acba-fbbf4684b579"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:16.036525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:16.037104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:16.037658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:16.047044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a7124c20-6f55-4946-9c4b-479e045166a1 req-cb3f70e7-a522-44ba-aad0-fd2df7d3e191 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:16.047553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a7124c20-6f55-4946-9c4b-479e045166a1 req-cb3f70e7-a522-44ba-aad0-fd2df7d3e191 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:16.048028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a7124c20-6f55-4946-9c4b-479e045166a1 req-cb3f70e7-a522-44ba-aad0-fd2df7d3e191 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:16.060453 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a7124c20-6f55-4946-9c4b-479e045166a1 req-cb3f70e7-a522-44ba-aad0-fd2df7d3e191 service nova] Creating event network-changed:649872cb-4f66-4806-acba-fbbf4684b579 for instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 on n-h1-master-1 Oct 16 02:11:16.066630 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a7124c20-6f55-4946-9c4b-479e045166a1 req-cb3f70e7-a522-44ba-aad0-fd2df7d3e191 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034365 Oct 16 02:11:16.067588 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3760/7386] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:11:16.180106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:16.189119 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a6f22faa-f996-47e1-9b41-82a672a13290 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1564 microversion: 2.1 time: 0.167079 Oct 16 02:11:16.189998 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3627/7387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:16 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:37.442455 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=13 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:37.443159 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=38 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:37.447622 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:37.449907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:37.457769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:37.458269 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:37.458722 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:37.459456 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:37.459939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:37.460384 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:37.526134 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a406fea6-8e1e-430b-b3cf-42259aec9b29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action" status: 200 len: 24571 microversion: 2.1 time: 0.085774 Oct 16 02:11:37.526768 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3761/7388] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:11:37 2022] POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action => generated 24571 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:11:48.229433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:48.229984 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:48.232139 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:48.232825 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=36 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:48.239775 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:48.240266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:48.240703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:48.241400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:48.241859 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:48.242340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:48.309427 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9abb5cc3-e4af-4c35-ada5-289c59ceb3b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action" status: 202 len: 0 microversion: 2.1 time: 0.083994 Oct 16 02:11:48.310070 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3628/7389] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:11:48 2022] POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:11:48.316993 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:48.317766 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:11:48.322021 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:48.322838 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:48.331600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:48.332110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:48.332570 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:48.333292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:48.333771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:48.334225 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:48.469480 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:48.477984 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8cf60eab-27bf-4160-bb29-74be4206cc7f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1688 microversion: 2.1 time: 0.163314 Oct 16 02:11:48.478552 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3762/7390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:48 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:49.505354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:49.505959 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:49.512139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:49.512625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:49.513061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:49.513746 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:49.514202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:49.514628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:49.656348 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:49.664563 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4fc29833-08da-43b8-85ec-4d8f20714c14 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1668 microversion: 2.1 time: 0.165033 Oct 16 02:11:49.665139 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3629/7391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:49 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:50.757566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:50.759778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:50.767511 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:50.768538 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:50.768990 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:50.769856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:50.770332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:50.770775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:50.836755 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-95424b6d-d528-47da-bbd9-3933c8389ed5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action" status: 200 len: 32646 microversion: 2.1 time: 0.082905 Oct 16 02:11:50.837306 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3763/7392] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:11:50 2022] POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action => generated 32646 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:11:50.849481 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:50.850021 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:50.856757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:50.857240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:50.857673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:50.858357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:50.858810 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:50.859257 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:50.923463 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-043255cb-4b36-4fdb-8a7d-dd0153f43431 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action" status: 202 len: 0 microversion: 2.1 time: 0.078251 Oct 16 02:11:50.924126 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3630/7393] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:11:50 2022] POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:11:50.933218 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:50.933923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:50.942157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:50.942653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:50.943378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:50.944243 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:50.944775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:50.945417 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:51.085651 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:51.093459 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-26b1a019-fe9c-4390-8457-55c2ddc04d30 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1675 microversion: 2.1 time: 0.164397 Oct 16 02:11:51.093959 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3764/7394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:50 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:52.119652 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:52.120350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:52.126650 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:52.127783 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:52.128223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:52.128911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:52.129376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:52.129797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:52.260128 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:52.268424 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-dd1c12b0-f0c4-440b-a38a-f3047250595f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1683 microversion: 2.1 time: 0.152921 Oct 16 02:11:52.269033 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3631/7395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:52 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:52.366645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:52.368875 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:52.376637 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:52.377728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:52.378415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:52.379200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:52.379680 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:52.380124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:52.441723 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0504ed30-5193-4ecf-bb4c-74936e36deb7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action" status: 200 len: 38396 microversion: 2.1 time: 0.078904 Oct 16 02:11:52.442382 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3765/7396] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:11:52 2022] POST /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5/action => generated 38396 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:11:53.411750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:53.417644 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-12bcb746-6aaf-4f0a-b116-248ec2b05b45 req-df485c3b-70d9-40d7-8e76-96cfd79c6d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12291d1-1a81-4b3d-9505-9bb1c676ebe5", "tag": "649872cb-4f66-4806-acba-fbbf4684b579"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:53.418389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:53.425724 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:53.426218 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:53.426654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:53.427391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:53.427847 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:53.428270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:53.428930 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-12bcb746-6aaf-4f0a-b116-248ec2b05b45 req-df485c3b-70d9-40d7-8e76-96cfd79c6d05 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:53.429497 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-12bcb746-6aaf-4f0a-b116-248ec2b05b45 req-df485c3b-70d9-40d7-8e76-96cfd79c6d05 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:53.430017 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-12bcb746-6aaf-4f0a-b116-248ec2b05b45 req-df485c3b-70d9-40d7-8e76-96cfd79c6d05 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:53.448029 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-12bcb746-6aaf-4f0a-b116-248ec2b05b45 req-df485c3b-70d9-40d7-8e76-96cfd79c6d05 service nova] Creating event network-changed:649872cb-4f66-4806-acba-fbbf4684b579 for instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 on n-h1-master-1 Oct 16 02:11:53.453484 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-12bcb746-6aaf-4f0a-b116-248ec2b05b45 req-df485c3b-70d9-40d7-8e76-96cfd79c6d05 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039778 Oct 16 02:11:53.454104 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3766/7397] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:11:53.457285 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:11:53.546269 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-57276d62-8787-4e19-bf0b-afe84b2d92c4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 204 len: 0 microversion: 2.1 time: 0.138104 Oct 16 02:11:53.547642 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3632/7398] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:11:53 2022] DELETE /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:11:53.558087 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:53.558974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:53.567523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:53.568152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:53.568802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:53.569573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:53.570633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:53.571664 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:53.709244 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:53.717305 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3b6de282-f1ce-499b-ba7a-d7d03c701e16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1689 microversion: 2.1 time: 0.164455 Oct 16 02:11:53.717880 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3767/7399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:53 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:54.743138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:54.743788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:54.750429 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:54.750904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:54.751363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:54.752068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:54.752522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:54.752937 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:54.890347 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:54.898412 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1a379fea-8941-4a89-8920-c9be779a7d22 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1689 microversion: 2.1 time: 0.159586 Oct 16 02:11:54.899020 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3633/7400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:54 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:55.922958 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:55.923582 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:55.932071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:55.932599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:55.933046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:55.933754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:55.934226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:55.934668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:55.944992 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-32934898-d9e8-4fc1-be79-9c2e21d6e024 req-f1ca5970-e1e0-4373-9af5-e5bf223bd225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12291d1-1a81-4b3d-9505-9bb1c676ebe5", "name": "network-vif-deleted", "tag": "649872cb-4f66-4806-acba-fbbf4684b579"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:11:55.955976 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-32934898-d9e8-4fc1-be79-9c2e21d6e024 req-f1ca5970-e1e0-4373-9af5-e5bf223bd225 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:55.956458 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-32934898-d9e8-4fc1-be79-9c2e21d6e024 req-f1ca5970-e1e0-4373-9af5-e5bf223bd225 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:55.957960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-32934898-d9e8-4fc1-be79-9c2e21d6e024 req-f1ca5970-e1e0-4373-9af5-e5bf223bd225 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:55.971989 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-32934898-d9e8-4fc1-be79-9c2e21d6e024 req-f1ca5970-e1e0-4373-9af5-e5bf223bd225 service nova] Creating event network-vif-deleted:649872cb-4f66-4806-acba-fbbf4684b579 for instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 on n-h1-master-1 Oct 16 02:11:55.977929 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-32934898-d9e8-4fc1-be79-9c2e21d6e024 req-f1ca5970-e1e0-4373-9af5-e5bf223bd225 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036057 Oct 16 02:11:55.978737 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3634/7401] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:11:56.009432 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:11:56.017355 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d3ac24c5-2321-4b10-990d-75a62c05731f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 200 len: 1502 microversion: 2.1 time: 0.098286 Oct 16 02:11:56.017983 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3768/7402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:55 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 1502 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:11:57.042513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:11:57.043074 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f12291d1-1a81-4b3d-9505-9bb1c676ebe5] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:11:57.049848 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:57.050894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:57.051350 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:57.052041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:11:57.052498 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:11:57.052923 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:11:57.072874 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] HTTP exception thrown: Instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 could not be found. Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Request method failure captured: Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 HTTP/1.1 Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2gw1un4B-9TzvU_NcvReYiRfmzKwj78ID6yrTwa9saKHqKshEUSlMO03SCAEgkMQvUgOIeRfDdgprSjWpj2qsGLsgTSvnJ-tRKq1i_hUZxWeb8LDhEHcsolvJ4osfaLEQSsjkpKZjU3HEdzklBGfuBFQiBl-hhmf-gPSpoO-u63BwA Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_78214f1cbf1f4856b3f2ce094a2a111a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1a52bdeacefc48c496206b4e4f5ee78f Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: exception: Instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 could not be found. Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'f12291d1-1a81-4b3d-9505-9bb1c676ebe5'} Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 could not be found. Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 could not be found. Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:11:57.074550 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 could not be found. Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Returning 404 to user: Instance f12291d1-1a81-4b3d-9505-9bb1c676ebe5 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3eb77836-f1e9-49ae-bc00-588304fcb926 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5" status: 404 len: 111 microversion: 2.1 time: 0.038786 Oct 16 02:11:57.079778 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3635/7403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:11:57 2022] GET /compute/v2.1/servers/f12291d1-1a81-4b3d-9505-9bb1c676ebe5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 16 02:12:00.125956 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07c43462-c50b-4e58-a22d-67b7f6d932a5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '.version_select at 0x7fd64ddbc1f0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:00.152818 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-07c43462-c50b-4e58-a22d-67b7f6d932a5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-710200157" status: 202 len: 0 microversion: 2.1 time: 0.031547 Oct 16 02:12:00.153578 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3769/7404] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Oct 16 02:12:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-710200157 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 02:12:00.182634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d9ba7fc2-75c1-4692-9da9-fdc8bd0f3577 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: .version_select at 0x7fd64cfa7e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1259483775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS3S1meeXbNq+yayTUjtGxldx5bq1HmDZACNNF+L0uQiGFFqBMFABK+F9FEiXu2QJYWdb9H8ptGiO9B48pTG35em6OUlS3GrfrfPmK3wkjMm8mEf032aB5++T5NJ0h2uQ=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:12:00.200362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-d9ba7fc2-75c1-4692-9da9-fdc8bd0f3577 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:12:00.207004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-d9ba7fc2-75c1-4692-9da9-fdc8bd0f3577 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:12:00.230840 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d9ba7fc2-75c1-4692-9da9-fdc8bd0f3577 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052092 Oct 16 02:12:00.231489 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3636/7405] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:12:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:12:05.474476 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-656150219", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "9545f8b2-f234-4cea-acea-2a6f6ffd33a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1259483775", "security_groups": [{"name": "tempest-secgroup-smoke-39615942"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:12:05.586578 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] validate_networks() for [('9545f8b2-f234-4cea-acea-2a6f6ffd33a0', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:12:06.014098 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=34 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:06.045017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:12:06.045265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:12:06.046414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:12:06.046816 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:12:06.047760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:12:06.058545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:06.059091 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:06.059639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:06.060292 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:06.060765 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:06.061668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:06.081235 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:12:06.087130 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:12:06.100708 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:12:06.103126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:12:06.155819 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8f84c253-a0a4-4649-a402-8b36d940b97c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.685338 Oct 16 02:12:06.157250 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3770/7406] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:12:05 2022] POST /compute/v2.1/servers => generated 404 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:12:06.169217 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9ef7c1d4-50f3-4748-a531-59522ee16421 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:06.170970 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9ef7c1d4-50f3-4748-a531-59522ee16421 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:06.240354 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9ef7c1d4-50f3-4748-a531-59522ee16421 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:06.248290 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9ef7c1d4-50f3-4748-a531-59522ee16421 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1266 microversion: 2.1 time: 0.082897 Oct 16 02:12:06.263086 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3637/7407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:06 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:07.273970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:07.274606 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:07.290138 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:07.290650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:07.291152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:07.292728 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:07.293213 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:07.293915 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:07.395766 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:07.405403 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d77df3e5-8197-4980-9ab4-d02fda1e6d5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1326 microversion: 2.1 time: 0.136128 Oct 16 02:12:07.406756 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3771/7408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:07 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1326 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:08.433882 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:08.436110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:08.441860 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:08.452189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:08.452988 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:08.453814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:08.454372 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:08.454840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:08.456624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:08.692810 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:08.701428 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d3143b79-78ce-4986-8766-6f0474173bb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1390 microversion: 2.1 time: 0.274574 Oct 16 02:12:08.702195 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3638/7409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:08 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1390 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:09.308272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-4ebbd186-2fae-47ff-b765-9614bd413912 req-4bf08982-040d-4f74-b01e-6fe46116aa51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d1fa5a-a7f7-4d06-86da-2bc5085d037d", "tag": "df79257d-0ab5-4329-84bd-2180e90a4f0d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:12:09.326541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4ebbd186-2fae-47ff-b765-9614bd413912 req-4bf08982-040d-4f74-b01e-6fe46116aa51 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:09.327197 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4ebbd186-2fae-47ff-b765-9614bd413912 req-4bf08982-040d-4f74-b01e-6fe46116aa51 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:09.327832 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-4ebbd186-2fae-47ff-b765-9614bd413912 req-4bf08982-040d-4f74-b01e-6fe46116aa51 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:09.341407 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-4ebbd186-2fae-47ff-b765-9614bd413912 req-4bf08982-040d-4f74-b01e-6fe46116aa51 service nova] Creating event network-changed:df79257d-0ab5-4329-84bd-2180e90a4f0d for instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d on n-h1-master-1 Oct 16 02:12:09.350103 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-4ebbd186-2fae-47ff-b765-9614bd413912 req-4bf08982-040d-4f74-b01e-6fe46116aa51 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050638 Oct 16 02:12:09.351348 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3772/7410] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:12:09.725795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:09.726562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:09.733467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:09.733958 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:09.734395 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:09.735129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:09.735592 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:09.736028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:09.874343 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:09.882216 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f76f6148-913b-433e-89e4-d4e368d6ebb4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1390 microversion: 2.1 time: 0.161135 Oct 16 02:12:09.882797 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3639/7411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:09 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:10.906139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:10.906927 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:10.914759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:10.915298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:10.915754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:10.916463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:10.916940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:10.917412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:11.126399 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:11.134596 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0d8fdc78-59a4-4356-a3d4-2ec48592b300 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1390 microversion: 2.1 time: 0.232802 Oct 16 02:12:11.135208 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3773/7412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:10 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1390 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:12.157753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:12.158389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:12.165553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:12.166042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:12.166482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:12.167202 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:12.167664 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:12.168092 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:12.300195 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:12.307869 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-084d73bb-99b3-4dc9-b1e8-4c4483cefae6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1390 microversion: 2.1 time: 0.154003 Oct 16 02:12:12.308441 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3640/7413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:12 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:13.331236 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:13.331856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:13.338596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:13.339120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:13.339565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:13.340262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:13.340733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:13.341156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:13.481991 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:13.490493 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f5e3a865-1b1b-4005-a24c-276b4713cb05 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1390 microversion: 2.1 time: 0.163392 Oct 16 02:12:13.491218 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3774/7414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:13 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:14.513542 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:14.514144 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:14.522459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:14.522968 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:14.523409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:14.524105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:14.524571 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:14.524998 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:14.559220 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-eb61fb72-f5a0-4957-bc96-dd363b170792 req-a02ba0df-13bc-496c-a65c-a4b1794271a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d1fa5a-a7f7-4d06-86da-2bc5085d037d", "name": "network-vif-plugged", "status": "completed", "tag": "df79257d-0ab5-4329-84bd-2180e90a4f0d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:12:14.572703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-eb61fb72-f5a0-4957-bc96-dd363b170792 req-a02ba0df-13bc-496c-a65c-a4b1794271a0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:14.573435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-eb61fb72-f5a0-4957-bc96-dd363b170792 req-a02ba0df-13bc-496c-a65c-a4b1794271a0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:14.573889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-eb61fb72-f5a0-4957-bc96-dd363b170792 req-a02ba0df-13bc-496c-a65c-a4b1794271a0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:14.587423 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-eb61fb72-f5a0-4957-bc96-dd363b170792 req-a02ba0df-13bc-496c-a65c-a4b1794271a0 service nova] Creating event network-vif-plugged:df79257d-0ab5-4329-84bd-2180e90a4f0d for instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d on n-h1-master-1 Oct 16 02:12:14.593235 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-eb61fb72-f5a0-4957-bc96-dd363b170792 req-a02ba0df-13bc-496c-a65c-a4b1794271a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037697 Oct 16 02:12:14.593850 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3775/7415] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:12:14.670362 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:14.679393 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f0e62826-8803-43d0-a478-c28a2edbb3e4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1390 microversion: 2.1 time: 0.169656 Oct 16 02:12:14.679966 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3641/7416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:14 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:15.704978 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:15.706249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:15.712397 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:15.712896 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:15.713342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:15.714034 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:15.714504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:15.714962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:15.851495 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:15.859410 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-f8b20df4-16c7-4d6d-aae0-e58425fcd797 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1390 microversion: 2.1 time: 0.159662 Oct 16 02:12:15.859991 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3776/7417] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:15 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:16.882889 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:16.883538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:16.886200 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:16.891702 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:16.892203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:16.892642 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:16.893831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:16.894455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:16.894888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:17.029768 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:17.037843 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f72e23aa-bc93-4c92-9c11-70f707b0eded tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1562 microversion: 2.1 time: 0.158689 Oct 16 02:12:17.038425 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3642/7418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:16 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:12:17.062050 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:17.062670 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:17.064633 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:17.066285 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:17.073827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:17.074345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:17.074929 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:17.075636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:17.076107 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:17.076541 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:17.213525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:17.221277 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c301ac40-8474-488b-8651-d4269c384e38 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1562 microversion: 2.1 time: 0.163130 Oct 16 02:12:17.222342 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3777/7419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:17 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:18.814335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3df9e498-bfd3-44a3-a4aa-e238edf4ff4e req-05765e3c-df9d-45b9-88cd-a1cee9ad7d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d1fa5a-a7f7-4d06-86da-2bc5085d037d", "tag": "df79257d-0ab5-4329-84bd-2180e90a4f0d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:12:18.817171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:18.817821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:18.820532 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:18.825953 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:18.832720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3df9e498-bfd3-44a3-a4aa-e238edf4ff4e req-05765e3c-df9d-45b9-88cd-a1cee9ad7d00 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:18.833530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3df9e498-bfd3-44a3-a4aa-e238edf4ff4e req-05765e3c-df9d-45b9-88cd-a1cee9ad7d00 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:18.833937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3df9e498-bfd3-44a3-a4aa-e238edf4ff4e req-05765e3c-df9d-45b9-88cd-a1cee9ad7d00 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:18.834406 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:18.834911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:18.835572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:18.836280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:18.836743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:18.837172 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:18.853670 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3df9e498-bfd3-44a3-a4aa-e238edf4ff4e req-05765e3c-df9d-45b9-88cd-a1cee9ad7d00 service nova] Creating event network-changed:df79257d-0ab5-4329-84bd-2180e90a4f0d for instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d on n-h1-master-1 Oct 16 02:12:18.860266 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3df9e498-bfd3-44a3-a4aa-e238edf4ff4e req-05765e3c-df9d-45b9-88cd-a1cee9ad7d00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049233 Oct 16 02:12:18.861227 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3778/7420] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:12:19.071835 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:19.080251 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-36368a0b-c0e2-4777-ad67-37dc0626d6bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1562 microversion: 2.1 time: 0.273797 Oct 16 02:12:19.080842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3643/7421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:18 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1562 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:40.320771 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=38 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:40.325987 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:12:40.328273 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:40.337607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:40.338096 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:40.338539 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:40.339275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:40.339739 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:40.340173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:40.408111 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cc096d70-eeeb-4b91-a01a-2e24928e19bd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d/action" status: 200 len: 24567 microversion: 2.1 time: 0.089634 Oct 16 02:12:40.408759 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3779/7422] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:12:40 2022] POST /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d/action => generated 24567 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:12:51.481123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:12:51.483363 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:51.485533 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:51.486177 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=36 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:51.491905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:51.492394 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:51.492832 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:51.493527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:51.493983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:51.494410 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:51.567015 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a8b4a663-9e3a-467c-ae07-6437e749c80e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d/action" status: 202 len: 0 microversion: 2.1 time: 0.090556 Oct 16 02:12:51.567668 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3644/7423] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:12:51 2022] POST /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:12:51.581868 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:51.583188 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:51.588838 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:51.589703 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:12:51.597136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:51.597776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:51.598227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:51.599035 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:51.599685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:51.600196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:52.089111 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:52.096776 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-249fb061-cdad-40bb-8bc9-94127d476713 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1673 microversion: 2.1 time: 0.523381 Oct 16 02:12:52.097350 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3780/7424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:51 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1673 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:12:53.123785 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:53.124476 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:53.130874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:53.131385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:53.131827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:53.133048 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:53.133512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:53.133941 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:53.266254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:53.275101 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1ccb61c9-cb98-495e-9f74-13e81365e49d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.156726 Oct 16 02:12:53.275669 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3645/7425] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:53 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:54.299135 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:54.299777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:54.310558 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:54.311097 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:54.311545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:54.312252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:54.312726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:54.313163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:54.443136 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:54.451180 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cce1d938-649c-4046-bc80-81c4d2ea683c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.155997 Oct 16 02:12:54.451759 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3781/7426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:54 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:55.475279 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:55.475818 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:55.483177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:55.483663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:55.484099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:55.484791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:55.485252 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:55.485678 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:55.620163 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:55.627839 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-61cd659a-f0fb-4131-ba25-4a62be3b7fd5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.156544 Oct 16 02:12:55.628413 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3646/7427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:55 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:56.651837 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:56.652414 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:56.659209 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:56.659706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:56.660156 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:56.660850 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:56.661320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:56.661755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:56.792619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:56.800319 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2daa88a8-00e3-4d1c-9e60-a0759e6c3428 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.152740 Oct 16 02:12:56.801164 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3782/7428] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:56 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:12:57.825550 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:57.826087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:57.832899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:57.833379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:57.833818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:57.834510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:57.834993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:57.835421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:57.969035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:57.976921 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ae5a1e44-7484-4c2e-a826-8b58bf6930dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.155332 Oct 16 02:12:57.977490 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3647/7429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:57 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:12:59.001162 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:12:59.001706 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:12:59.008999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:59.009495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:59.009944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:59.010647 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:12:59.011152 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:12:59.011593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:12:59.143960 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:12:59.152704 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7f83150d-7946-41dc-8e6e-55c833993b70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.155639 Oct 16 02:12:59.153362 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3783/7430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:12:58 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:00.176500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:00.177115 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:00.184412 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:00.184899 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:00.185368 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:00.186068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:00.186530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:00.186980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:00.317414 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:00.325868 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-90bba721-fa6f-480a-9a01-b6dc118fd6ce tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.153222 Oct 16 02:13:00.326444 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3648/7431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:00 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:01.349853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:01.350518 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:01.357926 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:01.358442 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:01.358900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:01.359644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:01.360124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:01.360568 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:01.591516 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:01.599619 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-453546b4-c7ac-4e4c-ab9e-2cacc983fe8c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.253461 Oct 16 02:13:01.600252 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3784/7432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:01 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:02.624225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:02.624855 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:02.631802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:02.632432 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:02.633641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:02.634339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:02.634799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:02.635253 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:02.768720 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:02.777231 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c165514c-78f1-4cf5-aae0-144a6076c2dd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.156900 Oct 16 02:13:02.777819 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3649/7433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:02 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:03.801091 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:03.801717 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:03.808738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:03.809238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:03.809687 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:03.810428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:03.810910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:03.811423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:03.948639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:03.956445 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7a2d395b-a0e5-45e5-8e31-a1968c39a08a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.159282 Oct 16 02:13:03.957019 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3785/7434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:03 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:04.979850 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:04.980409 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:04.987062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:04.987544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:04.987973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:04.988653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:04.989103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:04.989524 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:05.120513 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:05.128144 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-74060006-7d0c-4234-abf6-cd925f6bbfbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.152921 Oct 16 02:13:05.128710 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3650/7435] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:04 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:06.152171 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:06.152798 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:06.159706 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:06.160203 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:06.160653 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:06.161353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:06.161827 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:06.162266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:06.296090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:06.303844 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-becfb19c-1d27-4afa-be78-4690acdfbcac tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.155722 Oct 16 02:13:06.304960 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3786/7436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:06 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:07.327804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:07.328421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:07.335300 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:07.336382 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:07.336826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:07.337525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:07.338004 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:07.338425 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:07.468789 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:07.476630 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6e88ce5e-f9a4-4aa7-8148-cb8a5aea7eae tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1678 microversion: 2.1 time: 0.152722 Oct 16 02:13:07.477211 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3651/7437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:07 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:08.500037 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:08.500720 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:08.508129 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:08.508639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:08.509083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:08.509785 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:08.510255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:08.510692 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:08.649988 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:08.660282 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7d1cb64-2f32-451c-85b0-d7f01f338411 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1681 microversion: 2.1 time: 0.164102 Oct 16 02:13:08.660872 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3787/7438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:08 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:32.850024 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:13:32.852286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:32.854720 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=16 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:13:32.855412 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:13:32.861103 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:32.861588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:32.862027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:32.862716 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:32.863208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:32.863634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:32.936186 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2b442f51-7a5c-40a0-95b4-eba400e17dc0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d/action" status: 200 len: 69242 microversion: 2.1 time: 0.090048 Oct 16 02:13:32.936842 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3652/7439] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:13:32 2022] POST /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d/action => generated 69242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:13:40.268066 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-372fa8c9-41f6-4fd3-a4b6-222479c5b545 req-0c3ebb9f-ec31-436f-b499-0bcd1aa64b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d1fa5a-a7f7-4d06-86da-2bc5085d037d", "tag": "df79257d-0ab5-4329-84bd-2180e90a4f0d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:13:40.272112 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:40.272743 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:40.276880 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:13:40.277605 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=48 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:13:40.281471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:40.282113 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:40.282644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:40.283471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:40.284024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:40.284561 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:40.286426 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-372fa8c9-41f6-4fd3-a4b6-222479c5b545 req-0c3ebb9f-ec31-436f-b499-0bcd1aa64b83 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:40.286755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-372fa8c9-41f6-4fd3-a4b6-222479c5b545 req-0c3ebb9f-ec31-436f-b499-0bcd1aa64b83 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:40.287205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-372fa8c9-41f6-4fd3-a4b6-222479c5b545 req-0c3ebb9f-ec31-436f-b499-0bcd1aa64b83 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:40.299355 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-372fa8c9-41f6-4fd3-a4b6-222479c5b545 req-0c3ebb9f-ec31-436f-b499-0bcd1aa64b83 service nova] Creating event network-changed:df79257d-0ab5-4329-84bd-2180e90a4f0d for instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d on n-h1-master-1 Oct 16 02:13:40.304654 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-372fa8c9-41f6-4fd3-a4b6-222479c5b545 req-0c3ebb9f-ec31-436f-b499-0bcd1aa64b83 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040681 Oct 16 02:13:40.305635 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3653/7440] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:13:40.312371 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:13:40.413468 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea50efd4-1df4-4134-bd35-ab1f5f88095e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 204 len: 0 microversion: 2.1 time: 0.151436 Oct 16 02:13:40.414085 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3788/7441] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:13:40 2022] DELETE /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:13:40.423840 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:40.424562 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:40.431766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:40.432263 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:40.432698 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:40.433400 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:40.433854 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:40.434275 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:40.599592 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:40.607610 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1cb0db57-3dbf-4a75-a5be-c7c9477cddfb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1687 microversion: 2.1 time: 0.188484 Oct 16 02:13:40.608343 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3654/7442] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:40 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:41.632296 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:41.633020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:41.640641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:41.641149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:41.641604 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:41.642355 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:41.642834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:41.643312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:41.879209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:41.886967 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34f9922b-80c3-4492-9208-67530ade9bff tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1687 microversion: 2.1 time: 0.258948 Oct 16 02:13:41.887554 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3789/7443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:41 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1687 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:42.565812 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-ec1d5b07-bbd6-4a90-b93c-2df06758b659 req-8202081a-7eaf-45df-86ed-89282c2b2115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d1fa5a-a7f7-4d06-86da-2bc5085d037d", "name": "network-vif-deleted", "tag": "df79257d-0ab5-4329-84bd-2180e90a4f0d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:13:42.579225 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ec1d5b07-bbd6-4a90-b93c-2df06758b659 req-8202081a-7eaf-45df-86ed-89282c2b2115 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:42.579705 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ec1d5b07-bbd6-4a90-b93c-2df06758b659 req-8202081a-7eaf-45df-86ed-89282c2b2115 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:42.580135 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-ec1d5b07-bbd6-4a90-b93c-2df06758b659 req-8202081a-7eaf-45df-86ed-89282c2b2115 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:42.591407 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-ec1d5b07-bbd6-4a90-b93c-2df06758b659 req-8202081a-7eaf-45df-86ed-89282c2b2115 service nova] Creating event network-vif-deleted:df79257d-0ab5-4329-84bd-2180e90a4f0d for instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d on n-h1-master-1 Oct 16 02:13:42.596502 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-ec1d5b07-bbd6-4a90-b93c-2df06758b659 req-8202081a-7eaf-45df-86ed-89282c2b2115 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Oct 16 02:13:42.597226 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3655/7444] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:13:42.911662 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:42.912295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:42.919241 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:42.919745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:42.920205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:42.920937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:42.921403 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:42.921878 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:42.955641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:42.956148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:42.956603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:42.957070 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lazy-loading 'fault' on Instance uuid 36d1fa5a-a7f7-4d06-86da-2bc5085d037d {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:13:43.003557 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:43.012559 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-0103009f-622f-431f-b730-a71b86136f77 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 200 len: 1356 microversion: 2.1 time: 0.104901 Oct 16 02:13:43.013139 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3790/7445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:42 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:44.037653 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:44.038307 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 36d1fa5a-a7f7-4d06-86da-2bc5085d037d] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:44.044512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:44.044997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:44.045442 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:44.046134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:44.046593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:44.047055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:44.061190 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] HTTP exception thrown: Instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d could not be found. Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Request method failure captured: Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d HTTP/1.1 Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2gw1un4B-9TzvU_NcvReYiRfmzKwj78ID6yrTwa9saKHqKshEUSlMO03SCAEgkMQvUgOIeRfDdgprSjWpj2qsGLsgTSvnJ-tRKq1i_hUZxWeb8LDhEHcsolvJ4osfaLEQSsjkpKZjU3HEdzklBGfuBFQiBl-hhmf-gPSpoO-u63BwA Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_78214f1cbf1f4856b3f2ce094a2a111a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1a52bdeacefc48c496206b4e4f5ee78f Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d could not be found. Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '36d1fa5a-a7f7-4d06-86da-2bc5085d037d'} Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d could not be found. Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d could not be found. Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:13:44.062809 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d could not be found. Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Returning 404 to user: Instance 36d1fa5a-a7f7-4d06-86da-2bc5085d037d could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d2f79e1e-49cc-46f1-a364-ecceccc31b50 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d" status: 404 len: 111 microversion: 2.1 time: 0.031878 Oct 16 02:13:44.068428 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3656/7446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:44 2022] GET /compute/v2.1/servers/36d1fa5a-a7f7-4d06-86da-2bc5085d037d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:13:47.107731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-03948e51-e6c5-4bbf-b2a0-bc474228d6f8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '.version_select at 0x7fd64dfc8dc0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:47.129896 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-03948e51-e6c5-4bbf-b2a0-bc474228d6f8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1259483775" status: 202 len: 0 microversion: 2.1 time: 0.025645 Oct 16 02:13:47.130500 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3791/7447] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Oct 16 02:13:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1259483775 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:13:47.160361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c5548b1-0a29-44c0-9d0d-6fc8b135206c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: .version_select at 0x7fd64d0083a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1486401029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuX5OQFkF+/UwyGAK/R1d3BmvJ5R2AAxJbquYOZiT793NtX+C9CWZ6EGK8sTxFvyLq7idMmlnZaBJeyGDrJgvAfrFq1iVJqv3I0oL8gC70LtPoMuouQnuA46WvhQqkFfw=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:13:47.180010 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-1c5548b1-0a29-44c0-9d0d-6fc8b135206c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:13:47.186114 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-1c5548b1-0a29-44c0-9d0d-6fc8b135206c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:13:47.211075 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c5548b1-0a29-44c0-9d0d-6fc8b135206c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054548 Oct 16 02:13:47.212291 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3657/7448] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:13:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:13:52.573207 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1098718187", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "2ec8d71e-aee3-48f4-a45c-cfd3542d0efd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1486401029", "security_groups": [{"name": "tempest-secgroup-smoke-1474495575"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:13:52.696876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] validate_networks() for [('2ec8d71e-aee3-48f4-a45c-cfd3542d0efd', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:13:53.008046 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:13:53.167503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:13:53.167946 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:13:53.168438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:13:53.168917 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:13:53.169292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:13:53.180641 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:53.181372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:53.182194 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:53.183249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:53.184006 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:53.184666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:53.209405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:13:53.216815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:13:53.231176 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:13:53.233851 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:13:53.301552 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e4fa3dd0-db2b-4c81-8ec7-b0f74cb49b18 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733957 Oct 16 02:13:53.302199 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3792/7449] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:13:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:13:53.314060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-140c78e9-521c-4a8a-b74d-896cf740736b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:53.315225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-140c78e9-521c-4a8a-b74d-896cf740736b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:53.534867 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-140c78e9-521c-4a8a-b74d-896cf740736b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:53.552458 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-140c78e9-521c-4a8a-b74d-896cf740736b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1267 microversion: 2.1 time: 0.242266 Oct 16 02:13:53.553369 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3658/7450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:53 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:13:54.579808 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:54.581264 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:54.588364 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:54.588940 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:54.589607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:54.590432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:54.590942 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:54.591386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:54.681938 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:54.690062 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7754f615-49ad-4782-94b2-78fcc091c483 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1327 microversion: 2.1 time: 0.115580 Oct 16 02:13:54.695701 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3793/7451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:54 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:55.714523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:55.715883 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:55.721592 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=16 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:13:55.724928 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:13:55.725469 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:13:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a (ip 10.222.0.39) !!! Oct 16 02:13:55.730362 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:55.731234 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:55.732438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:55.733801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:55.734506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:55.735194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:55.909008 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:55.918191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a7efa045-c6c1-40d5-9667-b6a9d718fa65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1393 microversion: 2.1 time: 0.208353 Oct 16 02:13:55.918792 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3659/7452] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:55 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1393 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:56.298588 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-d0f059a3-11c0-4777-a020-9f79ca5ba71c req-74d85305-5f18-4f1d-ae5d-9d3c846f4ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df11db5-4be9-4093-aa9f-3c8a056f1f7a", "tag": "2abcf5bf-e1a0-4e95-b5ff-720231e94ca1"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:13:56.315414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d0f059a3-11c0-4777-a020-9f79ca5ba71c req-74d85305-5f18-4f1d-ae5d-9d3c846f4ba7 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:56.316011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d0f059a3-11c0-4777-a020-9f79ca5ba71c req-74d85305-5f18-4f1d-ae5d-9d3c846f4ba7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:56.316530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-d0f059a3-11c0-4777-a020-9f79ca5ba71c req-74d85305-5f18-4f1d-ae5d-9d3c846f4ba7 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:56.334365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-d0f059a3-11c0-4777-a020-9f79ca5ba71c req-74d85305-5f18-4f1d-ae5d-9d3c846f4ba7 service nova] Creating event network-changed:2abcf5bf-e1a0-4e95-b5ff-720231e94ca1 for instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a on n-h1-master-1 Oct 16 02:13:56.340990 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-d0f059a3-11c0-4777-a020-9f79ca5ba71c req-74d85305-5f18-4f1d-ae5d-9d3c846f4ba7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046056 Oct 16 02:13:56.341609 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3794/7453] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:13:56.941913 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:56.942524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:56.950505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:56.951020 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:56.951454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:56.952136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:56.952589 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:56.953014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:57.086226 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:57.094151 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9c568ffc-3020-4e59-b366-398d1acd2182 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1393 microversion: 2.1 time: 0.156401 Oct 16 02:13:57.094727 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3660/7454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:56 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:58.119192 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:58.120002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:58.126535 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:58.127090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:58.127575 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:58.128287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:58.128761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:58.129200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:58.265747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:58.273445 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fbbc2cff-6bb7-4700-b4c8-d3d66c6d1cdd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1393 microversion: 2.1 time: 0.159498 Oct 16 02:13:58.274077 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3795/7455] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:58 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:13:59.296743 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:13:59.297379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:13:59.304450 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:59.304966 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:59.305407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:59.306110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:13:59.306718 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:13:59.307036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:13:59.439862 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:13:59.448123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-334fbdb4-ebd1-4984-9185-69c2cb15c526 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1393 microversion: 2.1 time: 0.155172 Oct 16 02:13:59.448709 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3661/7456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:13:59 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:00.471257 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:00.471878 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:00.479347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:00.479846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:00.480295 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:00.480999 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:00.481470 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:00.481906 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:00.618139 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:00.625878 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-40ea493b-feea-49f0-9bd6-b9a6d1b48a5a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1393 microversion: 2.1 time: 0.158528 Oct 16 02:14:00.626458 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3796/7457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:00 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:01.147515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-6bd0a198-0057-4652-86e6-f9d996e23f3b req-f69493c2-00e8-43ae-961c-8c68425bfdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df11db5-4be9-4093-aa9f-3c8a056f1f7a", "name": "network-vif-plugged", "status": "completed", "tag": "2abcf5bf-e1a0-4e95-b5ff-720231e94ca1"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:14:01.160721 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6bd0a198-0057-4652-86e6-f9d996e23f3b req-f69493c2-00e8-43ae-961c-8c68425bfdf4 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:01.161212 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6bd0a198-0057-4652-86e6-f9d996e23f3b req-f69493c2-00e8-43ae-961c-8c68425bfdf4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:01.161643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-6bd0a198-0057-4652-86e6-f9d996e23f3b req-f69493c2-00e8-43ae-961c-8c68425bfdf4 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:01.173485 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-6bd0a198-0057-4652-86e6-f9d996e23f3b req-f69493c2-00e8-43ae-961c-8c68425bfdf4 service nova] Creating event network-vif-plugged:2abcf5bf-e1a0-4e95-b5ff-720231e94ca1 for instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a on n-h1-master-1 Oct 16 02:14:01.179278 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-6bd0a198-0057-4652-86e6-f9d996e23f3b req-f69493c2-00e8-43ae-961c-8c68425bfdf4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035392 Oct 16 02:14:01.179925 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3662/7458] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:14:01.649735 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:01.650363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:01.657371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:01.657873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:01.658327 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:01.659068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:01.659546 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:01.659989 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:01.794427 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:01.802114 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fa6439c6-1180-4eef-ba26-b23bf9c7f515 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1393 microversion: 2.1 time: 0.156404 Oct 16 02:14:01.802688 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3797/7459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:01 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:02.828531 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:02.829135 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:02.835359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:02.835835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:02.836278 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:02.837082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:02.837531 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:02.837951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:02.972087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:02.979856 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c2af5cc-7fff-4000-9fe6-0365c4973e41 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1564 microversion: 2.1 time: 0.156999 Oct 16 02:14:02.980425 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3663/7460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:02 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:14:03.002943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:03.003597 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:03.011108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:03.011602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:03.012048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:03.012743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:03.013216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:03.013652 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:03.143083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:03.151194 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-abaa0276-7861-4053-8a30-95314006e1dc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1564 microversion: 2.1 time: 0.152033 Oct 16 02:14:03.151775 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3798/7461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:02 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:05.022306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:05.022994 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:05.025722 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:05.027583 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:05.027945 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-9d81f9f4-c689-4013-b937-b93da41cf008 req-3b4e1f88-4cf6-4c91-9e6e-bbf4ff1c45f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df11db5-4be9-4093-aa9f-3c8a056f1f7a", "tag": "2abcf5bf-e1a0-4e95-b5ff-720231e94ca1"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:14:05.033980 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:05.034565 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:05.035277 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:05.036220 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:05.036813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:05.037492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:05.041665 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:05.043208 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:05.048723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9d81f9f4-c689-4013-b937-b93da41cf008 req-3b4e1f88-4cf6-4c91-9e6e-bbf4ff1c45f3 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:05.049634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9d81f9f4-c689-4013-b937-b93da41cf008 req-3b4e1f88-4cf6-4c91-9e6e-bbf4ff1c45f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:05.050259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-9d81f9f4-c689-4013-b937-b93da41cf008 req-3b4e1f88-4cf6-4c91-9e6e-bbf4ff1c45f3 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:05.065404 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-9d81f9f4-c689-4013-b937-b93da41cf008 req-3b4e1f88-4cf6-4c91-9e6e-bbf4ff1c45f3 service nova] Creating event network-changed:2abcf5bf-e1a0-4e95-b5ff-720231e94ca1 for instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a on n-h1-master-1 Oct 16 02:14:05.072113 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-9d81f9f4-c689-4013-b937-b93da41cf008 req-3b4e1f88-4cf6-4c91-9e6e-bbf4ff1c45f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050652 Oct 16 02:14:05.073135 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3799/7462] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:14:05.184474 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:05.192987 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bfd61409-45bf-4a12-8220-c70909c5aacd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1564 microversion: 2.1 time: 0.174885 Oct 16 02:14:05.193563 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3664/7463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:05 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:26.445380 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:26.446979 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=36 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:26.451033 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:14:26.453334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:26.461147 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:26.462259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:26.462708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:26.463471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:26.463947 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:26.464389 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:26.533503 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9c72ea78-cb63-4410-b9c0-395ed0686841 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a/action" status: 200 len: 24572 microversion: 2.1 time: 0.090062 Oct 16 02:14:26.534132 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3800/7464] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:14:26 2022] POST /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a/action => generated 24572 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:14:37.548326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:14:37.550583 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:37.552984 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:37.553630 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=32 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:37.560168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:37.560659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:37.561106 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:37.561812 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:37.562301 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:37.563105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:37.605369 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:37.611218 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120546) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 16 02:14:37.617769 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:14:37.618875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:14:37.620013 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:14:37.620440 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:14:37.620892 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:14:37.684970 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d9dc531c-11eb-4aa3-bc80-89ab9574efbd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.140568 Oct 16 02:14:37.686959 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3665/7465] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:14:37 2022] POST /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:14:37.694750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:37.695691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:37.698349 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:37.699025 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=4 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:14:37.704867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:37.705050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:37.705684 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:37.706405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:37.706882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:37.707351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:37.858826 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:37.866729 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2d7daa1c-0c0e-4024-b797-5b4a048944db tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1691 microversion: 2.1 time: 0.176548 Oct 16 02:14:37.867413 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3801/7466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:37 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:38.893087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:38.893645 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:38.900911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:38.901364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:38.901808 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:38.902505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:38.902986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:38.903417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:39.041099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:39.048860 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-744cc066-78b1-4a04-a33b-24bb16332acc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1691 microversion: 2.1 time: 0.160722 Oct 16 02:14:39.049425 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3666/7467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:38 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:40.074161 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:40.074753 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:40.081483 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:40.081976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:40.082424 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:40.083151 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:40.083621 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:40.084058 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:40.218909 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:40.226681 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-47f3f986-1f90-4943-9ac3-c44209801faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.156681 Oct 16 02:14:40.227285 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3802/7468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:40 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:41.252062 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:41.252680 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:41.260187 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:41.260792 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:41.261235 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:41.261930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:41.262391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:41.262823 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:41.393487 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:41.401274 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-14941eb3-ad5a-43c1-ae1c-c495c9ec75b9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.153109 Oct 16 02:14:41.401848 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3667/7469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:41 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:42.425254 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:42.425888 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:42.432826 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:42.433331 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:42.433787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:42.434496 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:42.435001 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:42.435450 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:42.570343 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:42.579629 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8b33e1fa-2efb-4d68-b203-384ea31432a8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.158302 Oct 16 02:14:42.580210 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3803/7470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:42 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:43.603479 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:43.604095 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:43.610893 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:43.611404 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:43.611845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:43.612526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:43.613216 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:43.613646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:43.743852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:43.751845 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4a13312c-69d7-4718-afa3-d5e6f95cd14f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.152298 Oct 16 02:14:43.752423 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3668/7471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:43 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:44.776503 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:44.777126 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:44.784142 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:44.784667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:44.785148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:44.785853 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:44.786342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:44.786781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:44.919718 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:44.927358 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fc69a8b4-545b-4fea-b2fb-4d04c44da7eb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.155423 Oct 16 02:14:44.927928 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3804/7472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:44 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:45.951771 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:45.952331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:45.959168 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:45.959652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:45.960093 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:45.960804 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:45.961262 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:45.961688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:46.100849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:46.109191 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cb158955-ba32-44ae-aa0e-a120b661fe29 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.161561 Oct 16 02:14:46.109768 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3669/7473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:45 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:47.133800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:47.135471 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:47.141952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:47.142453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:47.142907 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:47.143644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:47.144124 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:47.144572 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:47.275641 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:47.283331 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-665a45ba-bf6a-4ddc-b736-6c5d29f4e5df tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.153480 Oct 16 02:14:47.283910 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3805/7474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:47 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:48.310256 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:48.310870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:48.318094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:48.318583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:48.319053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:48.319749 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:48.320205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:48.320633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:48.461794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:48.470288 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-205e9eb7-ce95-49fb-9396-670776824404 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.164568 Oct 16 02:14:48.470872 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3670/7475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:48 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:49.494036 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:49.494758 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:49.501734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:49.502226 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:49.502667 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:49.503400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:49.503874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:49.504339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:49.639206 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:49.647031 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd4b03b9-356f-45af-8ad1-f7c61763be6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.157358 Oct 16 02:14:49.647612 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3806/7476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:49 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:50.670318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:50.670944 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:50.677759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:50.678236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:50.678668 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:50.679376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:50.679830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:50.680250 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:50.810491 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:50.818432 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-61b51b7c-c47c-42ee-89fe-c13c9482db16 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.152434 Oct 16 02:14:50.819120 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3671/7477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:50 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:51.841916 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:51.842447 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:51.849278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:51.849781 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:51.850229 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:51.850954 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:51.851495 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:51.851939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:51.991412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:51.999985 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a7fcef7-df10-4281-bcb1-dfe84da3e159 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.162009 Oct 16 02:14:52.000584 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3807/7478] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:51 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:53.030578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:53.031155 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:53.037113 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:53.037593 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:53.038030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:53.038743 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:53.039223 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:53.039643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:53.172690 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:53.180366 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bcb6338b-c443-4f7c-91ef-f89bb7f1b5ca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.154130 Oct 16 02:14:53.180973 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3672/7479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:53 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:54.205552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:54.206178 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:54.213010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:54.213505 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:54.214469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:54.215373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:54.215842 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:54.216279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:54.350749 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:54.358979 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a82af15-f0bc-4603-9418-adfc0cd49347 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.157287 Oct 16 02:14:54.359576 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3808/7480] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:54 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:55.383101 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:55.383748 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:55.391197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:55.391691 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:55.392126 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:55.392822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:55.393283 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:55.393714 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:55.526302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:55.534000 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c149cd7-f74b-48cd-bf64-a691e5bc8287 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.154817 Oct 16 02:14:55.534513 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3673/7481] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:55 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:56.557492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:56.558572 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:56.565251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:56.565756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:56.566208 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:56.566979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:56.567718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:56.568164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:56.702044 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:56.709799 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0619264-6c2a-4130-ae27-a10985c9dcf6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1696 microversion: 2.1 time: 0.156313 Oct 16 02:14:56.710373 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3809/7482] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:56 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:57.495180 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2f79ed1d-c893-4917-ad38-1fb40e8a142b req-e20f02d9-d989-4ad7-bd00-3dc327cfbb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df11db5-4be9-4093-aa9f-3c8a056f1f7a", "name": "network-vif-unplugged", "status": "completed", "tag": "2abcf5bf-e1a0-4e95-b5ff-720231e94ca1"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:14:57.505927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2f79ed1d-c893-4917-ad38-1fb40e8a142b req-e20f02d9-d989-4ad7-bd00-3dc327cfbb06 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:57.506428 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2f79ed1d-c893-4917-ad38-1fb40e8a142b req-e20f02d9-d989-4ad7-bd00-3dc327cfbb06 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:57.506811 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2f79ed1d-c893-4917-ad38-1fb40e8a142b req-e20f02d9-d989-4ad7-bd00-3dc327cfbb06 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:57.519455 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2f79ed1d-c893-4917-ad38-1fb40e8a142b req-e20f02d9-d989-4ad7-bd00-3dc327cfbb06 service nova] Creating event network-vif-unplugged:2abcf5bf-e1a0-4e95-b5ff-720231e94ca1 for instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a on n-h2-master-1 Oct 16 02:14:57.524838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [req-2f79ed1d-c893-4917-ad38-1fb40e8a142b req-e20f02d9-d989-4ad7-bd00-3dc327cfbb06 service nova] Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120546) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 02:14:57.536370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2f79ed1d-c893-4917-ad38-1fb40e8a142b req-e20f02d9-d989-4ad7-bd00-3dc327cfbb06 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044968 Oct 16 02:14:57.537000 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3674/7483] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:14:57.734488 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:57.735223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:57.742174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:57.742679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:57.743173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:57.743894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:57.744369 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:57.744812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:57.880781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:57.889306 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5047074c-e80b-45e1-af16-d91160f99dca tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1695 microversion: 2.1 time: 0.159388 Oct 16 02:14:57.890212 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3810/7484] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:57 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:58.915266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:14:58.915870 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:14:58.922416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:58.922898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:58.923364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:58.924051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:58.924502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:58.924925 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:59.059382 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:14:59.067090 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-86ca9c8a-99a8-467a-9760-012beacf3201 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1693 microversion: 2.1 time: 0.157164 Oct 16 02:14:59.067923 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3675/7485] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:14:58 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:14:59.579300 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c264f5cf-1fb1-4a77-a89a-1195af7887e1 req-eb91d6d6-da71-4983-bacb-db9d3a5fd8ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df11db5-4be9-4093-aa9f-3c8a056f1f7a", "tag": "2abcf5bf-e1a0-4e95-b5ff-720231e94ca1"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:14:59.589512 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c264f5cf-1fb1-4a77-a89a-1195af7887e1 req-eb91d6d6-da71-4983-bacb-db9d3a5fd8ee service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:14:59.590003 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c264f5cf-1fb1-4a77-a89a-1195af7887e1 req-eb91d6d6-da71-4983-bacb-db9d3a5fd8ee service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:14:59.590444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c264f5cf-1fb1-4a77-a89a-1195af7887e1 req-eb91d6d6-da71-4983-bacb-db9d3a5fd8ee service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:14:59.602138 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c264f5cf-1fb1-4a77-a89a-1195af7887e1 req-eb91d6d6-da71-4983-bacb-db9d3a5fd8ee service nova] Creating event network-changed:2abcf5bf-e1a0-4e95-b5ff-720231e94ca1 for instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a on n-h2-master-1 Oct 16 02:14:59.607699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-c264f5cf-1fb1-4a77-a89a-1195af7887e1 req-eb91d6d6-da71-4983-bacb-db9d3a5fd8ee service nova] Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 02:14:59.618613 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c264f5cf-1fb1-4a77-a89a-1195af7887e1 req-eb91d6d6-da71-4983-bacb-db9d3a5fd8ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043153 Oct 16 02:14:59.619249 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3811/7486] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:15:00.092326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:00.092948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:00.099773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:00.100256 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:00.100690 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:00.101384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:00.101836 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:00.102258 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:00.243396 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:00.252799 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a880c43c-1e3c-4337-9313-695ad0b16e4d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1693 microversion: 2.1 time: 0.164949 Oct 16 02:15:00.253557 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3676/7487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:00 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:01.279158 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:01.279873 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:01.287060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:01.287571 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:01.288028 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:01.288748 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:01.289228 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:01.289674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:01.425981 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:01.434387 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b11f2b8d-27a6-4a47-86bf-6d3c5e4905cc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1690 microversion: 2.1 time: 0.160452 Oct 16 02:15:01.434977 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3812/7488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:01 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:01.457346 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:01.457893 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:01.464844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:01.465337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:01.465774 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:01.466470 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:01.466940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:01.467380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:01.528228 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5bb46d30-bfc4-4556-ab74-c89de91dddd6 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a/action" status: 204 len: 0 microversion: 2.1 time: 0.074534 Oct 16 02:15:01.528904 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3677/7489] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:15:01 2022] POST /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:15:01.537788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:01.538431 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:01.545314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:01.545859 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:01.546271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:01.547530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:01.548018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:01.548703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:01.693497 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:01.706764 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-543fa810-d263-4ce3-8fa1-dc848dd81a10 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1690 microversion: 2.1 time: 0.169701 Oct 16 02:15:01.707437 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3813/7490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:01 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:01.731140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:01.732060 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:01.738195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:01.738686 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:01.739236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:01.739932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:01.740386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:01.740813 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:02.154037 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:02.162094 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-edaddcfd-b1ac-4901-bec2-80684064b306 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1690 microversion: 2.1 time: 0.435828 Oct 16 02:15:02.162772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3678/7491] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:01 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1690 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:02.694061 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-425520d3-a34b-472f-9bcc-cd564d0386ff req-a9209987-ec86-419d-ba7e-a3bef00cebca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df11db5-4be9-4093-aa9f-3c8a056f1f7a", "name": "network-vif-plugged", "status": "completed", "tag": "2abcf5bf-e1a0-4e95-b5ff-720231e94ca1"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:02.708428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-425520d3-a34b-472f-9bcc-cd564d0386ff req-a9209987-ec86-419d-ba7e-a3bef00cebca service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:02.708920 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-425520d3-a34b-472f-9bcc-cd564d0386ff req-a9209987-ec86-419d-ba7e-a3bef00cebca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:02.709363 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-425520d3-a34b-472f-9bcc-cd564d0386ff req-a9209987-ec86-419d-ba7e-a3bef00cebca service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:02.721971 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-425520d3-a34b-472f-9bcc-cd564d0386ff req-a9209987-ec86-419d-ba7e-a3bef00cebca service nova] Creating event network-vif-plugged:2abcf5bf-e1a0-4e95-b5ff-720231e94ca1 for instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a on n-h2-master-1 Oct 16 02:15:02.727216 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [req-425520d3-a34b-472f-9bcc-cd564d0386ff req-a9209987-ec86-419d-ba7e-a3bef00cebca service nova] Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=120545) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 16 02:15:02.740053 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-425520d3-a34b-472f-9bcc-cd564d0386ff req-a9209987-ec86-419d-ba7e-a3bef00cebca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049916 Oct 16 02:15:02.741092 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3814/7492] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:15:03.186671 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:03.187333 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:03.194328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:03.194805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:03.195284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:03.196071 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:03.196530 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:03.196949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:03.212286 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:03.330765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:03.338555 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2c8ef320-4b12-4ec9-9d06-8fe8b1f9b039 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1682 microversion: 2.1 time: 0.155726 Oct 16 02:15:03.339766 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3679/7493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:03 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:27.528170 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=28 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:27.529686 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=80 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:27.533974 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:27.536313 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:27.543255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:27.543766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:27.544215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:27.544924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:27.545400 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:27.545836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:27.617881 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6e2bf614-9ca6-4839-af04-6085eb7812fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a/action" status: 200 len: 24569 microversion: 2.1 time: 0.091636 Oct 16 02:15:27.618533 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3815/7494] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:15:27 2022] POST /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a/action => generated 24569 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:15:34.878026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:34.878575 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:34.880773 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=34 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:34.881615 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:34.887994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:34.888626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:34.889086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:34.889801 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:34.890265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:34.890692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:34.918549 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:15:34.944814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-13708307-7bcf-4447-ad81-2a3aca137fc3 req-68a10e1d-6fe0-45b1-b1b0-6ec99da012fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df11db5-4be9-4093-aa9f-3c8a056f1f7a", "tag": "2abcf5bf-e1a0-4e95-b5ff-720231e94ca1"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:34.957599 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-13708307-7bcf-4447-ad81-2a3aca137fc3 req-68a10e1d-6fe0-45b1-b1b0-6ec99da012fb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:34.958353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-13708307-7bcf-4447-ad81-2a3aca137fc3 req-68a10e1d-6fe0-45b1-b1b0-6ec99da012fb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:34.959030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-13708307-7bcf-4447-ad81-2a3aca137fc3 req-68a10e1d-6fe0-45b1-b1b0-6ec99da012fb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:34.970813 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-13708307-7bcf-4447-ad81-2a3aca137fc3 req-68a10e1d-6fe0-45b1-b1b0-6ec99da012fb service nova] Creating event network-changed:2abcf5bf-e1a0-4e95-b5ff-720231e94ca1 for instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a on n-h2-master-1 Oct 16 02:15:34.977576 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-13708307-7bcf-4447-ad81-2a3aca137fc3 req-68a10e1d-6fe0-45b1-b1b0-6ec99da012fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101832 Oct 16 02:15:34.978493 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3816/7495] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:15:35.001178 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df17bb1c-ebe9-443f-a81d-e74a676d3d46 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 204 len: 0 microversion: 2.1 time: 0.128759 Oct 16 02:15:35.001772 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3680/7496] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:15:34 2022] DELETE /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:15:35.010701 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:35.011451 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:35.018358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:35.018864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:35.019386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:35.020098 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:35.020761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:35.021214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:35.167850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:35.175935 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4108d121-9ec7-49f2-928c-059fbcfafdd0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1688 microversion: 2.1 time: 0.169445 Oct 16 02:15:35.176532 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3817/7497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:35 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:36.201302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:36.201942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:36.210144 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:36.210623 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:36.211081 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:36.211770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:36.212226 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:36.212649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:36.344086 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:36.352024 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d98992a-9813-442f-86d3-26a31ea4f656 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1688 microversion: 2.1 time: 0.155359 Oct 16 02:15:36.352598 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3681/7498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:36 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:37.186797 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c03a35f1-c6e1-44c8-a4a8-5545accaeb0f req-d9b1c71c-322b-4e28-b1ef-86bb3e1acbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df11db5-4be9-4093-aa9f-3c8a056f1f7a", "name": "network-vif-deleted", "tag": "2abcf5bf-e1a0-4e95-b5ff-720231e94ca1"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:37.198119 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c03a35f1-c6e1-44c8-a4a8-5545accaeb0f req-d9b1c71c-322b-4e28-b1ef-86bb3e1acbc0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:37.203143 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c03a35f1-c6e1-44c8-a4a8-5545accaeb0f req-d9b1c71c-322b-4e28-b1ef-86bb3e1acbc0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:37.203616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c03a35f1-c6e1-44c8-a4a8-5545accaeb0f req-d9b1c71c-322b-4e28-b1ef-86bb3e1acbc0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:37.215469 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c03a35f1-c6e1-44c8-a4a8-5545accaeb0f req-d9b1c71c-322b-4e28-b1ef-86bb3e1acbc0 service nova] Creating event network-vif-deleted:2abcf5bf-e1a0-4e95-b5ff-720231e94ca1 for instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a on n-h2-master-1 Oct 16 02:15:37.220727 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c03a35f1-c6e1-44c8-a4a8-5545accaeb0f req-d9b1c71c-322b-4e28-b1ef-86bb3e1acbc0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038186 Oct 16 02:15:37.223189 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3818/7499] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:15:37.376442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:37.377090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:37.384683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:37.385211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:37.385652 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:37.386364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:37.386861 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:37.387334 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:37.418543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:37.419557 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:37.419997 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:37.420447 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lazy-loading 'fault' on Instance uuid 1df11db5-4be9-4093-aa9f-3c8a056f1f7a {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:15:37.463777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:37.472744 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d52cbd30-09d3-440f-8004-5e32199ccab7 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 200 len: 1357 microversion: 2.1 time: 0.100975 Oct 16 02:15:37.473326 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3682/7500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:37 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:38.498601 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:38.499342 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: 1df11db5-4be9-4093-aa9f-3c8a056f1f7a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:38.505507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:38.506009 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:38.506460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:38.507230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:38.507707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:38.508150 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:38.521495 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] HTTP exception thrown: Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a could not be found. Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Request method failure captured: Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a HTTP/1.1 Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2gw1un4B-9TzvU_NcvReYiRfmzKwj78ID6yrTwa9saKHqKshEUSlMO03SCAEgkMQvUgOIeRfDdgprSjWpj2qsGLsgTSvnJ-tRKq1i_hUZxWeb8LDhEHcsolvJ4osfaLEQSsjkpKZjU3HEdzklBGfuBFQiBl-hhmf-gPSpoO-u63BwA Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_78214f1cbf1f4856b3f2ce094a2a111a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1a52bdeacefc48c496206b4e4f5ee78f Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: exception: Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a could not be found. Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': '1df11db5-4be9-4093-aa9f-3c8a056f1f7a'} Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a could not be found. Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a could not be found. Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:15:38.523134 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a could not be found. Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Returning 404 to user: Instance 1df11db5-4be9-4093-aa9f-3c8a056f1f7a could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cb141711-f3b2-4ef1-8817-2b118c66aff9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a" status: 404 len: 111 microversion: 2.1 time: 0.031408 Oct 16 02:15:38.528010 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3819/7501] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:38 2022] GET /compute/v2.1/servers/1df11db5-4be9-4093-aa9f-3c8a056f1f7a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:15:41.854972 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8aa2aef4-43a6-4ebb-9a08-a0c39827c8b3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '.version_select at 0x7fd64cfac5e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:41.878652 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8aa2aef4-43a6-4ebb-9a08-a0c39827c8b3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1486401029" status: 202 len: 0 microversion: 2.1 time: 0.027559 Oct 16 02:15:41.882681 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3683/7502] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Oct 16 02:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1486401029 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:15:41.907567 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-71ddaca5-14f6-413d-8177-d01cb77991c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: .version_select at 0x7fd64df1bf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2088325689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9ntMsye+kImbfVDnWofES0pxcgbgliwPYb8uFuqZy3SJqkY7qGidJuqsbm+vXJig88YIo1qQ3PlvEVOQn/9Bdrta8NxH3xl6xxI6yasRUcmbt8xdprtJhxYoXpqFOgqA=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:41.926209 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-71ddaca5-14f6-413d-8177-d01cb77991c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:15:41.931436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-71ddaca5-14f6-413d-8177-d01cb77991c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:15:41.958898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-71ddaca5-14f6-413d-8177-d01cb77991c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055648 Oct 16 02:15:41.959540 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3820/7503] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:15:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:15:47.489268 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:47.494106 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1872179024", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "10977d3f-d237-4b18-97d3-77dc8f68b004"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2088325689", "security_groups": [{"name": "tempest-secgroup-smoke-1908896327"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:47.622449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] validate_networks() for [('10977d3f-d237-4b18-97d3-77dc8f68b004', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:15:48.311477 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:15:48.311987 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:15:48.312525 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:15:48.312940 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:15:48.313360 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:15:48.322541 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:48.323062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:48.323505 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:48.324431 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:48.325683 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:48.325819 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:48.344310 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:15:48.349919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:15:48.363121 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:15:48.365446 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:15:48.413278 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-36b28f98-2f2c-4f45-b430-3c59f736bae8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.925957 Oct 16 02:15:48.420976 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3684/7504] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:15:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:15:48.426250 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e66769a5-c207-4805-8266-84855e4cfa7e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:48.426872 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e66769a5-c207-4805-8266-84855e4cfa7e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:48.485506 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e66769a5-c207-4805-8266-84855e4cfa7e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:48.494443 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e66769a5-c207-4805-8266-84855e4cfa7e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1267 microversion: 2.1 time: 0.072041 Oct 16 02:15:48.510871 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3821/7505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:48 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:49.520749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:49.521623 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:49.530688 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:49.543380 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:49.544462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:49.548868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:49.548868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:49.548868 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:49.661953 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:49.674965 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-60a787c4-bcf6-4eb9-b1f5-400de0bfa984 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1327 microversion: 2.1 time: 0.160147 Oct 16 02:15:49.690942 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3685/7506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:49 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1327 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:50.700402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:50.701016 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:50.703060 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:50.709925 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:50.710430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:50.710885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:50.711632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:50.712109 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:50.712553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:50.848665 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:50.857121 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bd2f793b-28cf-4392-98a1-b4d3924f2e1b tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1393 microversion: 2.1 time: 0.160613 Oct 16 02:15:50.857692 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3822/7507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:50 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:51.181293 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-1a2657f8-b37e-492d-9bf2-c26e7fbc8022 req-46a977b6-e460-498e-bf76-2ef8ff206319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6fab948-4f84-4ec0-9b7e-ffb57468b9ca", "tag": "b44d7922-ad74-4830-a0d7-988529a67a27"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:51.191002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1a2657f8-b37e-492d-9bf2-c26e7fbc8022 req-46a977b6-e460-498e-bf76-2ef8ff206319 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:51.191486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1a2657f8-b37e-492d-9bf2-c26e7fbc8022 req-46a977b6-e460-498e-bf76-2ef8ff206319 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:51.191922 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-1a2657f8-b37e-492d-9bf2-c26e7fbc8022 req-46a977b6-e460-498e-bf76-2ef8ff206319 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:51.203830 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-1a2657f8-b37e-492d-9bf2-c26e7fbc8022 req-46a977b6-e460-498e-bf76-2ef8ff206319 service nova] Creating event network-changed:b44d7922-ad74-4830-a0d7-988529a67a27 for instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca on n-h1-master-1 Oct 16 02:15:51.208937 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-1a2657f8-b37e-492d-9bf2-c26e7fbc8022 req-46a977b6-e460-498e-bf76-2ef8ff206319 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092415 Oct 16 02:15:51.209547 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3686/7508] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:15:51.881104 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:51.881737 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:51.889305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:51.889798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:51.890249 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:51.890973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:51.891452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:51.891889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:52.023090 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:52.031045 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bdc15804-7ac8-46bf-8856-9605763033c8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1393 microversion: 2.1 time: 0.153890 Oct 16 02:15:52.031642 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3823/7509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:51 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:53.054661 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:53.055387 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:53.063333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:53.063927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:53.064455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:53.065491 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:53.066080 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:53.066741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:53.202750 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:53.210457 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1fc8ac8f-adbb-4401-9efb-3b45394c44a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1393 microversion: 2.1 time: 0.160944 Oct 16 02:15:53.211053 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3687/7510] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:53 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:54.234391 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:54.235141 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:54.241933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:54.242446 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:54.242895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:54.243629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:54.244103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:54.244548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:54.378316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:54.385980 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2da47d7d-d1de-4c2c-b719-562492a912b8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1393 microversion: 2.1 time: 0.156159 Oct 16 02:15:54.386544 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3824/7511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:54 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:55.410461 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:55.411108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:55.417946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:55.418520 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:55.418903 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:55.420420 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:55.421027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:55.421463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:55.598781 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:55.606866 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d877abe7-b586-4071-accc-3f424d30c72a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1393 microversion: 2.1 time: 0.200243 Oct 16 02:15:55.608552 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3688/7512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:55 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1393 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:55.768645 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b3ccc662-6139-4cd5-8355-ba99c1415a90 req-9258a38b-bb2e-42ca-bb9c-05fda6894df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6fab948-4f84-4ec0-9b7e-ffb57468b9ca", "name": "network-vif-plugged", "status": "completed", "tag": "b44d7922-ad74-4830-a0d7-988529a67a27"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:55.779865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b3ccc662-6139-4cd5-8355-ba99c1415a90 req-9258a38b-bb2e-42ca-bb9c-05fda6894df1 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:55.780366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b3ccc662-6139-4cd5-8355-ba99c1415a90 req-9258a38b-bb2e-42ca-bb9c-05fda6894df1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:55.780813 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b3ccc662-6139-4cd5-8355-ba99c1415a90 req-9258a38b-bb2e-42ca-bb9c-05fda6894df1 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:55.791840 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b3ccc662-6139-4cd5-8355-ba99c1415a90 req-9258a38b-bb2e-42ca-bb9c-05fda6894df1 service nova] Creating event network-vif-plugged:b44d7922-ad74-4830-a0d7-988529a67a27 for instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca on n-h1-master-1 Oct 16 02:15:55.797414 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b3ccc662-6139-4cd5-8355-ba99c1415a90 req-9258a38b-bb2e-42ca-bb9c-05fda6894df1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032540 Oct 16 02:15:55.798221 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3825/7513] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:15:56.630868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:56.631509 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:56.638830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:56.639354 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:56.639796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:56.640486 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:56.640945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:56.641371 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:56.772459 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:56.780837 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b82d6ff1-9107-4343-a8d6-10d3ec656021 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1393 microversion: 2.1 time: 0.153962 Oct 16 02:15:56.781395 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3689/7514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:56 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:57.805599 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:57.806323 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:57.808276 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:57.814480 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:57.814938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:57.815402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:57.816121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:57.816602 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:57.817053 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:57.955052 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:57.962855 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1c00891-249c-44e6-9492-c499efa7ba2c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1566 microversion: 2.1 time: 0.162528 Oct 16 02:15:57.963450 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3826/7515] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:57 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:57.986907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:57.987538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:57.994152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:57.994639 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:57.995114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:57.995799 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:57.996251 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:57.996671 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:58.128050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:58.135821 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-04cbfeb4-2640-4255-9e87-e691b1cb56bc tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1566 microversion: 2.1 time: 0.152718 Oct 16 02:15:58.136412 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3690/7516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:57 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:15:59.734789 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:15:59.735734 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:15:59.736342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-765e3904-ec75-49ea-8fbc-d8b6e8dcfbbe req-49bee406-ac4d-416d-8f41-da2384462203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6fab948-4f84-4ec0-9b7e-ffb57468b9ca", "tag": "b44d7922-ad74-4830-a0d7-988529a67a27"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:15:59.739103 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:59.741925 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:59.742538 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:15:59.751139 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-765e3904-ec75-49ea-8fbc-d8b6e8dcfbbe req-49bee406-ac4d-416d-8f41-da2384462203 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:59.751627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-765e3904-ec75-49ea-8fbc-d8b6e8dcfbbe req-49bee406-ac4d-416d-8f41-da2384462203 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:59.752056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-765e3904-ec75-49ea-8fbc-d8b6e8dcfbbe req-49bee406-ac4d-416d-8f41-da2384462203 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:59.754686 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:59.756070 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:59.756882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:59.758215 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:15:59.759227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:15:59.760012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:15:59.763903 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-765e3904-ec75-49ea-8fbc-d8b6e8dcfbbe req-49bee406-ac4d-416d-8f41-da2384462203 service nova] Creating event network-changed:b44d7922-ad74-4830-a0d7-988529a67a27 for instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca on n-h1-master-1 Oct 16 02:15:59.769204 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-765e3904-ec75-49ea-8fbc-d8b6e8dcfbbe req-49bee406-ac4d-416d-8f41-da2384462203 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037499 Oct 16 02:15:59.770190 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3691/7517] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:15:59.932027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:15:59.940650 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-64300069-8159-4bb6-a32a-f777e2297397 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1566 microversion: 2.1 time: 0.211548 Oct 16 02:15:59.941713 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3827/7518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:15:59 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:21.188788 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:21.189652 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=36 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:21.194426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:16:21.196714 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:21.205019 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:21.205506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:21.205946 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:21.206635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:21.207137 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:21.207567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:21.277172 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a14ed9d6-50f7-4db4-9a53-8b0ff05497a9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action" status: 200 len: 24565 microversion: 2.1 time: 0.090578 Oct 16 02:16:21.277802 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3692/7519] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:16:21 2022] POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action => generated 24565 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:16:32.352190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c28f82ef-744d-4c87-b0c1-24ca29b82bc4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:16:32.354527 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:32.355412 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=32 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:32.361345 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28f82ef-744d-4c87-b0c1-24ca29b82bc4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:32.361851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28f82ef-744d-4c87-b0c1-24ca29b82bc4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:32.362306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28f82ef-744d-4c87-b0c1-24ca29b82bc4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:32.384566 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c28f82ef-744d-4c87-b0c1-24ca29b82bc4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Going to try to stop instance {{(pid=120545) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 16 02:16:32.426943 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c28f82ef-744d-4c87-b0c1-24ca29b82bc4 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action" status: 202 len: 0 microversion: 2.1 time: 0.078236 Oct 16 02:16:32.427705 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3828/7520] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:16:32 2022] POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:16:32.436847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:32.437691 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:32.440520 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:32.441192 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:16:32.448143 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:32.448637 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:32.449078 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:32.449786 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:32.450246 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:32.450675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:32.595282 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:32.603291 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-033288b2-721c-46cf-9ede-ee7b3a42484f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.170889 Oct 16 02:16:32.603786 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3693/7521] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:32 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:33.629391 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:33.630020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:33.637173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:33.637668 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:33.638115 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:33.638810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:33.639307 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:33.639742 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:33.771939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:33.779560 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b52ee7aa-48ec-49a4-8ba1-a94840db0362 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.155278 Oct 16 02:16:33.780130 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3829/7522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:33 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:34.803730 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:34.805109 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:34.812089 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:34.812514 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:34.812959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:34.813648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:34.814105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:34.815249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:34.949349 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:34.957996 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d4f227ab-f832-4345-bf82-c98e5bcf4c47 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.158182 Oct 16 02:16:34.958571 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3694/7523] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:34 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:35.982249 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:35.982874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:35.990164 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:35.990775 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:35.991351 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:35.992160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:35.992723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:35.993252 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:36.129329 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:36.136995 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-51f31797-51c5-4bef-952e-def2ba5ae77f tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.158708 Oct 16 02:16:36.137566 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3830/7524] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:35 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:37.161030 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:37.161681 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:37.168469 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:37.168957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:37.169398 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:37.170091 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:37.170551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:37.171003 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:37.305197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:37.313034 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-81897c7d-9cf1-46f5-b46d-ef061d74235e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.156403 Oct 16 02:16:37.313611 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3695/7525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:37 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:38.340442 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:38.341071 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:38.348409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:38.348903 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:38.349350 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:38.350045 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:38.350515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:38.350969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:38.485253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:38.493230 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-67140e35-a174-47f0-a13d-6f907fc06313 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.156734 Oct 16 02:16:38.493801 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3831/7526] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:38 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:16:39.517341 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:39.518538 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:39.525351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:39.525833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:39.526266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:39.527005 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:39.527463 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:39.527888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:39.658233 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:39.666015 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7dce4249-af4d-4d29-a9ef-ed5f961393a1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.152663 Oct 16 02:16:39.666586 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3696/7527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:39 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:40.690187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:40.690813 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:40.697839 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:40.698332 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:40.698773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:40.699490 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:40.699957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:40.700392 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:40.833711 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:40.841403 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-bef0c691-594a-4d98-8cd5-7f2aabd7a7d3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.155324 Oct 16 02:16:40.841981 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3832/7528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:40 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:41.865709 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:41.866361 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:41.873149 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:41.873640 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:41.874110 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:41.874806 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:41.875294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:41.875728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:42.010572 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:42.020405 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-df386152-a284-44b8-9377-f6751d8e0624 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.159313 Oct 16 02:16:42.021031 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3697/7529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:41 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:43.045454 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:43.045990 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:43.053468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:43.053962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:43.054415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:43.055145 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:43.055622 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:43.056060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:43.188624 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:43.197139 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-999e340c-f4a8-486a-b3f1-cd194a2d93d1 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.155938 Oct 16 02:16:43.197708 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3833/7530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:43 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:44.221795 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:44.222400 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:44.229393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:44.229905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:44.230346 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:44.231067 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:44.231529 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:44.231957 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:44.363004 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:44.370695 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6dcdb581-72b2-44c7-a691-b514fc50e9c3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.153485 Oct 16 02:16:44.371299 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3698/7531] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:44 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:45.394369 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:45.395020 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:45.401823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:45.402317 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:45.402761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:45.403498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:45.403969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:45.404402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:45.537211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:45.544875 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7966c4cc-f718-4b18-a42c-eda564eb6259 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.154504 Oct 16 02:16:45.545444 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3834/7532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:45 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:46.570110 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:46.570725 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:46.577648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:46.578130 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:46.578572 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:46.579288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:46.579750 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:46.580666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:46.711488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:46.719079 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ad0a1f1b-48fe-4854-9c64-75c978524f6a tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.153663 Oct 16 02:16:46.719657 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3699/7533] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:46 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:47.742835 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:47.743405 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:47.751004 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:47.751565 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:47.752586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:47.753556 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:47.754012 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:47.754472 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:47.888836 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:47.897062 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-22e169d5-2953-48ef-b166-b9ba19cbeb66 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1695 microversion: 2.1 time: 0.158394 Oct 16 02:16:47.897636 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3835/7534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:47 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:48.920389 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:48.920927 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:48.928570 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:48.929063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:48.929506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:48.930205 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:48.930663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:48.931129 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:49.065608 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:49.074799 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7c6710d8-6fc2-4c41-ab1a-85f862729e13 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1672 microversion: 2.1 time: 0.158338 Oct 16 02:16:49.075426 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3700/7535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:48 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:50.173027 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:16:50.175338 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:50.182205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:50.182702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:50.183176 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:50.183874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:50.184338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:50.184772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:50.248228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-539d40d7-2374-4428-b25c-47e3209a8e00 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action" status: 200 len: 38415 microversion: 2.1 time: 0.078968 Oct 16 02:16:50.248860 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3836/7536] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:16:50 2022] POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action => generated 38415 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:16:50.261271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c011540-d859-4525-bc44-2b6c665d7066 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:16:50.268273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c011540-d859-4525-bc44-2b6c665d7066 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:50.268761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c011540-d859-4525-bc44-2b6c665d7066 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:50.269203 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c011540-d859-4525-bc44-2b6c665d7066 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:50.291831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0c011540-d859-4525-bc44-2b6c665d7066 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Going to try to start instance {{(pid=120546) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 16 02:16:50.332370 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0c011540-d859-4525-bc44-2b6c665d7066 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action" status: 202 len: 0 microversion: 2.1 time: 0.074896 Oct 16 02:16:50.333547 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3701/7537] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:16:50 2022] POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:16:50.342498 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:50.343240 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:50.351721 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:50.352227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:50.352681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:50.353426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:50.353921 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:50.354342 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:50.493906 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:50.501716 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fb077b22-1d7f-42c4-a12b-7a2efa0422cf tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1681 microversion: 2.1 time: 0.163463 Oct 16 02:16:50.502404 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3837/7538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:50 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:16:51.528463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:16:51.529169 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:16:51.539880 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:51.540478 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:51.540949 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:51.541660 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:16:51.542146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:16:51.542643 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:16:51.673740 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:16:51.682169 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5104d63f-8816-4aaf-8b45-0f000d88bd52 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1685 microversion: 2.1 time: 0.158316 Oct 16 02:16:51.682762 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3702/7539] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:16:51 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:15.873636 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:17:15.875890 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:15.878478 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=20 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:15.879197 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:15.887650 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:15.888166 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:15.888625 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:15.889347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:15.889844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:15.890271 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:15.962117 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-573a9c37-45bd-49ea-8686-3350d03c9caa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action" status: 200 len: 62976 microversion: 2.1 time: 0.092484 Oct 16 02:17:15.963118 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3838/7540] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:17:15 2022] POST /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca/action => generated 62976 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:17:23.242035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:23.242894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:23.245663 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-f988ccbd-423b-4ba2-8891-a89e442bc42d req-854605a3-80cf-4f3c-9806-a00e7b8fecfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6fab948-4f84-4ec0-9b7e-ffb57468b9ca", "tag": "b44d7922-ad74-4830-a0d7-988529a67a27"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:17:23.246148 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=20 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:23.247047 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:23.253692 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:23.254188 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:23.254629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:23.255515 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:23.255982 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:23.256545 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:23.257413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f988ccbd-423b-4ba2-8891-a89e442bc42d req-854605a3-80cf-4f3c-9806-a00e7b8fecfe service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:23.258207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f988ccbd-423b-4ba2-8891-a89e442bc42d req-854605a3-80cf-4f3c-9806-a00e7b8fecfe service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:23.258660 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-f988ccbd-423b-4ba2-8891-a89e442bc42d req-854605a3-80cf-4f3c-9806-a00e7b8fecfe service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:23.270230 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-f988ccbd-423b-4ba2-8891-a89e442bc42d req-854605a3-80cf-4f3c-9806-a00e7b8fecfe service nova] Creating event network-changed:b44d7922-ad74-4830-a0d7-988529a67a27 for instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca on n-h1-master-1 Oct 16 02:17:23.276281 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-f988ccbd-423b-4ba2-8891-a89e442bc42d req-854605a3-80cf-4f3c-9806-a00e7b8fecfe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034757 Oct 16 02:17:23.277827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3839/7541] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:17:23.292204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:17:23.377965 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9338200b-14e2-4d63-a29e-e71f49f2bf73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 204 len: 0 microversion: 2.1 time: 0.139788 Oct 16 02:17:23.379213 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3703/7542] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:17:23 2022] DELETE /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:17:23.389654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:23.390377 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:23.398298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:23.398889 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:23.399413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:23.400136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:23.401185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:23.401640 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:23.539656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:23.548361 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dab2785b-eec9-4091-b034-04f07aaa6e4c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1691 microversion: 2.1 time: 0.163930 Oct 16 02:17:23.549145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3840/7543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:23 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:17:24.574697 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:24.575677 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:24.582675 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:24.583194 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:24.583634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:24.584327 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:24.584781 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:24.585210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:24.721679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:24.729792 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-146426e6-3093-4498-85e5-563e88a401fd tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1691 microversion: 2.1 time: 0.159923 Oct 16 02:17:24.730390 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3704/7544] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:24 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:25.508587 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5c57e1bf-9f9a-495b-b490-707f9fab6721 req-278cfc8f-9d57-4195-8056-01d7eccf90ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6fab948-4f84-4ec0-9b7e-ffb57468b9ca", "name": "network-vif-deleted", "tag": "b44d7922-ad74-4830-a0d7-988529a67a27"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:17:25.521471 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5c57e1bf-9f9a-495b-b490-707f9fab6721 req-278cfc8f-9d57-4195-8056-01d7eccf90ba service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:25.521977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5c57e1bf-9f9a-495b-b490-707f9fab6721 req-278cfc8f-9d57-4195-8056-01d7eccf90ba service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:25.522423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5c57e1bf-9f9a-495b-b490-707f9fab6721 req-278cfc8f-9d57-4195-8056-01d7eccf90ba service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:25.536446 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5c57e1bf-9f9a-495b-b490-707f9fab6721 req-278cfc8f-9d57-4195-8056-01d7eccf90ba service nova] Creating event network-vif-deleted:b44d7922-ad74-4830-a0d7-988529a67a27 for instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca on n-h1-master-1 Oct 16 02:17:25.544265 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5c57e1bf-9f9a-495b-b490-707f9fab6721 req-278cfc8f-9d57-4195-8056-01d7eccf90ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038759 Oct 16 02:17:25.544265 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3841/7545] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:17:25.753203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:25.753941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:25.760916 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:25.761427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:25.761864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:25.762561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:25.763104 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:25.763467 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:25.801953 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:25.803725 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:25.804835 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:25.805948 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lazy-loading 'fault' on Instance uuid e6fab948-4f84-4ec0-9b7e-ffb57468b9ca {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:17:25.861350 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:25.869540 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a54f52dc-fc47-4182-be06-76cd4dba1997 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 200 len: 1357 microversion: 2.1 time: 0.120182 Oct 16 02:17:25.870130 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3705/7546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:25 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 1357 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:26.893811 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:26.894436 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: e6fab948-4f84-4ec0-9b7e-ffb57468b9ca] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:26.902205 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:26.902697 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:26.903165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:26.903866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:26.904333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:26.904769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:26.917793 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.wsgi [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] HTTP exception thrown: Instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca could not be found. Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Request method failure captured: Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: request: GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca HTTP/1.1 Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: Accept: application/json Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: Accept-Encoding: identity Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: Connection: close Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: Content-Length: 0 Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: Content-Type: application/json Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: Host: 10.222.0.39 Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: Openstack-System-Scope: None Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: User-Agent: python-urllib3/1.26.12 Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Auth-Token: gAAAAABjS2gw1un4B-9TzvU_NcvReYiRfmzKwj78ID6yrTwa9saKHqKshEUSlMO03SCAEgkMQvUgOIeRfDdgprSjWpj2qsGLsgTSvnJ-tRKq1i_hUZxWeb8LDhEHcsolvJ4osfaLEQSsjkpKZjU3HEdzklBGfuBFQiBl-hhmf-gPSpoO-u63BwA Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Id: None Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Domain-Name: None Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Identity-Status: Confirmed Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Is-Admin-Project: True Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Id: default Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Project-Domain-Name: Default Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Project-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Role: member,reader Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Roles: member,reader Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_78214f1cbf1f4856b3f2ce094a2a111a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-User: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Id: default Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-User-Domain-Name: Default Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-User-Id: 1a52bdeacefc48c496206b4e4f5ee78f Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: method: > Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: exception: Instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca could not be found. Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: action_args: {'id': 'e6fab948-4f84-4ec0-9b7e-ffb57468b9ca'} Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca could not be found. Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca could not be found. Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:17:26.919428 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca could not be found. Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: ERROR nova.api.openstack.wsgi Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Returning 404 to user: Instance e6fab948-4f84-4ec0-9b7e-ffb57468b9ca could not be found. {{(pid=120545) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6ec2e273-5111-4cf1-aede-cf48b460e331 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca" status: 404 len: 111 microversion: 2.1 time: 0.031444 Oct 16 02:17:26.924463 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3842/7547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:26 2022] GET /compute/v2.1/servers/e6fab948-4f84-4ec0-9b7e-ffb57468b9ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:17:30.246134 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8c922a6d-312c-40fe-88cf-9cb346d51796 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '.version_select at 0x7fd64ce865e0>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:30.267342 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8c922a6d-312c-40fe-88cf-9cb346d51796 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2088325689" status: 202 len: 0 microversion: 2.1 time: 0.026352 Oct 16 02:17:30.267939 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3706/7548] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Oct 16 02:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2088325689 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:17:30.302066 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e8b4c9eb-5d37-44c8-8525-33c5985f6b36 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: .version_select at 0x7fd6527a1040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2133673298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfqmF5WNebMXlh42rlO/jY5IZSSvuugEdmmOhgLA6XEavWmSe2hQ9xDyQRK3AsxYIpcQ2m22TND5YNsRXzBSGgU3ul34UcHzbpknZrAzN2ndzxsImrLl6K5CpKsMIDlWw=="}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:17:30.319524 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-e8b4c9eb-5d37-44c8-8525-33c5985f6b36 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:17:30.324781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-e8b4c9eb-5d37-44c8-8525-33c5985f6b36 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'key_pairs'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:17:30.348853 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e8b4c9eb-5d37-44c8-8525-33c5985f6b36 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050251 Oct 16 02:17:30.349067 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3843/7549] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:17:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:17:36.250302 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:36.254790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-248758208", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "networks": [{"uuid": "10a5e55e-6bf8-496b-9137-0b7c322e12fb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2133673298", "security_groups": [{"name": "tempest-secgroup-smoke-1417717983"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:17:36.369371 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] validate_networks() for [('10a5e55e-6bf8-496b-9137-0b7c322e12fb', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:17:36.867609 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:17:36.868041 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:17:36.868521 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:17:36.868936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:17:36.869931 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:17:36.892261 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:36.892935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:36.893482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:36.894326 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:36.894894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:36.895472 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:36.920025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:17:36.925936 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Getting quotas for user 1a52bdeacefc48c496206b4e4f5ee78f and project 78214f1cbf1f4856b3f2ce094a2a111a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:17:36.941313 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:17:36.943813 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:17:37.006155 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5fd69510-11f4-455e-964c-6c0f1d8f0913 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.757431 Oct 16 02:17:37.007771 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3707/7550] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:17:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:17:37.017246 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=16 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:37.028294 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-573edbc4-1d83-4717-a896-3a6ba7b726f8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:37.029217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-573edbc4-1d83-4717-a896-3a6ba7b726f8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:37.114361 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-573edbc4-1d83-4717-a896-3a6ba7b726f8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:37.123247 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-573edbc4-1d83-4717-a896-3a6ba7b726f8 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1266 microversion: 2.1 time: 0.108063 Oct 16 02:17:37.124889 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3844/7551] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:37 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:38.147425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:38.148157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:38.156276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:38.157059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:38.157631 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:38.158414 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:38.158884 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:38.159342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:38.237248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:38.249690 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-207206f7-61e2-461e-8e34-0482d6b229c9 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1318 microversion: 2.1 time: 0.107138 Oct 16 02:17:38.265357 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3708/7552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:38 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1318 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:39.279713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:39.281043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:39.289207 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:39.289981 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:39.290654 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:39.292821 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:39.293310 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:39.293751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:39.492994 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:39.501686 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5835c7a9-1a28-41c8-ab26-b0401ac59aa3 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1392 microversion: 2.1 time: 0.227724 Oct 16 02:17:39.502568 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3845/7553] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:39 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:39.842804 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a0bbde90-9cf7-4977-b0b6-9926a0aabdf5 req-3c1cdaa0-3c5c-4699-afe6-84673d674a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a84815-aebf-4288-a9c2-4b6eb3511638", "tag": "4a76c4a9-974d-40d4-b487-36a27cbe0147"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:17:39.853582 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a0bbde90-9cf7-4977-b0b6-9926a0aabdf5 req-3c1cdaa0-3c5c-4699-afe6-84673d674a2b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:39.854845 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a0bbde90-9cf7-4977-b0b6-9926a0aabdf5 req-3c1cdaa0-3c5c-4699-afe6-84673d674a2b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:39.855309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a0bbde90-9cf7-4977-b0b6-9926a0aabdf5 req-3c1cdaa0-3c5c-4699-afe6-84673d674a2b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:39.866485 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a0bbde90-9cf7-4977-b0b6-9926a0aabdf5 req-3c1cdaa0-3c5c-4699-afe6-84673d674a2b service nova] Creating event network-changed:4a76c4a9-974d-40d4-b487-36a27cbe0147 for instance f6a84815-aebf-4288-a9c2-4b6eb3511638 on n-h1-master-1 Oct 16 02:17:39.872111 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a0bbde90-9cf7-4977-b0b6-9926a0aabdf5 req-3c1cdaa0-3c5c-4699-afe6-84673d674a2b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Oct 16 02:17:39.872730 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3709/7554] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:17:40.527228 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:40.527954 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:40.534586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:40.535128 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:40.535586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:40.536298 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:40.536767 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:40.537214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:40.672075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:40.679762 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c28cdc65-1a69-475e-a2a4-4d1ea7d05ab5 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1392 microversion: 2.1 time: 0.156812 Oct 16 02:17:40.680335 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3846/7555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:40 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:41.705588 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:41.706379 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:41.712536 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:41.713454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:41.714042 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:41.714748 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:41.715245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:41.715677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:41.929746 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:41.938585 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-476eecbf-5ad1-48ad-b6d6-ecbae96eac9c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1392 microversion: 2.1 time: 0.238080 Oct 16 02:17:41.939431 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3710/7556] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:41 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1392 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:42.961671 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:42.962274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:42.970029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:42.970525 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:42.970994 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:42.971696 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:42.972168 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:42.972606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:43.104500 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:43.112894 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-49039907-a13d-4d58-83a1-8aeac3522c84 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1392 microversion: 2.1 time: 0.155124 Oct 16 02:17:43.113472 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3847/7557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:42 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:44.136759 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:44.137398 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:44.144544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:44.145036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:44.145481 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:44.146320 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:44.146653 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:44.147116 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:44.290668 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:44.294069 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-23b2ae8d-268c-4473-9bcb-28dada6a4763 req-645e7026-19f9-43f2-a5f2-3148db7b052d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a84815-aebf-4288-a9c2-4b6eb3511638", "name": "network-vif-plugged", "status": "completed", "tag": "4a76c4a9-974d-40d4-b487-36a27cbe0147"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:17:44.298593 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a9ac7153-4517-47bf-b4c3-f863ffdabf08 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1392 microversion: 2.1 time: 0.166238 Oct 16 02:17:44.299471 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3711/7558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:44 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:44.311078 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-23b2ae8d-268c-4473-9bcb-28dada6a4763 req-645e7026-19f9-43f2-a5f2-3148db7b052d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:44.311615 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-23b2ae8d-268c-4473-9bcb-28dada6a4763 req-645e7026-19f9-43f2-a5f2-3148db7b052d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:44.312064 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-23b2ae8d-268c-4473-9bcb-28dada6a4763 req-645e7026-19f9-43f2-a5f2-3148db7b052d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:44.323994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-23b2ae8d-268c-4473-9bcb-28dada6a4763 req-645e7026-19f9-43f2-a5f2-3148db7b052d service nova] Creating event network-vif-plugged:4a76c4a9-974d-40d4-b487-36a27cbe0147 for instance f6a84815-aebf-4288-a9c2-4b6eb3511638 on n-h1-master-1 Oct 16 02:17:44.328877 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-23b2ae8d-268c-4473-9bcb-28dada6a4763 req-645e7026-19f9-43f2-a5f2-3148db7b052d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095738 Oct 16 02:17:44.329473 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3848/7559] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:17:45.323554 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:45.324262 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:45.331136 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:45.331625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:45.332069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:45.332802 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:45.333267 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:45.333703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:45.472022 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:45.480750 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ba2f83c8-938b-42b3-8056-a0b2226c54fa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1392 microversion: 2.1 time: 0.161348 Oct 16 02:17:45.481351 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3712/7560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:45 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:46.506083 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:46.506716 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:46.508724 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:46.514437 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:46.514951 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:46.515409 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:46.516118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:46.516590 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:46.517030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:46.654787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:46.662542 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8accf85d-6aa5-4690-badb-819a48cbf098 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1565 microversion: 2.1 time: 0.161652 Oct 16 02:17:46.663157 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3849/7561] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:46 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:46.685868 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:46.686484 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:46.693305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:46.693796 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:46.694487 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:46.695211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:46.695682 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:46.696114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:46.824832 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:46.832725 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bab8a594-e1fc-4590-9bb1-b3fc626e73fe tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1565 microversion: 2.1 time: 0.151243 Oct 16 02:17:46.833296 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3713/7562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:46 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:17:48.443956 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-31b05aca-6b3e-4e14-9949-9ea867788cd7 req-aa4c4da8-7c8c-4daa-9b4c-7995123a0cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a84815-aebf-4288-a9c2-4b6eb3511638", "tag": "4a76c4a9-974d-40d4-b487-36a27cbe0147"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:17:48.445637 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:17:48.446277 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:17:48.448270 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:48.456436 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:48.457112 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:17:48.467435 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:48.467941 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:48.468393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:48.469114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:48.469587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:48.470025 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:48.475062 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-31b05aca-6b3e-4e14-9949-9ea867788cd7 req-aa4c4da8-7c8c-4daa-9b4c-7995123a0cf9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:17:48.475559 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-31b05aca-6b3e-4e14-9949-9ea867788cd7 req-aa4c4da8-7c8c-4daa-9b4c-7995123a0cf9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:17:48.475994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-31b05aca-6b3e-4e14-9949-9ea867788cd7 req-aa4c4da8-7c8c-4daa-9b4c-7995123a0cf9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:17:48.488002 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-31b05aca-6b3e-4e14-9949-9ea867788cd7 req-aa4c4da8-7c8c-4daa-9b4c-7995123a0cf9 service nova] Creating event network-changed:4a76c4a9-974d-40d4-b487-36a27cbe0147 for instance f6a84815-aebf-4288-a9c2-4b6eb3511638 on n-h1-master-1 Oct 16 02:17:48.493161 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-31b05aca-6b3e-4e14-9949-9ea867788cd7 req-aa4c4da8-7c8c-4daa-9b4c-7995123a0cf9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052923 Oct 16 02:17:48.493832 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3714/7563] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:17:48.692409 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:17:48.703600 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-42b46709-f93d-4369-9aa0-83dbcf0d445e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1565 microversion: 2.1 time: 0.267381 Oct 16 02:17:48.718963 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3850/7564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:17:48 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1565 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:09.946263 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:09.947087 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=36 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:09.953092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:09.955425 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:09.962824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:09.963494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:09.963942 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:09.964646 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:09.965107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:09.965537 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:10.036949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0122d6ec-e254-44c1-b0b9-a5c36af304cb tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action" status: 200 len: 24568 microversion: 2.1 time: 0.092640 Oct 16 02:18:10.037598 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3715/7565] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:18:09 2022] POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action => generated 24568 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:18:21.112699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:21.113320 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:21.115269 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:21.115985 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=32 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:21.121916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:21.122979 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:21.123466 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:21.124174 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:21.124645 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:21.125084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:21.148284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lazy-loading 'flavor' on Instance uuid f6a84815-aebf-4288-a9c2-4b6eb3511638 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:18:21.213913 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e0c95cc4-752a-4391-915c-830b52f4dc65 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action" status: 202 len: 0 microversion: 2.1 time: 0.105243 Oct 16 02:18:21.214602 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3851/7566] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:18:21 2022] POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:18:21.224116 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:21.224945 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:21.227835 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:21.228467 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:21.236438 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:21.236972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:21.241336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:21.241336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:21.241336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:21.241336 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:21.373886 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:21.381719 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-050b5626-ee5f-4c34-b3d1-97aee5856a70 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1691 microversion: 2.1 time: 0.161973 Oct 16 02:18:21.382292 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3716/7567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:21 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:22.407160 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:22.407874 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:22.414973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:22.415475 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:22.415927 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:22.416632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:22.417139 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:22.417581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:22.554533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:22.563739 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4bf3fcca-9e2a-4477-9636-869fd1bf8d04 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1674 microversion: 2.1 time: 0.161343 Oct 16 02:18:22.564355 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3852/7568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:22 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:23.659790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:23.661983 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:23.668627 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:23.669112 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:23.669625 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:23.670365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:23.670827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:23.671289 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:23.740063 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-bba74f4e-68c0-44ca-9cc4-1947c86c0c73 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action" status: 200 len: 38376 microversion: 2.1 time: 0.084261 Oct 16 02:18:23.740711 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3717/7569] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:18:23 2022] POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action => generated 38376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 16 02:18:23.752819 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:23.753394 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:23.760163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:23.760639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:23.761084 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:23.761776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:23.762242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:23.762674 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:23.829835 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3268e47e-8da2-423a-9f5f-6dc3def752e0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action" status: 202 len: 0 microversion: 2.1 time: 0.080733 Oct 16 02:18:23.830506 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3853/7570] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:18:23 2022] POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:18:23.839483 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:23.840342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:23.848290 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:23.848773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:23.849211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:23.849910 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:23.850441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:23.850875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:24.063873 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:24.072098 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f62c0942-a9aa-4474-b3f2-78cc1c180253 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1680 microversion: 2.1 time: 0.236854 Oct 16 02:18:24.072791 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3718/7571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:23 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:25.097006 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:25.098404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:25.105617 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:25.106120 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:25.106573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:25.107844 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:25.108311 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:25.108755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:25.249786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:25.260393 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-544f331b-090f-4717-9d17-aa395da80280 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1680 microversion: 2.1 time: 0.167756 Oct 16 02:18:25.261010 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3854/7572] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:25 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:18:26.285026 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:26.285644 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:26.292657 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:26.293145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:26.293597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:26.294656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:26.295342 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:26.295793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:26.429331 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:26.437175 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e63ca833-8ccc-4412-acb9-8c43cfa03c6d tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1683 microversion: 2.1 time: 0.156197 Oct 16 02:18:26.437748 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3719/7573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:26 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:26.539224 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:26.541562 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:26.548836 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:26.549333 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:26.549778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:26.550479 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:26.550965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:26.551402 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:26.613329 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-893a552b-09a0-496d-8bfb-1beccb49e120 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action" status: 200 len: 38376 microversion: 2.1 time: 0.078024 Oct 16 02:18:26.613983 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3855/7574] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:18:26 2022] POST /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638/action => generated 38376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 16 02:18:27.585500 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:27.586122 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:27.588186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-960ef010-a332-40a4-ad84-68f2e1073c7e req-5f8774f7-abd9-4cc2-82eb-43fb15e1da76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a84815-aebf-4288-a9c2-4b6eb3511638", "tag": "4a76c4a9-974d-40d4-b487-36a27cbe0147"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:27.594309 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:27.594938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:27.595568 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:27.596546 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:27.597213 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:27.597831 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:27.600135 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-960ef010-a332-40a4-ad84-68f2e1073c7e req-5f8774f7-abd9-4cc2-82eb-43fb15e1da76 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:27.600634 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-960ef010-a332-40a4-ad84-68f2e1073c7e req-5f8774f7-abd9-4cc2-82eb-43fb15e1da76 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:27.601074 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-960ef010-a332-40a4-ad84-68f2e1073c7e req-5f8774f7-abd9-4cc2-82eb-43fb15e1da76 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:27.613277 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-960ef010-a332-40a4-ad84-68f2e1073c7e req-5f8774f7-abd9-4cc2-82eb-43fb15e1da76 service nova] Creating event network-changed:4a76c4a9-974d-40d4-b487-36a27cbe0147 for instance f6a84815-aebf-4288-a9c2-4b6eb3511638 on n-h1-master-1 Oct 16 02:18:27.618299 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-960ef010-a332-40a4-ad84-68f2e1073c7e req-5f8774f7-abd9-4cc2-82eb-43fb15e1da76 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034166 Oct 16 02:18:27.619296 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3856/7575] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:18:27.629663 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:18:27.716788 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-17ebd4b6-c9b9-4e3d-98fe-b6ecc7007faa tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 204 len: 0 microversion: 2.1 time: 0.134595 Oct 16 02:18:27.717532 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3720/7576] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:18:27 2022] DELETE /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:18:27.727364 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:27.728295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:27.735595 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:27.736191 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:27.736709 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:27.737498 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:27.738068 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:27.738577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:28.210858 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:28.219413 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-58274486-6ed7-4a89-8489-889da57d2e3c tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1689 microversion: 2.1 time: 0.496937 Oct 16 02:18:28.219999 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3857/7577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:27 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1689 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:29.244738 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:29.245448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:29.252441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:29.252932 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:29.253366 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:29.254068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:29.254526 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:29.254973 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:29.469040 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a52bdeacefc48c496206b4e4f5ee78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78214f1cbf1f4856b3f2ce094a2a111a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:29.480870 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7640c264-dad6-4307-ad20-4aa8cab24a2e tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 200 len: 1689 microversion: 2.1 time: 0.240287 Oct 16 02:18:29.482073 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3721/7578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:29 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:29.862492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-34ccca43-8102-4e00-8eb7-bfa4777b113c req-3f1624f8-40cc-4ebd-9a4b-1b34a47547df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a84815-aebf-4288-a9c2-4b6eb3511638", "name": "network-vif-deleted", "tag": "4a76c4a9-974d-40d4-b487-36a27cbe0147"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:29.875236 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-34ccca43-8102-4e00-8eb7-bfa4777b113c req-3f1624f8-40cc-4ebd-9a4b-1b34a47547df service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:29.878553 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-34ccca43-8102-4e00-8eb7-bfa4777b113c req-3f1624f8-40cc-4ebd-9a4b-1b34a47547df service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:29.879112 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-34ccca43-8102-4e00-8eb7-bfa4777b113c req-3f1624f8-40cc-4ebd-9a4b-1b34a47547df service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:29.890517 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-34ccca43-8102-4e00-8eb7-bfa4777b113c req-3f1624f8-40cc-4ebd-9a4b-1b34a47547df service nova] Creating event network-vif-deleted:4a76c4a9-974d-40d4-b487-36a27cbe0147 for instance f6a84815-aebf-4288-a9c2-4b6eb3511638 on n-h1-master-1 Oct 16 02:18:29.895611 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-34ccca43-8102-4e00-8eb7-bfa4777b113c req-3f1624f8-40cc-4ebd-9a4b-1b34a47547df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037246 Oct 16 02:18:29.896223 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3858/7579] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:18:30.505087 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:30.505631 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] [instance: f6a84815-aebf-4288-a9c2-4b6eb3511638] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:30.512403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:30.513504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:30.514017 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:30.514711 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:30.515197 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:30.515624 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:30.528940 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] HTTP exception thrown: Instance f6a84815-aebf-4288-a9c2-4b6eb3511638 could not be found. Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Request method failure captured: Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 HTTP/1.1 Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2gw1un4B-9TzvU_NcvReYiRfmzKwj78ID6yrTwa9saKHqKshEUSlMO03SCAEgkMQvUgOIeRfDdgprSjWpj2qsGLsgTSvnJ-tRKq1i_hUZxWeb8LDhEHcsolvJ4osfaLEQSsjkpKZjU3HEdzklBGfuBFQiBl-hhmf-gPSpoO-u63BwA Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_78214f1cbf1f4856b3f2ce094a2a111a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78214f1cbf1f4856b3f2ce094a2a111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 78214f1cbf1f4856b3f2ce094a2a111a Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2115093978 Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 1a52bdeacefc48c496206b4e4f5ee78f Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2115093978-project Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: exception: Instance f6a84815-aebf-4288-a9c2-4b6eb3511638 could not be found. Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'f6a84815-aebf-4288-a9c2-4b6eb3511638'} Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a84815-aebf-4288-a9c2-4b6eb3511638 could not be found. Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a84815-aebf-4288-a9c2-4b6eb3511638 could not be found. Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:18:30.530565 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a84815-aebf-4288-a9c2-4b6eb3511638 could not be found. Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Returning 404 to user: Instance f6a84815-aebf-4288-a9c2-4b6eb3511638 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-05b7f6be-babb-43b5-bf7e-a8bf812115c0 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638" status: 404 len: 111 microversion: 2.1 time: 0.030980 Oct 16 02:18:30.535981 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3722/7580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:30 2022] GET /compute/v2.1/servers/f6a84815-aebf-4288-a9c2-4b6eb3511638 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:18:34.042674 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-11d8c404-1bae-428c-a880-62c61b701340 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] Calling method '.version_select at 0x7fd6526eab80>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:34.069929 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-11d8c404-1bae-428c-a880-62c61b701340 tempest-TestNetworkAdvancedServerOps-2115093978 tempest-TestNetworkAdvancedServerOps-2115093978-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2133673298" status: 202 len: 0 microversion: 2.1 time: 0.032478 Oct 16 02:18:34.070863 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3859/7581] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Oct 16 02:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2133673298 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:18:45.238587 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:45.239927 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:45.521986 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-20f85730-7ec5-4e85-ae9f-ff63b943a1b8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Action: 'create', calling method: .version_select at 0x7fd64d075310>, body: {"keypair": {"name": "tempest-TestShelveInstance-124419067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpUZrePQ00I6vCWmSfWKR0BHU3e4BCno16wRr+CF8pLrNMhJhU1gJuJHl9NVN2y6pDKNBSyV11KDbGeZZF9V7yqsbNXHNhO+sRK74wDVmjJ7V2n1BuL1mg3bSANulasBw=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:45.538372 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-20f85730-7ec5-4e85-ae9f-ff63b943a1b8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Getting quotas for project 6e75b1540be246fb9be6572513050082. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:18:45.549924 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-20f85730-7ec5-4e85-ae9f-ff63b943a1b8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Getting quotas for user 111c47d7a44f48559e9e22d25677d6dd and project 6e75b1540be246fb9be6572513050082. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:18:45.584072 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-20f85730-7ec5-4e85-ae9f-ff63b943a1b8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.351582 Oct 16 02:18:45.584700 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3723/7582] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:18:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:18:46.584237 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:46.585108 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:46.589776 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1620871678", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-124419067", "security_groups": [{"name": "tempest-secgroup-smoke-1061838893"}], "networks": [{"uuid": "a074a876-9771-41e0-8383-f4cee9eae318"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:46.832223 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] validate_networks() for [('a074a876-9771-41e0-8383-f4cee9eae318', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:18:47.213011 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:18:47.213452 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:18:47.213964 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:18:47.214388 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:18:47.214814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:18:47.223909 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:47.224415 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:47.224868 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:47.225616 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:47.226094 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:47.226537 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:47.245075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Getting quotas for project 6e75b1540be246fb9be6572513050082. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:18:47.251316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Getting quotas for user 111c47d7a44f48559e9e22d25677d6dd and project 6e75b1540be246fb9be6572513050082. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:18:47.263788 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:18:47.266331 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:18:47.312150 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [c2d50605-1477-476d-aa05-778ca77e8984] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 16 02:18:48.320506 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [c2d50605-1477-476d-aa05-778ca77e8984] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37126. Oct 16 02:18:48.326044 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d79f179a-ff01-4d4b-8718-65eb8b76b486 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.743168 Oct 16 02:18:48.326712 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3860/7583] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:18:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:18:48.339271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-07d2f56b-558b-4731-b98e-0d0fcd8b8ef2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:48.340025 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-07d2f56b-558b-4731-b98e-0d0fcd8b8ef2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:48.400524 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-07d2f56b-558b-4731-b98e-0d0fcd8b8ef2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:48.410964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-07d2f56b-558b-4731-b98e-0d0fcd8b8ef2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1246 microversion: 2.1 time: 0.076382 Oct 16 02:18:48.412111 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3724/7584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:48 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:49.436505 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:49.437181 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:49.444658 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:49.445159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:49.445624 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:49.446862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:49.447548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:49.447976 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:49.517333 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:49.525594 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ea6b43f5-7cef-4600-9d25-c672ad14d69e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1298 microversion: 2.1 time: 0.093877 Oct 16 02:18:49.527827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3861/7585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:49 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:50.552941 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:50.553555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:50.565281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:50.565970 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:50.566597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:50.567562 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:50.568086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:50.569028 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:50.714099 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:50.723070 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1b06092a-135b-4d95-b341-1a35b2d56878 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1372 microversion: 2.1 time: 0.174718 Oct 16 02:18:50.723648 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3725/7586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:50 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:51.061325 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c8342aa2-d077-4898-880b-37a10ba25110 req-79ced68b-d710-4d86-88d9-a43462cba85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad046f3d-e0bf-4b91-92e5-77227b9a4124", "tag": "3e534dab-8d7b-4fce-971e-e86b3c2f758d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:51.074260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8342aa2-d077-4898-880b-37a10ba25110 req-79ced68b-d710-4d86-88d9-a43462cba85e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:51.074806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8342aa2-d077-4898-880b-37a10ba25110 req-79ced68b-d710-4d86-88d9-a43462cba85e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:51.075745 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8342aa2-d077-4898-880b-37a10ba25110 req-79ced68b-d710-4d86-88d9-a43462cba85e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:51.090777 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c8342aa2-d077-4898-880b-37a10ba25110 req-79ced68b-d710-4d86-88d9-a43462cba85e service nova] Creating event network-changed:3e534dab-8d7b-4fce-971e-e86b3c2f758d for instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 on n-h1-master-1 Oct 16 02:18:51.096057 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c8342aa2-d077-4898-880b-37a10ba25110 req-79ced68b-d710-4d86-88d9-a43462cba85e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040060 Oct 16 02:18:51.096802 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3862/7587] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:18:51.746568 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:51.747210 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:51.754148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:51.754634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:51.755195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:51.755898 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:51.756360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:51.756793 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:51.890665 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:51.898471 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-59fdb95b-31b0-40f6-b436-ea431874fee2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1372 microversion: 2.1 time: 0.155852 Oct 16 02:18:51.899085 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3726/7588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:51 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:52.925316 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:52.926063 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:52.932469 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:52.932961 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:52.933432 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:52.934136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:52.934648 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:52.935726 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:53.071247 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:53.080128 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ca54c105-bfe3-4d83-b012-551dbb9e315e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1372 microversion: 2.1 time: 0.162053 Oct 16 02:18:53.080644 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3863/7589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:52 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:54.103442 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:54.104092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:54.111635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:54.112118 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:54.112556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:54.113269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:54.113720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:54.114151 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:54.360059 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:54.367786 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8572ff6b-19b1-4bba-8ba4-cf3b35114c39 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1372 microversion: 2.1 time: 0.268203 Oct 16 02:18:54.368372 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3727/7590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:54 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:55.391760 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:55.392397 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:55.399255 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:55.399759 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:55.400211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:55.400917 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:55.401390 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:55.401833 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:55.533025 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:55.540604 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e30fc735-c8b9-42de-b913-995da48a1e88 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1372 microversion: 2.1 time: 0.153400 Oct 16 02:18:55.541174 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3864/7591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:55 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:56.539424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-c121560e-2d5a-488a-9986-64955282d521 req-6c531e20-e2cb-4e38-b840-17a4f2a9c01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad046f3d-e0bf-4b91-92e5-77227b9a4124", "name": "network-vif-plugged", "status": "completed", "tag": "3e534dab-8d7b-4fce-971e-e86b3c2f758d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:56.551493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c121560e-2d5a-488a-9986-64955282d521 req-6c531e20-e2cb-4e38-b840-17a4f2a9c01d service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:56.551986 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c121560e-2d5a-488a-9986-64955282d521 req-6c531e20-e2cb-4e38-b840-17a4f2a9c01d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:56.552421 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-c121560e-2d5a-488a-9986-64955282d521 req-6c531e20-e2cb-4e38-b840-17a4f2a9c01d service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:56.564983 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-c121560e-2d5a-488a-9986-64955282d521 req-6c531e20-e2cb-4e38-b840-17a4f2a9c01d service nova] Creating event network-vif-plugged:3e534dab-8d7b-4fce-971e-e86b3c2f758d for instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 on n-h1-master-1 Oct 16 02:18:56.567199 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:56.567831 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:56.570720 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-c121560e-2d5a-488a-9986-64955282d521 req-6c531e20-e2cb-4e38-b840-17a4f2a9c01d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Oct 16 02:18:56.571387 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3728/7592] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:18:56.577974 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:56.578478 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:56.579108 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:56.579834 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:56.580312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:56.580754 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:56.727309 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:56.735093 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d60134c-05ee-487b-9513-54424924c07d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1372 microversion: 2.1 time: 0.173620 Oct 16 02:18:56.735872 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3865/7593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:56 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:57.760140 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:57.760836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:57.768231 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:57.768717 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:57.769148 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:57.769842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:57.770298 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:57.770722 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:57.921563 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:57.929375 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-11dd18f0-7bf2-41e3-b7d8-28d1fa1d0475 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1556 microversion: 2.1 time: 0.174517 Oct 16 02:18:57.929956 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3729/7594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:57 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:57.952691 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:18:57.953310 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:18:57.955270 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:57.955934 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:57.963330 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:57.963824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:57.964270 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:57.964969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:57.965436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:57.966510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:58.103522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:18:58.111607 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-031a97b9-7e0b-478f-879d-357d2e8efcf8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1556 microversion: 2.1 time: 0.163365 Oct 16 02:18:58.112137 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3866/7595] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:18:57 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:18:59.733318 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-8e6bfd0a-c5e5-4569-af04-697bfcddcc58 req-c58af87c-7006-4760-bfd5-dcd74d102834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad046f3d-e0bf-4b91-92e5-77227b9a4124", "tag": "3e534dab-8d7b-4fce-971e-e86b3c2f758d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:18:59.738362 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:18:59.744935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8e6bfd0a-c5e5-4569-af04-697bfcddcc58 req-c58af87c-7006-4760-bfd5-dcd74d102834 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:18:59.747856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8e6bfd0a-c5e5-4569-af04-697bfcddcc58 req-c58af87c-7006-4760-bfd5-dcd74d102834 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:18:59.747856 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-8e6bfd0a-c5e5-4569-af04-697bfcddcc58 req-c58af87c-7006-4760-bfd5-dcd74d102834 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:18:59.758074 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-8e6bfd0a-c5e5-4569-af04-697bfcddcc58 req-c58af87c-7006-4760-bfd5-dcd74d102834 service nova] Creating event network-changed:3e534dab-8d7b-4fce-971e-e86b3c2f758d for instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 on n-h1-master-1 Oct 16 02:18:59.763732 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-8e6bfd0a-c5e5-4569-af04-697bfcddcc58 req-c58af87c-7006-4760-bfd5-dcd74d102834 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033848 Oct 16 02:18:59.764335 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3730/7596] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:20:54.907184 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cc26444-5a34-40e5-a065-e292a5e28b0a] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:20:54.908093 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62e940bc-1122-42ca-9330-e9768cf96d02] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:20:54.908559 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:20:54.909433 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=34 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:20:54.914534 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:20:54.915107 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:20:54.922895 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:54.923487 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:54.923965 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:54.924666 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:54.925136 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:54.925573 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:54.948966 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lazy-loading 'flavor' on Instance uuid ad046f3d-e0bf-4b91-92e5-77227b9a4124 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:20:55.147945 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-130f8279-4a28-4582-8f2c-fb7e559d1b3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "POST /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124/action" status: 202 len: 0 microversion: 2.1 time: 0.242678 Oct 16 02:20:55.148562 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3867/7597] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:20:54 2022] POST /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:20:55.158188 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] AMQP server on 10.222.0.39:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 16 02:20:55.160015 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] AMQP server on 10.222.0.39:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 16 02:20:55.160929 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 16 02:20:55.161068 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 (ip 10.222.0.39) !!! Oct 16 02:20:55.163118 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:20:55.164117 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=28 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:20:55.173039 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:20:55.173751 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:20:55.183140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:55.183626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:55.184063 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:55.184791 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:55.185249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:55.185776 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:55.327683 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:20:55.335463 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0f262165-fe8c-4120-a10f-60d63dd4837a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.181780 Oct 16 02:20:55.336060 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3731/7598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:20:55 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:20:56.363148 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:20:56.363863 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:20:56.374393 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:56.374939 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:56.375413 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:56.376125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:56.376601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:56.377044 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:56.377760 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] [62e940bc-1122-42ca-9330-e9768cf96d02] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37228. Oct 16 02:20:56.381916 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cc26444-5a34-40e5-a065-e292a5e28b0a] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37226. Oct 16 02:20:56.511363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:20:56.519719 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-535aeaec-dbb7-4416-bd68-7f9d56958b68 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.164239 Oct 16 02:20:56.520290 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3868/7599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:20:56 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:20:57.543723 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:20:57.544357 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:20:57.558837 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37234. Oct 16 02:20:57.560747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:57.561244 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:57.561693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:57.562827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:57.562972 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:57.563306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:57.567112 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37236. Oct 16 02:20:57.697866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:20:57.706330 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e25313e6-0f97-479d-be4e-4fc364c26598 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.166620 Oct 16 02:20:57.706905 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3732/7600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:20:57 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:20:58.730536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:20:58.731251 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:20:58.738183 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:58.738681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:58.739160 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:58.739864 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:58.740343 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:58.740783 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:58.870668 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:20:58.879271 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b5c7e781-01ac-4ef3-a7e8-c8b6497ec54e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.152629 Oct 16 02:20:58.879852 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3869/7601] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:20:58 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:20:59.902580 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:20:59.903261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:20:59.910094 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:59.910583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:59.911056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:20:59.911761 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:20:59.912224 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:20:59.912659 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:00.327710 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:00.335460 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-1c32ba22-20e0-4eaa-90ba-6d1272aded1e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.436815 Oct 16 02:21:00.336062 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3733/7602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:20:59 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:01.360777 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:01.361459 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:01.368282 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:01.368773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:01.369216 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:01.369911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:01.370379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:01.370812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:01.500764 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:01.508573 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e85ee2b5-215b-4527-b823-42c076263929 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.152708 Oct 16 02:21:01.509143 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3870/7603] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:01 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:02.533138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:02.533752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:02.540542 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:02.541024 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:02.541461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:02.542147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:02.542601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:02.543051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:02.680724 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:02.688643 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-db5baf30-8d6f-4f5a-b7fb-02641f4e2c11 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.159871 Oct 16 02:21:02.689232 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3734/7604] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:02 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:03.712898 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:03.713456 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:03.720681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:03.721173 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:03.721618 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:03.722312 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:03.722778 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:03.723248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:03.854274 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:03.862703 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a1f13637-7acb-40ab-b0df-ad3067db5d33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.153780 Oct 16 02:21:03.863328 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3871/7605] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:03 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:04.887629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:04.888156 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:04.895543 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:04.896027 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:04.896461 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:04.897147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:04.897601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:04.898025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:05.032578 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:05.040420 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-085497e4-7e78-45dc-9b35-9cb0254a39a3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.156770 Oct 16 02:21:05.041002 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3735/7606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:04 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:06.065172 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:06.065807 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:06.073056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:06.073581 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:06.074029 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:06.074734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:06.075232 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:06.075673 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:06.209458 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:06.217500 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e44f5e72-97f9-4de3-bb54-5798b3e825f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1701 microversion: 2.1 time: 0.156822 Oct 16 02:21:06.218088 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3872/7607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:06 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:07.241772 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:07.242406 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:07.249609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:07.250105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:07.250547 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:07.251288 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:07.251753 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:07.252189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:07.394306 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:07.402617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-a240eaa4-238f-45ac-b987-3b54fdccf653 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1701 microversion: 2.1 time: 0.164729 Oct 16 02:21:07.403387 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3736/7608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:07 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:08.427683 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:08.429005 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:08.437106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:08.438048 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:08.438679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:08.439623 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:08.440248 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:08.440689 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:08.595193 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:08.604153 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4aafaeb1-4733-4a0a-b830-fec06d03d0a9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1696 microversion: 2.1 time: 0.180237 Oct 16 02:21:08.604804 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3873/7609] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:08 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:09.232627 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fd6ea2b1-0273-426c-ad42-a97fa042d2ee req-d0d0417d-1c69-4e6e-8c6d-2775c46057ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad046f3d-e0bf-4b91-92e5-77227b9a4124", "name": "network-vif-plugged", "status": "completed", "tag": "3e534dab-8d7b-4fce-971e-e86b3c2f758d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:21:09.245551 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd6ea2b1-0273-426c-ad42-a97fa042d2ee req-d0d0417d-1c69-4e6e-8c6d-2775c46057ec service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:09.246036 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd6ea2b1-0273-426c-ad42-a97fa042d2ee req-d0d0417d-1c69-4e6e-8c6d-2775c46057ec service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:09.246493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd6ea2b1-0273-426c-ad42-a97fa042d2ee req-d0d0417d-1c69-4e6e-8c6d-2775c46057ec service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:09.262155 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fd6ea2b1-0273-426c-ad42-a97fa042d2ee req-d0d0417d-1c69-4e6e-8c6d-2775c46057ec service nova] Creating event network-vif-plugged:3e534dab-8d7b-4fce-971e-e86b3c2f758d for instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 on n-h1-master-1 Oct 16 02:21:09.268261 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fd6ea2b1-0273-426c-ad42-a97fa042d2ee req-d0d0417d-1c69-4e6e-8c6d-2775c46057ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040367 Oct 16 02:21:09.269220 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3737/7610] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:21:09.628584 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:09.629402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:09.636600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:09.637103 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:09.637552 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:09.638368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:09.639051 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:09.639492 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:09.789358 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:09.798417 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-05b0e17a-ae77-4260-aec7-fbf5d200ba3b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1696 microversion: 2.1 time: 0.173755 Oct 16 02:21:09.811524 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3874/7611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:09 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:10.825638 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:10.826831 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:10.833663 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:10.834164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:10.834603 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:10.835357 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:10.835826 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:10.836296 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:10.991794 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:11.010092 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-55da89c4-cad2-47b6-b6b0-ca48ab8158f1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1696 microversion: 2.1 time: 0.189772 Oct 16 02:21:11.017818 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3738/7612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:10 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:12.036132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:12.037416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:12.045083 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:12.045755 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:12.046031 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:12.046741 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:12.047306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:12.048018 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:12.211415 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:12.223249 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6c05ce0d-f075-43f1-9242-43d72b28a31f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1696 microversion: 2.1 time: 0.191120 Oct 16 02:21:12.236002 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3875/7613] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:12 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:13.250463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:13.251122 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:13.258954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:13.259707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:13.260145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:13.260842 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:13.261462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:13.262051 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:13.411548 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:13.420648 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f8d3f0c4-83be-4b02-8429-03a9bfad3bb8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1696 microversion: 2.1 time: 0.174309 Oct 16 02:21:13.427270 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3739/7614] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:13 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:14.444790 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:14.446350 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:14.454820 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:14.455508 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:14.456187 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:14.457101 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:14.457718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:14.458169 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:14.604413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:14.614182 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-cd3d6181-b9fe-4dd5-9f03-78c85e9bfb6d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1696 microversion: 2.1 time: 0.173471 Oct 16 02:21:14.614991 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3876/7615] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:14 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:15.637655 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:15.639762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:15.647506 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:15.647995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:15.648733 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:15.649494 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:15.650332 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:15.651014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:15.802535 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:15.811727 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-96851a0f-689d-4306-b067-41f254a136a7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1696 microversion: 2.1 time: 0.177876 Oct 16 02:21:15.812324 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3740/7616] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:15 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:16.837504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:16.838821 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:16.846627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:16.847423 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:16.847952 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:16.848757 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:16.849306 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:16.849825 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:16.995525 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:17.003994 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6f6d9f7e-254b-4d37-afb6-d868bf9d1cfd tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1696 microversion: 2.1 time: 0.170360 Oct 16 02:21:17.004583 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3877/7617] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:16 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:18.028654 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:18.030090 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:18.037656 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:18.038152 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:18.038597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:18.039475 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:18.039943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:18.040376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:18.181515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:18.189964 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-934226c4-88e8-4e7d-a561-a1c78bda94b2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1678 microversion: 2.1 time: 0.165412 Oct 16 02:21:18.190559 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3741/7618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:18 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:19.214000 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:19.214635 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:19.222200 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:19.222702 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:19.223184 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:19.223892 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:19.224372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:19.224817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:19.364983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:19.373275 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d6608a06-39c9-41a4-ac4d-db572c66193c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1678 microversion: 2.1 time: 0.163208 Oct 16 02:21:19.373852 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3878/7619] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:19 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:20.397108 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:20.397762 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:20.404707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:20.405191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:20.405634 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:20.406337 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:20.406803 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:20.407260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:20.542161 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:20.552168 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-294ae323-42d4-4779-92c9-424869c88a0d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1681 microversion: 2.1 time: 0.158899 Oct 16 02:21:20.552768 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3742/7620] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:20 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:20.576773 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:21:20.577376 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:20.584285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:20.584789 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:20.585244 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:20.585957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:20.586431 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:20.586902 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:20.683747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120545) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 02:21:20.749912 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5eb3136b-301b-4752-99a3-575ae396721b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "POST /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124/action" status: 202 len: 0 microversion: 2.1 time: 0.177129 Oct 16 02:21:20.750637 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3879/7621] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:21:20 2022] POST /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:21:20.758821 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:20.759470 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:20.766606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:20.766606 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:20.766965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:20.767594 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:20.768056 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:20.768482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:20.908828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:20.917004 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e435cd5c-a0b4-481e-a824-aa5c370a3d1c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1629 microversion: 2.1 time: 0.162147 Oct 16 02:21:20.917625 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3743/7622] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:20 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1629 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:21.212536 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-51d37a14-a697-41d5-a4d3-4247dd871416 req-3959b0bd-2992-4620-b34d-deea0c1b3608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad046f3d-e0bf-4b91-92e5-77227b9a4124", "name": "network-vif-unplugged", "status": "completed", "tag": "3e534dab-8d7b-4fce-971e-e86b3c2f758d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:21:21.224477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-51d37a14-a697-41d5-a4d3-4247dd871416 req-3959b0bd-2992-4620-b34d-deea0c1b3608 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:21.224969 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-51d37a14-a697-41d5-a4d3-4247dd871416 req-3959b0bd-2992-4620-b34d-deea0c1b3608 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:21.225600 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-51d37a14-a697-41d5-a4d3-4247dd871416 req-3959b0bd-2992-4620-b34d-deea0c1b3608 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:21.238521 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.compute.server_external_events [req-51d37a14-a697-41d5-a4d3-4247dd871416 req-3959b0bd-2992-4620-b34d-deea0c1b3608 service nova] Unable to find a host for instance ad046f3d-e0bf-4b91-92e5-77227b9a4124. Dropping event network-vif-unplugged {{(pid=120545) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 16 02:21:21.239646 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-51d37a14-a697-41d5-a4d3-4247dd871416 req-3959b0bd-2992-4620-b34d-deea0c1b3608 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031171 Oct 16 02:21:21.240245 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3880/7623] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 16 02:21:21.941997 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:21.942985 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:21.949807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:21.950328 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:21.951052 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:21.951765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:21.952228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:21.952658 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:22.090077 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:22.098829 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-b8494acd-8f04-4903-9a92-cd26466a348e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.160650 Oct 16 02:21:22.099713 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3744/7624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:21 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:23.123217 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:23.123853 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:23.135386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:23.135966 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:23.136504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:23.137337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:23.138761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:23.139314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:23.180521 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:23.336425 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:23.346372 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-01a2880d-40a4-4f38-b6df-b6c415dae915 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.227115 Oct 16 02:21:23.347584 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3881/7625] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:23 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:24.370433 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:24.371091 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:24.379696 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:24.380189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:24.380665 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:24.381454 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:24.381965 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:24.382405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:24.531187 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:24.539258 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7227a860-beb0-4d80-b12d-33f985318205 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.172598 Oct 16 02:21:24.539948 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3745/7626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:24 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:25.565096 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:25.565611 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:25.569779 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:25.573548 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:25.574050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:25.574504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:25.576050 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:25.576532 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:25.576973 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:25.766948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:25.788752 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b4113ad2-c6f4-4373-905c-211ce9345b96 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.228073 Oct 16 02:21:25.789621 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3882/7627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:25 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:26.813765 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:26.814312 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:26.817055 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=31 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:26.823077 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:26.823569 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:26.824002 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:26.824742 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:26.825201 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:26.826156 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:26.834945 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=87 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:21:26.979587 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:26.988682 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5163857f-37a4-4bda-b8f8-8686813a0725 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.179607 Oct 16 02:21:26.989271 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3746/7628] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:26 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:28.014586 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:28.015265 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:28.021919 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:28.022421 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:28.022866 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:28.023603 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:28.024071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:28.024504 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:28.172695 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:28.180640 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e2e2908d-d204-4615-a30b-ac68007b20e3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.171146 Oct 16 02:21:28.181270 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3883/7629] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:28 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:29.205016 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:29.205649 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:29.212012 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:29.212497 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:29.212930 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:29.213614 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:29.214069 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:29.214495 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:29.359364 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:29.367994 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5f8c3302-6dca-4165-99cb-bd771dda73ce tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.167375 Oct 16 02:21:29.379823 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3747/7630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:29 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:30.395639 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:30.396301 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:30.403157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:30.403772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:30.404220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:30.404924 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:30.405398 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:30.405838 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:30.540660 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:30.549027 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-90dc4cbc-8726-45c2-9d6d-c0fabf813755 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.157688 Oct 16 02:21:30.549606 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3884/7631] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:30 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:31.574010 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:31.574777 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:31.582105 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:31.582588 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:31.583053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:31.583744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:31.584199 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:31.584626 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:31.714875 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:31.723297 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aed1fcf2-0686-4761-8310-f9987b120582 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.153111 Oct 16 02:21:31.723865 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3748/7632] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:31 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:32.748152 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:32.748779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:32.755918 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:32.756426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:32.756879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:32.757587 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:32.758065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:32.758510 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:32.895983 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:32.904102 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e448e7a5-d201-41ec-88d5-a35dd13f67c4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.160035 Oct 16 02:21:32.904750 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3885/7633] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:32 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:33.928261 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:33.928864 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:33.936374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:33.936858 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:33.937294 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:33.937990 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:33.938449 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:33.938879 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:34.070254 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:34.078037 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-240228b2-edc6-4d34-aff2-6317bc6604d9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.153706 Oct 16 02:21:34.078622 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3749/7634] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:33 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:35.104365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:35.105023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:35.116715 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:35.117214 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:35.117663 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:35.118373 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:35.118845 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:35.119309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:35.280607 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:35.288732 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b1915c25-df94-461f-a8c8-d8f972631f35 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.190740 Oct 16 02:21:35.289770 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3886/7635] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:35 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:35.365397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5618ee95-e0e7-4240-9594-85516151ff89 req-770d5da6-b85b-4ad3-9f4a-0e3587fd1224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad046f3d-e0bf-4b91-92e5-77227b9a4124", "name": "network-vif-plugged", "status": "completed", "tag": "3e534dab-8d7b-4fce-971e-e86b3c2f758d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:21:35.377509 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5618ee95-e0e7-4240-9594-85516151ff89 req-770d5da6-b85b-4ad3-9f4a-0e3587fd1224 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:35.378068 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5618ee95-e0e7-4240-9594-85516151ff89 req-770d5da6-b85b-4ad3-9f4a-0e3587fd1224 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:35.378648 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5618ee95-e0e7-4240-9594-85516151ff89 req-770d5da6-b85b-4ad3-9f4a-0e3587fd1224 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:35.402251 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5618ee95-e0e7-4240-9594-85516151ff89 req-770d5da6-b85b-4ad3-9f4a-0e3587fd1224 service nova] Creating event network-vif-plugged:3e534dab-8d7b-4fce-971e-e86b3c2f758d for instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 on n-h1-master-1 Oct 16 02:21:35.410312 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5618ee95-e0e7-4240-9594-85516151ff89 req-770d5da6-b85b-4ad3-9f4a-0e3587fd1224 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048145 Oct 16 02:21:35.412021 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3750/7636] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:21:36.312815 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:36.313443 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:36.320729 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:36.321230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:36.321703 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:36.322406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:36.322874 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:36.323339 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:36.458963 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:36.467004 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9fe1fc36-2512-40ef-9023-9a0321057c34 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1687 microversion: 2.1 time: 0.158100 Oct 16 02:21:36.467582 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3887/7637] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:36 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:21:37.491242 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:21:37.491955 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:21:37.498895 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:37.499474 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:37.499935 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:37.500765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:21:37.501287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:21:37.501755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:21:37.634752 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:21:37.643539 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4a29c6e3-eaf4-404d-980c-09f58d056e1f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1674 microversion: 2.1 time: 0.157592 Oct 16 02:21:37.644118 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3751/7638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:21:37 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:22:48.159799 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=11 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:22:48.161059 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=40 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:22:48.163067 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=11 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:22:48.164013 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=31 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:22:48.165266 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:22:48.165266 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:22:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 16 02:22:48.167522 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:22:48.169424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:22:48.178633 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:48.179198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:48.179777 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:48.180506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:48.181027 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:48.181968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:48.210186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:22:48.237894 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-d82e1a7a-93be-4551-b5a3-d4e9793ede1e req-912d7256-ca7b-4a27-b211-c6c8923b236c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad046f3d-e0bf-4b91-92e5-77227b9a4124", "tag": "3e534dab-8d7b-4fce-971e-e86b3c2f758d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:22:48.247446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d82e1a7a-93be-4551-b5a3-d4e9793ede1e req-912d7256-ca7b-4a27-b211-c6c8923b236c service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:48.247984 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d82e1a7a-93be-4551-b5a3-d4e9793ede1e req-912d7256-ca7b-4a27-b211-c6c8923b236c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:48.248502 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-d82e1a7a-93be-4551-b5a3-d4e9793ede1e req-912d7256-ca7b-4a27-b211-c6c8923b236c service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:48.260719 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-d82e1a7a-93be-4551-b5a3-d4e9793ede1e req-912d7256-ca7b-4a27-b211-c6c8923b236c service nova] Creating event network-changed:3e534dab-8d7b-4fce-971e-e86b3c2f758d for instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 on n-h1-master-1 Oct 16 02:22:48.266617 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-d82e1a7a-93be-4551-b5a3-d4e9793ede1e req-912d7256-ca7b-4a27-b211-c6c8923b236c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105780 Oct 16 02:22:48.267520 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3752/7639] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:22:48.292286 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c80f7158-c830-4869-a60b-5b14778ebd95 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 204 len: 0 microversion: 2.1 time: 0.134135 Oct 16 02:22:48.293406 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3888/7640] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:22:48 2022] DELETE /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:22:48.302329 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:22:48.303173 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:22:48.311287 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:48.311785 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:48.312236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:48.312943 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:48.313408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:48.313841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:48.456793 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:22:48.466263 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-fe346cea-9757-49d8-9ce1-eba61a4aa8d2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.166955 Oct 16 02:22:48.466684 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3753/7641] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:22:48 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:22:49.491115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:22:49.491865 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:22:49.498774 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:49.499305 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:49.499761 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:49.500468 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:49.500938 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:49.501376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:49.633699 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:22:49.642647 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5a36b20d-444f-4887-a535-5e44c4983df2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1680 microversion: 2.1 time: 0.155840 Oct 16 02:22:49.643251 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3889/7642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:22:49 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:22:50.254519 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-5aca0edc-95f5-4b8a-b304-24b076e5fba4 req-1b9f62bf-297d-424b-a800-d86cb008218b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad046f3d-e0bf-4b91-92e5-77227b9a4124", "name": "network-vif-deleted", "tag": "3e534dab-8d7b-4fce-971e-e86b3c2f758d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:22:50.265707 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5aca0edc-95f5-4b8a-b304-24b076e5fba4 req-1b9f62bf-297d-424b-a800-d86cb008218b service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:50.266191 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5aca0edc-95f5-4b8a-b304-24b076e5fba4 req-1b9f62bf-297d-424b-a800-d86cb008218b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:50.266629 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-5aca0edc-95f5-4b8a-b304-24b076e5fba4 req-1b9f62bf-297d-424b-a800-d86cb008218b service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:50.279718 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-5aca0edc-95f5-4b8a-b304-24b076e5fba4 req-1b9f62bf-297d-424b-a800-d86cb008218b service nova] Creating event network-vif-deleted:3e534dab-8d7b-4fce-971e-e86b3c2f758d for instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 on n-h1-master-1 Oct 16 02:22:50.285451 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-5aca0edc-95f5-4b8a-b304-24b076e5fba4 req-1b9f62bf-297d-424b-a800-d86cb008218b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093249 Oct 16 02:22:50.286332 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3754/7643] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:22:50.666771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:22:50.667438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:22:50.674418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:50.674937 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:50.675391 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:50.676105 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:50.676580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:50.677022 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:50.712024 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:50.713185 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:50.713630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:50.714098 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lazy-loading 'fault' on Instance uuid ad046f3d-e0bf-4b91-92e5-77227b9a4124 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:22:50.756656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:22:50.768485 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e5323e0c-7c1d-45c1-a139-07841d93acc4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 200 len: 1336 microversion: 2.1 time: 0.104988 Oct 16 02:22:50.769553 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3890/7644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:22:50 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:22:51.794328 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:22:51.794961 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: ad046f3d-e0bf-4b91-92e5-77227b9a4124] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:22:51.801178 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:51.801654 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:51.802086 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:51.802769 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:22:51.803255 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:22:51.803681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:22:51.817188 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] HTTP exception thrown: Instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 could not be found. Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Request method failure captured: Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 HTTP/1.1 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2oA3V5kob9ue53uSx-ArERjNJvCqxef0341rQ_9J7IMaxGVKnZCNqxqimOLJ_aKuB1a-2rF894fyj5FmGAtqtB1ebI3OuQ1QUU_UmtuA2Esjs069C7Z_RlMaZRJf9BMqZkyeq9okYbC0qRVzI-Xw4FI5sLV6UqUZi6qJRpuSc-l_qo Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 6e75b1540be246fb9be6572513050082 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestShelveInstance-517780655 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6e75b1540be246fb9be6572513050082", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6e75b1540be246fb9be6572513050082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6e75b1540be246fb9be6572513050082"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6e75b1540be246fb9be6572513050082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestShelveInstance-517780655 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 6e75b1540be246fb9be6572513050082 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestShelveInstance-517780655 Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestShelveInstance-517780655-project Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 111c47d7a44f48559e9e22d25677d6dd Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestShelveInstance-517780655-project Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: exception: Instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 could not be found. Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'ad046f3d-e0bf-4b91-92e5-77227b9a4124'} Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 could not be found. Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 could not be found. Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:22:51.818788 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 could not be found. Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Returning 404 to user: Instance ad046f3d-e0bf-4b91-92e5-77227b9a4124 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cd2cecea-40eb-4a9a-8d8f-7e4f9ac17fa7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124" status: 404 len: 111 microversion: 2.1 time: 0.031189 Oct 16 02:22:51.825200 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3755/7645] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:22:51 2022] GET /compute/v2.1/servers/ad046f3d-e0bf-4b91-92e5-77227b9a4124 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:22:51.984630 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-6a6feb0b-2dd6-4515-b92b-f29ff589b8d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '.version_select at 0x7fd64e0bbdc0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:22:52.005454 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-6a6feb0b-2dd6-4515-b92b-f29ff589b8d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-124419067" status: 202 len: 0 microversion: 2.1 time: 0.025953 Oct 16 02:22:52.006055 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3891/7646] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 02:22:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-124419067 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 16 02:22:52.035823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-564e0c8c-8bbe-42ba-9643-b15086a3601d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Action: 'create', calling method: .version_select at 0x7fd64d52fe50>, body: {"keypair": {"name": "tempest-TestShelveInstance-263868993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuynuovG2xgkhBSo5+n5x8ogKiM0d4tQximERstXgFg4Nl5A+6+B/biOmvYnCh7XNLpQ7zJfxSqDtd+UvdnozrhkWLEUAuA8fCNzSEI6wcSl7jngBEY8UQIgJloJS1+pg=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:22:52.052569 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-564e0c8c-8bbe-42ba-9643-b15086a3601d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Getting quotas for project 6e75b1540be246fb9be6572513050082. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:22:52.057904 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-564e0c8c-8bbe-42ba-9643-b15086a3601d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Getting quotas for user 111c47d7a44f48559e9e22d25677d6dd and project 6e75b1540be246fb9be6572513050082. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:22:52.089265 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-564e0c8c-8bbe-42ba-9643-b15086a3601d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.057745 Oct 16 02:22:52.090782 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3756/7647] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:22:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:23:08.325924 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:08.327005 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:08.334886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-30512208", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-263868993", "security_groups": [{"name": "tempest-secgroup-smoke-1930058406"}], "networks": [{"uuid": "a074a876-9771-41e0-8383-f4cee9eae318"}], "block_device_mapping_v2": [{"uuid": "f1016a1a-b73b-4b77-bf30-80464490f1c1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:23:08.450438 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] validate_networks() for [('a074a876-9771-41e0-8383-f4cee9eae318', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:23:08.815426 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:23:08.815857 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:23:08.816335 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:23:08.817002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:23:08.817417 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:23:08.826632 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:08.827162 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:08.827607 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:08.828337 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:08.828802 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:08.829242 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:08.847806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Getting quotas for project 6e75b1540be246fb9be6572513050082. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:23:08.853219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Getting quotas for user 111c47d7a44f48559e9e22d25677d6dd and project 6e75b1540be246fb9be6572513050082. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:23:08.911774 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:23:08.913928 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1016a1a-b73b-4b77-bf30-80464490f1c1',volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:23:09.041290 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-de24a790-7e9e-4693-b8f0-b0b015e4985b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717098 Oct 16 02:23:09.042208 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3892/7648] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:23:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:23:09.053634 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-93570f7e-d066-407b-b2cc-5fad85940e85 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:09.054267 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-93570f7e-d066-407b-b2cc-5fad85940e85 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:09.058949 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=12 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:09.059710 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=4 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:09.060599 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:09.116863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-93570f7e-d066-407b-b2cc-5fad85940e85 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:09.124175 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-93570f7e-d066-407b-b2cc-5fad85940e85 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1086 microversion: 2.1 time: 0.074759 Oct 16 02:23:09.124750 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3757/7649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:09 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1086 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:10.149186 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:10.149801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:10.157211 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:10.157751 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:10.158227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:10.158957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:10.159436 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:10.159873 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:10.242806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:10.252543 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7a9a656-3fa1-49bd-b147-5064582aeb33 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1192 microversion: 2.1 time: 0.109131 Oct 16 02:23:10.264476 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3893/7650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:10 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1192 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:11.277131 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:11.278244 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:11.285548 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:11.286053 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:11.286492 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:11.287361 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:11.287891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:11.288385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:11.488136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:11.496364 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-42ec9f82-a8ea-4bb1-9eab-a3d6a6e0bf54 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1270 microversion: 2.1 time: 0.223899 Oct 16 02:23:11.513126 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3758/7651] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:11 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:11.812023 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3ce28b5e-5c7c-484e-b892-1ab5708cef67 req-db3ed976-bf43-4653-9639-4cb1a90afbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea6243a-e401-45b5-a1a2-e495dcf48672", "tag": "b4de0065-d09a-404b-b517-876da919312d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:23:11.824872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3ce28b5e-5c7c-484e-b892-1ab5708cef67 req-db3ed976-bf43-4653-9639-4cb1a90afbb2 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:11.826157 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3ce28b5e-5c7c-484e-b892-1ab5708cef67 req-db3ed976-bf43-4653-9639-4cb1a90afbb2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:11.826867 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3ce28b5e-5c7c-484e-b892-1ab5708cef67 req-db3ed976-bf43-4653-9639-4cb1a90afbb2 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:11.841688 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-3ce28b5e-5c7c-484e-b892-1ab5708cef67 req-db3ed976-bf43-4653-9639-4cb1a90afbb2 service nova] Creating event network-changed:b4de0065-d09a-404b-b517-876da919312d for instance bea6243a-e401-45b5-a1a2-e495dcf48672 on n-h2-master-1 Oct 16 02:23:11.847793 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3ce28b5e-5c7c-484e-b892-1ab5708cef67 req-db3ed976-bf43-4653-9639-4cb1a90afbb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039514 Oct 16 02:23:11.848417 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3894/7652] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:23:12.520629 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:12.521504 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:12.529599 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:12.530211 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:12.530739 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:12.531633 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:12.532195 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:12.532720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:12.754472 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:12.762536 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7196d005-4706-459b-ad45-422aa75999aa tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1270 microversion: 2.1 time: 0.245846 Oct 16 02:23:12.763444 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3759/7653] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:12 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1270 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:13.787565 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:13.788189 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:13.795263 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:13.795773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:13.796224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:13.797231 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:13.797718 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:13.798159 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:13.931638 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:13.940072 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-df64ae09-e304-407d-971a-05db7731e54c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1270 microversion: 2.1 time: 0.158166 Oct 16 02:23:13.940666 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3895/7654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:13 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:14.963737 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:14.964302 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:14.972163 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:14.972662 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:14.973107 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:14.973821 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:14.974284 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:14.974747 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:15.118043 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:15.125922 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ff13f993-b113-48d6-84db-1ee92cb79880 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1270 microversion: 2.1 time: 0.166226 Oct 16 02:23:15.126726 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3760/7655] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:14 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:16.149649 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:16.150272 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:16.157217 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:16.157714 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:16.158163 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:16.158875 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:16.159371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:16.159812 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:16.291363 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:16.299338 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-9d9cacb4-cc4d-45e4-a585-eeef6063919a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.153534 Oct 16 02:23:16.299917 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3896/7656] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:16 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:17.323749 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:17.324416 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:17.331243 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:17.331729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:17.332170 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:17.332864 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:17.333325 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:17.333755 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:17.465602 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:17.473440 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-deae8ce8-a5d0-4eb8-a02e-2ee7c3e36c04 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.154100 Oct 16 02:23:17.474022 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3761/7657] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:17 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:18.497585 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:18.498211 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:18.505043 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:18.505534 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:18.505978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:18.506678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:18.507198 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:18.507630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:18.834626 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:18.860762 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:18.930204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:18.938214 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80bfbd0b-1e8e-45d1-8399-d7a89413c1ed tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.445196 Oct 16 02:23:18.938790 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3897/7658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:18 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:19.962203 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:19.962824 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:19.966070 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:23:19.971945 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:19.972441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:19.972888 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:19.973586 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:19.974049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:19.974480 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:20.106098 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:20.113815 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cad14cca-28d0-4daf-add6-06682281c6d7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.155572 Oct 16 02:23:20.114391 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3762/7659] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:19 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:21.138214 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:21.138802 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:21.145734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:21.146237 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:21.147131 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:21.147801 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:21.147913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:21.148771 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:21.286241 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:21.295898 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-e1489a3c-396b-4705-9d00-3e536e63b113 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.163016 Oct 16 02:23:21.296478 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3898/7660] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:21 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:22.320193 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:22.320838 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:22.327904 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:22.328384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:22.328820 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:22.329512 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:22.329971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:22.330401 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:22.462498 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:22.470904 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d30f5838-6942-4250-b36d-5c98e908d751 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.154886 Oct 16 02:23:22.471500 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3763/7661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:22 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:23.493652 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:23.494267 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:23.502148 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:23.502639 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:23.503118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:23.503816 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:23.504316 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:23.504749 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:23.637411 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:23.645068 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ffa2df76-3572-4518-9c11-95a3f3c34f90 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.155232 Oct 16 02:23:23.645639 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3899/7662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:23 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:24.669136 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:24.669754 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:24.676679 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:24.677164 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:24.677604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:24.678304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:24.678766 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:24.679228 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:24.809171 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:24.817406 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-198c99f6-367e-41da-84fd-3e4e4cb37ca7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.152606 Oct 16 02:23:24.817922 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3764/7663] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:24 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:25.840847 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:25.841472 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:25.848326 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:25.848823 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:25.849267 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:25.849972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:25.850438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:25.850876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:25.983413 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:25.991572 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3474eabe-caef-4cf2-b22a-ce6c5063dec7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.155051 Oct 16 02:23:25.992179 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3900/7664] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:25 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:27.015368 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:27.016533 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:27.022378 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:27.022883 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:27.023582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:27.024328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:27.024824 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:27.025247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:27.031326 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-fd9fd029-ee72-4e85-9055-28317f62a1dc req-70fde63b-c4cb-4bde-b9c3-8befde560d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea6243a-e401-45b5-a1a2-e495dcf48672", "name": "network-vif-plugged", "status": "completed", "tag": "b4de0065-d09a-404b-b517-876da919312d"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:23:27.042190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd9fd029-ee72-4e85-9055-28317f62a1dc req-70fde63b-c4cb-4bde-b9c3-8befde560d46 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:27.042684 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd9fd029-ee72-4e85-9055-28317f62a1dc req-70fde63b-c4cb-4bde-b9c3-8befde560d46 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:27.043155 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-fd9fd029-ee72-4e85-9055-28317f62a1dc req-70fde63b-c4cb-4bde-b9c3-8befde560d46 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:27.054622 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-fd9fd029-ee72-4e85-9055-28317f62a1dc req-70fde63b-c4cb-4bde-b9c3-8befde560d46 service nova] Creating event network-vif-plugged:b4de0065-d09a-404b-b517-876da919312d for instance bea6243a-e401-45b5-a1a2-e495dcf48672 on n-h2-master-1 Oct 16 02:23:27.060655 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-fd9fd029-ee72-4e85-9055-28317f62a1dc req-70fde63b-c4cb-4bde-b9c3-8befde560d46 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092580 Oct 16 02:23:27.061274 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3765/7665] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:23:27.176179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:27.187185 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c7192414-d355-44d4-b626-84649c06bab4 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.175917 Oct 16 02:23:27.187777 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3901/7666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:27 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:23:28.212566 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:28.213286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:28.220208 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:28.220701 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:28.221145 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:28.221841 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:28.222304 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:28.222736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:28.364200 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:28.373328 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9d04b6e9-4036-4da7-8af5-67f87cb5dd37 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1258 microversion: 2.1 time: 0.165980 Oct 16 02:23:28.374271 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3766/7667] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:28 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:29.396793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:29.397418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:29.405090 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:29.405586 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:29.406033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:29.406736 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:29.407240 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:29.407679 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:29.536793 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:29.544747 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-1130a909-e2c3-451c-9f72-b52c8c898d12 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1443 microversion: 2.1 time: 0.151865 Oct 16 02:23:29.545321 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3902/7668] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:29 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:29.568766 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:23:29.569380 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:23:29.576927 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:29.577407 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:29.577840 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:29.578528 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:29.579007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:29.579433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:29.711383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:23:29.719282 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-6fdab2d3-ebb4-42f7-8f68-548b6e758ae8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1443 microversion: 2.1 time: 0.154711 Oct 16 02:23:29.719852 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3767/7669] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:23:29 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:23:31.298093 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6423a29a-7dfb-46d8-a877-9e87e9622716 req-b47ee084-fbe4-4dc6-ac1e-14fb7b646206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea6243a-e401-45b5-a1a2-e495dcf48672", "tag": "b4de0065-d09a-404b-b517-876da919312d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:23:31.308911 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6423a29a-7dfb-46d8-a877-9e87e9622716 req-b47ee084-fbe4-4dc6-ac1e-14fb7b646206 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:23:31.309405 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6423a29a-7dfb-46d8-a877-9e87e9622716 req-b47ee084-fbe4-4dc6-ac1e-14fb7b646206 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:23:31.309846 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6423a29a-7dfb-46d8-a877-9e87e9622716 req-b47ee084-fbe4-4dc6-ac1e-14fb7b646206 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:23:31.321142 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6423a29a-7dfb-46d8-a877-9e87e9622716 req-b47ee084-fbe4-4dc6-ac1e-14fb7b646206 service nova] Creating event network-changed:b4de0065-d09a-404b-b517-876da919312d for instance bea6243a-e401-45b5-a1a2-e495dcf48672 on n-h2-master-1 Oct 16 02:23:31.326792 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6423a29a-7dfb-46d8-a877-9e87e9622716 req-b47ee084-fbe4-4dc6-ac1e-14fb7b646206 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032422 Oct 16 02:23:31.327880 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3903/7670] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:25:28.490776 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:25:28.491719 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:25:28.492527 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=24 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:25:28.493313 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=56 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:25:28.494710 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:25:28.494856 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:25:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672/action (ip 10.222.0.39) !!! Oct 16 02:25:28.559397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:25:28.559942 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:28.566894 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:28.567409 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:28.567843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:28.568567 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:28.569026 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:28.569448 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:28.594907 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.objects.instance [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lazy-loading 'flavor' on Instance uuid bea6243a-e401-45b5-a1a2-e495dcf48672 {{(pid=120546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:25:28.672128 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2cb2ba40-360b-4f71-9c75-034d23fa5584 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "POST /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672/action" status: 202 len: 0 microversion: 2.1 time: 0.182944 Oct 16 02:25:28.672748 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3768/7671] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:25:28 2022] POST /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:25:28.679509 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cc26444-5a34-40e5-a065-e292a5e28b0a] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:25:28.680962 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62e940bc-1122-42ca-9330-e9768cf96d02] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:25:28.681590 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:25:28.682529 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=60 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:25:28.688233 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:28.688941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:28.697584 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:28.699230 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:28.699685 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:28.700396 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:28.700865 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:28.701301 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:28.902461 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:28.910234 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-4ced7804-9117-49c7-9736-505b91a09024 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.232860 Oct 16 02:25:28.910806 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3904/7672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:28 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:29.939209 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:29.939848 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:29.948844 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:29.949333 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:29.949771 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:29.950468 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:29.950944 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:29.951379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:29.956184 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37774. Oct 16 02:25:29.956878 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37772. Oct 16 02:25:30.129753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:30.138489 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3055cd32-fe93-4868-895f-a71ddf6427cf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.206118 Oct 16 02:25:30.139109 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3769/7673] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:29 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:31.162024 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:31.162801 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:31.178066 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cc26444-5a34-40e5-a065-e292a5e28b0a] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37780. Oct 16 02:25:31.185574 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] [62e940bc-1122-42ca-9330-e9768cf96d02] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37782. Oct 16 02:25:31.187769 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:31.188280 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:31.188733 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:31.189457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:31.189933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:31.190379 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:31.328738 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:31.336672 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-48cbe287-10fb-4927-bf38-02ec5cea3ca8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.178669 Oct 16 02:25:31.337249 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3905/7674] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:31 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:32.360221 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:32.360825 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:32.367770 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:32.368260 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:32.368736 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:32.369427 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:32.370182 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:32.370544 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:32.503264 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:32.512235 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d5f90205-70e6-4960-982d-7116961ace94 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.155972 Oct 16 02:25:32.512808 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3770/7675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:32 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:33.535722 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:33.536334 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:33.543879 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:33.544380 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:33.544829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:33.545536 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:33.546011 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:33.546452 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:33.681682 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:33.689524 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-43ced8fa-733b-4c0c-9962-5068fd54024a tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.157756 Oct 16 02:25:33.690101 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3906/7676] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:33 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:34.713996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:34.714660 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:34.721525 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:34.722007 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:34.722441 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:34.723158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:34.723611 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:34.724035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:34.855669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:34.863386 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37922781-a6f6-431b-9a5c-d1da8c05eedf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.154008 Oct 16 02:25:34.863968 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3771/7677] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:34 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:35.888418 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:35.889043 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:35.895818 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:35.896290 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:35.896734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:35.897430 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:35.897894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:35.898328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:36.030185 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:36.037959 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c035ba55-683a-4375-b299-e45d04faba9d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.154349 Oct 16 02:25:36.038540 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3907/7678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:35 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:37.061620 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:37.062227 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:37.069728 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:37.070393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:37.071241 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:37.072015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:37.072485 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:37.072940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:37.559847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:37.568965 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1f6d0f2-27c8-419b-9d65-692414f43c58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.511255 Oct 16 02:25:37.569550 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3772/7679] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:37 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:38.593179 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:38.593814 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:38.600744 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:38.601247 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:38.601700 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:38.602408 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:38.602946 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:38.603453 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:38.732260 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:38.740112 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-50f00a9f-2388-4a90-bc24-0aed873c00f2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.150884 Oct 16 02:25:38.740682 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3908/7680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:38 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:39.765866 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:39.766426 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:39.773273 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:39.773757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:39.774189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:39.774872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:39.775351 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:39.776508 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:39.909783 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:39.917633 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-412ebb78-38a1-4dcf-9882-c3c37024096d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.155752 Oct 16 02:25:39.918223 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3773/7681] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:39 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:40.940933 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:40.941492 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:40.949287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:40.949776 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:40.950219 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:40.950933 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:40.951404 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:40.951872 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:41.084923 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:41.092718 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5de9c30b-ebb0-4dae-aa3f-131354a27d9e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.155714 Oct 16 02:25:41.093290 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3909/7682] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:40 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:42.117599 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:42.118272 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:42.125493 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:42.125983 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:42.126455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:42.127181 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:42.127673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:42.128102 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:42.268465 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:42.276976 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-88b365de-142f-464d-b60c-ec5c3017dd58 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.163387 Oct 16 02:25:42.277559 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3774/7683] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:42 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:43.300678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:43.301295 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:43.309787 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:43.310266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:43.310707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:43.311448 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:43.311913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:43.312349 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:43.451592 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:43.461369 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c30f95df-7a84-4d11-8264-6b4ba6a52ad7 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.164778 Oct 16 02:25:43.461954 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3910/7684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:43 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:44.485271 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:44.485921 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:44.492878 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:44.493315 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:44.493754 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:44.495014 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:44.495462 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:44.495867 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:44.629448 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:44.637961 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-9332d518-58fc-4bfa-a387-00d5c514683c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1508 microversion: 2.1 time: 0.156629 Oct 16 02:25:44.638538 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3775/7685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:44 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:44.660723 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:25:44.661336 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:44.668314 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:44.668809 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:44.669256 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:44.669957 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:44.670426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:44.670862 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:44.702747 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120545) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 16 02:25:44.765575 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-07aed91b-6036-4601-b7c6-3ada04224c7d tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "POST /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672/action" status: 202 len: 0 microversion: 2.1 time: 0.108623 Oct 16 02:25:44.766125 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3911/7686] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:25:44 2022] POST /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:25:44.774247 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:44.775050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:44.782147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:44.782644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:44.783114 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:44.783822 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:44.784281 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:44.784710 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:44.959753 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:44.968275 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c105ce6e-1377-4d78-b373-e8ae6242aa27 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1516 microversion: 2.1 time: 0.197897 Oct 16 02:25:44.968855 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3776/7687] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:44 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:25:45.638750 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-3eff60d9-6226-4db3-aa19-9b1e4a11f929 req-24546cf9-2f86-46a6-ab37-896e8c449858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea6243a-e401-45b5-a1a2-e495dcf48672", "name": "network-vif-unplugged", "status": "completed", "tag": "b4de0065-d09a-404b-b517-876da919312d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:25:45.652984 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3eff60d9-6226-4db3-aa19-9b1e4a11f929 req-24546cf9-2f86-46a6-ab37-896e8c449858 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:45.653750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3eff60d9-6226-4db3-aa19-9b1e4a11f929 req-24546cf9-2f86-46a6-ab37-896e8c449858 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:45.655121 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-3eff60d9-6226-4db3-aa19-9b1e4a11f929 req-24546cf9-2f86-46a6-ab37-896e8c449858 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:45.671621 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.compute.server_external_events [req-3eff60d9-6226-4db3-aa19-9b1e4a11f929 req-24546cf9-2f86-46a6-ab37-896e8c449858 service nova] Unable to find a host for instance bea6243a-e401-45b5-a1a2-e495dcf48672. Dropping event network-vif-unplugged {{(pid=120545) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 16 02:25:45.673318 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-3eff60d9-6226-4db3-aa19-9b1e4a11f929 req-24546cf9-2f86-46a6-ab37-896e8c449858 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040157 Oct 16 02:25:45.674393 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3912/7688] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 16 02:25:45.992286 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:45.992828 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:46.000132 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:46.000610 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:46.001041 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:46.001729 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:46.002180 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:46.002609 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:46.142878 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:46.151522 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2375d0b1-894c-465b-a383-3cf8ac215a0e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1518 microversion: 2.1 time: 0.162598 Oct 16 02:25:46.152107 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3777/7689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:45 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:47.175859 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:47.176424 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:47.183948 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:47.184443 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:47.184886 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:47.185593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:47.186056 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:47.186566 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:47.320381 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:47.328562 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8c5c0317-dc00-4d16-a600-a1de99138889 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1518 microversion: 2.1 time: 0.156725 Oct 16 02:25:47.329143 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3913/7690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:47 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:48.352594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:48.353206 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:48.360245 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:48.360732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:48.361204 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:48.361902 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:48.362363 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:48.362788 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:48.509198 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:48.517752 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0bfabaec-5c9b-459c-8f00-9eeb8f16af65 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1518 microversion: 2.1 time: 0.169100 Oct 16 02:25:48.518336 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3778/7691] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:48 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:49.542504 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:49.543253 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:49.550609 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:49.551144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:49.551608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:49.552328 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:49.552806 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:49.553251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:49.690731 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:49.699436 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-034536b9-360e-438e-a223-a1754b86eb52 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1518 microversion: 2.1 time: 0.161675 Oct 16 02:25:49.700029 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3914/7692] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:49 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:50.722865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:50.723458 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:50.730706 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:50.731230 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:50.731677 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:50.732376 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:50.732837 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:50.733268 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:50.928600 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:50.936889 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-3979eb23-1d88-4655-81b0-45263316674e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.217920 Oct 16 02:25:50.937491 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3779/7693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:50 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:51.688656 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-a2ac4909-7f82-4d65-9eea-3331dcd2606a req-fad43af2-b50a-4f9f-bef9-9f5fff7a4bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea6243a-e401-45b5-a1a2-e495dcf48672", "tag": "b4de0065-d09a-404b-b517-876da919312d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:25:51.699412 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a2ac4909-7f82-4d65-9eea-3331dcd2606a req-fad43af2-b50a-4f9f-bef9-9f5fff7a4bf5 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:51.699912 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a2ac4909-7f82-4d65-9eea-3331dcd2606a req-fad43af2-b50a-4f9f-bef9-9f5fff7a4bf5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:51.700576 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-a2ac4909-7f82-4d65-9eea-3331dcd2606a req-fad43af2-b50a-4f9f-bef9-9f5fff7a4bf5 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:51.711940 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-a2ac4909-7f82-4d65-9eea-3331dcd2606a req-fad43af2-b50a-4f9f-bef9-9f5fff7a4bf5 service nova] Creating event network-changed:b4de0065-d09a-404b-b517-876da919312d for instance bea6243a-e401-45b5-a1a2-e495dcf48672 on n-h1-master-1 Oct 16 02:25:51.717331 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-a2ac4909-7f82-4d65-9eea-3331dcd2606a req-fad43af2-b50a-4f9f-bef9-9f5fff7a4bf5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Oct 16 02:25:51.717951 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3915/7694] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:25:51.961669 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:51.962342 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:51.969699 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:51.970196 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:51.970617 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:51.971358 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:51.971830 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:51.972266 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:52.186890 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:52.194949 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ecd7d94a-ff06-421b-820a-1510188d2abf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.237203 Oct 16 02:25:52.195533 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3780/7695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:51 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:53.221017 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:53.221732 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:53.229338 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:53.229953 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:53.230406 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:53.231149 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:53.231627 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:53.232065 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:53.370304 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:53.378251 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-655aa1ab-7db0-440a-9acd-8b666e241170 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.162340 Oct 16 02:25:53.378827 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3916/7696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:53 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:54.401973 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:54.402594 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:54.409433 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:54.409911 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:54.410345 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:54.411065 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:54.411519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:54.411938 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:54.543449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:54.551344 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0c6d4728-4a91-4c78-88dd-1aa12562452b tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.153924 Oct 16 02:25:54.551923 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3781/7697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:54 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:55.575881 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:55.576511 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:55.583382 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:55.583876 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:55.584325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:55.585059 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:55.585530 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:55.585968 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:55.717412 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:55.725169 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3c59a3a5-5cb3-44b1-84ef-22c42ae304bf tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.153373 Oct 16 02:25:55.725736 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3917/7698] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:55 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:56.749929 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:56.750546 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:56.757504 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:56.757993 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:56.758440 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:56.759161 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:56.760271 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:56.760758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:56.779175 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:25:56.895865 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:56.903587 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-8b5a2949-a177-46bb-89c0-621b1ca21c4e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.157602 Oct 16 02:25:56.904159 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3782/7699] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:56 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:57.927546 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:57.928190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:57.935325 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:57.935817 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:57.936289 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:57.937180 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:57.937791 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:57.938285 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:58.069542 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:58.078461 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-3e1f8940-2442-4cf1-b19c-b0c0bce411d5 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.154794 Oct 16 02:25:58.079063 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3918/7700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:57 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:25:59.101897 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:25:59.102515 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:25:59.106064 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=31 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:25:59.112758 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:59.113303 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:59.113741 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:59.114439 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:25:59.114936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:25:59.115379 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:25:59.253662 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:25:59.267553 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-31d35527-8170-426c-bcdb-4ea06cbb9d3f tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.169167 Oct 16 02:25:59.268670 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3783/7701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:25:59 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:26:00.293132 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:26:00.293757 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:26:00.296701 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:26:00.302719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:00.303262 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:00.303716 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:00.304428 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:00.304905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:00.305381 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:00.308908 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:26:00.438561 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:26:00.446657 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-87489588-6181-421c-af24-13c41308a3b3 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.157464 Oct 16 02:26:00.447270 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3919/7702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:26:00 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:26:01.471530 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:26:01.472063 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:26:01.478324 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:01.478814 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:01.479954 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:01.480734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:01.481207 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:01.481641 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:01.615757 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:26:01.623800 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-580290c2-6182-4780-a66c-83507b8a409e tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.156521 Oct 16 02:26:01.624389 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3784/7703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:26:01 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:26:02.647619 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:26:02.648256 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:26:02.655260 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:02.655772 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:02.656227 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:02.656945 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:02.657422 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:02.657863 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:02.793416 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:26:02.801523 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-55258fde-6a41-4d38-84c4-a256ed478011 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.157983 Oct 16 02:26:02.802092 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3920/7704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:26:02 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:26:03.826966 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:26:03.827579 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:26:03.834340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:03.834827 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:03.835306 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:03.835991 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:03.836443 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:03.836865 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:03.967236 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:26:03.974967 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eff13af0-4247-43c6-810b-ea1a7cbec55c tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.152443 Oct 16 02:26:03.975548 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3785/7705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:26:03 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:26:04.669939 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-2f5f424a-4d31-46a4-b70e-0370426ce3b4 req-9166718e-1d12-46fd-931c-68d08b2bc3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea6243a-e401-45b5-a1a2-e495dcf48672", "name": "network-vif-plugged", "status": "completed", "tag": "b4de0065-d09a-404b-b517-876da919312d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:26:04.681550 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2f5f424a-4d31-46a4-b70e-0370426ce3b4 req-9166718e-1d12-46fd-931c-68d08b2bc3a8 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:04.682153 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2f5f424a-4d31-46a4-b70e-0370426ce3b4 req-9166718e-1d12-46fd-931c-68d08b2bc3a8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:04.682708 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-2f5f424a-4d31-46a4-b70e-0370426ce3b4 req-9166718e-1d12-46fd-931c-68d08b2bc3a8 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:04.696395 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-2f5f424a-4d31-46a4-b70e-0370426ce3b4 req-9166718e-1d12-46fd-931c-68d08b2bc3a8 service nova] Creating event network-vif-plugged:b4de0065-d09a-404b-b517-876da919312d for instance bea6243a-e401-45b5-a1a2-e495dcf48672 on n-h1-master-1 Oct 16 02:26:04.702816 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-2f5f424a-4d31-46a4-b70e-0370426ce3b4 req-9166718e-1d12-46fd-931c-68d08b2bc3a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037708 Oct 16 02:26:04.703483 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3921/7706] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:26:04.998980 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:26:04.999590 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:26:05.006391 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:05.006870 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:05.007340 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:05.008025 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:05.008482 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:05.008905 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:05.141291 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:26:05.149194 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0406e627-caff-47a6-8696-aa79681a3a24 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1574 microversion: 2.1 time: 0.154282 Oct 16 02:26:05.149712 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3786/7707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:26:04 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:26:06.174948 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:26:06.175648 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:26:06.181764 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:06.182259 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:06.182738 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:06.183477 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:26:06.184110 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:26:06.184551 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:26:06.320970 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:26:06.329809 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-40937c89-146c-44d9-a2d4-7ed78cc47027 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1561 microversion: 2.1 time: 0.160772 Oct 16 02:26:06.330392 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3922/7708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:26:06 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:20.180186 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=7 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:20.180983 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=26 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:20.181834 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:27:20.182009 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 (ip 10.222.0.39) !!! Oct 16 02:27:20.186298 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=7 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:20.187369 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=19 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:20.189458 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:27:20.192279 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 02:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 16 02:27:20.202046 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-5ea8b9d9-9b7b-49c8-86b5-0cbe01d47448 req-25ddf27d-22b7-4866-8a7b-f37d8da4db82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea6243a-e401-45b5-a1a2-e495dcf48672", "tag": "b4de0065-d09a-404b-b517-876da919312d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:27:20.213919 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:20.214434 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:20.217287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ea8b9d9-9b7b-49c8-86b5-0cbe01d47448 req-25ddf27d-22b7-4866-8a7b-f37d8da4db82 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:20.217790 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ea8b9d9-9b7b-49c8-86b5-0cbe01d47448 req-25ddf27d-22b7-4866-8a7b-f37d8da4db82 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:20.218460 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-5ea8b9d9-9b7b-49c8-86b5-0cbe01d47448 req-25ddf27d-22b7-4866-8a7b-f37d8da4db82 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:20.221994 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:20.222499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:20.222959 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:20.223891 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:20.224359 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:20.224790 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:20.231589 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-5ea8b9d9-9b7b-49c8-86b5-0cbe01d47448 req-25ddf27d-22b7-4866-8a7b-f37d8da4db82 service nova] Creating event network-changed:b4de0065-d09a-404b-b517-876da919312d for instance bea6243a-e401-45b5-a1a2-e495dcf48672 on n-h1-master-1 Oct 16 02:27:20.238212 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-5ea8b9d9-9b7b-49c8-86b5-0cbe01d47448 req-25ddf27d-22b7-4866-8a7b-f37d8da4db82 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053818 Oct 16 02:27:20.239202 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3923/7709] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:27:20.255222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:27:20.340990 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-d670d892-926b-441b-81c5-193bd21f14e1 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 204 len: 0 microversion: 2.1 time: 0.162422 Oct 16 02:27:20.345293 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3787/7710] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:27:20 2022] DELETE /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:27:20.352806 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:20.353856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:20.360740 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:20.361425 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:20.361814 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:20.362629 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:20.363224 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:20.363894 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:20.503227 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:20.511203 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0f3d44e-19d3-4923-a258-cc8ec42275a2 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.163630 Oct 16 02:27:20.511952 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3924/7711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:20 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:21.536698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:21.537421 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:21.544339 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:21.544818 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:21.545247 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:21.545933 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:21.546384 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:21.546805 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:21.752633 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:21.760374 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-cde09ef9-4ef5-4db3-b8ba-b0f88e43e9e8 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1567 microversion: 2.1 time: 0.228197 Oct 16 02:27:21.760962 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3788/7712] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:21 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:22.443823 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-64d183bc-ed54-4c00-8f85-2690ff5319a5 req-8bf56d70-8b15-4403-a55c-0596ac52e9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea6243a-e401-45b5-a1a2-e495dcf48672", "name": "network-vif-deleted", "tag": "b4de0065-d09a-404b-b517-876da919312d"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:27:22.456220 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64d183bc-ed54-4c00-8f85-2690ff5319a5 req-8bf56d70-8b15-4403-a55c-0596ac52e9e9 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:22.456719 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64d183bc-ed54-4c00-8f85-2690ff5319a5 req-8bf56d70-8b15-4403-a55c-0596ac52e9e9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:22.457201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-64d183bc-ed54-4c00-8f85-2690ff5319a5 req-8bf56d70-8b15-4403-a55c-0596ac52e9e9 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:22.469624 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-64d183bc-ed54-4c00-8f85-2690ff5319a5 req-8bf56d70-8b15-4403-a55c-0596ac52e9e9 service nova] Creating event network-vif-deleted:b4de0065-d09a-404b-b517-876da919312d for instance bea6243a-e401-45b5-a1a2-e495dcf48672 on n-h1-master-1 Oct 16 02:27:22.475422 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-64d183bc-ed54-4c00-8f85-2690ff5319a5 req-8bf56d70-8b15-4403-a55c-0596ac52e9e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Oct 16 02:27:22.476057 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3925/7713] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:27:22.785523 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:22.786424 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:22.794095 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:22.794600 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:22.795159 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:22.796146 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:22.796628 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:22.797099 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:22.864852 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:22.873014 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-4e747092-d0a7-403d-a599-0d3700b59163 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1217 microversion: 2.1 time: 0.092218 Oct 16 02:27:22.873605 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3789/7714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:22 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:23.898902 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:23.899632 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:23.906414 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:23.907481 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:23.907950 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:23.908698 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:23.909165 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:23.909601 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:23.984187 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:23.992508 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-8d145023-bb2b-4131-81f3-b180dccf4c49 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1217 microversion: 2.1 time: 0.098811 Oct 16 02:27:23.993360 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3926/7715] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:23 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:27:25.035849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:25.036664 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:25.043795 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:25.044293 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:25.044744 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:25.045583 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:25.046059 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:25.046496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:25.120969 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:25.130390 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-919032cf-ada8-49ed-85dc-ffc35d9f2ea9 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1217 microversion: 2.1 time: 0.099283 Oct 16 02:27:25.132161 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3790/7716] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:25 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:26.156099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:26.156876 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:26.163773 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:26.164279 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:26.164730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:26.165440 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:26.165913 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:26.166353 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:26.231167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '111c47d7a44f48559e9e22d25677d6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e75b1540be246fb9be6572513050082', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:26.239351 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-dbd54e06-b315-45be-acf2-078938562659 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 200 len: 1217 microversion: 2.1 time: 0.087143 Oct 16 02:27:26.239928 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3927/7717] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:26 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:27.263092 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:27.263964 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] [instance: bea6243a-e401-45b5-a1a2-e495dcf48672] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:27.270843 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:27.271365 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:27.271807 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:27.272511 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:27.272971 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:27.273527 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:27.287686 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] HTTP exception thrown: Instance bea6243a-e401-45b5-a1a2-e495dcf48672 could not be found. Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Request method failure captured: Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 HTTP/1.1 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2oA3V5kob9ue53uSx-ArERjNJvCqxef0341rQ_9J7IMaxGVKnZCNqxqimOLJ_aKuB1a-2rF894fyj5FmGAtqtB1ebI3OuQ1QUU_UmtuA2Esjs069C7Z_RlMaZRJf9BMqZkyeq9okYbC0qRVzI-Xw4FI5sLV6UqUZi6qJRpuSc-l_qo Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 6e75b1540be246fb9be6572513050082 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestShelveInstance-517780655 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6e75b1540be246fb9be6572513050082", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6e75b1540be246fb9be6572513050082"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6e75b1540be246fb9be6572513050082"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6e75b1540be246fb9be6572513050082"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestShelveInstance-517780655 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 6e75b1540be246fb9be6572513050082 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestShelveInstance-517780655 Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestShelveInstance-517780655-project Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: 111c47d7a44f48559e9e22d25677d6dd Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestShelveInstance-517780655-project Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: exception: Instance bea6243a-e401-45b5-a1a2-e495dcf48672 could not be found. Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'bea6243a-e401-45b5-a1a2-e495dcf48672'} Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea6243a-e401-45b5-a1a2-e495dcf48672 could not be found. Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea6243a-e401-45b5-a1a2-e495dcf48672 could not be found. Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:27:27.289352 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea6243a-e401-45b5-a1a2-e495dcf48672 could not be found. Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Returning 404 to user: Instance bea6243a-e401-45b5-a1a2-e495dcf48672 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5205368a-0b2e-4467-80da-801c3a28f9fc tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672" status: 404 len: 111 microversion: 2.1 time: 0.031754 Oct 16 02:27:27.295123 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3791/7718] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:27 2022] GET /compute/v2.1/servers/bea6243a-e401-45b5-a1a2-e495dcf48672 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:27:27.471382 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7e4c5130-4343-4411-bc33-fea86957fb46 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] Calling method '.version_select at 0x7fd64c023ca0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:27.503961 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7e4c5130-4343-4411-bc33-fea86957fb46 tempest-TestShelveInstance-517780655 tempest-TestShelveInstance-517780655-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-263868993" status: 202 len: 0 microversion: 2.1 time: 0.037767 Oct 16 02:27:27.504762 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3928/7719] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Oct 16 02:27:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-263868993 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 16 02:27:45.714313 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:45.715197 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:45.952411 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-c5f3434c-2b23-41c3-9524-6251fac676b0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Action: 'create', calling method: .version_select at 0x7fd64e77b4c0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-227772202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcq+iLajkfqC+TeggGeu4OmkxsKjPM+YfArxN2ZK3A5ltwwbPp3/2wRsKvEyORiiCps9zGOsBjrOG731TDalnJxBEOEIzS+U8LPxpeUvf6O1AQPt56C8iAZDE4NIp4Gfw=="}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:27:45.969046 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-c5f3434c-2b23-41c3-9524-6251fac676b0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Getting quotas for project 7a6d6fcb1d6e4c27ad3094f19f63947a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:27:45.974823 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-c5f3434c-2b23-41c3-9524-6251fac676b0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Getting quotas for user a5fafb3514414163a106f10d800bacfb and project 7a6d6fcb1d6e4c27ad3094f19f63947a. Resources: {'key_pairs'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:27:46.008357 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-c5f3434c-2b23-41c3-9524-6251fac676b0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.303942 Oct 16 02:27:46.009203 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3792/7720] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Oct 16 02:27:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:27:46.993822 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=22 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:46.994589 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:46.998580 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-217211971", "imageRef": "a103d6a4-5636-40e5-8e77-0179ae547423", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-227772202", "security_groups": [{"name": "tempest-secgroup-smoke-1617393518"}], "networks": [{"uuid": "9248c366-0238-4c59-96ea-ae68280b9376"}]}} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:27:47.112643 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.network.neutron [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] validate_networks() for [('9248c366-0238-4c59-96ea-ae68280b9376', None, None, None, None, None)] {{(pid=120545) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:27:47.608507 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Flavor limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:27:47.609591 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Image limits 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:27:47.610155 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Flavor pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:27:47.610647 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Image pref 0:0:0 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:27:47.611219 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.virt.hardware [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120545) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:27:47.620545 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:47.621049 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:47.621555 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:47.622324 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:47.622807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:47.623275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:47.641912 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Getting quotas for project 7a6d6fcb1d6e4c27ad3094f19f63947a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:27:47.647311 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.quota [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Getting quotas for user a5fafb3514414163a106f10d800bacfb and project 7a6d6fcb1d6e4c27ad3094f19f63947a. Resources: {'ram', 'cores', 'instances'} {{(pid=120545) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:27:47.659856 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Going to run 1 instances... {{(pid=120545) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:27:47.662234 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a103d6a4-5636-40e5-8e77-0179ae547423',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120545) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:27:47.709222 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-80f63188-893b-4e66-9194-cd12748f8922 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717168 Oct 16 02:27:47.710065 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3929/7721] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:27:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:27:47.723225 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-aac99c53-1f41-44e1-9a0a-d8876cd0436f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:47.727463 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-aac99c53-1f41-44e1-9a0a-d8876cd0436f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:47.823325 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-aac99c53-1f41-44e1-9a0a-d8876cd0436f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:47.841627 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-aac99c53-1f41-44e1-9a0a-d8876cd0436f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1247 microversion: 2.1 time: 0.123776 Oct 16 02:27:47.844392 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3793/7722] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:47 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1247 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:48.868919 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:48.869654 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:48.878235 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:48.878851 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:48.879580 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:48.880371 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:48.880910 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:48.881366 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:48.955713 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:48.965664 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c30ff7b3-575f-4805-a9d1-b60ef440b1e3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1299 microversion: 2.1 time: 0.101586 Oct 16 02:27:48.966259 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3930/7723] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:48 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:49.991488 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:49.992149 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:50.003190 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:50.004035 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:50.004566 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:50.006535 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:50.007265 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:50.007824 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:50.156010 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:50.164292 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-929709fb-ed0a-418d-ad15-a01ac8cba236 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1373 microversion: 2.1 time: 0.177165 Oct 16 02:27:50.164879 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3794/7724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:49 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:50.584768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-c8d352df-d49a-4f6d-a8f8-3282eea8a091 req-07574ab9-21fe-47e7-b492-b6a030550252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7383d58c-c741-49b4-b825-19f65337d542", "tag": "4ae10312-a183-4bc4-9f97-68cdcceffb85"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:27:50.594931 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8d352df-d49a-4f6d-a8f8-3282eea8a091 req-07574ab9-21fe-47e7-b492-b6a030550252 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:50.595519 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8d352df-d49a-4f6d-a8f8-3282eea8a091 req-07574ab9-21fe-47e7-b492-b6a030550252 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:50.596033 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-c8d352df-d49a-4f6d-a8f8-3282eea8a091 req-07574ab9-21fe-47e7-b492-b6a030550252 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:50.607365 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-c8d352df-d49a-4f6d-a8f8-3282eea8a091 req-07574ab9-21fe-47e7-b492-b6a030550252 service nova] Creating event network-changed:4ae10312-a183-4bc4-9f97-68cdcceffb85 for instance 7383d58c-c741-49b4-b825-19f65337d542 on n-h1-master-1 Oct 16 02:27:50.613263 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-c8d352df-d49a-4f6d-a8f8-3282eea8a091 req-07574ab9-21fe-47e7-b492-b6a030550252 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114357 Oct 16 02:27:50.613933 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3931/7725] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:27:51.187648 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:51.188248 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:51.197150 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:51.197644 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:51.198082 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:51.198780 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:51.199264 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:51.199693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:51.333801 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:51.341561 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ffa7a421-3be5-4c61-b9a3-705f00db3716 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1373 microversion: 2.1 time: 0.158253 Oct 16 02:27:51.342134 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3795/7726] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:51 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:52.366787 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:52.367604 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:52.374606 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:52.375118 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:52.375577 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:52.376286 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:52.376766 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:52.377210 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:52.510367 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:52.518856 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-d57d7850-60da-4101-b59b-94c42f9f428f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1373 microversion: 2.1 time: 0.156459 Oct 16 02:27:52.519464 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3932/7727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:52 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:53.541729 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:53.542336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:53.550276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:53.550759 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:53.551240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:53.551934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:53.552392 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:53.552817 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:53.687316 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:53.695342 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-487d5551-e0b7-4c3b-ab4a-ee2c68b6a816 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1373 microversion: 2.1 time: 0.157478 Oct 16 02:27:53.695932 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3796/7728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:53 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:54.717803 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:54.718907 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:54.725730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:54.726238 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:54.726691 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:54.727426 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:54.727905 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:54.728352 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:54.867681 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:54.875300 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-be9eac67-2f46-4816-bee9-28bd29977e22 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1373 microversion: 2.1 time: 0.161459 Oct 16 02:27:54.875896 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3933/7729] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:54 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:55.899335 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:55.899950 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:55.907666 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:55.908452 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:55.908601 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:55.909951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:55.910693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:55.911158 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:56.042011 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:56.050252 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f5d0c1d7-47e8-44ec-ba29-0ebf785d3f7c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1373 microversion: 2.1 time: 0.154808 Oct 16 02:27:56.050829 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3797/7730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:55 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:57.073558 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:57.074292 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:57.081320 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:57.081829 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:57.082288 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:57.083032 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:57.083515 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:57.083962 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:57.170449 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-a8232b8f-7115-4c3b-91ba-fc9cb4824f07 req-70c61fc5-43bb-4a1e-a3b7-d678a7cadf66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7383d58c-c741-49b4-b825-19f65337d542", "name": "network-vif-plugged", "status": "completed", "tag": "4ae10312-a183-4bc4-9f97-68cdcceffb85"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:27:57.184964 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a8232b8f-7115-4c3b-91ba-fc9cb4824f07 req-70c61fc5-43bb-4a1e-a3b7-d678a7cadf66 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:57.185444 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a8232b8f-7115-4c3b-91ba-fc9cb4824f07 req-70c61fc5-43bb-4a1e-a3b7-d678a7cadf66 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:57.185871 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-a8232b8f-7115-4c3b-91ba-fc9cb4824f07 req-70c61fc5-43bb-4a1e-a3b7-d678a7cadf66 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:57.202047 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-a8232b8f-7115-4c3b-91ba-fc9cb4824f07 req-70c61fc5-43bb-4a1e-a3b7-d678a7cadf66 service nova] Creating event network-vif-plugged:4ae10312-a183-4bc4-9f97-68cdcceffb85 for instance 7383d58c-c741-49b4-b825-19f65337d542 on n-h1-master-1 Oct 16 02:27:57.208268 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-a8232b8f-7115-4c3b-91ba-fc9cb4824f07 req-70c61fc5-43bb-4a1e-a3b7-d678a7cadf66 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041911 Oct 16 02:27:57.209241 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3798/7731] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:27:57.233886 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:57.246882 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c0ba9fac-51a6-484f-9070-475499376d20 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1373 microversion: 2.1 time: 0.176780 Oct 16 02:27:57.247525 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3934/7732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:57 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:58.268380 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:58.273581 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:58.274204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:58.280720 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:58.281236 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:58.281681 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:58.282374 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:58.282838 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:58.283920 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:58.422018 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:58.429918 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7217699b-6311-4ee3-ac20-0b8e9a1930a3 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1373 microversion: 2.1 time: 0.162624 Oct 16 02:27:58.430499 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3799/7733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:58 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:59.453768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:59.454404 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:59.456978 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:59.457651 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=6 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:27:59.464302 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:59.464811 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:59.465266 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:59.465978 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:59.466457 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:59.466900 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:59.598055 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:59.605853 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-44170563-86d1-47e6-a40c-fbc4de5f85f9 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1558 microversion: 2.1 time: 0.156096 Oct 16 02:27:59.606439 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3935/7734] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:59 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:27:59.628679 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:27:59.629288 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:27:59.636018 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:59.636499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:59.636931 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:59.637619 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:27:59.638070 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:27:59.638499 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:27:59.774397 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:27:59.782573 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-975b65d5-da91-4ca5-9bbb-256f48ec2608 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1558 microversion: 2.1 time: 0.158305 Oct 16 02:27:59.783236 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3800/7735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:27:59 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:28:01.714678 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6bb35994-4ef2-49b5-8635-46386685104c req-be0ef4c0-099e-4da0-85e2-13b5470f9b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7383d58c-c741-49b4-b825-19f65337d542", "tag": "4ae10312-a183-4bc4-9f97-68cdcceffb85"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:28:01.725644 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6bb35994-4ef2-49b5-8635-46386685104c req-be0ef4c0-099e-4da0-85e2-13b5470f9b69 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:28:01.726201 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6bb35994-4ef2-49b5-8635-46386685104c req-be0ef4c0-099e-4da0-85e2-13b5470f9b69 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:28:01.726737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6bb35994-4ef2-49b5-8635-46386685104c req-be0ef4c0-099e-4da0-85e2-13b5470f9b69 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:28:01.738022 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6bb35994-4ef2-49b5-8635-46386685104c req-be0ef4c0-099e-4da0-85e2-13b5470f9b69 service nova] Creating event network-changed:4ae10312-a183-4bc4-9f97-68cdcceffb85 for instance 7383d58c-c741-49b4-b825-19f65337d542 on n-h1-master-1 Oct 16 02:28:01.743118 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6bb35994-4ef2-49b5-8635-46386685104c req-be0ef4c0-099e-4da0-85e2-13b5470f9b69 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032146 Oct 16 02:28:01.743897 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3936/7736] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:29:55.890637 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:29:55.891503 n-d-master-1 devstack@n-api.service[120546]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 16 02:29:55.892361 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:29:55.893096 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=38 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:29:55.895549 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:29:55.895744 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:29:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542/action (ip 10.222.0.39) !!! Oct 16 02:29:55.900511 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-114780155"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:29:55.902792 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:29:55.910977 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:29:55.911459 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:29:55.911892 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:29:55.912578 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:29:55.913033 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:29:55.913455 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:29:56.116904 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-7df8cb75-cac4-4672-8cc3-d718feb13a36 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "POST /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542/action" status: 202 len: 0 microversion: 2.1 time: 0.227973 Oct 16 02:29:56.117626 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3801/7737] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:29:55 2022] POST /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 02:30:01.713919 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62e940bc-1122-42ca-9330-e9768cf96d02] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 16 02:30:01.715388 n-d-master-1 devstack@n-api.service[120545]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8cc26444-5a34-40e5-a065-e292a5e28b0a] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 16 02:30:01.716224 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:01.717617 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=36 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:01.719870 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 16 02:30:01.720259 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 02:30:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 16 02:30:01.837833 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-154b76f0-d145-43ce-87c4-caf0f06b6cd6 req-d990b07c-3d08-4410-95a7-0bb5328a6886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7383d58c-c741-49b4-b825-19f65337d542", "name": "network-vif-plugged", "status": "completed", "tag": "4ae10312-a183-4bc4-9f97-68cdcceffb85"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:30:01.850141 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-154b76f0-d145-43ce-87c4-caf0f06b6cd6 req-d990b07c-3d08-4410-95a7-0bb5328a6886 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:01.850630 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-154b76f0-d145-43ce-87c4-caf0f06b6cd6 req-d990b07c-3d08-4410-95a7-0bb5328a6886 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:01.851106 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-154b76f0-d145-43ce-87c4-caf0f06b6cd6 req-d990b07c-3d08-4410-95a7-0bb5328a6886 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:01.870207 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-154b76f0-d145-43ce-87c4-caf0f06b6cd6 req-d990b07c-3d08-4410-95a7-0bb5328a6886 service nova] Creating event network-vif-plugged:4ae10312-a183-4bc4-9f97-68cdcceffb85 for instance 7383d58c-c741-49b4-b825-19f65337d542 on n-h1-master-1 Oct 16 02:30:01.875976 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-154b76f0-d145-43ce-87c4-caf0f06b6cd6 req-d990b07c-3d08-4410-95a7-0bb5328a6886 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163889 Oct 16 02:30:01.877026 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3937/7738] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:30:09.731343 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:09.732111 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:09.736843 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1794534875", "imageRef": "bd227876-8d01-440b-9107-0de7714880e0", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-227772202", "security_groups": [{"name": "tempest-secgroup-smoke-1617393518"}], "networks": [{"uuid": "9248c366-0238-4c59-96ea-ae68280b9376"}]}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:30:09.760613 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f596868-87fe-420a-9fcb-c9f99dfa6b6b] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 38278. Oct 16 02:30:09.764699 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] [30b54136-28d7-4b0c-b5c4-75d105c35fd5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 38280. Oct 16 02:30:09.851486 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.network.neutron [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] validate_networks() for [('9248c366-0238-4c59-96ea-ae68280b9376', None, None, None, None, None)] {{(pid=120546) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 16 02:30:10.285543 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Flavor limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 16 02:30:10.285996 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Image limits 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 16 02:30:10.286501 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Flavor pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 16 02:30:10.286967 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Image pref 0:0:0 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 16 02:30:10.287381 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.virt.hardware [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 16 02:30:10.296473 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:10.296960 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:10.297416 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:10.298134 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:10.298585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:10.299101 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:10.316222 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Getting quotas for project 7a6d6fcb1d6e4c27ad3094f19f63947a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 16 02:30:10.321715 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.quota [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Getting quotas for user a5fafb3514414163a106f10d800bacfb and project 7a6d6fcb1d6e4c27ad3094f19f63947a. Resources: {'ram', 'cores', 'instances'} {{(pid=120546) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 16 02:30:10.334420 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Going to run 1 instances... {{(pid=120546) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 16 02:30:10.336922 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd227876-8d01-440b-9107-0de7714880e0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120546) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 16 02:30:10.387656 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f4fa04a1-3cf0-463e-be24-9d9181f5599e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.658549 Oct 16 02:30:10.388323 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3802/7739] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Oct 16 02:30:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 16 02:30:10.404689 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-2771dbd0-aae0-46f1-9cfb-f8df3b607057 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:10.406075 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-2771dbd0-aae0-46f1-9cfb-f8df3b607057 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:10.422809 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] [62e940bc-1122-42ca-9330-e9768cf96d02] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 38296. Oct 16 02:30:10.427460 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] [8cc26444-5a34-40e5-a065-e292a5e28b0a] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 38298. Oct 16 02:30:10.475781 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-2771dbd0-aae0-46f1-9cfb-f8df3b607057 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:10.483607 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-2771dbd0-aae0-46f1-9cfb-f8df3b607057 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1248 microversion: 2.1 time: 0.087713 Oct 16 02:30:10.484176 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3938/7740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:10 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 16 02:30:11.508301 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:11.508858 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:11.515896 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:11.516378 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:11.516815 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:11.518312 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:11.518875 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:11.519408 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:11.590053 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:11.598308 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f71ef781-4adb-4148-a759-9798d62770e0 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1300 microversion: 2.1 time: 0.094008 Oct 16 02:30:11.598885 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3803/7741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:11 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:12.629212 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:12.630028 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:12.636940 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:12.639977 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:12.640569 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:12.641144 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:12.642010 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:12.642582 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:12.643681 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:12.863778 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:12.873228 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-34d1ef0c-2190-47f9-82dc-8dc617b61fd6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.253661 Oct 16 02:30:12.874131 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3939/7742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:12 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:13.763394 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-e57a9b5a-3869-442b-b90a-b22885b2f371 req-089de7c6-998e-4256-b50d-a0abb445b856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7383d58c-c741-49b4-b825-19f65337d542", "name": "network-vif-unplugged", "status": "completed", "tag": "4ae10312-a183-4bc4-9f97-68cdcceffb85"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:30:13.775073 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e57a9b5a-3869-442b-b90a-b22885b2f371 req-089de7c6-998e-4256-b50d-a0abb445b856 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:13.775386 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e57a9b5a-3869-442b-b90a-b22885b2f371 req-089de7c6-998e-4256-b50d-a0abb445b856 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:13.776045 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-e57a9b5a-3869-442b-b90a-b22885b2f371 req-089de7c6-998e-4256-b50d-a0abb445b856 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:13.795755 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-e57a9b5a-3869-442b-b90a-b22885b2f371 req-089de7c6-998e-4256-b50d-a0abb445b856 service nova] Creating event network-vif-unplugged:4ae10312-a183-4bc4-9f97-68cdcceffb85 for instance 7383d58c-c741-49b4-b825-19f65337d542 on n-h1-master-1 Oct 16 02:30:13.804486 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-e57a9b5a-3869-442b-b90a-b22885b2f371 req-089de7c6-998e-4256-b50d-a0abb445b856 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044708 Oct 16 02:30:13.805861 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3804/7743] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:30:13.897840 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:13.898786 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:13.906885 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:13.907506 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:13.908046 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:13.909323 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:13.909804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:13.910251 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:14.066955 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:14.075274 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-76df2d92-64b9-464f-bd52-fd680be7966c tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.181281 Oct 16 02:30:14.084999 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3940/7744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:13 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:15.100565 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:15.101266 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:15.108510 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:15.109008 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:15.109446 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:15.110147 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:15.110604 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:15.111049 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:15.266616 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:15.278897 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-eee056c0-3b8f-4ec8-ad16-0b3a52ce4acc tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.184430 Oct 16 02:30:15.279524 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3805/7745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:15 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:16.302633 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:16.303345 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:16.310636 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:16.311275 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:16.311798 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:16.312594 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:16.313261 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:16.313822 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:16.494105 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:16.503678 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-fd3cebe9-cd16-48c9-8622-c759b6ff8d62 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.205335 Oct 16 02:30:16.504769 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3941/7746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:16 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:17.531573 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:17.532305 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:17.545030 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:17.546364 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:17.547313 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:17.548553 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:17.549794 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:17.550635 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:17.706151 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:17.714183 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-5146fd7c-b9d7-4b39-ad23-978412427c10 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.186607 Oct 16 02:30:17.714767 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3806/7747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:17 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:18.739771 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:18.740402 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:18.747347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:18.747856 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:18.748309 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:18.749030 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:18.749507 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:18.750002 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:18.888796 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:18.898979 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-17a4d76d-17d0-4010-bd79-f01717a90cb1 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.163306 Oct 16 02:30:18.915463 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3942/7748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:18 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:19.922582 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:19.923232 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:19.930585 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:19.931122 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:19.931555 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:19.932239 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:19.932693 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:19.933117 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:20.076836 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:20.084852 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-e1b46a6b-27b2-4877-93c3-ce23fa67734f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.166187 Oct 16 02:30:20.085546 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3807/7749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:19 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:20.754664 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell0:SELECT=2 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:20.820509 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-698336e2-9bcc-453d-b333-0cfd1615e5e7 req-99c15dd9-27e0-4ab1-a4d3-007b4292ebdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d35660-dc69-41b3-bfd4-4c27e381613a", "tag": "45475c04-a69e-4fdc-8fbb-892aaab58794"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:30:20.831574 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-698336e2-9bcc-453d-b333-0cfd1615e5e7 req-99c15dd9-27e0-4ab1-a4d3-007b4292ebdb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:20.832071 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-698336e2-9bcc-453d-b333-0cfd1615e5e7 req-99c15dd9-27e0-4ab1-a4d3-007b4292ebdb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:20.832517 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-698336e2-9bcc-453d-b333-0cfd1615e5e7 req-99c15dd9-27e0-4ab1-a4d3-007b4292ebdb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:20.844181 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-698336e2-9bcc-453d-b333-0cfd1615e5e7 req-99c15dd9-27e0-4ab1-a4d3-007b4292ebdb service nova] Creating event network-changed:45475c04-a69e-4fdc-8fbb-892aaab58794 for instance c8d35660-dc69-41b3-bfd4-4c27e381613a on n-h2-master-1 Oct 16 02:30:20.849621 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-698336e2-9bcc-453d-b333-0cfd1615e5e7 req-99c15dd9-27e0-4ab1-a4d3-007b4292ebdb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101856 Oct 16 02:30:20.850232 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3943/7750] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:30:21.109052 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:21.109698 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:21.111713 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:21.112469 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell0:SELECT=6 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:30:21.119221 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:21.119700 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:21.120140 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:21.120846 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:21.121305 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:21.121734 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:21.325223 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:21.333873 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2b2f3ec2-2010-41a2-b014-3f5e246a6c96 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.228738 Oct 16 02:30:21.334446 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3808/7751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:21 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:22.359002 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:22.359726 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:22.366746 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:22.367278 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:22.367734 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:22.368444 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:22.368932 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:22.369375 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:22.581832 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:22.589571 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-00bdb897-e629-4a03-9aa3-85f50bb16d51 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.235670 Oct 16 02:30:22.590145 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3944/7752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:22 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:23.612141 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:23.612758 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:23.619934 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:23.620417 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:23.620872 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:23.621561 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:23.622015 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:23.622445 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:23.751529 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:23.759841 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-84f608e2-fa90-4e78-8487-ec0a321123b6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.151574 Oct 16 02:30:23.760420 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3809/7753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:23 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:24.784284 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:24.784941 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:24.791843 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:24.792347 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:24.792804 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:24.793520 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:24.793995 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:24.794438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:24.831211 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-0c9e4636-48cf-4a41-b629-87f9bdbbdc3e req-c2188259-e49e-4639-8aae-de3e3526718a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d35660-dc69-41b3-bfd4-4c27e381613a", "name": "network-vif-plugged", "status": "completed", "tag": "45475c04-a69e-4fdc-8fbb-892aaab58794"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:30:24.842276 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0c9e4636-48cf-4a41-b629-87f9bdbbdc3e req-c2188259-e49e-4639-8aae-de3e3526718a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:24.842757 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0c9e4636-48cf-4a41-b629-87f9bdbbdc3e req-c2188259-e49e-4639-8aae-de3e3526718a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:24.843483 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-0c9e4636-48cf-4a41-b629-87f9bdbbdc3e req-c2188259-e49e-4639-8aae-de3e3526718a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:24.866076 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-0c9e4636-48cf-4a41-b629-87f9bdbbdc3e req-c2188259-e49e-4639-8aae-de3e3526718a service nova] Creating event network-vif-plugged:45475c04-a69e-4fdc-8fbb-892aaab58794 for instance c8d35660-dc69-41b3-bfd4-4c27e381613a on n-h2-master-1 Oct 16 02:30:24.872000 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-0c9e4636-48cf-4a41-b629-87f9bdbbdc3e req-c2188259-e49e-4639-8aae-de3e3526718a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045158 Oct 16 02:30:24.872885 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3810/7754] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:30:24.949149 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:24.958663 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-a7c0a8c3-9f4f-4559-a925-73abbfda034e tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.178873 Oct 16 02:30:24.959357 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3945/7755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:24 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:25.983272 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:25.984138 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:25.991282 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:25.991773 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:25.992210 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:25.992936 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:25.993403 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:25.993833 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:26.140872 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:26.150015 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-f3bf16f4-3058-4ea5-8fb8-26099b3d7b7d tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1374 microversion: 2.1 time: 0.172016 Oct 16 02:30:26.150630 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3811/7756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:25 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:27.174114 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:27.175115 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:27.181750 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:27.182254 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:27.182707 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:27.183438 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:27.183916 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:27.184358 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:27.316110 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:27.324078 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-c25cc3f7-e093-4cd5-b6af-5e8ce6733aeb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1558 microversion: 2.1 time: 0.154467 Oct 16 02:30:27.324653 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3946/7757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:27 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:27.347415 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:30:27.348035 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:30:27.354756 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:27.355269 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:27.355703 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:27.356393 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:27.356849 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:27.357270 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:27.487499 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:30:27.495280 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-175c3630-4363-4e29-9405-cf1e0f147973 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1558 microversion: 2.1 time: 0.152851 Oct 16 02:30:27.495850 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3812/7758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:30:27 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:30:29.389800 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-6dc49a5d-812b-4fbc-915e-1aeaccc74789 req-3f5604b2-7afc-470b-a77e-47355c825ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d35660-dc69-41b3-bfd4-4c27e381613a", "tag": "45475c04-a69e-4fdc-8fbb-892aaab58794"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:30:29.401114 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6dc49a5d-812b-4fbc-915e-1aeaccc74789 req-3f5604b2-7afc-470b-a77e-47355c825ae0 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:30:29.401614 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6dc49a5d-812b-4fbc-915e-1aeaccc74789 req-3f5604b2-7afc-470b-a77e-47355c825ae0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:30:29.402060 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-6dc49a5d-812b-4fbc-915e-1aeaccc74789 req-3f5604b2-7afc-470b-a77e-47355c825ae0 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:30:29.413901 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-6dc49a5d-812b-4fbc-915e-1aeaccc74789 req-3f5604b2-7afc-470b-a77e-47355c825ae0 service nova] Creating event network-changed:45475c04-a69e-4fdc-8fbb-892aaab58794 for instance c8d35660-dc69-41b3-bfd4-4c27e381613a on n-h2-master-1 Oct 16 02:30:29.419004 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-6dc49a5d-812b-4fbc-915e-1aeaccc74789 req-3f5604b2-7afc-470b-a77e-47355c825ae0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033039 Oct 16 02:30:29.419613 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3947/7759] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:31:59.489971 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:31:59.490724 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=54 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:31:59.491604 n-d-master-1 devstack@n-api.service[120546]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:31:59.491752 n-d-master-1 devstack@n-api.service[120546]: Sun Oct 16 02:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a/action (ip 10.222.0.39) !!! Oct 16 02:31:59.497383 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-721002444"}} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:31:59.499742 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:31:59.511876 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:31:59.512360 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:31:59.512797 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:31:59.513496 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:31:59.513962 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:31:59.514389 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:31:59.835410 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-ed25c328-f10e-4cbe-8eb0-ed80a19022a6 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "POST /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a/action" status: 202 len: 0 microversion: 2.1 time: 0.347867 Oct 16 02:31:59.836065 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3813/7760] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Oct 16 02:31:59 2022] POST /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 16 02:32:05.299547 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_api:SELECT=24 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:05.301539 n-d-master-1 devstack@n-api.service[120545]: DEBUG dbcounter [-] [120545] Writing DB stats nova_cell1:SELECT=46 {{(pid=120545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:05.303858 n-d-master-1 devstack@n-api.service[120545]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 16 02:32:05.304317 n-d-master-1 devstack@n-api.service[120545]: Sun Oct 16 02:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 16 02:32:05.311730 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-b3c06580-a218-440a-bde7-62700cfae598 req-5bafc497-d913-431e-a6b0-a3805a055ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d35660-dc69-41b3-bfd4-4c27e381613a", "name": "network-vif-plugged", "status": "completed", "tag": "45475c04-a69e-4fdc-8fbb-892aaab58794"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:32:05.337368 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b3c06580-a218-440a-bde7-62700cfae598 req-5bafc497-d913-431e-a6b0-a3805a055ecb service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:05.338287 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b3c06580-a218-440a-bde7-62700cfae598 req-5bafc497-d913-431e-a6b0-a3805a055ecb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:05.338944 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-b3c06580-a218-440a-bde7-62700cfae598 req-5bafc497-d913-431e-a6b0-a3805a055ecb service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:05.352783 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-b3c06580-a218-440a-bde7-62700cfae598 req-5bafc497-d913-431e-a6b0-a3805a055ecb service nova] Creating event network-vif-plugged:45475c04-a69e-4fdc-8fbb-892aaab58794 for instance c8d35660-dc69-41b3-bfd4-4c27e381613a on n-h2-master-1 Oct 16 02:32:05.368346 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-b3c06580-a218-440a-bde7-62700cfae598 req-5bafc497-d913-431e-a6b0-a3805a055ecb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072088 Oct 16 02:32:05.369161 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3948/7761] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 16 02:32:14.455790 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:14.458289 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:14.458721 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [req-393d5dd3-e63d-42c2-bd0d-c885b973ac0f req-ce1f53f3-c065-43c8-b339-3255d789c20e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d35660-dc69-41b3-bfd4-4c27e381613a", "tag": "45475c04-a69e-4fdc-8fbb-892aaab58794"}]} {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:32:14.461761 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_api:SELECT=2 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:14.462527 n-d-master-1 devstack@n-api.service[120546]: DEBUG dbcounter [-] [120546] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 02:32:14.467860 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:14.468605 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:14.469040 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:14.469737 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-393d5dd3-e63d-42c2-bd0d-c885b973ac0f req-ce1f53f3-c065-43c8-b339-3255d789c20e service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:14.469874 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:14.470189 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:14.470730 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-393d5dd3-e63d-42c2-bd0d-c885b973ac0f req-ce1f53f3-c065-43c8-b339-3255d789c20e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:14.470851 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:14.471386 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [req-393d5dd3-e63d-42c2-bd0d-c885b973ac0f req-ce1f53f3-c065-43c8-b339-3255d789c20e service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:14.485940 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.compute.server_external_events [req-393d5dd3-e63d-42c2-bd0d-c885b973ac0f req-ce1f53f3-c065-43c8-b339-3255d789c20e service nova] Creating event network-changed:45475c04-a69e-4fdc-8fbb-892aaab58794 for instance c8d35660-dc69-41b3-bfd4-4c27e381613a on n-h2-master-1 Oct 16 02:32:14.492081 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [req-393d5dd3-e63d-42c2-bd0d-c885b973ac0f req-ce1f53f3-c065-43c8-b339-3255d789c20e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038894 Oct 16 02:32:14.493040 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3949/7762] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:32:14.508204 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Going to try to terminate instance {{(pid=120546) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:32:14.605800 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-37392578-22f3-4bdf-99aa-53a51ddf8844 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 204 len: 0 microversion: 2.1 time: 0.154705 Oct 16 02:32:14.606990 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3814/7763] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:32:14 2022] DELETE /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:32:14.620190 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:14.621167 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:14.629346 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:14.630125 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:14.630756 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:14.631500 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:14.631972 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:14.632407 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:14.837204 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:32:14.844913 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-15324ad5-2de1-4e58-817a-dcc65c31336f tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1682 microversion: 2.1 time: 0.233099 Oct 16 02:32:14.845486 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3950/7764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:32:14 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1682 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:32:15.870197 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:15.870849 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:15.877575 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:15.878061 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:15.879519 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:15.879950 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:15.880405 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:15.880829 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:16.011971 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:32:16.020187 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-0e4a35a4-ecd7-4a08-84ed-ce6e201572f4 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1682 microversion: 2.1 time: 0.154293 Oct 16 02:32:16.020760 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3815/7765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:32:15 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:32:17.049552 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:17.050779 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:17.058222 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:17.058723 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:17.059193 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:17.059904 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:17.060372 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:17.060810 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:17.096157 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-aefc75e8-00a0-4807-b714-15dae3337b5e req-9801db7b-f681-4906-8f7a-cd10462cf87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d35660-dc69-41b3-bfd4-4c27e381613a", "name": "network-vif-deleted", "tag": "45475c04-a69e-4fdc-8fbb-892aaab58794"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:32:17.108111 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aefc75e8-00a0-4807-b714-15dae3337b5e req-9801db7b-f681-4906-8f7a-cd10462cf87a service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:17.108951 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aefc75e8-00a0-4807-b714-15dae3337b5e req-9801db7b-f681-4906-8f7a-cd10462cf87a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:17.109385 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-aefc75e8-00a0-4807-b714-15dae3337b5e req-9801db7b-f681-4906-8f7a-cd10462cf87a service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:17.125549 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-aefc75e8-00a0-4807-b714-15dae3337b5e req-9801db7b-f681-4906-8f7a-cd10462cf87a service nova] Creating event network-vif-deleted:45475c04-a69e-4fdc-8fbb-892aaab58794 for instance c8d35660-dc69-41b3-bfd4-4c27e381613a on n-h2-master-1 Oct 16 02:32:17.129943 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:32:17.132035 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-aefc75e8-00a0-4807-b714-15dae3337b5e req-9801db7b-f681-4906-8f7a-cd10462cf87a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039930 Oct 16 02:32:17.132657 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3816/7766] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:32:17.142164 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7993712f-2633-455d-805e-0f25c24de060 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 200 len: 1496 microversion: 2.1 time: 0.101283 Oct 16 02:32:17.142749 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3951/7767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:32:17 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 1496 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:32:18.167337 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:18.168033 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: c8d35660-dc69-41b3-bfd4-4c27e381613a] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:18.174940 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:18.176622 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:18.177084 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:18.177772 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:18.178227 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:18.178649 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:18.195291 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] HTTP exception thrown: Instance c8d35660-dc69-41b3-bfd4-4c27e381613a could not be found. Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Request method failure captured: Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a HTTP/1.1 Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2wcjICLV2WVnW5IM7cIeTIQ3ItVzR-G3W49TeTC8qpSYFwI__Ru3TAUdRWCM9kshjV2CvBOMBGU6iuTG0oEAtF7xnwhUdHdYGL3rMbeMwJQP469uPW9HAyu8mz3FWasvuXeQRzZn4wDz267Z0XCOWcxbcLGxX5ZfTVIwmI8x6QZwqs Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 7a6d6fcb1d6e4c27ad3094f19f63947a Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestSnapshotPattern-2110276509 Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a6d6fcb1d6e4c27ad3094f19f63947a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a6d6fcb1d6e4c27ad3094f19f63947a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a6d6fcb1d6e4c27ad3094f19f63947a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a6d6fcb1d6e4c27ad3094f19f63947a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestSnapshotPattern-2110276509 Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 7a6d6fcb1d6e4c27ad3094f19f63947a Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestSnapshotPattern-2110276509 Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestSnapshotPattern-2110276509-project Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a5fafb3514414163a106f10d800bacfb Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestSnapshotPattern-2110276509-project Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: exception: Instance c8d35660-dc69-41b3-bfd4-4c27e381613a could not be found. Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': 'c8d35660-dc69-41b3-bfd4-4c27e381613a'} Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d35660-dc69-41b3-bfd4-4c27e381613a could not be found. Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d35660-dc69-41b3-bfd4-4c27e381613a could not be found. Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:32:18.196923 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d35660-dc69-41b3-bfd4-4c27e381613a could not be found. Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Returning 404 to user: Instance c8d35660-dc69-41b3-bfd4-4c27e381613a could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-885da6f7-3696-4c29-885f-43aceaccf83b tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a" status: 404 len: 111 microversion: 2.1 time: 0.035244 Oct 16 02:32:18.202050 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3817/7768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:32:18 2022] GET /compute/v2.1/servers/c8d35660-dc69-41b3-bfd4-4c27e381613a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:32:19.587706 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:19.588446 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:19.591839 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-2d6c137a-084c-44c6-a432-160c5a1c281c req-b445590f-505b-47f2-a98f-63b71f5e1f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7383d58c-c741-49b4-b825-19f65337d542", "tag": "4ae10312-a183-4bc4-9f97-68cdcceffb85"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:32:19.595608 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:19.596246 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:19.596807 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:19.598418 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:19.599190 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:19.599743 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:19.602522 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d6c137a-084c-44c6-a432-160c5a1c281c req-b445590f-505b-47f2-a98f-63b71f5e1f54 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:19.603055 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d6c137a-084c-44c6-a432-160c5a1c281c req-b445590f-505b-47f2-a98f-63b71f5e1f54 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:19.603488 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-2d6c137a-084c-44c6-a432-160c5a1c281c req-b445590f-505b-47f2-a98f-63b71f5e1f54 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:19.615594 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-2d6c137a-084c-44c6-a432-160c5a1c281c req-b445590f-505b-47f2-a98f-63b71f5e1f54 service nova] Creating event network-changed:4ae10312-a183-4bc4-9f97-68cdcceffb85 for instance 7383d58c-c741-49b4-b825-19f65337d542 on n-h1-master-1 Oct 16 02:32:19.620986 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-2d6c137a-084c-44c6-a432-160c5a1c281c req-b445590f-505b-47f2-a98f-63b71f5e1f54 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032724 Oct 16 02:32:19.621595 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3818/7769] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:32:19.627163 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Going to try to terminate instance {{(pid=120545) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 16 02:32:19.723897 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-7fd6b3d0-9f67-4c24-b404-95ca61537e94 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 204 len: 0 microversion: 2.1 time: 0.139601 Oct 16 02:32:19.724771 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3952/7770] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Oct 16 02:32:19 2022] DELETE /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 16 02:32:19.733822 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:19.734820 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:19.741240 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:19.741735 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:19.742177 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:19.742887 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:19.743556 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:19.743995 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:19.888177 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.policy [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120546) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:32:19.896889 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-128ec941-cf17-4948-89e2-aacf7e4457fe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1683 microversion: 2.1 time: 0.167459 Oct 16 02:32:19.897556 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3819/7771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:32:19 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:32:20.920099 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:20.920850 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:20.928376 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:20.928882 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:20.929336 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:20.930047 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:20.930523 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:20.930993 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:21.068768 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:32:21.076693 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-5008ae26-c2ad-4fb6-b023-0c095911d440 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1683 microversion: 2.1 time: 0.160838 Oct 16 02:32:21.077282 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3953/7772] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:32:20 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:32:21.843336 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [req-7e1340c5-269d-426c-b21a-32a3c4d0dddc req-f7d55e10-70f3-4721-86ce-1b4ec0832882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7383d58c-c741-49b4-b825-19f65337d542", "name": "network-vif-deleted", "tag": "4ae10312-a183-4bc4-9f97-68cdcceffb85"}]} {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 16 02:32:21.853765 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7e1340c5-269d-426c-b21a-32a3c4d0dddc req-f7d55e10-70f3-4721-86ce-1b4ec0832882 service nova] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:21.854249 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7e1340c5-269d-426c-b21a-32a3c4d0dddc req-f7d55e10-70f3-4721-86ce-1b4ec0832882 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:21.854687 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [req-7e1340c5-269d-426c-b21a-32a3c4d0dddc req-f7d55e10-70f3-4721-86ce-1b4ec0832882 service nova] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:21.868395 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.compute.server_external_events [req-7e1340c5-269d-426c-b21a-32a3c4d0dddc req-f7d55e10-70f3-4721-86ce-1b4ec0832882 service nova] Creating event network-vif-deleted:4ae10312-a183-4bc4-9f97-68cdcceffb85 for instance 7383d58c-c741-49b4-b825-19f65337d542 on n-h1-master-1 Oct 16 02:32:21.873808 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [req-7e1340c5-269d-426c-b21a-32a3c4d0dddc req-f7d55e10-70f3-4721-86ce-1b4ec0832882 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Oct 16 02:32:21.874794 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3820/7773] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Oct 16 02:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 16 02:32:22.102117 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:22.102748 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.compute.api [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120545) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:22.109678 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:22.110186 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:22.110991 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:22.111720 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:22.112196 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:22.113463 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:22.150596 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:22.151130 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:22.151593 n-d-master-1 devstack@n-api.service[120545]: DEBUG oslo_concurrency.lockutils [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120545) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:22.152059 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.objects.instance [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lazy-loading 'fault' on Instance uuid 7383d58c-c741-49b4-b825-19f65337d542 {{(pid=120545) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 16 02:32:22.199080 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.policy [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fafb3514414163a106f10d800bacfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6d6fcb1d6e4c27ad3094f19f63947a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120545) authorize /opt/stack/nova/nova/policy.py:199}} Oct 16 02:32:22.207082 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-b99d977d-796a-490d-ab72-373270cf8e93 tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 200 len: 1337 microversion: 2.1 time: 0.108649 Oct 16 02:32:22.207689 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3954/7774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:32:22 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 1337 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 16 02:32:23.231863 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '>' {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:23.232555 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.compute.api [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] [instance: 7383d58c-c741-49b4-b825-19f65337d542] Fetching instance by UUID {{(pid=120546) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 16 02:32:23.239673 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:23.240157 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:23.240597 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:23.241280 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Acquiring lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 16 02:32:23.241732 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 16 02:32:23.242154 n-d-master-1 devstack@n-api.service[120546]: DEBUG oslo_concurrency.lockutils [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Lock "15fd7fc4-bf67-4964-a6d6-3d113af26712" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120546) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 16 02:32:23.255245 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.wsgi [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] HTTP exception thrown: Instance 7383d58c-c741-49b4-b825-19f65337d542 could not be found. Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Request method failure captured: Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: request: GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 HTTP/1.1 Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: Accept: application/json Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: Accept-Encoding: identity Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: Connection: close Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: Content-Length: 0 Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: Content-Type: application/json Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: Host: 10.222.0.39 Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: Openstack-System-Scope: None Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: User-Agent: python-urllib3/1.26.12 Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Auth-Token: gAAAAABjS2wcjICLV2WVnW5IM7cIeTIQ3ItVzR-G3W49TeTC8qpSYFwI__Ru3TAUdRWCM9kshjV2CvBOMBGU6iuTG0oEAtF7xnwhUdHdYGL3rMbeMwJQP469uPW9HAyu8mz3FWasvuXeQRzZn4wDz267Z0XCOWcxbcLGxX5ZfTVIwmI8x6QZwqs Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Id: None Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Domain-Name: None Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Identity-Status: Confirmed Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Is-Admin-Project: True Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Id: default Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Project-Domain-Name: Default Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Project-Id: 7a6d6fcb1d6e4c27ad3094f19f63947a Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Project-Name: tempest-TestSnapshotPattern-2110276509 Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Role: member,reader Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Roles: member,reader Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7a6d6fcb1d6e4c27ad3094f19f63947a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7a6d6fcb1d6e4c27ad3094f19f63947a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a6d6fcb1d6e4c27ad3094f19f63947a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7a6d6fcb1d6e4c27ad3094f19f63947a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}] Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Tenant: tempest-TestSnapshotPattern-2110276509 Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Id: 7a6d6fcb1d6e4c27ad3094f19f63947a Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-Tenant-Name: tempest-TestSnapshotPattern-2110276509 Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-User: tempest-TestSnapshotPattern-2110276509-project Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Id: default Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-User-Domain-Name: Default Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-User-Id: a5fafb3514414163a106f10d800bacfb Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: X-User-Name: tempest-TestSnapshotPattern-2110276509-project Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: method: > Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: exception: Instance 7383d58c-c741-49b4-b825-19f65337d542 could not be found. Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: action_args: {'id': '7383d58c-c741-49b4-b825-19f65337d542'} Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: {{(pid=120546) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7383d58c-c741-49b4-b825-19f65337d542 could not be found. Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7383d58c-c741-49b4-b825-19f65337d542 could not be found. Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 16 02:32:23.256847 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7383d58c-c741-49b4-b825-19f65337d542 could not be found. Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: ERROR nova.api.openstack.wsgi Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: DEBUG nova.api.openstack.wsgi [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Returning 404 to user: Instance 7383d58c-c741-49b4-b825-19f65337d542 could not be found. {{(pid=120546) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: INFO nova.api.openstack.requestlog [None req-2ebc5ea3-ca73-4c40-8b78-b9a302b1bfbe tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542" status: 404 len: 111 microversion: 2.1 time: 0.030695 Oct 16 02:32:23.262908 n-d-master-1 devstack@n-api.service[120546]: [pid: 120546|app: 0|req: 3821/7775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Oct 16 02:32:23 2022] GET /compute/v2.1/servers/7383d58c-c741-49b4-b825-19f65337d542 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 16 02:32:23.421365 n-d-master-1 devstack@n-api.service[120545]: DEBUG nova.api.openstack.wsgi [None req-ff07e322-c647-4411-a1cb-40e0100f5ebb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] Calling method '.version_select at 0x7fd64c0fc5e0>' {{(pid=120545) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 16 02:32:23.447037 n-d-master-1 devstack@n-api.service[120545]: INFO nova.api.openstack.requestlog [None req-ff07e322-c647-4411-a1cb-40e0100f5ebb tempest-TestSnapshotPattern-2110276509 tempest-TestSnapshotPattern-2110276509-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-227772202" status: 202 len: 0 microversion: 2.1 time: 0.029222 Oct 16 02:32:23.453003 n-d-master-1 devstack@n-api.service[120545]: [pid: 120545|app: 0|req: 3955/7776] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Oct 16 02:32:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-227772202 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)